Started by upstream project "osmo-gsm-tester_build-osmo-trx" build number 4674 originally caused by: Started by upstream project "master-osmo-trx" build number 4878 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17653 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7504 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6678 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8697 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8943 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2947 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29259 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5150 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30035 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4674 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12965 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9238 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4694 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8035 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5189 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5531 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3907 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins8141294102493189613.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-09 11:17:33 + trial_dir_prefix=trial- + rm -rf trial-2358 trial-2358-bin.tgz trial-2358-run.tgz + trial_dir=trial-2359 + mkdir -p trial-2359 + mv open5gs.build-8.tgz osmo-bsc.build-17653.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6678.tgz osmo-hlr.build-8697.tgz osmo-hnbgw.build-2947.tgz osmo-mgw.build-8943.tgz osmo-msc.build-29259.tgz osmo-nitb.build-12965.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30035.tgz osmo-stp.build-9238.tgz osmo-trx.build-4674.tgz osmocom-bb.build-4694.tgz srslte.build-19.tgz trial-2359 + cat open5gs.build-8.md5 osmo-bsc.build-17653.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6678.md5 osmo-hlr.build-8697.md5 osmo-hnbgw.build-2947.md5 osmo-mgw.build-8943.md5 osmo-msc.build-29259.md5 osmo-nitb.build-12965.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30035.md5 osmo-stp.build-9238.md5 osmo-trx.build-4674.md5 osmocom-bb.build-4694.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17653.md5 osmo-bts-oc2g.build-5531.md5 osmo-bts-sysmo.build-8035.md5 osmo-bts.build-7504.md5 osmo-ggsn.build-6678.md5 osmo-hlr.build-8697.md5 osmo-hnbgw.build-2947.md5 osmo-mgw.build-8943.md5 osmo-msc.build-29259.md5 osmo-nitb.build-12965.md5 osmo-pcu-oc2g.build-3907.md5 osmo-pcu-sysmo.build-5189.md5 osmo-pcu.build-5150.md5 osmo-sgsn.build-30035.md5 osmo-stp.build-9238.md5 osmo-trx.build-4674.md5 osmocom-bb.build-4694.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2359 combinations: None trial: 'trial-2359' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2359 -------------------------------------------------------------------------------------------- 11:17:44.222939 tst trial-2359: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/log --------------------------------------------------------------------- trial-2359 nitb_sms:sysmo --------------------------------------------------------------------- 11:19:51.776184 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:19:51.779746 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 11:19:51.800548 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 11:19:51.808055 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 11:19:51.861100 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 11:19:51.882338 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 11:19:51.889821 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 11:19:52.426736 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 11:19:52.431677 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 11:19:52.442587 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 11:19:52.827916 tst mo_mt_sms.py: using LAC 21103 11:19:53.085391 tst mo_mt_sms.py: using RAC 193 11:19:53.210285 tst mo_mt_sms.py: using CellId 21103 11:19:53.337150 tst mo_mt_sms.py: using BVCI 21104 11:19:53.453756 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 11:19:53.635989 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 11:19:53.755938 tst mo_mt_sms.py:9: start nitb and bts... 11:19:53.975663 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:19:56.320421 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30635): Launched 11:19:56.648328 run osmo-nitb_10.42.42.2(pid=30636): Launched 11:19:56.824410 run osmo-nitb_10.42.42.2(pid=30636): ERR: Terminated: ERROR {rc=2} [trial-2359↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30636)] 11:19:56.958102 run osmo-nitb_10.42.42.2(pid=30636): stdout: | (launched: 2022-12-09_11:19:56.587543) 11:19:57.092641 run osmo-nitb_10.42.42.2(pid=30636): stderr: | (launched: 2022-12-09_11:19:56.635849) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:19:57.227223 run osmo-nitb_10.42.42.2(pid=30636): stdout: | (launched: 2022-12-09_11:19:56.587543) 11:19:57.355529 run osmo-nitb_10.42.42.2(pid=30636): stderr: | (launched: 2022-12-09_11:19:56.635849) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:19:57.511899 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=30636): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30636) [trial-2359↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30636)] [trial-2359↪nitb_sms:sysmo↪mo_mt_sms.py:11] 11:19:57.521439 tst mo_mt_sms.py:11: Test FAILED (5.1 sec) 11:19:57.528878 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30635): Terminating (SIGTERM) 11:19:57.740758 --- ParallelTerminationStrategy: PID 30635 died... 11:19:57.762724 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=30635): Terminated: ok {rc=0} 11:19:57.853236 bus /sierra_3: Setting Powered False 11:19:58.955850 bus /sierra_3: Setting Powered False 11:20:00.074708 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 sms:sysmo --------------------------------------------------------------------- 11:20:01.275371 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:20:01.280407 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 11:20:01.309261 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 11:20:01.345095 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 11:20:01.406331 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 11:20:01.428814 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 11:20:01.460573 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 11:20:02.064348 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 sms:sysmo mo_mt_sms.py ---------------------------------------------- 11:20:02.070568 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:20:02.086136 tst sms:sysmo: Using 1 x bts (candidates: 1) 11:20:02.130821 tst mo_mt_sms.py: using LAC 21104 11:20:02.288930 tst mo_mt_sms.py: using RAC 194 11:20:02.431756 tst mo_mt_sms.py: using CellId 21104 11:20:02.559676 tst mo_mt_sms.py: using BVCI 21105 11:20:02.677984 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:20:02.689105 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:20:02.700124 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:20:02.711696 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:20:02.723380 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 11:20:02.734918 tst sms:sysmo: Using 1 x modem (candidates: 2) 11:20:02.854067 tst sms:sysmo: Using 1 x modem (candidates: 2) 11:20:02.973984 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:20:04.683128 run create_hlr_db(pid=30650): Launched 11:20:04.810041 bus /sierra_2: Setting Powered False 11:20:05.870988 run create_hlr_db(pid=30650): Terminated: ok {rc=0} 11:20:06.320656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30652): Launched 11:20:06.648835 run osmo-hlr_10.42.42.2(pid=30653): Launched 11:20:06.772582 run osmo-stp_10.42.42.5: Starting osmo-stp 11:20:09.340048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30655): Launched 11:20:09.668543 run osmo-stp_10.42.42.5(pid=30656): Launched 11:20:09.793750 run osmo-msc_10.42.42.6: Starting osmo-msc 11:20:15.210041 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31009): Launched 11:20:15.514060 run osmo-msc_10.42.42.6(pid=31010): Launched 11:20:15.681368 run osmo-stp_10.42.42.5(pid=30656): ERR: Terminated: ERROR {rc=1} [trial-2359↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30656)] 11:20:15.808110 run osmo-stp_10.42.42.5(pid=30656): stdout: | (launched: 2022-12-09_11:20:09.606820) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:15.988320 run osmo-stp_10.42.42.5(pid=30656): stderr: | 20221209112009801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112009801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112009802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112009802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112009803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112009803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112009803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:16.129173 run osmo-stp_10.42.42.5(pid=30656): stdout: | (launched: 2022-12-09_11:20:09.606820) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:16.264078 run osmo-stp_10.42.42.5(pid=30656): stderr: | 20221209112009801 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112009801 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112009802 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112009802 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112009803 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112009803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112009803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:16.424342 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=30656): Process ended prematurely: osmo-stp_10.42.42.5(pid=30656) [trial-2359↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30656)] [trial-2359↪sms:sysmo↪mo_mt_sms.py:16] 11:20:16.434294 tst mo_mt_sms.py:16: Test FAILED (14.4 sec) 11:20:16.465667 run osmo-hlr_10.42.42.2(pid=30653): ERR: Terminated: ERROR {rc=237} [trial-2359↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=30653)] 11:20:16.520304 run osmo-hlr_10.42.42.2(pid=30653): stdout: | (launched: 2022-12-09_11:20:06.587405) 11:20:16.576271 run osmo-hlr_10.42.42.2(pid=30653): stderr: | 20221209112006788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112006789 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112006789 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112006789 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112006789 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112006789 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112006806 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112006816 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112006816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112006816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:20:16.652639 run osmo-msc_10.42.42.6(pid=31010): ERR: Terminated: ERROR {rc=2} [trial-2359↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31010)] 11:20:16.707975 run osmo-msc_10.42.42.6(pid=31010): stdout: | (launched: 2022-12-09_11:20:15.456224) 11:20:16.764017 run osmo-msc_10.42.42.6(pid=31010): stderr: | 20221209112015735 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112015736 DLGLOBAL DEBUG validating counter group 0x7f3b7326ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112015736 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112015736 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112015736 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112015736 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112015738 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112015738 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112015738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112015739 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:20:16.820192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30652): Terminating (SIGTERM) 11:20:16.866312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30655): Terminating (SIGTERM) 11:20:16.912217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31009): Terminating (SIGTERM) 11:20:16.959808 --- ParallelTerminationStrategy: PID 30652 died... 11:20:16.981780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=30652): Terminated: ok {rc=0} 11:20:17.034825 --- ParallelTerminationStrategy: PID 30655 died... 11:20:17.055873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=30655): Terminated: ok {rc=0} 11:20:17.107779 --- ParallelTerminationStrategy: PID 31009 died... 11:20:17.128732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31009): Terminated: ok {rc=0} 11:20:17.221241 bus /sierra_3: Setting Powered False 11:20:18.322170 bus /sierra_3: Setting Powered False 11:20:19.436126 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 nitb_ussd:sysmo --------------------------------------------------------------------- 11:20:20.652142 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:20:20.656117 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 11:20:20.679395 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 11:20:20.687518 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 11:20:20.722737 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 11:20:20.743336 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 11:20:20.750728 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 11:20:21.270753 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2359 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 11:20:21.276928 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 11:20:21.289259 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 11:20:21.328511 tst assert_extension.py: using LAC 21105 11:20:21.457051 tst assert_extension.py: using RAC 195 11:20:21.582883 tst assert_extension.py: using CellId 21105 11:20:21.710004 tst assert_extension.py: using BVCI 21106 11:20:21.829944 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 11:20:21.946214 tst assert_extension.py:10: start nitb and bts... 11:20:22.149947 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:20:22.775806 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31023): Launched 11:20:23.112282 run osmo-nitb_10.42.42.2(pid=31092): Launched 11:20:23.296748 run osmo-nitb_10.42.42.2(pid=31092): ERR: Terminated: ERROR {rc=2} [trial-2359↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31092)] 11:20:23.448376 run osmo-nitb_10.42.42.2(pid=31092): stdout: | (launched: 2022-12-09_11:20:23.050582) 11:20:23.604739 run osmo-nitb_10.42.42.2(pid=31092): stderr: | (launched: 2022-12-09_11:20:23.097186) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:20:23.749375 run osmo-nitb_10.42.42.2(pid=31092): stdout: | (launched: 2022-12-09_11:20:23.050582) 11:20:23.880852 run osmo-nitb_10.42.42.2(pid=31092): stderr: | (launched: 2022-12-09_11:20:23.097186) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31092): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31092) [trial-2359↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31092)] 11:20:24.241296 tst osmo-nitb_10.42.42.2(pid=31092): stdout: | (launched: 2022-12-09_11:20:23.050582) 11:20:24.368188 tst osmo-nitb_10.42.42.2(pid=31092): stderr: | (launched: 2022-12-09_11:20:23.097186) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:20:24.518709 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=31092): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31092) [trial-2359↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31092)] [trial-2359↪nitb_ussd:sysmo↪assert_extension.py:12] 11:20:24.528270 tst assert_extension.py:12: Test FAILED (3.2 sec) 11:20:24.535996 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31023): Terminating (SIGTERM) 11:20:24.749600 --- ParallelTerminationStrategy: PID 31023 died... 11:20:24.771566 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31023): Terminated: ok {rc=0} 11:20:24.862595 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 ussd:sysmo --------------------------------------------------------------------- 11:20:26.029114 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:20:26.033247 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 11:20:26.055075 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 11:20:26.087929 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 11:20:26.123637 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 11:20:26.145789 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 11:20:26.175717 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 11:20:26.700775 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2359 ussd:sysmo assert_extension.py ---------------------------------------------- 11:20:26.707356 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:20:26.718891 tst ussd:sysmo: Using 1 x bts (candidates: 1) 11:20:26.755038 tst assert_extension.py: using LAC 21106 11:20:26.878401 tst assert_extension.py: using RAC 196 11:20:26.998987 tst assert_extension.py: using CellId 21106 11:20:27.122408 tst assert_extension.py: using BVCI 21107 11:20:27.235917 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:20:27.247629 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:20:27.259064 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:20:27.271582 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:20:27.283214 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 11:20:27.294888 tst ussd:sysmo: Using 1 x modem (candidates: 1) 11:20:27.412867 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:20:27.907036 run create_hlr_db(pid=31196): Launched 11:20:28.080574 bus /sierra_2: Setting Powered False 11:20:29.142764 run create_hlr_db(pid=31196): Terminated: ok {rc=0} 11:20:29.594573 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31199): Launched 11:20:29.922271 run osmo-hlr_10.42.42.2(pid=31200): Launched 11:20:30.046499 run osmo-stp_10.42.42.5: Starting osmo-stp 11:20:30.615752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31202): Launched 11:20:30.952733 run osmo-stp_10.42.42.5(pid=31203): Launched 11:20:31.270745 run osmo-msc_10.42.42.6: Starting osmo-msc 11:20:31.937071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31205): Launched 11:20:32.280597 run osmo-msc_10.42.42.6(pid=31206): Launched 11:20:32.462763 run osmo-stp_10.42.42.5(pid=31203): ERR: Terminated: ERROR {rc=1} [trial-2359↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31203)] 11:20:32.602955 run osmo-stp_10.42.42.5(pid=31203): stdout: | (launched: 2022-12-09_11:20:30.883903) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:32.743339 run osmo-stp_10.42.42.5(pid=31203): stderr: | 20221209112031169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112031169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112031170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112031170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112031172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112031172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112031172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:32.882850 run osmo-stp_10.42.42.5(pid=31203): stdout: | (launched: 2022-12-09_11:20:30.883903) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:33.012799 run osmo-stp_10.42.42.5(pid=31203): stderr: | 20221209112031169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112031169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112031170 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112031170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112031172 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112031172 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112031172 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:33.168445 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=31203): Process ended prematurely: osmo-stp_10.42.42.5(pid=31203) [trial-2359↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31203)] [trial-2359↪ussd:sysmo↪assert_extension.py:17] 11:20:33.177555 tst assert_extension.py:17: Test FAILED (6.5 sec) 11:20:33.205878 run osmo-hlr_10.42.42.2(pid=31200): ERR: Terminated: ERROR {rc=237} [trial-2359↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31200)] 11:20:33.257514 run osmo-hlr_10.42.42.2(pid=31200): stdout: | (launched: 2022-12-09_11:20:29.861160) 11:20:33.311007 run osmo-hlr_10.42.42.2(pid=31200): stderr: | 20221209112030060 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112030060 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112030061 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112030061 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112030061 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112030061 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112030076 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112030084 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112030085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112030085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:20:33.385627 run osmo-msc_10.42.42.6(pid=31206): ERR: Terminated: ERROR {rc=2} [trial-2359↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31206)] 11:20:33.437289 run osmo-msc_10.42.42.6(pid=31206): stdout: | (launched: 2022-12-09_11:20:32.218480) 11:20:33.490817 run osmo-msc_10.42.42.6(pid=31206): stderr: | 20221209112032622 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112032622 DLGLOBAL DEBUG validating counter group 0x7f618c346c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112032622 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112032623 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112032623 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112032623 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112032625 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112032625 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112032625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112032625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:20:33.544594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31199): Terminating (SIGTERM) 11:20:33.587646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31202): Terminating (SIGTERM) 11:20:33.630807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31205): Terminating (SIGTERM) 11:20:33.674296 --- ParallelTerminationStrategy: PID 31199 died... 11:20:33.694838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31199): Terminated: ok {rc=0} 11:20:33.742763 --- ParallelTerminationStrategy: PID 31202 died... 11:20:33.762898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31202): Terminated: ok {rc=0} 11:20:33.810682 --- ParallelTerminationStrategy: PID 31205 died... 11:20:33.830600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31205): Terminated: ok {rc=0} 11:20:33.920452 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 11:20:35.120553 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:20:35.127061 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 11:20:35.148751 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 11:20:35.177225 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 11:20:35.228492 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 11:20:35.249469 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 11:20:35.276731 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 11:20:35.827708 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 11:20:35.879829 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:20:35.891086 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:20:35.949303 tst mo_mt_call.py: using LAC 21107 11:20:36.070257 tst mo_mt_call.py: using RAC 197 11:20:36.193035 tst mo_mt_call.py: using CellId 21107 11:20:36.314061 tst mo_mt_call.py: using BVCI 21108 11:20:36.427920 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:20:36.439166 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:20:36.450104 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:20:36.460818 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:20:36.471733 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:20:36.482648 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:20:36.602638 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:20:36.721530 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:20:37.204572 run create_hlr_db(pid=31211): Launched 11:20:37.331015 bus /sierra_2: Setting Powered False 11:20:38.393131 run create_hlr_db(pid=31211): Terminated: ok {rc=0} 11:20:38.869619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31213): Launched 11:20:39.204319 run osmo-hlr_10.42.42.2(pid=31214): Launched 11:20:39.331264 run osmo-stp_10.42.42.5: Starting osmo-stp 11:20:39.913499 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31216): Launched 11:20:40.247660 run osmo-stp_10.42.42.5(pid=31217): Launched 11:20:40.374335 run osmo-msc_10.42.42.6: Starting osmo-msc 11:20:40.973895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31219): Launched 11:20:41.307490 run osmo-msc_10.42.42.6(pid=31220): Launched 11:20:41.492038 run osmo-stp_10.42.42.5(pid=31217): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31217)] 11:20:41.631473 run osmo-stp_10.42.42.5(pid=31217): stdout: | (launched: 2022-12-09_11:20:40.185386) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:41.771564 run osmo-stp_10.42.42.5(pid=31217): stderr: | 20221209112040380 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112040380 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112040380 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112040381 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112040383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112040383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112040383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:41.910471 run osmo-stp_10.42.42.5(pid=31217): stdout: | (launched: 2022-12-09_11:20:40.185386) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:42.041838 run osmo-stp_10.42.42.5(pid=31217): stderr: | 20221209112040380 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112040380 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112040380 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112040381 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112040383 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112040383 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112040383 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:42.199447 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31217): Process ended prematurely: osmo-stp_10.42.42.5(pid=31217) [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31217)] [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 11:20:42.209055 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:20:42.237817 run osmo-hlr_10.42.42.2(pid=31214): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31214)] 11:20:42.288866 run osmo-hlr_10.42.42.2(pid=31214): stdout: | (launched: 2022-12-09_11:20:39.141928) 11:20:42.341489 run osmo-hlr_10.42.42.2(pid=31214): stderr: | 20221209112039342 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112039343 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112039343 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112039343 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112039343 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112039343 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112039355 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112039364 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112039364 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112039364 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:20:42.414609 run osmo-msc_10.42.42.6(pid=31220): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31220)] 11:20:42.465697 run osmo-msc_10.42.42.6(pid=31220): stdout: | (launched: 2022-12-09_11:20:41.245273) 11:20:42.518204 run osmo-msc_10.42.42.6(pid=31220): stderr: | 20221209112041570 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112041570 DLGLOBAL DEBUG validating counter group 0x7fe8dcfafc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112041570 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112041570 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112041570 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112041570 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112041572 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112041573 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112041573 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112041573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:20:42.571398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31213): Terminating (SIGTERM) 11:20:42.613983 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31216): Terminating (SIGTERM) 11:20:42.656559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31219): Terminating (SIGTERM) 11:20:42.700134 --- ParallelTerminationStrategy: PID 31213 died... 11:20:42.720347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31213): Terminated: ok {rc=0} 11:20:42.767852 --- ParallelTerminationStrategy: PID 31216 died... 11:20:42.787651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31216): Terminated: ok {rc=0} 11:20:42.835270 --- ParallelTerminationStrategy: PID 31219 died... 11:20:42.855207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31219): Terminated: ok {rc=0} 11:20:42.945546 bus /sierra_3: Setting Powered False 11:20:44.046613 bus /sierra_3: Setting Powered False 11:20:45.167330 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 11:20:46.339051 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:20:46.355385 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:20:46.462571 tst mo_mt_call_osmux.py: using LAC 21108 11:20:46.595187 tst mo_mt_call_osmux.py: using RAC 198 11:20:46.720193 tst mo_mt_call_osmux.py: using CellId 21108 11:20:46.857737 tst mo_mt_call_osmux.py: using BVCI 21109 11:20:46.982860 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:20:46.995514 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:20:47.008003 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:20:47.021167 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:20:47.034384 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:20:47.049224 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:20:47.174125 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:20:47.293553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:20:47.776680 run create_hlr_db(pid=31222): Launched 11:20:47.903624 bus /sierra_2: Setting Powered False 11:20:48.965793 run create_hlr_db(pid=31222): Terminated: ok {rc=0} 11:20:49.423307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31224): Launched 11:20:49.758625 run osmo-hlr_10.42.42.2(pid=31225): Launched 11:20:49.885930 run osmo-stp_10.42.42.5: Starting osmo-stp 11:20:50.466913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31227): Launched 11:20:50.801441 run osmo-stp_10.42.42.5(pid=31228): Launched 11:20:50.929356 run osmo-msc_10.42.42.6: Starting osmo-msc 11:20:51.535690 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31230): Launched 11:20:51.870181 run osmo-msc_10.42.42.6(pid=31231): Launched 11:20:52.055047 run osmo-stp_10.42.42.5(pid=31228): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31228)] 11:20:52.196134 run osmo-stp_10.42.42.5(pid=31228): stdout: | (launched: 2022-12-09_11:20:50.739135) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:52.338163 run osmo-stp_10.42.42.5(pid=31228): stderr: | 20221209112050939 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112050939 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112050939 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112050939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112050940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112050940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112050940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:52.478303 run osmo-stp_10.42.42.5(pid=31228): stdout: | (launched: 2022-12-09_11:20:50.739135) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:20:52.610485 run osmo-stp_10.42.42.5(pid=31228): stderr: | 20221209112050939 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112050939 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112050939 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112050939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112050940 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112050940 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112050940 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:20:52.768442 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31228): Process ended prematurely: osmo-stp_10.42.42.5(pid=31228) [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31228)] [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 11:20:52.778193 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 11:20:52.806635 run osmo-hlr_10.42.42.2(pid=31225): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31225)] 11:20:52.858015 run osmo-hlr_10.42.42.2(pid=31225): stdout: | (launched: 2022-12-09_11:20:49.696132) 11:20:52.911119 run osmo-hlr_10.42.42.2(pid=31225): stderr: | 20221209112049900 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112049900 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112049900 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112049900 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112049901 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112049901 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112049916 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112049926 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112049926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112049926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:20:52.984677 run osmo-msc_10.42.42.6(pid=31231): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31231)] 11:20:53.035605 run osmo-msc_10.42.42.6(pid=31231): stdout: | (launched: 2022-12-09_11:20:51.807397) 11:20:53.088462 run osmo-msc_10.42.42.6(pid=31231): stderr: | 20221209112052134 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112052134 DLGLOBAL DEBUG validating counter group 0x7fe6ad934c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112052134 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112052134 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112052134 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112052135 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112052136 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112052137 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112052137 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112052137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:20:53.141403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31224): Terminating (SIGTERM) 11:20:53.183936 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31227): Terminating (SIGTERM) 11:20:53.226864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31230): Terminating (SIGTERM) 11:20:53.269832 --- ParallelTerminationStrategy: PID 31224 died... 11:20:53.290326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31224): Terminated: ok {rc=0} 11:20:53.338170 --- ParallelTerminationStrategy: PID 31227 died... 11:20:53.358241 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31227): Terminated: ok {rc=0} 11:20:53.405478 --- ParallelTerminationStrategy: PID 31230 died... 11:20:53.425409 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31230): Terminated: ok {rc=0} 11:20:53.516068 bus /sierra_3: Setting Powered False 11:20:54.616284 bus /sierra_3: Setting Powered False 11:20:55.735235 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 11:20:56.968419 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:20:56.974776 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 11:20:56.995823 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 11:20:57.022192 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 11:20:57.071963 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 11:20:57.092285 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 11:20:57.118625 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 11:20:57.674946 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 11:20:57.723956 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:20:57.734979 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:20:57.789842 tst mo_mt_call.py: using LAC 21109 11:20:57.921797 tst mo_mt_call.py: using RAC 199 11:20:58.053456 tst mo_mt_call.py: using CellId 21109 11:20:58.184118 tst mo_mt_call.py: using BVCI 21110 11:20:58.305673 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:20:58.317551 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:20:58.328685 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:20:58.340191 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:20:58.351864 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:20:58.363384 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:20:58.482242 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:20:58.604072 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:20:59.120513 run create_hlr_db(pid=31237): Launched 11:20:59.247152 bus /sierra_2: Setting Powered False 11:21:00.312901 run create_hlr_db(pid=31237): Terminated: ok {rc=0} 11:21:00.758333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31239): Launched 11:21:01.121110 run osmo-hlr_10.42.42.2(pid=31240): Launched 11:21:01.371301 run osmo-stp_10.42.42.5: Starting osmo-stp 11:21:02.154042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31242): Launched 11:21:02.501860 run osmo-stp_10.42.42.5(pid=31243): Launched 11:21:02.631508 run osmo-msc_10.42.42.6: Starting osmo-msc 11:21:03.232496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31245): Launched 11:21:03.567666 run osmo-msc_10.42.42.6(pid=31246): Launched 11:21:03.752002 run osmo-stp_10.42.42.5(pid=31243): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31243)] 11:21:03.891837 run osmo-stp_10.42.42.5(pid=31243): stdout: | (launched: 2022-12-09_11:21:02.438996) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:04.031875 run osmo-stp_10.42.42.5(pid=31243): stderr: | 20221209112102634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112102634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112102634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112102635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112102635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112102635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112102635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:04.170712 run osmo-stp_10.42.42.5(pid=31243): stdout: | (launched: 2022-12-09_11:21:02.438996) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:04.302301 run osmo-stp_10.42.42.5(pid=31243): stderr: | 20221209112102634 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112102634 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112102634 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112102635 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112102635 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112102635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112102635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:04.459871 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31243): Process ended prematurely: osmo-stp_10.42.42.5(pid=31243) [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31243)] [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 11:21:04.469594 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 11:21:04.498459 run osmo-hlr_10.42.42.2(pid=31240): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31240)] 11:21:04.549601 run osmo-hlr_10.42.42.2(pid=31240): stdout: | (launched: 2022-12-09_11:21:01.055497) 11:21:04.602328 run osmo-hlr_10.42.42.2(pid=31240): stderr: | 20221209112101326 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112101326 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112101326 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112101326 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112101326 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112101326 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112101379 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112101396 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112101396 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112101396 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:21:04.674878 run osmo-msc_10.42.42.6(pid=31246): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31246)] 11:21:04.725604 run osmo-msc_10.42.42.6(pid=31246): stdout: | (launched: 2022-12-09_11:21:03.504591) 11:21:04.778021 run osmo-msc_10.42.42.6(pid=31246): stderr: | 20221209112103831 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112103831 DLGLOBAL DEBUG validating counter group 0x7f7f8dfb0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112103831 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112103831 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112103831 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112103831 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112103833 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112103834 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112103834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112103834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:21:04.830853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31239): Terminating (SIGTERM) 11:21:04.873474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31242): Terminating (SIGTERM) 11:21:04.916101 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31245): Terminating (SIGTERM) 11:21:04.958760 --- ParallelTerminationStrategy: PID 31239 died... 11:21:04.978970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31239): Terminated: ok {rc=0} 11:21:05.026174 --- ParallelTerminationStrategy: PID 31242 died... 11:21:05.046008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31242): Terminated: ok {rc=0} 11:21:05.093383 --- ParallelTerminationStrategy: PID 31245 died... 11:21:05.113322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31245): Terminated: ok {rc=0} 11:21:05.203156 bus /sierra_3: Setting Powered False 11:21:06.303476 bus /sierra_3: Setting Powered False 11:21:07.422005 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 11:21:08.574721 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:21:08.587005 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:21:08.645615 tst mo_mt_call_osmux.py: using LAC 21110 11:21:08.768162 tst mo_mt_call_osmux.py: using RAC 200 11:21:08.892357 tst mo_mt_call_osmux.py: using CellId 21110 11:21:09.016260 tst mo_mt_call_osmux.py: using BVCI 21111 11:21:09.130987 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:21:09.142552 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:21:09.153512 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:21:09.164359 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:21:09.175203 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:21:09.186116 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:21:09.306872 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:21:09.426806 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:21:09.911519 run create_hlr_db(pid=31248): Launched 11:21:10.040721 bus /sierra_2: Setting Powered False 11:21:11.102567 run create_hlr_db(pid=31248): Terminated: ok {rc=0} 11:21:11.539447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31250): Launched 11:21:11.851983 run osmo-hlr_10.42.42.2(pid=31251): Launched 11:21:11.969909 run osmo-stp_10.42.42.5: Starting osmo-stp 11:21:12.522116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31253): Launched 11:21:12.834056 run osmo-stp_10.42.42.5(pid=31254): Launched 11:21:12.951438 run osmo-msc_10.42.42.6: Starting osmo-msc 11:21:13.515368 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31256): Launched 11:21:13.828623 run osmo-msc_10.42.42.6(pid=31257): Launched 11:21:14.002286 run osmo-stp_10.42.42.5(pid=31254): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31254)] 11:21:14.133244 run osmo-stp_10.42.42.5(pid=31254): stdout: | (launched: 2022-12-09_11:21:12.774856) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:14.264370 run osmo-stp_10.42.42.5(pid=31254): stderr: | 20221209112112949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112112949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112112949 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112112950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112112952 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112112952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112112952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:14.394128 run osmo-stp_10.42.42.5(pid=31254): stdout: | (launched: 2022-12-09_11:21:12.774856) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:14.517413 run osmo-stp_10.42.42.5(pid=31254): stderr: | 20221209112112949 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112112949 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112112949 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112112950 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112112952 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112112952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112112952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:14.664718 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31254): Process ended prematurely: osmo-stp_10.42.42.5(pid=31254) [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31254)] [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 11:21:14.673923 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 11:21:14.700369 run osmo-hlr_10.42.42.2(pid=31251): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31251)] 11:21:14.748371 run osmo-hlr_10.42.42.2(pid=31251): stdout: | (launched: 2022-12-09_11:21:11.793287) 11:21:14.798109 run osmo-hlr_10.42.42.2(pid=31251): stderr: | 20221209112111974 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112111974 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112111974 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112111974 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112111974 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112111974 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112111986 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112111995 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112111995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112111995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:21:14.867560 run osmo-msc_10.42.42.6(pid=31257): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31257)] 11:21:14.916248 run osmo-msc_10.42.42.6(pid=31257): stdout: | (launched: 2022-12-09_11:21:13.769420) 11:21:14.966093 run osmo-msc_10.42.42.6(pid=31257): stderr: | 20221209112114044 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112114044 DLGLOBAL DEBUG validating counter group 0x7f3a1ab75c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112114044 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112114044 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112114044 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112114045 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112114046 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112114047 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112114047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112114047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:21:15.015996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31250): Terminating (SIGTERM) 11:21:15.056105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31253): Terminating (SIGTERM) 11:21:15.096038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31256): Terminating (SIGTERM) 11:21:15.136097 --- ParallelTerminationStrategy: PID 31250 died... 11:21:15.155372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31250): Terminated: ok {rc=0} 11:21:15.199768 --- ParallelTerminationStrategy: PID 31253 died... 11:21:15.218686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31253): Terminated: ok {rc=0} 11:21:15.262912 --- ParallelTerminationStrategy: PID 31256 died... 11:21:15.281790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31256): Terminated: ok {rc=0} 11:21:15.368586 bus /sierra_3: Setting Powered False 11:21:16.467016 bus /sierra_3: Setting Powered False 11:21:17.582905 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 11:21:18.828501 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:21:18.835641 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 11:21:18.857915 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 11:21:18.886387 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 11:21:18.937249 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 11:21:18.958559 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 11:21:18.986121 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 11:21:19.541037 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 11:21:19.594533 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:21:19.606087 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:21:19.661680 tst mo_mt_call.py: using LAC 21111 11:21:19.792717 tst mo_mt_call.py: using RAC 201 11:21:19.921950 tst mo_mt_call.py: using CellId 21111 11:21:20.050534 tst mo_mt_call.py: using BVCI 21112 11:21:20.172056 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:21:20.183756 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:21:20.195088 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:21:20.206584 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:21:20.218050 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:21:20.229794 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:21:20.349997 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:21:20.466858 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:21:20.951754 run create_hlr_db(pid=31262): Launched 11:21:21.082305 bus /sierra_2: Setting Powered False 11:21:22.147329 run create_hlr_db(pid=31262): Terminated: ok {rc=0} 11:21:22.593274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31264): Launched 11:21:22.906278 run osmo-hlr_10.42.42.2(pid=31265): Launched 11:21:23.024172 run osmo-stp_10.42.42.5: Starting osmo-stp 11:21:23.561456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31267): Launched 11:21:23.875913 run osmo-stp_10.42.42.5(pid=31268): Launched 11:21:23.994861 run osmo-msc_10.42.42.6: Starting osmo-msc 11:21:24.558404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31270): Launched 11:21:24.873678 run osmo-msc_10.42.42.6(pid=31271): Launched 11:21:25.047823 run osmo-stp_10.42.42.5(pid=31268): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31268)] 11:21:25.180376 run osmo-stp_10.42.42.5(pid=31268): stdout: | (launched: 2022-12-09_11:21:23.816291) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:25.312568 run osmo-stp_10.42.42.5(pid=31268): stderr: | 20221209112123990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112123990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112123990 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112123991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112123991 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112123991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112123991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:25.442546 run osmo-stp_10.42.42.5(pid=31268): stdout: | (launched: 2022-12-09_11:21:23.816291) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:25.567032 run osmo-stp_10.42.42.5(pid=31268): stderr: | 20221209112123990 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112123990 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112123990 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112123991 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112123991 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112123991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112123991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:25.716148 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31268): Process ended prematurely: osmo-stp_10.42.42.5(pid=31268) [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31268)] [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 11:21:25.725086 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:21:25.751512 run osmo-hlr_10.42.42.2(pid=31265): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31265)] 11:21:25.799788 run osmo-hlr_10.42.42.2(pid=31265): stdout: | (launched: 2022-12-09_11:21:22.846947) 11:21:25.849649 run osmo-hlr_10.42.42.2(pid=31265): stderr: | 20221209112123027 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112123027 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112123027 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112123027 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112123027 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112123027 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112123039 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112123050 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112123050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112123050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:21:25.918823 run osmo-msc_10.42.42.6(pid=31271): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31271)] 11:21:25.966672 run osmo-msc_10.42.42.6(pid=31271): stdout: | (launched: 2022-12-09_11:21:24.813365) 11:21:26.016225 run osmo-msc_10.42.42.6(pid=31271): stderr: | 20221209112125091 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112125091 DLGLOBAL DEBUG validating counter group 0x7f66bca8cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112125091 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112125091 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112125092 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112125092 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112125093 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112125094 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112125094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112125094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:21:26.066264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31264): Terminating (SIGTERM) 11:21:26.106128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31267): Terminating (SIGTERM) 11:21:26.146002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31270): Terminating (SIGTERM) 11:21:26.186044 --- ParallelTerminationStrategy: PID 31264 died... 11:21:26.205162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31264): Terminated: ok {rc=0} 11:21:26.249343 --- ParallelTerminationStrategy: PID 31267 died... 11:21:26.267941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31267): Terminated: ok {rc=0} 11:21:26.312317 --- ParallelTerminationStrategy: PID 31270 died... 11:21:26.331148 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31270): Terminated: ok {rc=0} 11:21:26.418814 bus /sierra_3: Setting Powered False 11:21:27.519617 bus /sierra_3: Setting Powered False 11:21:28.638013 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 11:21:29.782484 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:21:29.794412 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:21:29.850442 tst mo_mt_call_osmux.py: using LAC 21112 11:21:29.977533 tst mo_mt_call_osmux.py: using RAC 202 11:21:30.108347 tst mo_mt_call_osmux.py: using CellId 21112 11:21:30.237961 tst mo_mt_call_osmux.py: using BVCI 21113 11:21:30.361997 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:21:30.373833 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:21:30.385427 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:21:30.396912 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:21:30.408637 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:21:30.423478 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:21:30.541233 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:21:30.661812 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:21:31.206507 run create_hlr_db(pid=31273): Launched 11:21:31.364010 bus /sierra_2: Setting Powered False 11:21:32.425066 run create_hlr_db(pid=31273): Terminated: ok {rc=0} 11:21:32.882691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31275): Launched 11:21:33.218195 run osmo-hlr_10.42.42.2(pid=31276): Launched 11:21:33.344668 run osmo-stp_10.42.42.5: Starting osmo-stp 11:21:33.920375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31278): Launched 11:21:34.255153 run osmo-stp_10.42.42.5(pid=31279): Launched 11:21:34.381798 run osmo-msc_10.42.42.6: Starting osmo-msc 11:21:34.986770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31281): Launched 11:21:35.324439 run osmo-msc_10.42.42.6(pid=31282): Launched 11:21:35.510625 run osmo-stp_10.42.42.5(pid=31279): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31279)] 11:21:35.653893 run osmo-stp_10.42.42.5(pid=31279): stdout: | (launched: 2022-12-09_11:21:34.192266) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:35.795389 run osmo-stp_10.42.42.5(pid=31279): stderr: | 20221209112134389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112134389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112134390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112134390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112134390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112134390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112134391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:35.934850 run osmo-stp_10.42.42.5(pid=31279): stdout: | (launched: 2022-12-09_11:21:34.192266) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:36.067643 run osmo-stp_10.42.42.5(pid=31279): stderr: | 20221209112134389 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112134389 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112134390 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112134390 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112134390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112134390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112134391 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:36.226357 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31279): Process ended prematurely: osmo-stp_10.42.42.5(pid=31279) [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31279)] [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 11:21:36.236128 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 11:21:36.264811 run osmo-hlr_10.42.42.2(pid=31276): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31276)] 11:21:36.315711 run osmo-hlr_10.42.42.2(pid=31276): stdout: | (launched: 2022-12-09_11:21:33.155296) 11:21:36.368263 run osmo-hlr_10.42.42.2(pid=31276): stderr: | 20221209112133359 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112133359 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112133359 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112133359 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112133360 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112133360 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112133371 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112133380 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112133380 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112133380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:21:36.441399 run osmo-msc_10.42.42.6(pid=31282): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31282)] 11:21:36.492565 run osmo-msc_10.42.42.6(pid=31282): stdout: | (launched: 2022-12-09_11:21:35.261429) 11:21:36.545451 run osmo-msc_10.42.42.6(pid=31282): stderr: | 20221209112135588 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112135588 DLGLOBAL DEBUG validating counter group 0x7f4aada01c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112135588 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112135588 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112135588 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112135588 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112135590 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112135590 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112135591 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112135591 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:21:36.598528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31275): Terminating (SIGTERM) 11:21:36.641173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31278): Terminating (SIGTERM) 11:21:36.683925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31281): Terminating (SIGTERM) 11:21:36.726804 --- ParallelTerminationStrategy: PID 31275 died... 11:21:36.747141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31275): Terminated: ok {rc=0} 11:21:36.794487 --- ParallelTerminationStrategy: PID 31278 died... 11:21:36.814432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31278): Terminated: ok {rc=0} 11:21:36.861627 --- ParallelTerminationStrategy: PID 31281 died... 11:21:36.881374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31281): Terminated: ok {rc=0} 11:21:36.971103 bus /sierra_3: Setting Powered False 11:21:38.071362 bus /sierra_3: Setting Powered False 11:21:39.188988 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 11:21:40.428226 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:21:40.434592 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 11:21:40.455269 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 11:21:40.482194 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 11:21:40.537531 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 11:21:40.558081 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 11:21:40.584030 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 11:21:41.133885 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 11:21:41.187771 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:21:41.199385 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:21:41.255914 tst mo_mt_call.py: using LAC 21113 11:21:41.385353 tst mo_mt_call.py: using RAC 203 11:21:41.515463 tst mo_mt_call.py: using CellId 21113 11:21:41.646255 tst mo_mt_call.py: using BVCI 21114 11:21:41.769643 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:21:41.781227 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:21:41.792471 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:21:41.804239 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:21:41.815975 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:21:41.827785 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:21:41.948201 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:21:42.066069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:21:42.548620 run create_hlr_db(pid=31288): Launched 11:21:42.675641 bus /sierra_2: Setting Powered False 11:21:43.737705 run create_hlr_db(pid=31288): Terminated: ok {rc=0} 11:21:44.171986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31290): Launched 11:21:44.483958 run osmo-hlr_10.42.42.2(pid=31291): Launched 11:21:44.601822 run osmo-stp_10.42.42.5: Starting osmo-stp 11:21:45.138265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31293): Launched 11:21:45.450874 run osmo-stp_10.42.42.5(pid=31294): Launched 11:21:45.568022 run osmo-msc_10.42.42.6: Starting osmo-msc 11:21:46.153637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31296): Launched 11:21:46.511542 run osmo-msc_10.42.42.6(pid=31297): Launched 11:21:46.909810 run osmo-stp_10.42.42.5(pid=31294): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31294)] 11:21:47.159739 run osmo-stp_10.42.42.5(pid=31294): stdout: | (launched: 2022-12-09_11:21:45.391828) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:47.292716 run osmo-stp_10.42.42.5(pid=31294): stderr: | 20221209112145566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112145566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112145566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112145567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112145567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112145567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112145567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:47.422220 run osmo-stp_10.42.42.5(pid=31294): stdout: | (launched: 2022-12-09_11:21:45.391828) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:47.545637 run osmo-stp_10.42.42.5(pid=31294): stderr: | 20221209112145566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112145566 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112145566 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112145567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112145567 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112145567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112145567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:47.693392 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31294): Process ended prematurely: osmo-stp_10.42.42.5(pid=31294) [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31294)] [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 11:21:47.702128 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 11:21:47.729052 run osmo-hlr_10.42.42.2(pid=31291): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31291)] 11:21:47.777322 run osmo-hlr_10.42.42.2(pid=31291): stdout: | (launched: 2022-12-09_11:21:44.424855) 11:21:47.827195 run osmo-hlr_10.42.42.2(pid=31291): stderr: | 20221209112144605 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112144605 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112144605 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112144606 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112144606 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112144606 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112144632 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112144641 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112144641 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112144641 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:21:47.897033 run osmo-msc_10.42.42.6(pid=31297): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31297)] 11:21:47.945056 run osmo-msc_10.42.42.6(pid=31297): stdout: | (launched: 2022-12-09_11:21:46.443142) 11:21:47.994831 run osmo-msc_10.42.42.6(pid=31297): stderr: | 20221209112146888 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112146888 DLGLOBAL DEBUG validating counter group 0x7ff75436ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112146888 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112146888 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112146888 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112146889 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112146890 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112146891 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112146891 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112146891 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:21:48.045152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31290): Terminating (SIGTERM) 11:21:48.085145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31293): Terminating (SIGTERM) 11:21:48.125155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31296): Terminating (SIGTERM) 11:21:48.165321 --- ParallelTerminationStrategy: PID 31290 died... 11:21:48.184383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31290): Terminated: ok {rc=0} 11:21:48.228549 --- ParallelTerminationStrategy: PID 31293 died... 11:21:48.247224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31293): Terminated: ok {rc=0} 11:21:48.291315 --- ParallelTerminationStrategy: PID 31296 died... 11:21:48.309949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31296): Terminated: ok {rc=0} 11:21:48.396497 bus /sierra_3: Setting Powered False 11:21:49.496682 bus /sierra_3: Setting Powered False 11:21:50.612550 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 11:21:51.760621 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:21:51.772516 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:21:51.830782 tst mo_mt_call_osmux.py: using LAC 21114 11:21:51.956923 tst mo_mt_call_osmux.py: using RAC 204 11:21:52.078841 tst mo_mt_call_osmux.py: using CellId 21114 11:21:52.201834 tst mo_mt_call_osmux.py: using BVCI 21115 11:21:52.325627 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:21:52.337464 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:21:52.348921 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:21:52.361150 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:21:52.372882 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:21:52.384805 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:21:52.503955 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:21:52.626284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:21:53.145205 run create_hlr_db(pid=31299): Launched 11:21:53.272146 bus /sierra_2: Setting Powered False 11:21:54.338125 run create_hlr_db(pid=31299): Terminated: ok {rc=0} 11:21:54.783933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31301): Launched 11:21:55.096473 run osmo-hlr_10.42.42.2(pid=31302): Launched 11:21:55.215512 run osmo-stp_10.42.42.5: Starting osmo-stp 11:21:55.753960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31304): Launched 11:21:56.067657 run osmo-stp_10.42.42.5(pid=31305): Launched 11:21:56.184743 run osmo-msc_10.42.42.6: Starting osmo-msc 11:21:56.749242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31307): Launched 11:21:57.061426 run osmo-msc_10.42.42.6(pid=31308): Launched 11:21:57.235597 run osmo-stp_10.42.42.5(pid=31305): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31305)] 11:21:57.367556 run osmo-stp_10.42.42.5(pid=31305): stdout: | (launched: 2022-12-09_11:21:56.008164) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:57.499493 run osmo-stp_10.42.42.5(pid=31305): stderr: | 20221209112156182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112156182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112156183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112156183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112156183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112156183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112156184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:57.629796 run osmo-stp_10.42.42.5(pid=31305): stdout: | (launched: 2022-12-09_11:21:56.008164) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:21:57.753687 run osmo-stp_10.42.42.5(pid=31305): stderr: | 20221209112156182 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112156182 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112156183 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112156183 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112156183 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112156183 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112156184 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:21:57.902817 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31305): Process ended prematurely: osmo-stp_10.42.42.5(pid=31305) [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31305)] [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 11:21:57.911721 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:21:57.938285 run osmo-hlr_10.42.42.2(pid=31302): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31302)] 11:21:57.986584 run osmo-hlr_10.42.42.2(pid=31302): stdout: | (launched: 2022-12-09_11:21:55.037717) 11:21:58.037079 run osmo-hlr_10.42.42.2(pid=31302): stderr: | 20221209112155217 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112155217 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112155217 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112155217 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112155217 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112155217 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112155230 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112155238 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112155238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112155238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:21:58.107444 run osmo-msc_10.42.42.6(pid=31308): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31308)] 11:21:58.156379 run osmo-msc_10.42.42.6(pid=31308): stdout: | (launched: 2022-12-09_11:21:57.002596) 11:21:58.206589 run osmo-msc_10.42.42.6(pid=31308): stderr: | 20221209112157279 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112157279 DLGLOBAL DEBUG validating counter group 0x7fb60c807c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112157279 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112157279 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112157280 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112157280 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112157282 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112157282 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112157282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112157282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:21:58.257058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31301): Terminating (SIGTERM) 11:21:58.297029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31304): Terminating (SIGTERM) 11:21:58.337203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31307): Terminating (SIGTERM) 11:21:58.378036 --- ParallelTerminationStrategy: PID 31301 died... 11:21:58.397299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31301): Terminated: ok {rc=0} 11:21:58.441804 --- ParallelTerminationStrategy: PID 31304 died... 11:21:58.460596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31304): Terminated: ok {rc=0} 11:21:58.505047 --- ParallelTerminationStrategy: PID 31307 died... 11:21:58.523681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31307): Terminated: ok {rc=0} 11:21:58.610567 bus /sierra_3: Setting Powered False 11:21:59.713402 bus /sierra_3: Setting Powered False 11:22:00.831635 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 11:22:02.095279 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:22:02.102627 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 11:22:02.126626 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 11:22:02.156531 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 11:22:02.214055 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 11:22:02.236347 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 11:22:02.265953 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 11:22:02.811257 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 11:22:02.865941 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:22:02.877869 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:22:02.935845 tst mo_mt_call.py: using LAC 21115 11:22:03.066523 tst mo_mt_call.py: using RAC 205 11:22:03.198621 tst mo_mt_call.py: using CellId 21115 11:22:03.330820 tst mo_mt_call.py: using BVCI 21116 11:22:03.452330 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:22:03.464046 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:22:03.475380 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:22:03.486986 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:22:03.498647 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:22:03.510630 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:22:03.634322 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:22:03.753891 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:22:04.240548 run create_hlr_db(pid=31313): Launched 11:22:04.368881 bus /sierra_2: Setting Powered False 11:22:05.431151 run create_hlr_db(pid=31313): Terminated: ok {rc=0} 11:22:05.888485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31315): Launched 11:22:06.224446 run osmo-hlr_10.42.42.2(pid=31316): Launched 11:22:06.353612 run osmo-stp_10.42.42.5: Starting osmo-stp 11:22:06.898210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31318): Launched 11:22:07.211628 run osmo-stp_10.42.42.5(pid=31319): Launched 11:22:07.329405 run osmo-msc_10.42.42.6: Starting osmo-msc 11:22:07.892772 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31321): Launched 11:22:08.205665 run osmo-msc_10.42.42.6(pid=31322): Launched 11:22:08.378549 run osmo-stp_10.42.42.5(pid=31319): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31319)] 11:22:08.510007 run osmo-stp_10.42.42.5(pid=31319): stdout: | (launched: 2022-12-09_11:22:07.152508) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:08.641209 run osmo-stp_10.42.42.5(pid=31319): stderr: | 20221209112207327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112207327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112207328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112207328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112207329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112207329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112207329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:08.770606 run osmo-stp_10.42.42.5(pid=31319): stdout: | (launched: 2022-12-09_11:22:07.152508) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:08.893694 run osmo-stp_10.42.42.5(pid=31319): stderr: | 20221209112207327 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112207327 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112207328 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112207328 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112207329 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112207329 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112207329 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:09.041171 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31319): Process ended prematurely: osmo-stp_10.42.42.5(pid=31319) [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31319)] [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 11:22:09.049878 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:22:09.076318 run osmo-hlr_10.42.42.2(pid=31316): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31316)] 11:22:09.124471 run osmo-hlr_10.42.42.2(pid=31316): stdout: | (launched: 2022-12-09_11:22:06.162020) 11:22:09.174529 run osmo-hlr_10.42.42.2(pid=31316): stderr: | 20221209112206365 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112206365 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112206365 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112206366 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112206366 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112206366 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112206379 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112206389 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112206389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112206389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:22:09.244068 run osmo-msc_10.42.42.6(pid=31322): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31322)] 11:22:09.292303 run osmo-msc_10.42.42.6(pid=31322): stdout: | (launched: 2022-12-09_11:22:08.146777) 11:22:09.342476 run osmo-msc_10.42.42.6(pid=31322): stderr: | 20221209112208423 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112208423 DLGLOBAL DEBUG validating counter group 0x7f94be0b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112208423 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112208423 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112208424 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112208424 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112208425 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112208426 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112208426 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112208426 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:22:09.392714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31315): Terminating (SIGTERM) 11:22:09.433018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31318): Terminating (SIGTERM) 11:22:09.473118 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31321): Terminating (SIGTERM) 11:22:09.513429 --- ParallelTerminationStrategy: PID 31315 died... 11:22:09.532663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31315): Terminated: ok {rc=0} 11:22:09.577175 --- ParallelTerminationStrategy: PID 31318 died... 11:22:09.595930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31318): Terminated: ok {rc=0} 11:22:09.640412 --- ParallelTerminationStrategy: PID 31321 died... 11:22:09.659241 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31321): Terminated: ok {rc=0} 11:22:09.744487 bus /sierra_3: Setting Powered False 11:22:10.844028 bus /sierra_3: Setting Powered False 11:22:11.962338 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 11:22:13.113306 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:22:13.125540 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:22:13.184201 tst mo_mt_call_osmux.py: using LAC 21116 11:22:13.316404 tst mo_mt_call_osmux.py: using RAC 206 11:22:13.446322 tst mo_mt_call_osmux.py: using CellId 21116 11:22:13.576908 tst mo_mt_call_osmux.py: using BVCI 21117 11:22:13.698097 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:22:13.709762 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:22:13.721137 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:22:13.732629 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:22:13.744240 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:22:13.755930 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:22:13.877869 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:22:14.000463 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:22:14.483771 run create_hlr_db(pid=31324): Launched 11:22:14.611513 bus /sierra_2: Setting Powered False 11:22:15.672739 run create_hlr_db(pid=31324): Terminated: ok {rc=0} 11:22:16.139719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31326): Launched 11:22:16.460152 run osmo-hlr_10.42.42.2(pid=31327): Launched 11:22:16.726723 run osmo-stp_10.42.42.5: Starting osmo-stp 11:22:17.381368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31329): Launched 11:22:17.694997 run osmo-stp_10.42.42.5(pid=31330): Launched 11:22:17.814206 run osmo-msc_10.42.42.6: Starting osmo-msc 11:22:18.393741 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31332): Launched 11:22:18.707767 run osmo-msc_10.42.42.6(pid=31333): Launched 11:22:18.880876 run osmo-stp_10.42.42.5(pid=31330): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31330)] 11:22:19.011714 run osmo-stp_10.42.42.5(pid=31330): stdout: | (launched: 2022-12-09_11:22:17.635934) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:19.142714 run osmo-stp_10.42.42.5(pid=31330): stderr: | 20221209112217810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112217810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112217810 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112217810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112217811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112217811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112217811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:19.271232 run osmo-stp_10.42.42.5(pid=31330): stdout: | (launched: 2022-12-09_11:22:17.635934) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:19.393857 run osmo-stp_10.42.42.5(pid=31330): stderr: | 20221209112217810 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112217810 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112217810 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112217810 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112217811 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112217811 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112217811 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:19.540728 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31330): Process ended prematurely: osmo-stp_10.42.42.5(pid=31330) [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31330)] [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 11:22:19.549578 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 11:22:19.575720 run osmo-hlr_10.42.42.2(pid=31327): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31327)] 11:22:19.623193 run osmo-hlr_10.42.42.2(pid=31327): stdout: | (launched: 2022-12-09_11:22:16.397932) 11:22:19.672409 run osmo-hlr_10.42.42.2(pid=31327): stderr: | 20221209112216667 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112216667 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112216667 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112216667 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112216667 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112216667 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112216688 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112216696 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112216696 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112216705 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:22:19.741031 run osmo-msc_10.42.42.6(pid=31333): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31333)] 11:22:19.788540 run osmo-msc_10.42.42.6(pid=31333): stdout: | (launched: 2022-12-09_11:22:18.648599) 11:22:19.837929 run osmo-msc_10.42.42.6(pid=31333): stderr: | 20221209112218925 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112218926 DLGLOBAL DEBUG validating counter group 0x7f3fcb88ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112218926 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112218926 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112218926 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112218926 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112218928 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112218928 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112218928 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112218928 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:22:19.887495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31326): Terminating (SIGTERM) 11:22:19.926921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31329): Terminating (SIGTERM) 11:22:19.966434 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31332): Terminating (SIGTERM) 11:22:20.006553 --- ParallelTerminationStrategy: PID 31326 died... 11:22:20.025503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31326): Terminated: ok {rc=0} 11:22:20.069344 --- ParallelTerminationStrategy: PID 31329 died... 11:22:20.087783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31329): Terminated: ok {rc=0} 11:22:20.131668 --- ParallelTerminationStrategy: PID 31332 died... 11:22:20.150149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31332): Terminated: ok {rc=0} 11:22:20.235417 bus /sierra_3: Setting Powered False 11:22:21.336240 bus /sierra_3: Setting Powered False 11:22:22.453243 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:22:23.692618 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:22:23.699653 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:22:23.721611 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 11:22:23.749514 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:22:23.803946 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:22:23.825520 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 11:22:23.853291 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:22:24.402924 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 11:22:24.456521 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:22:24.468095 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:22:24.526456 tst mo_mt_call.py: using LAC 21117 11:22:24.658532 tst mo_mt_call.py: using RAC 207 11:22:24.789511 tst mo_mt_call.py: using CellId 21117 11:22:24.912861 tst mo_mt_call.py: using BVCI 21118 11:22:25.027966 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:22:25.039225 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:22:25.050351 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:22:25.061988 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:22:25.073705 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:22:25.085690 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:22:25.209038 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:22:25.331055 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:22:25.850133 run create_hlr_db(pid=31338): Launched 11:22:25.978039 bus /sierra_2: Setting Powered False 11:22:27.044140 run create_hlr_db(pid=31338): Terminated: ok {rc=0} 11:22:27.491910 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31340): Launched 11:22:27.806369 run osmo-hlr_10.42.42.2(pid=31341): Launched 11:22:27.925099 run osmo-stp_10.42.42.5: Starting osmo-stp 11:22:28.463523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31343): Launched 11:22:28.776604 run osmo-stp_10.42.42.5(pid=31344): Launched 11:22:28.895351 run osmo-msc_10.42.42.6: Starting osmo-msc 11:22:29.458478 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31346): Launched 11:22:29.771601 run osmo-msc_10.42.42.6(pid=31347): Launched 11:22:29.945552 run osmo-stp_10.42.42.5(pid=31344): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31344)] 11:22:30.077652 run osmo-stp_10.42.42.5(pid=31344): stdout: | (launched: 2022-12-09_11:22:28.717368) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:30.209822 run osmo-stp_10.42.42.5(pid=31344): stderr: | 20221209112228892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112228892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112228892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112228893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112228893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112228893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112228893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:30.339276 run osmo-stp_10.42.42.5(pid=31344): stdout: | (launched: 2022-12-09_11:22:28.717368) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:30.463308 run osmo-stp_10.42.42.5(pid=31344): stderr: | 20221209112228892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112228892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112228892 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112228893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112228893 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112228893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112228893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:30.611113 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31344): Process ended prematurely: osmo-stp_10.42.42.5(pid=31344) [trial-2359↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31344)] [trial-2359↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 11:22:30.620059 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:22:30.646671 run osmo-hlr_10.42.42.2(pid=31341): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31341)] 11:22:30.695390 run osmo-hlr_10.42.42.2(pid=31341): stdout: | (launched: 2022-12-09_11:22:27.747290) 11:22:30.745629 run osmo-hlr_10.42.42.2(pid=31341): stderr: | 20221209112227926 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112227926 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112227926 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112227926 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112227926 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112227926 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112227939 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112227947 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112227947 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112227947 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:22:30.815557 run osmo-msc_10.42.42.6(pid=31347): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31347)] 11:22:30.865090 run osmo-msc_10.42.42.6(pid=31347): stdout: | (launched: 2022-12-09_11:22:29.712856) 11:22:30.920203 run osmo-msc_10.42.42.6(pid=31347): stderr: | 20221209112229987 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112229987 DLGLOBAL DEBUG validating counter group 0x7fdaa117fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112229987 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112229987 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112229988 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112229988 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112229990 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112229990 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112229990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112229990 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:22:30.974017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31340): Terminating (SIGTERM) 11:22:31.015155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31343): Terminating (SIGTERM) 11:22:31.056831 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31346): Terminating (SIGTERM) 11:22:31.098503 --- ParallelTerminationStrategy: PID 31340 died... 11:22:31.118068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31340): Terminated: ok {rc=0} 11:22:31.163792 --- ParallelTerminationStrategy: PID 31343 died... 11:22:31.183477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31343): Terminated: ok {rc=0} 11:22:31.229290 --- ParallelTerminationStrategy: PID 31346 died... 11:22:31.248715 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31346): Terminated: ok {rc=0} 11:22:31.335074 bus /sierra_3: Setting Powered False 11:22:32.431719 bus /sierra_3: Setting Powered False 11:22:33.548168 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 11:22:34.697358 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:22:34.709441 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:22:34.766247 tst mo_mt_call_osmux.py: using LAC 21118 11:22:34.893821 tst mo_mt_call_osmux.py: using RAC 208 11:22:35.015543 tst mo_mt_call_osmux.py: using CellId 21118 11:22:35.135899 tst mo_mt_call_osmux.py: using BVCI 21119 11:22:35.259225 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:22:35.271112 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:22:35.282829 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:22:35.294759 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:22:35.306801 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:22:35.318912 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:22:35.437166 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:22:35.559428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:22:36.082966 run create_hlr_db(pid=31351): Launched 11:22:36.209913 bus /sierra_2: Setting Powered False 11:22:37.275367 run create_hlr_db(pid=31351): Terminated: ok {rc=0} 11:22:37.723588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31353): Launched 11:22:38.061127 run osmo-hlr_10.42.42.2(pid=31354): Launched 11:22:38.188060 run osmo-stp_10.42.42.5: Starting osmo-stp 11:22:38.762280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31356): Launched 11:22:39.096336 run osmo-stp_10.42.42.5(pid=31357): Launched 11:22:39.222963 run osmo-msc_10.42.42.6: Starting osmo-msc 11:22:39.826539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31359): Launched 11:22:40.161652 run osmo-msc_10.42.42.6(pid=31360): Launched 11:22:40.346531 run osmo-stp_10.42.42.5(pid=31357): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31357)] 11:22:40.487036 run osmo-stp_10.42.42.5(pid=31357): stdout: | (launched: 2022-12-09_11:22:39.033980) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:40.628406 run osmo-stp_10.42.42.5(pid=31357): stderr: | 20221209112239230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112239230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112239230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112239231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112239231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112239231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112239231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:40.768335 run osmo-stp_10.42.42.5(pid=31357): stdout: | (launched: 2022-12-09_11:22:39.033980) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:40.900688 run osmo-stp_10.42.42.5(pid=31357): stderr: | 20221209112239230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112239230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112239230 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112239231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112239231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112239231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112239231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:41.059094 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31357): Process ended prematurely: osmo-stp_10.42.42.5(pid=31357) [trial-2359↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31357)] [trial-2359↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 11:22:41.068470 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:22:41.096926 run osmo-hlr_10.42.42.2(pid=31354): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31354)] 11:22:41.148016 run osmo-hlr_10.42.42.2(pid=31354): stdout: | (launched: 2022-12-09_11:22:37.998793) 11:22:41.200896 run osmo-hlr_10.42.42.2(pid=31354): stderr: | 20221209112238200 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112238200 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112238200 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112238200 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112238200 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112238200 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112238217 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112238227 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112238227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112238227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:22:41.274568 run osmo-msc_10.42.42.6(pid=31360): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31360)] 11:22:41.325265 run osmo-msc_10.42.42.6(pid=31360): stdout: | (launched: 2022-12-09_11:22:40.098926) 11:22:41.377822 run osmo-msc_10.42.42.6(pid=31360): stderr: | 20221209112240426 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112240426 DLGLOBAL DEBUG validating counter group 0x7fa1f24b0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112240426 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112240426 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112240426 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112240426 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112240428 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112240429 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112240429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112240429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:22:41.430742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31353): Terminating (SIGTERM) 11:22:41.473292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31356): Terminating (SIGTERM) 11:22:41.515916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31359): Terminating (SIGTERM) 11:22:41.559060 --- ParallelTerminationStrategy: PID 31353 died... 11:22:41.579283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31353): Terminated: ok {rc=0} 11:22:41.626661 --- ParallelTerminationStrategy: PID 31356 died... 11:22:41.646335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31356): Terminated: ok {rc=0} 11:22:41.693373 --- ParallelTerminationStrategy: PID 31359 died... 11:22:41.713000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31359): Terminated: ok {rc=0} 11:22:41.802370 bus /sierra_3: Setting Powered False 11:22:42.902202 bus /sierra_3: Setting Powered False 11:22:44.018923 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:22:45.258655 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:22:45.264714 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:22:45.286700 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 11:22:45.314413 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 11:22:45.367567 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:22:45.389216 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 11:22:45.416781 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 11:22:45.987470 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 11:22:46.040123 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:22:46.052163 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:22:46.111166 tst mo_mt_call.py: using LAC 21119 11:22:46.236465 tst mo_mt_call.py: using RAC 209 11:22:46.363800 tst mo_mt_call.py: using CellId 21119 11:22:46.533294 tst mo_mt_call.py: using BVCI 21120 11:22:46.655790 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:22:46.667674 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:22:46.679878 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:22:46.690963 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:22:46.702119 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:22:46.713547 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:22:46.832889 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:22:46.956407 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:22:47.460076 run create_hlr_db(pid=31365): Launched 11:22:47.589536 bus /sierra_2: Setting Powered False 11:22:48.651504 run create_hlr_db(pid=31365): Terminated: ok {rc=0} 11:22:49.086710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31367): Launched 11:22:49.399038 run osmo-hlr_10.42.42.2(pid=31368): Launched 11:22:49.516577 run osmo-stp_10.42.42.5: Starting osmo-stp 11:22:50.072728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31370): Launched 11:22:50.386552 run osmo-stp_10.42.42.5(pid=31371): Launched 11:22:50.504318 run osmo-msc_10.42.42.6: Starting osmo-msc 11:22:51.089135 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31373): Launched 11:22:51.402246 run osmo-msc_10.42.42.6(pid=31374): Launched 11:22:51.575958 run osmo-stp_10.42.42.5(pid=31371): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31371)] 11:22:51.706894 run osmo-stp_10.42.42.5(pid=31371): stdout: | (launched: 2022-12-09_11:22:50.327769) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:51.838550 run osmo-stp_10.42.42.5(pid=31371): stderr: | 20221209112250502 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112250503 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112250503 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112250503 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112250504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112250504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112250504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:51.968114 run osmo-stp_10.42.42.5(pid=31371): stdout: | (launched: 2022-12-09_11:22:50.327769) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:22:52.091622 run osmo-stp_10.42.42.5(pid=31371): stderr: | 20221209112250502 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112250503 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112250503 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112250503 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112250504 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112250504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112250504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:22:52.239916 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31371): Process ended prematurely: osmo-stp_10.42.42.5(pid=31371) [trial-2359↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31371)] [trial-2359↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 11:22:52.249124 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:22:52.275613 run osmo-hlr_10.42.42.2(pid=31368): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31368)] 11:22:52.323766 run osmo-hlr_10.42.42.2(pid=31368): stdout: | (launched: 2022-12-09_11:22:49.340234) 11:22:52.373867 run osmo-hlr_10.42.42.2(pid=31368): stderr: | 20221209112249519 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112249519 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112249520 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112249520 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112249520 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112249520 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112249532 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112249541 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112249541 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112249541 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:22:52.442893 run osmo-msc_10.42.42.6(pid=31374): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31374)] 11:22:52.490748 run osmo-msc_10.42.42.6(pid=31374): stdout: | (launched: 2022-12-09_11:22:51.343143) 11:22:52.540463 run osmo-msc_10.42.42.6(pid=31374): stderr: | 20221209112251621 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112251622 DLGLOBAL DEBUG validating counter group 0x7f6f08cd3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112251622 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112251622 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112251622 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112251622 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112251624 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112251624 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112251624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112251624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:22:52.590313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31367): Terminating (SIGTERM) 11:22:52.630062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31370): Terminating (SIGTERM) 11:22:52.669859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31373): Terminating (SIGTERM) 11:22:52.710255 --- ParallelTerminationStrategy: PID 31367 died... 11:22:52.729480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31367): Terminated: ok {rc=0} 11:22:52.773824 --- ParallelTerminationStrategy: PID 31370 died... 11:22:52.792492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31370): Terminated: ok {rc=0} 11:22:52.836623 --- ParallelTerminationStrategy: PID 31373 died... 11:22:52.855407 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31373): Terminated: ok {rc=0} 11:22:52.943095 bus /sierra_3: Setting Powered False 11:22:54.044234 bus /sierra_3: Setting Powered False 11:22:55.160454 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 11:22:56.307200 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:22:56.318860 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:22:56.378754 tst mo_mt_call_osmux.py: using LAC 21120 11:22:56.500278 tst mo_mt_call_osmux.py: using RAC 210 11:22:56.621179 tst mo_mt_call_osmux.py: using CellId 21120 11:22:56.745390 tst mo_mt_call_osmux.py: using BVCI 21121 11:22:56.857689 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:22:56.868559 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:22:56.879311 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:22:56.890009 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:22:56.900629 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:22:56.911462 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:22:57.027874 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:22:57.149426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:22:57.669243 run create_hlr_db(pid=31376): Launched 11:22:57.796886 bus /sierra_2: Setting Powered False 11:22:58.862052 run create_hlr_db(pid=31376): Terminated: ok {rc=0} 11:22:59.307660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31378): Launched 11:22:59.621592 run osmo-hlr_10.42.42.2(pid=31379): Launched 11:22:59.741435 run osmo-stp_10.42.42.5: Starting osmo-stp 11:23:00.280868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31381): Launched 11:23:00.594527 run osmo-stp_10.42.42.5(pid=31382): Launched 11:23:00.713420 run osmo-msc_10.42.42.6: Starting osmo-msc 11:23:01.302977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31384): Launched 11:23:01.642574 run osmo-msc_10.42.42.6(pid=31388): Launched 11:23:02.008353 run osmo-stp_10.42.42.5(pid=31382): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31382)] 11:23:02.336834 run osmo-stp_10.42.42.5(pid=31382): stdout: | (launched: 2022-12-09_11:23:00.535098) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:02.531016 run osmo-stp_10.42.42.5(pid=31382): stderr: | 20221209112300711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112300711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112300711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112300712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112300712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112300712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112300712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:02.677650 run osmo-stp_10.42.42.5(pid=31382): stdout: | (launched: 2022-12-09_11:23:00.535098) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:02.802565 run osmo-stp_10.42.42.5(pid=31382): stderr: | 20221209112300711 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112300711 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112300711 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112300712 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112300712 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112300712 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112300712 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:03.032405 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31382): Process ended prematurely: osmo-stp_10.42.42.5(pid=31382) [trial-2359↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31382)] [trial-2359↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 11:23:03.043107 tst mo_mt_call_osmux.py:8: Test FAILED (6.8 sec) 11:23:03.079249 run osmo-hlr_10.42.42.2(pid=31379): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31379)] 11:23:03.147823 run osmo-hlr_10.42.42.2(pid=31379): stdout: | (launched: 2022-12-09_11:22:59.562704) 11:23:03.216417 run osmo-hlr_10.42.42.2(pid=31379): stderr: | 20221209112259744 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112259744 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112259744 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112259744 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112259744 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112259744 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112259755 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112259763 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112259764 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112259764 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:23:03.310710 run osmo-msc_10.42.42.6(pid=31388): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31388)] 11:23:03.370892 run osmo-msc_10.42.42.6(pid=31388): stdout: | (launched: 2022-12-09_11:23:01.572604) 11:23:03.439382 run osmo-msc_10.42.42.6(pid=31388): stderr: | 20221209112302103 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112302103 DLGLOBAL DEBUG validating counter group 0x7f347bd09c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112302103 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112302104 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112302104 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112302104 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112302114 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112302115 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112302115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112302115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:23:03.504884 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31378): Terminating (SIGTERM) 11:23:03.564094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31381): Terminating (SIGTERM) 11:23:03.622342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31384): Terminating (SIGTERM) 11:23:03.681471 --- ParallelTerminationStrategy: PID 31378 died... 11:23:03.707906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31378): Terminated: ok {rc=0} 11:23:03.766731 --- ParallelTerminationStrategy: PID 31381 died... 11:23:03.794872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31381): Terminated: ok {rc=0} 11:23:03.854162 --- ParallelTerminationStrategy: PID 31384 died... 11:23:03.882716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31384): Terminated: ok {rc=0} 11:23:03.999546 bus /sierra_3: Setting Powered False 11:23:05.124114 bus /sierra_3: Setting Powered False 11:23:06.239755 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 emergency:sysmo --------------------------------------------------------------------- 11:23:07.474402 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:23:07.479312 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 11:23:07.503175 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 11:23:07.531593 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 11:23:07.617665 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 11:23:07.639298 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 11:23:07.667171 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 11:23:08.247294 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2359 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 11:23:08.253849 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:23:08.265408 tst emergency:sysmo: Using 1 x bts (candidates: 1) 11:23:08.302559 tst emergency_mo_mt_call.py: using LAC 21121 11:23:08.424168 tst emergency_mo_mt_call.py: using RAC 211 11:23:08.547922 tst emergency_mo_mt_call.py: using CellId 21121 11:23:08.672675 tst emergency_mo_mt_call.py: using BVCI 21122 11:23:08.786496 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:23:08.798245 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:23:08.809792 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:23:08.821591 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:23:08.833203 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:23:08.845147 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:23:08.965275 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:23:09.083905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:23:09.577983 run create_hlr_db(pid=31661): Launched 11:23:09.732600 bus /sierra_2: Setting Powered False 11:23:10.798354 run create_hlr_db(pid=31661): Terminated: ok {rc=0} 11:23:11.277739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31663): Launched 11:23:11.631832 run osmo-hlr_10.42.42.2(pid=31664): Launched 11:23:11.887412 run osmo-stp_10.42.42.5: Starting osmo-stp 11:23:12.578513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31666): Launched 11:23:12.932356 run osmo-stp_10.42.42.5(pid=31667): Launched 11:23:13.196708 tst emergency_mo_mt_call.py: using MSISDN 7187 11:23:13.444076 run osmo-msc_10.42.42.6: Starting osmo-msc 11:23:14.056350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31669): Launched 11:23:14.408421 run osmo-msc_10.42.42.6(pid=31670): Launched 11:23:14.780261 run osmo-stp_10.42.42.5(pid=31667): ERR: Terminated: ERROR {rc=1} [trial-2359↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31667)] 11:23:15.072307 run osmo-stp_10.42.42.5(pid=31667): stdout: | (launched: 2022-12-09_11:23:12.866772) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:15.253534 run osmo-stp_10.42.42.5(pid=31667): stderr: | 20221209112313174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112313174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112313175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112313175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112313175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112313176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112313176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:15.396447 run osmo-stp_10.42.42.5(pid=31667): stdout: | (launched: 2022-12-09_11:23:12.866772) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:15.533692 run osmo-stp_10.42.42.5(pid=31667): stderr: | 20221209112313174 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112313174 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112313175 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112313175 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112313175 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112313176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112313176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:15.698236 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=31667): Process ended prematurely: osmo-stp_10.42.42.5(pid=31667) [trial-2359↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31667)] [trial-2359↪emergency:sysmo↪emergency_mo_mt_call.py:19] 11:23:15.708103 tst emergency_mo_mt_call.py:19: Test FAILED (7.4 sec) 11:23:15.738825 run osmo-hlr_10.42.42.2(pid=31664): ERR: Terminated: ERROR {rc=237} [trial-2359↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31664)] 11:23:15.794605 run osmo-hlr_10.42.42.2(pid=31664): stdout: | (launched: 2022-12-09_11:23:11.566671) 11:23:15.854855 run osmo-hlr_10.42.42.2(pid=31664): stderr: | 20221209112311891 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112311892 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112311892 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112311892 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112311892 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112311892 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112311911 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112311923 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112311923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112311924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:23:15.936360 run osmo-msc_10.42.42.6(pid=31670): ERR: Terminated: ERROR {rc=2} [trial-2359↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31670)] 11:23:16.005959 run osmo-msc_10.42.42.6(pid=31670): stdout: | (launched: 2022-12-09_11:23:14.344599) 11:23:16.065455 run osmo-msc_10.42.42.6(pid=31670): stderr: | 20221209112314855 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112314856 DLGLOBAL DEBUG validating counter group 0x7fd42f6c9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112314856 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112314856 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112314856 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112314856 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112314862 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112314863 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112314863 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112314863 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:23:16.123267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31663): Terminating (SIGTERM) 11:23:16.168831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31666): Terminating (SIGTERM) 11:23:16.216666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31669): Terminating (SIGTERM) 11:23:16.277653 --- ParallelTerminationStrategy: PID 31663 died... 11:23:16.313842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31663): Terminated: ok {rc=0} 11:23:16.392912 --- ParallelTerminationStrategy: PID 31666 died... 11:23:16.416862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31666): Terminated: ok {rc=0} 11:23:16.471612 --- ParallelTerminationStrategy: PID 31669 died... 11:23:16.490908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31669): Terminated: ok {rc=0} 11:23:16.589244 bus /sierra_3: Setting Powered False 11:23:17.709251 bus /sierra_3: Setting Powered False 11:23:18.835547 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 11:23:19.930093 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:23:19.943306 tst emergency:sysmo: Using 1 x bts (candidates: 1) 11:23:19.985495 tst emergency_preemptive_call.py: using LAC 21122 11:23:20.127648 tst emergency_preemptive_call.py: using RAC 212 11:23:20.260296 tst emergency_preemptive_call.py: using CellId 21122 11:23:20.392774 tst emergency_preemptive_call.py: using BVCI 21123 11:23:20.517300 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:23:20.529824 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:23:20.543522 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:23:20.557012 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:23:20.569658 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 11:23:20.582914 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:23:20.713143 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:23:20.839180 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:23:20.969490 tst emergency:sysmo: Using 1 x modem (candidates: 4) 11:23:21.098265 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:23:21.629860 run create_hlr_db(pid=31672): Launched 11:23:21.797980 bus /sierra_2: Setting Powered False 11:23:22.863196 run create_hlr_db(pid=31672): Terminated: ok {rc=0} 11:23:23.344380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31674): Launched 11:23:23.703971 run osmo-hlr_10.42.42.2(pid=31675): Launched 11:23:23.962207 run osmo-stp_10.42.42.5: Starting osmo-stp 11:23:24.637666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31677): Launched 11:23:24.946924 run osmo-stp_10.42.42.5(pid=31678): Launched 11:23:25.071337 tst emergency_preemptive_call.py: using MSISDN 7188 11:23:25.227926 run osmo-msc_10.42.42.6: Starting osmo-msc 11:23:25.779551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31680): Launched 11:23:26.087190 run osmo-msc_10.42.42.6(pid=31681): Launched 11:23:26.263846 run osmo-stp_10.42.42.5(pid=31678): ERR: Terminated: ERROR {rc=1} [trial-2359↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31678)] 11:23:26.392584 run osmo-stp_10.42.42.5(pid=31678): stdout: | (launched: 2022-12-09_11:23:24.888138) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:26.522105 run osmo-stp_10.42.42.5(pid=31678): stderr: | 20221209112325060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112325060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112325060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112325061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112325063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112325064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112325065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:26.650130 run osmo-stp_10.42.42.5(pid=31678): stdout: | (launched: 2022-12-09_11:23:24.888138) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:26.771417 run osmo-stp_10.42.42.5(pid=31678): stderr: | 20221209112325060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112325060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112325060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112325061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112325063 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112325064 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112325065 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:26.916817 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=31678): Process ended prematurely: osmo-stp_10.42.42.5(pid=31678) [trial-2359↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31678)] [trial-2359↪emergency:sysmo↪emergency_preemptive_call.py:32] 11:23:26.925391 tst emergency_preemptive_call.py:32: Test FAILED (7.0 sec) 11:23:26.951464 run osmo-hlr_10.42.42.2(pid=31675): ERR: Terminated: ERROR {rc=237} [trial-2359↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31675)] 11:23:26.999514 run osmo-hlr_10.42.42.2(pid=31675): stdout: | (launched: 2022-12-09_11:23:23.637420) 11:23:27.049358 run osmo-hlr_10.42.42.2(pid=31675): stderr: | 20221209112323957 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112323958 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112323958 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112323958 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112323958 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112323958 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112323975 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112323987 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112323988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112323988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:23:27.118905 run osmo-msc_10.42.42.6(pid=31681): ERR: Terminated: ERROR {rc=2} [trial-2359↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=31681)] 11:23:27.167006 run osmo-msc_10.42.42.6(pid=31681): stdout: | (launched: 2022-12-09_11:23:26.029108) 11:23:27.216489 run osmo-msc_10.42.42.6(pid=31681): stderr: | 20221209112326303 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112326304 DLGLOBAL DEBUG validating counter group 0x7efea378cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112326304 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112326304 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112326304 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112326304 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112326306 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112326306 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112326307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112326307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:23:27.266614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31674): Terminating (SIGTERM) 11:23:27.306590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31677): Terminating (SIGTERM) 11:23:27.346593 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31680): Terminating (SIGTERM) 11:23:27.386762 --- ParallelTerminationStrategy: PID 31674 died... 11:23:27.406316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31674): Terminated: ok {rc=0} 11:23:27.450809 --- ParallelTerminationStrategy: PID 31677 died... 11:23:27.469730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31677): Terminated: ok {rc=0} 11:23:27.514513 --- ParallelTerminationStrategy: PID 31680 died... 11:23:27.533466 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=31680): Terminated: ok {rc=0} 11:23:27.617667 bus /sierra_9: Setting Powered False 11:23:28.713049 bus /sierra_9: Setting Powered False 11:23:29.826508 bus /sierra_8: Setting Powered False 11:23:30.928884 bus /sierra_8: Setting Powered False 11:23:32.053580 bus /sierra_3: Setting Powered False 11:23:33.153855 bus /sierra_3: Setting Powered False 11:23:34.268823 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:sysmo --------------------------------------------------------------------- 11:23:35.533204 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:23:35.537821 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 11:23:35.560202 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 11:23:35.600136 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 11:23:35.689248 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 11:23:35.710927 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 11:23:35.750468 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 11:23:36.341493 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 11:23:36.397158 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:23:36.408122 tst gprs:sysmo: Using 1 x bts (candidates: 1) 11:23:36.444607 tst cs_paging_gprs_active.py: using LAC 21123 11:23:36.579008 tst cs_paging_gprs_active.py: using RAC 213 11:23:36.715606 tst cs_paging_gprs_active.py: using CellId 21123 11:23:36.847013 tst cs_paging_gprs_active.py: using BVCI 21124 11:23:36.969776 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:23:36.980923 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:23:36.991862 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:23:37.002965 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:23:37.014029 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:23:37.025213 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:23:37.036331 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:23:37.047400 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:23:37.058809 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:23:37.177817 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:23:37.297342 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:23:37.510658 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:23:37.829463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31686): Launched 11:23:38.105614 run iperf3-srv_10.42.42.10(pid=31687): Launched 11:23:38.223546 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:23:38.434671 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:23:38.752261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31688): Launched 11:23:39.026720 run iperf3-srv_10.42.42.10(pid=31689): Launched 11:23:39.144209 tst cs_paging_gprs_active.py:38: start network... 11:23:39.353577 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:23:39.839182 run create_hlr_db(pid=31690): Launched 11:23:39.969743 bus /sierra_2: Setting Powered False 11:23:41.031403 run create_hlr_db(pid=31690): Terminated: ok {rc=0} 11:23:41.468411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31692): Launched 11:23:41.782805 run osmo-hlr_10.42.42.2(pid=31693): Launched 11:23:41.901770 run osmo-stp_10.42.42.5: Starting osmo-stp 11:23:42.437629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31695): Launched 11:23:42.752013 run osmo-stp_10.42.42.5(pid=31696): Launched 11:23:42.870524 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:23:44.384492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31698): Launched 11:23:44.503496 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:23:44.770838 run patchelf(pid=31699): Launched 11:23:44.946054 run osmo-stp_10.42.42.5(pid=31696): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31696)] 11:23:45.077819 run osmo-stp_10.42.42.5(pid=31696): stdout: | (launched: 2022-12-09_11:23:42.692872) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:45.210825 run osmo-stp_10.42.42.5(pid=31696): stderr: | 20221209112342867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112342867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112342868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112342868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112342869 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112342869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112342869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:45.343870 run osmo-stp_10.42.42.5(pid=31696): stdout: | (launched: 2022-12-09_11:23:42.692872) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:45.471950 run osmo-stp_10.42.42.5(pid=31696): stderr: | 20221209112342867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112342867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112342868 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112342868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112342869 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112342869 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112342869 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:45.623704 run patchelf(pid=31699): Terminating (SIGINT) 11:23:45.800740 run patchelf(pid=31699): Terminated: ok {rc=0} 11:23:45.940022 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31696): Process ended prematurely: osmo-stp_10.42.42.5(pid=31696) [trial-2359↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31696)] [trial-2359↪gprs:sysmo↪cs_paging_gprs_active.py:38] 11:23:45.950499 tst cs_paging_gprs_active.py:38: Test FAILED (9.6 sec) 11:23:45.979379 run osmo-hlr_10.42.42.2(pid=31693): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31693)] 11:23:46.028819 run osmo-hlr_10.42.42.2(pid=31693): stdout: | (launched: 2022-12-09_11:23:41.722676) 11:23:46.080269 run osmo-hlr_10.42.42.2(pid=31693): stderr: | 20221209112341904 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112341904 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112341904 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112341904 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112341904 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112341904 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112341917 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112341926 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112341926 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112341926 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:23:46.132124 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31686): Terminating (SIGTERM) 11:23:46.173668 run iperf3-srv_10.42.42.10(pid=31687): Terminating (SIGTERM) 11:23:46.216448 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31688): Terminating (SIGTERM) 11:23:46.258993 run iperf3-srv_10.42.42.10(pid=31689): Terminating (SIGTERM) 11:23:46.300670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31692): Terminating (SIGTERM) 11:23:46.343565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31695): Terminating (SIGTERM) 11:23:46.384905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31698): Terminating (SIGTERM) 11:23:46.426528 --- ParallelTerminationStrategy: PID 31686 died... 11:23:46.446170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31686): Terminated: ok {rc=0} 11:23:46.492234 --- ParallelTerminationStrategy: PID 31687 died... 11:23:46.511816 run iperf3-srv_10.42.42.10(pid=31687): Terminated {rc=256} 11:23:46.557818 --- ParallelTerminationStrategy: PID 31688 died... 11:23:46.577679 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31688): Terminated: ok {rc=0} 11:23:46.624019 --- ParallelTerminationStrategy: PID 31689 died... 11:23:46.643868 run iperf3-srv_10.42.42.10(pid=31689): Terminated {rc=256} 11:23:46.690583 --- ParallelTerminationStrategy: PID 31692 died... 11:23:46.710474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31692): Terminated: ok {rc=0} 11:23:46.756554 --- ParallelTerminationStrategy: PID 31695 died... 11:23:46.776264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31695): Terminated: ok {rc=0} 11:23:46.822669 --- ParallelTerminationStrategy: PID 31698 died... 11:23:46.842591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31698): Terminated: ok {rc=0} 11:23:46.932165 bus /gobi_0: Setting Powered False 11:23:48.032139 bus /gobi_0: Setting Powered False 11:23:49.149948 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:sysmo iperf3.py ---------------------------------------------- 11:23:50.303791 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:23:50.315908 tst gprs:sysmo: Using 1 x bts (candidates: 1) 11:23:50.354122 tst iperf3.py: using LAC 21124 11:23:50.479925 tst iperf3.py: using RAC 214 11:23:50.605260 tst iperf3.py: using CellId 21124 11:23:50.730764 tst iperf3.py: using BVCI 21125 11:23:50.846520 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:23:50.857379 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:23:50.867855 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:23:50.878857 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:23:50.890203 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:23:50.901347 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:23:50.912470 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:23:50.923597 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:23:50.934785 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:23:51.052337 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:23:51.262206 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:23:51.577603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31700): Launched 11:23:51.852774 run iperf3-srv_10.42.42.10(pid=31701): Launched 11:23:51.970193 tst iperf3.py:8: start network... 11:23:52.178669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:23:52.663352 run create_hlr_db(pid=31702): Launched 11:23:52.790392 bus /gobi_6: Setting Powered False 11:23:53.851910 run create_hlr_db(pid=31702): Terminated: ok {rc=0} 11:23:54.308657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31704): Launched 11:23:54.644897 run osmo-hlr_10.42.42.2(pid=31705): Launched 11:23:54.771970 run osmo-stp_10.42.42.5: Starting osmo-stp 11:23:55.353605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31707): Launched 11:23:55.689217 run osmo-stp_10.42.42.5(pid=31708): Launched 11:23:55.816307 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:23:56.394055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31710): Launched 11:23:56.524414 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:23:56.810621 run patchelf(pid=31711): Launched 11:23:56.996303 run osmo-stp_10.42.42.5(pid=31708): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31708)] 11:23:57.137555 run osmo-stp_10.42.42.5(pid=31708): stdout: | (launched: 2022-12-09_11:23:55.626576) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:57.280079 run osmo-stp_10.42.42.5(pid=31708): stderr: | 20221209112355823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112355823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112355824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112355824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112355825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112355825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112355825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:57.422692 run osmo-stp_10.42.42.5(pid=31708): stdout: | (launched: 2022-12-09_11:23:55.626576) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:23:57.559551 run osmo-stp_10.42.42.5(pid=31708): stderr: | 20221209112355823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112355823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112355824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112355824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112355825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112355825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112355825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:23:57.722371 run patchelf(pid=31711): Terminating (SIGINT) 11:23:57.910303 run patchelf(pid=31711): Terminated: ok {rc=0} 11:23:58.046375 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31708): Process ended prematurely: osmo-stp_10.42.42.5(pid=31708) [trial-2359↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31708)] [trial-2359↪gprs:sysmo↪iperf3.py:8] 11:23:58.056510 tst iperf3.py:8: Test FAILED (7.8 sec) 11:23:58.085712 run osmo-hlr_10.42.42.2(pid=31705): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31705)] 11:23:58.136774 run osmo-hlr_10.42.42.2(pid=31705): stdout: | (launched: 2022-12-09_11:23:54.581987) 11:23:58.189769 run osmo-hlr_10.42.42.2(pid=31705): stderr: | 20221209112354788 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112354788 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112354788 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112354789 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112354789 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112354789 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112354799 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112354808 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112354808 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112354808 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:23:58.243254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31700): Terminating (SIGTERM) 11:23:58.286099 run iperf3-srv_10.42.42.10(pid=31701): Terminating (SIGTERM) 11:23:58.330454 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31704): Terminating (SIGTERM) 11:23:58.373775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31707): Terminating (SIGTERM) 11:23:58.416560 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31710): Terminating (SIGTERM) 11:23:58.460077 --- ParallelTerminationStrategy: PID 31700 died... 11:23:58.480393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31700): Terminated: ok {rc=0} 11:23:58.528605 --- ParallelTerminationStrategy: PID 31701 died... 11:23:58.548515 run iperf3-srv_10.42.42.10(pid=31701): Terminated {rc=256} 11:23:58.596302 --- ParallelTerminationStrategy: PID 31704 died... 11:23:58.616389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31704): Terminated: ok {rc=0} 11:23:58.663968 --- ParallelTerminationStrategy: PID 31707 died... 11:23:58.684014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31707): Terminated: ok {rc=0} 11:23:58.731640 --- ParallelTerminationStrategy: PID 31710 died... 11:23:58.751628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31710): Terminated: ok {rc=0} 11:23:58.841730 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:sysmo iperf3m4.py ---------------------------------------------- 11:23:59.989663 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:00.000909 tst gprs:sysmo: Using 1 x bts (candidates: 1) 11:24:00.037592 tst iperf3m4.py: using LAC 21125 11:24:00.162432 tst iperf3m4.py: using RAC 215 11:24:00.288868 tst iperf3m4.py: using CellId 21125 11:24:00.412834 tst iperf3m4.py: using BVCI 21126 11:24:00.528858 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:00.539699 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:00.550212 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:00.561189 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:00.571907 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:00.582834 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:00.594002 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:00.604919 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:00.615866 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:24:00.734580 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:24:00.870335 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:24:01.013394 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:24:01.174570 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:24:01.392895 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:24:01.717899 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31712): Launched 11:24:02.013912 run iperf3-srv_10.42.42.10(pid=31713): Launched 11:24:02.149103 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:24:02.360859 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:24:02.676358 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31714): Launched 11:24:02.951126 run iperf3-srv_10.42.42.10(pid=31715): Launched 11:24:03.068025 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:24:03.276281 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:24:03.590298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31716): Launched 11:24:03.863756 run iperf3-srv_10.42.42.10(pid=31717): Launched 11:24:03.980876 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:24:04.189016 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:24:04.502708 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31718): Launched 11:24:04.791529 run iperf3-srv_10.42.42.10(pid=31719): Launched 11:24:04.909661 tst iperf3m4.py:8: start network... 11:24:05.117377 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:24:05.602611 run create_hlr_db(pid=31720): Launched 11:24:05.730037 bus /gobi_6: Setting Powered False 11:24:06.791454 run create_hlr_db(pid=31720): Terminated: ok {rc=0} 11:24:07.250248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31722): Launched 11:24:07.587670 run osmo-hlr_10.42.42.2(pid=31723): Launched 11:24:07.716658 run osmo-stp_10.42.42.5: Starting osmo-stp 11:24:08.294147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31725): Launched 11:24:08.631254 run osmo-stp_10.42.42.5(pid=31726): Launched 11:24:08.759997 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:24:09.339050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31728): Launched 11:24:09.467819 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:24:09.751990 run patchelf(pid=31729): Launched 11:24:09.937720 run osmo-stp_10.42.42.5(pid=31726): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31726)] 11:24:10.079045 run osmo-stp_10.42.42.5(pid=31726): stdout: | (launched: 2022-12-09_11:24:08.567786) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:10.221555 run osmo-stp_10.42.42.5(pid=31726): stderr: | 20221209112408763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112408763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112408763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112408764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112408766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112408766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112408766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:10.364294 run osmo-stp_10.42.42.5(pid=31726): stdout: | (launched: 2022-12-09_11:24:08.567786) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:10.501137 run osmo-stp_10.42.42.5(pid=31726): stderr: | 20221209112408763 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112408763 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112408763 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112408764 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112408766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112408766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112408766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:10.664135 run patchelf(pid=31729): Terminating (SIGINT) 11:24:10.852066 run patchelf(pid=31729): Terminated: ok {rc=0} 11:24:10.988659 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31726): Process ended prematurely: osmo-stp_10.42.42.5(pid=31726) [trial-2359↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31726)] [trial-2359↪gprs:sysmo↪iperf3m4.py:8] 11:24:10.998819 tst iperf3m4.py:8: Test FAILED (11.0 sec) 11:24:11.028513 run osmo-hlr_10.42.42.2(pid=31723): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31723)] 11:24:11.079607 run osmo-hlr_10.42.42.2(pid=31723): stdout: | (launched: 2022-12-09_11:24:07.524279) 11:24:11.132906 run osmo-hlr_10.42.42.2(pid=31723): stderr: | 20221209112407729 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112407729 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112407729 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112407729 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112407729 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112407729 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112407742 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112407751 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112407751 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112407751 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:24:11.186223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31712): Terminating (SIGTERM) 11:24:11.228834 run iperf3-srv_10.42.42.10(pid=31713): Terminating (SIGTERM) 11:24:11.271495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31714): Terminating (SIGTERM) 11:24:11.314355 run iperf3-srv_10.42.42.10(pid=31715): Terminating (SIGTERM) 11:24:11.356908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31716): Terminating (SIGTERM) 11:24:11.399675 run iperf3-srv_10.42.42.10(pid=31717): Terminating (SIGTERM) 11:24:11.442355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31718): Terminating (SIGTERM) 11:24:11.484998 run iperf3-srv_10.42.42.10(pid=31719): Terminating (SIGTERM) 11:24:11.527712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31722): Terminating (SIGTERM) 11:24:11.570651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31725): Terminating (SIGTERM) 11:24:11.613686 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31728): Terminating (SIGTERM) 11:24:11.656687 --- ParallelTerminationStrategy: PID 31712 died... 11:24:11.677073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31712): Terminated: ok {rc=0} 11:24:11.724588 --- ParallelTerminationStrategy: PID 31713 died... 11:24:11.744420 run iperf3-srv_10.42.42.10(pid=31713): Terminated {rc=256} 11:24:11.791749 --- ParallelTerminationStrategy: PID 31714 died... 11:24:11.811613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31714): Terminated: ok {rc=0} 11:24:11.859085 --- ParallelTerminationStrategy: PID 31715 died... 11:24:11.878993 run iperf3-srv_10.42.42.10(pid=31715): Terminated {rc=256} 11:24:11.926770 --- ParallelTerminationStrategy: PID 31716 died... 11:24:11.946543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31716): Terminated: ok {rc=0} 11:24:11.994138 --- ParallelTerminationStrategy: PID 31717 died... 11:24:12.013867 run iperf3-srv_10.42.42.10(pid=31717): Terminated {rc=256} 11:24:12.061139 --- ParallelTerminationStrategy: PID 31718 died... 11:24:12.080838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31718): Terminated: ok {rc=0} 11:24:12.128210 --- ParallelTerminationStrategy: PID 31719 died... 11:24:12.147926 run iperf3-srv_10.42.42.10(pid=31719): Terminated {rc=256} 11:24:12.195229 --- ParallelTerminationStrategy: PID 31722 died... 11:24:12.215108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31722): Terminated: ok {rc=0} 11:24:12.262326 --- ParallelTerminationStrategy: PID 31725 died... 11:24:12.282065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31725): Terminated: ok {rc=0} 11:24:12.329429 --- ParallelTerminationStrategy: PID 31728 died... 11:24:12.349352 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31728): Terminated: ok {rc=0} 11:24:12.438712 bus /gobi_4: Setting Powered False 11:24:13.540156 bus /gobi_4: Setting Powered False 11:24:14.657063 bus /gobi_1: Setting Powered False 11:24:15.755867 bus /gobi_1: Setting Powered False 11:24:16.873322 bus /gobi_0: Setting Powered False 11:24:17.970941 bus /gobi_0: Setting Powered False 11:24:19.087578 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:sysmo ping.py ---------------------------------------------- 11:24:20.190555 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:20.202107 tst gprs:sysmo: Using 1 x bts (candidates: 1) 11:24:20.239291 tst ping.py: using LAC 21126 11:24:20.362601 tst ping.py: using RAC 216 11:24:20.484742 tst ping.py: using CellId 21126 11:24:20.605959 tst ping.py: using BVCI 21127 11:24:20.717080 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:20.727820 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:20.738429 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:20.749178 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:20.759668 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:20.770266 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:20.780896 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:20.791624 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:24:20.908317 tst ping.py:19: start network... 11:24:21.114678 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:24:21.590312 run create_hlr_db(pid=31731): Launched 11:24:21.715467 bus /gobi_6: Setting Powered False 11:24:22.777403 run create_hlr_db(pid=31731): Terminated: ok {rc=0} 11:24:23.229860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31733): Launched 11:24:23.559346 run osmo-hlr_10.42.42.2(pid=31734): Launched 11:24:23.686900 run osmo-stp_10.42.42.5: Starting osmo-stp 11:24:24.253009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31736): Launched 11:24:24.582001 run osmo-stp_10.42.42.5(pid=31737): Launched 11:24:24.710122 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:24:25.279047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31739): Launched 11:24:25.407030 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:24:25.686720 run patchelf(pid=31740): Launched 11:24:25.869762 run osmo-stp_10.42.42.5(pid=31737): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31737)] 11:24:26.009693 run osmo-stp_10.42.42.5(pid=31737): stdout: | (launched: 2022-12-09_11:24:24.520172) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:26.150167 run osmo-stp_10.42.42.5(pid=31737): stderr: | 20221209112424715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112424715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112424716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112424716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112424716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112424717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112424717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:26.290990 run osmo-stp_10.42.42.5(pid=31737): stdout: | (launched: 2022-12-09_11:24:24.520172) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:26.425407 run osmo-stp_10.42.42.5(pid=31737): stderr: | 20221209112424715 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112424715 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112424716 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112424716 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112424716 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112424717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112424717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:26.584925 run patchelf(pid=31740): Terminating (SIGINT) 11:24:26.770311 run patchelf(pid=31740): Terminated: ok {rc=0} 11:24:26.904047 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31737): Process ended prematurely: osmo-stp_10.42.42.5(pid=31737) [trial-2359↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31737)] [trial-2359↪gprs:sysmo↪ping.py:22] 11:24:26.913535 tst ping.py:22: Test FAILED (6.7 sec) 11:24:26.942494 run osmo-hlr_10.42.42.2(pid=31734): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31734)] 11:24:26.993487 run osmo-hlr_10.42.42.2(pid=31734): stdout: | (launched: 2022-12-09_11:24:23.497682) 11:24:27.046536 run osmo-hlr_10.42.42.2(pid=31734): stderr: | 20221209112423699 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112423699 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112423699 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112423699 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112423699 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112423699 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112423711 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112423719 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112423720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112423720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:24:27.099723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31733): Terminating (SIGTERM) 11:24:27.142508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31736): Terminating (SIGTERM) 11:24:27.185603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31739): Terminating (SIGTERM) 11:24:27.228785 --- ParallelTerminationStrategy: PID 31733 died... 11:24:27.249254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31733): Terminated: ok {rc=0} 11:24:27.296716 --- ParallelTerminationStrategy: PID 31736 died... 11:24:27.316685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31736): Terminated: ok {rc=0} 11:24:27.364107 --- ParallelTerminationStrategy: PID 31739 died... 11:24:27.383943 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31739): Terminated: ok {rc=0} 11:24:27.474271 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 11:24:28.561732 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:28.573551 tst gprs:sysmo: Using 1 x bts (candidates: 1) 11:24:28.612359 tst ping_idle_ping.py: using LAC 21127 11:24:28.743251 tst ping_idle_ping.py: using RAC 217 11:24:28.873334 tst ping_idle_ping.py: using CellId 21127 11:24:29.005069 tst ping_idle_ping.py: using BVCI 21128 11:24:29.126158 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:29.137244 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:29.148111 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:29.159785 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:29.171280 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:29.182912 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:29.194760 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 11:24:29.206412 tst gprs:sysmo: Using 1 x modem (candidates: 4) 11:24:29.334198 tst ping_idle_ping.py:24: start network... 11:24:29.541195 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:24:30.044876 run create_hlr_db(pid=31741): Launched 11:24:30.166544 bus /gobi_6: Setting Powered False 11:24:31.239064 run create_hlr_db(pid=31741): Terminated: ok {rc=0} 11:24:31.695512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31743): Launched 11:24:32.037890 run osmo-hlr_10.42.42.2(pid=31744): Launched 11:24:32.266105 run osmo-stp_10.42.42.5: Starting osmo-stp 11:24:32.809508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31746): Launched 11:24:33.111358 run osmo-stp_10.42.42.5(pid=31747): Launched 11:24:33.224070 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:24:33.740003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31749): Launched 11:24:33.855384 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:24:34.109378 run patchelf(pid=31750): Launched 11:24:34.276871 run osmo-stp_10.42.42.5(pid=31747): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31747)] 11:24:34.404637 run osmo-stp_10.42.42.5(pid=31747): stdout: | (launched: 2022-12-09_11:24:33.054151) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:34.534137 run osmo-stp_10.42.42.5(pid=31747): stderr: | 20221209112433223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112433224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112433224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112433224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112433226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112433227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112433227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:34.663030 run osmo-stp_10.42.42.5(pid=31747): stdout: | (launched: 2022-12-09_11:24:33.054151) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:34.787211 run osmo-stp_10.42.42.5(pid=31747): stderr: | 20221209112433223 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112433224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112433224 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112433224 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112433226 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112433227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112433227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:34.933344 run patchelf(pid=31750): Terminating (SIGINT) 11:24:35.104490 run patchelf(pid=31750): Terminated: ok {rc=0} 11:24:35.227386 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31747): Process ended prematurely: osmo-stp_10.42.42.5(pid=31747) [trial-2359↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31747)] [trial-2359↪gprs:sysmo↪ping_idle_ping.py:27] 11:24:35.236114 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 11:24:35.262570 run osmo-hlr_10.42.42.2(pid=31744): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31744)] 11:24:35.309913 run osmo-hlr_10.42.42.2(pid=31744): stdout: | (launched: 2022-12-09_11:24:31.972352) 11:24:35.359644 run osmo-hlr_10.42.42.2(pid=31744): stderr: | 20221209112432281 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112432281 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112432281 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112432281 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112432281 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112432281 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112432300 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112432316 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112432316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112432316 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:24:35.409134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31743): Terminating (SIGTERM) 11:24:35.449170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31746): Terminating (SIGTERM) 11:24:35.489198 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31749): Terminating (SIGTERM) 11:24:35.529176 --- ParallelTerminationStrategy: PID 31743 died... 11:24:35.548204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31743): Terminated: ok {rc=0} 11:24:35.592474 --- ParallelTerminationStrategy: PID 31746 died... 11:24:35.611105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31746): Terminated: ok {rc=0} 11:24:35.655267 --- ParallelTerminationStrategy: PID 31749 died... 11:24:35.673987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31749): Terminated: ok {rc=0} 11:24:35.760043 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 11:24:37.046212 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:24:37.051700 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:24:37.073038 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:24:37.111123 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:24:37.197685 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:24:37.218563 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:24:37.256198 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:24:37.848073 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:24:37.896933 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:24:37.907591 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:24:37.944308 tst cs_paging_gprs_active.py: using LAC 21128 11:24:38.065125 tst cs_paging_gprs_active.py: using RAC 218 11:24:38.193329 tst cs_paging_gprs_active.py: using CellId 21128 11:24:38.313790 tst cs_paging_gprs_active.py: using BVCI 21129 11:24:38.424479 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:24:38.435338 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:24:38.445959 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:24:38.456480 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:24:38.466986 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:24:38.477443 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:24:38.488015 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:24:38.498545 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:24:38.509349 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:24:38.629234 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:24:38.749336 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:24:38.954648 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:24:39.263406 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31755): Launched 11:24:39.530930 run iperf3-srv_10.42.42.10(pid=31756): Launched 11:24:39.645609 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:24:39.850259 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:24:40.158994 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31757): Launched 11:24:40.426329 run iperf3-srv_10.42.42.10(pid=31758): Launched 11:24:40.540660 tst cs_paging_gprs_active.py:38: start network... 11:24:40.744518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:24:41.218549 run create_hlr_db(pid=31759): Launched 11:24:41.343061 bus /gobi_6: Setting Powered False 11:24:42.404055 run create_hlr_db(pid=31759): Terminated: ok {rc=0} 11:24:42.851944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31761): Launched 11:24:43.182131 run osmo-hlr_10.42.42.2(pid=31762): Launched 11:24:43.307241 run osmo-stp_10.42.42.5: Starting osmo-stp 11:24:43.875036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31764): Launched 11:24:44.186714 run osmo-stp_10.42.42.5(pid=31765): Launched 11:24:44.302444 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:24:44.827631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31767): Launched 11:24:44.944010 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:24:45.204619 run patchelf(pid=31768): Launched 11:24:45.374286 run osmo-stp_10.42.42.5(pid=31765): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31765)] 11:24:45.503169 run osmo-stp_10.42.42.5(pid=31765): stdout: | (launched: 2022-12-09_11:24:44.128622) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:45.633153 run osmo-stp_10.42.42.5(pid=31765): stderr: | 20221209112444301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112444301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112444302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112444302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112444303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112444303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112444303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:45.763573 run osmo-stp_10.42.42.5(pid=31765): stdout: | (launched: 2022-12-09_11:24:44.128622) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:45.894525 run osmo-stp_10.42.42.5(pid=31765): stderr: | 20221209112444301 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112444301 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112444302 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112444302 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112444303 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112444303 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112444303 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:46.045791 run patchelf(pid=31768): Terminating (SIGINT) 11:24:46.221293 run patchelf(pid=31768): Terminated: ok {rc=0} 11:24:46.348031 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31765): Process ended prematurely: osmo-stp_10.42.42.5(pid=31765) [trial-2359↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31765)] [trial-2359↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:24:46.358108 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 11:24:46.385846 run osmo-hlr_10.42.42.2(pid=31762): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31762)] 11:24:46.434921 run osmo-hlr_10.42.42.2(pid=31762): stdout: | (launched: 2022-12-09_11:24:43.119998) 11:24:46.485538 run osmo-hlr_10.42.42.2(pid=31762): stderr: | 20221209112443323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112443323 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112443323 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112443323 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112443323 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112443323 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112443335 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112443343 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112443344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112443344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:24:46.536561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31755): Terminating (SIGTERM) 11:24:46.577663 run iperf3-srv_10.42.42.10(pid=31756): Terminating (SIGTERM) 11:24:46.620045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31757): Terminating (SIGTERM) 11:24:46.661743 run iperf3-srv_10.42.42.10(pid=31758): Terminating (SIGTERM) 11:24:46.703964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31761): Terminating (SIGTERM) 11:24:46.745441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31764): Terminating (SIGTERM) 11:24:46.788146 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31767): Terminating (SIGTERM) 11:24:46.831014 --- ParallelTerminationStrategy: PID 31755 died... 11:24:46.850532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31755): Terminated: ok {rc=0} 11:24:46.896725 --- ParallelTerminationStrategy: PID 31756 died... 11:24:46.915754 run iperf3-srv_10.42.42.10(pid=31756): Terminated {rc=256} 11:24:46.960697 --- ParallelTerminationStrategy: PID 31757 died... 11:24:46.979969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31757): Terminated: ok {rc=0} 11:24:47.024761 --- ParallelTerminationStrategy: PID 31758 died... 11:24:47.043738 run iperf3-srv_10.42.42.10(pid=31758): Terminated {rc=256} 11:24:47.088197 --- ParallelTerminationStrategy: PID 31761 died... 11:24:47.107310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31761): Terminated: ok {rc=0} 11:24:47.152378 --- ParallelTerminationStrategy: PID 31764 died... 11:24:47.171500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31764): Terminated: ok {rc=0} 11:24:47.216160 --- ParallelTerminationStrategy: PID 31767 died... 11:24:47.235051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31767): Terminated: ok {rc=0} 11:24:47.319404 bus /gobi_0: Setting Powered False 11:24:48.417961 bus /gobi_0: Setting Powered False 11:24:49.536293 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:24:50.686165 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:24:50.698215 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:24:50.740068 tst iperf3.py: using LAC 21129 11:24:50.867822 tst iperf3.py: using RAC 219 11:24:50.998691 tst iperf3.py: using CellId 21129 11:24:51.126526 tst iperf3.py: using BVCI 21130 11:24:51.247102 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:24:51.258289 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:24:51.269416 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:24:51.280616 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:24:51.291921 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:24:51.303141 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:24:51.314565 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:24:51.325827 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:24:51.337455 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:24:51.460545 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:24:51.681313 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:24:52.010340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31769): Launched 11:24:52.296402 run iperf3-srv_10.42.42.10(pid=31770): Launched 11:24:52.419062 tst iperf3.py:8: start network... 11:24:52.638824 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:24:53.145760 run create_hlr_db(pid=31771): Launched 11:24:53.270928 bus /gobi_6: Setting Powered False 11:24:54.335094 run create_hlr_db(pid=31771): Terminated: ok {rc=0} 11:24:54.771862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31773): Launched 11:24:55.077847 run osmo-hlr_10.42.42.2(pid=31774): Launched 11:24:55.193479 run osmo-stp_10.42.42.5: Starting osmo-stp 11:24:55.733729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31776): Launched 11:24:56.038511 run osmo-stp_10.42.42.5(pid=31777): Launched 11:24:56.153385 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:24:56.680344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31779): Launched 11:24:56.797084 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:24:57.056204 run patchelf(pid=31780): Launched 11:24:57.224805 run osmo-stp_10.42.42.5(pid=31777): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31777)] 11:24:57.354156 run osmo-stp_10.42.42.5(pid=31777): stdout: | (launched: 2022-12-09_11:24:55.980558) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:57.483993 run osmo-stp_10.42.42.5(pid=31777): stderr: | 20221209112456153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112456153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112456153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112456154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112456156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112456156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112456156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:57.614583 run osmo-stp_10.42.42.5(pid=31777): stdout: | (launched: 2022-12-09_11:24:55.980558) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:24:57.738755 run osmo-stp_10.42.42.5(pid=31777): stderr: | 20221209112456153 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112456153 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112456153 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112456154 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112456156 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112456156 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112456156 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:24:57.886153 run patchelf(pid=31780): Terminating (SIGINT) 11:24:58.057808 run patchelf(pid=31780): Terminated: ok {rc=0} 11:24:58.182503 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31777): Process ended prematurely: osmo-stp_10.42.42.5(pid=31777) [trial-2359↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31777)] [trial-2359↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 11:24:58.191933 tst iperf3.py:8: Test FAILED (7.5 sec) 11:24:58.218999 run osmo-hlr_10.42.42.2(pid=31774): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31774)] 11:24:58.266751 run osmo-hlr_10.42.42.2(pid=31774): stdout: | (launched: 2022-12-09_11:24:55.019971) 11:24:58.315929 run osmo-hlr_10.42.42.2(pid=31774): stderr: | 20221209112455200 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112455200 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112455200 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112455200 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112455200 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112455200 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112455216 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112455226 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112455227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112455227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:24:58.365503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31769): Terminating (SIGTERM) 11:24:58.405028 run iperf3-srv_10.42.42.10(pid=31770): Terminating (SIGTERM) 11:24:58.444439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31773): Terminating (SIGTERM) 11:24:58.483803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31776): Terminating (SIGTERM) 11:24:58.523260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31779): Terminating (SIGTERM) 11:24:58.563087 --- ParallelTerminationStrategy: PID 31769 died... 11:24:58.581983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31769): Terminated: ok {rc=0} 11:24:58.625655 --- ParallelTerminationStrategy: PID 31770 died... 11:24:58.644021 run iperf3-srv_10.42.42.10(pid=31770): Terminated {rc=256} 11:24:58.687643 --- ParallelTerminationStrategy: PID 31773 died... 11:24:58.706261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31773): Terminated: ok {rc=0} 11:24:58.750029 --- ParallelTerminationStrategy: PID 31776 died... 11:24:58.768590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31776): Terminated: ok {rc=0} 11:24:58.812189 --- ParallelTerminationStrategy: PID 31779 died... 11:24:58.831060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31779): Terminated: ok {rc=0} 11:24:58.914753 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:25:00.064043 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:00.076125 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:25:00.115539 tst iperf3m4.py: using LAC 21130 11:25:00.245387 tst iperf3m4.py: using RAC 220 11:25:00.395766 tst iperf3m4.py: using CellId 21130 11:25:00.513863 tst iperf3m4.py: using BVCI 21131 11:25:00.624303 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:00.635316 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:00.646172 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:00.656864 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:00.667561 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:00.678215 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:00.689043 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:00.699438 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:00.710082 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:25:00.831145 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:25:00.985164 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:25:01.116835 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:25:01.260253 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:25:01.495778 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:25:01.843193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31784): Launched 11:25:02.145908 run iperf3-srv_10.42.42.10(pid=31785): Launched 11:25:02.277755 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:25:02.497164 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:25:02.824690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31786): Launched 11:25:03.107618 run iperf3-srv_10.42.42.10(pid=31787): Launched 11:25:03.229852 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:25:03.449359 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:25:03.776339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31788): Launched 11:25:04.059167 run iperf3-srv_10.42.42.10(pid=31789): Launched 11:25:04.181231 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:25:04.399839 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:25:04.726951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31790): Launched 11:25:05.010338 run iperf3-srv_10.42.42.10(pid=31791): Launched 11:25:05.132545 tst iperf3m4.py:8: start network... 11:25:05.352163 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:25:05.856136 run create_hlr_db(pid=31792): Launched 11:25:05.979761 bus /gobi_6: Setting Powered False 11:25:07.044721 run create_hlr_db(pid=31792): Terminated: ok {rc=0} 11:25:07.479541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31794): Launched 11:25:07.782506 run osmo-hlr_10.42.42.2(pid=31795): Launched 11:25:07.898062 run osmo-stp_10.42.42.5: Starting osmo-stp 11:25:08.428056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31797): Launched 11:25:08.735700 run osmo-stp_10.42.42.5(pid=31798): Launched 11:25:08.853522 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:25:09.388404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31800): Launched 11:25:09.506975 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:25:09.767714 run patchelf(pid=31801): Launched 11:25:09.940863 run osmo-stp_10.42.42.5(pid=31798): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31798)] 11:25:10.072462 run osmo-stp_10.42.42.5(pid=31798): stdout: | (launched: 2022-12-09_11:25:08.678983) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:10.205354 run osmo-stp_10.42.42.5(pid=31798): stderr: | 20221209112508845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112508845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112508846 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112508846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112508847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112508847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112508847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:10.338911 run osmo-stp_10.42.42.5(pid=31798): stdout: | (launched: 2022-12-09_11:25:08.678983) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:10.466709 run osmo-stp_10.42.42.5(pid=31798): stderr: | 20221209112508845 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112508845 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112508846 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112508846 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112508847 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112508847 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112508847 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:10.621192 run patchelf(pid=31801): Terminating (SIGINT) 11:25:10.797538 run patchelf(pid=31801): Terminated: ok {rc=0} 11:25:10.924685 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31798): Process ended prematurely: osmo-stp_10.42.42.5(pid=31798) [trial-2359↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31798)] [trial-2359↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 11:25:10.934241 tst iperf3m4.py:8: Test FAILED (10.9 sec) 11:25:10.961983 run osmo-hlr_10.42.42.2(pid=31795): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31795)] 11:25:11.010071 run osmo-hlr_10.42.42.2(pid=31795): stdout: | (launched: 2022-12-09_11:25:07.726953) 11:25:11.060182 run osmo-hlr_10.42.42.2(pid=31795): stderr: | 20221209112507900 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112507900 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112507900 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112507900 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112507900 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112507900 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112507912 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112507923 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112507923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112507923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:25:11.111001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31784): Terminating (SIGTERM) 11:25:11.151456 run iperf3-srv_10.42.42.10(pid=31785): Terminating (SIGTERM) 11:25:11.191946 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31786): Terminating (SIGTERM) 11:25:11.232499 run iperf3-srv_10.42.42.10(pid=31787): Terminating (SIGTERM) 11:25:11.272787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31788): Terminating (SIGTERM) 11:25:11.313229 run iperf3-srv_10.42.42.10(pid=31789): Terminating (SIGTERM) 11:25:11.354112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31790): Terminating (SIGTERM) 11:25:11.394617 run iperf3-srv_10.42.42.10(pid=31791): Terminating (SIGTERM) 11:25:11.434881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31794): Terminating (SIGTERM) 11:25:11.475588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31797): Terminating (SIGTERM) 11:25:11.516119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31800): Terminating (SIGTERM) 11:25:11.556689 --- ParallelTerminationStrategy: PID 31784 died... 11:25:11.576066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31784): Terminated: ok {rc=0} 11:25:11.620857 --- ParallelTerminationStrategy: PID 31785 died... 11:25:11.640097 run iperf3-srv_10.42.42.10(pid=31785): Terminated {rc=256} 11:25:11.684496 --- ParallelTerminationStrategy: PID 31786 died... 11:25:11.703230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31786): Terminated: ok {rc=0} 11:25:11.747671 --- ParallelTerminationStrategy: PID 31787 died... 11:25:11.766547 run iperf3-srv_10.42.42.10(pid=31787): Terminated {rc=256} 11:25:11.811752 --- ParallelTerminationStrategy: PID 31788 died... 11:25:11.830573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31788): Terminated: ok {rc=0} 11:25:11.875389 --- ParallelTerminationStrategy: PID 31789 died... 11:25:11.894302 run iperf3-srv_10.42.42.10(pid=31789): Terminated {rc=256} 11:25:11.938546 --- ParallelTerminationStrategy: PID 31790 died... 11:25:11.957295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31790): Terminated: ok {rc=0} 11:25:12.002067 --- ParallelTerminationStrategy: PID 31791 died... 11:25:12.020921 run iperf3-srv_10.42.42.10(pid=31791): Terminated {rc=256} 11:25:12.065240 --- ParallelTerminationStrategy: PID 31794 died... 11:25:12.083788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31794): Terminated: ok {rc=0} 11:25:12.128109 --- ParallelTerminationStrategy: PID 31797 died... 11:25:12.147036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31797): Terminated: ok {rc=0} 11:25:12.191312 --- ParallelTerminationStrategy: PID 31800 died... 11:25:12.210087 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31800): Terminated: ok {rc=0} 11:25:12.296791 bus /gobi_4: Setting Powered False 11:25:13.398705 bus /gobi_4: Setting Powered False 11:25:14.514720 bus /gobi_1: Setting Powered False 11:25:15.616496 bus /gobi_1: Setting Powered False 11:25:16.731232 bus /gobi_0: Setting Powered False 11:25:17.834629 bus /gobi_0: Setting Powered False 11:25:18.952438 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 11:25:20.057800 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:20.070097 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:25:20.109278 tst ping.py: using LAC 21131 11:25:20.238393 tst ping.py: using RAC 221 11:25:20.367927 tst ping.py: using CellId 21131 11:25:20.497854 tst ping.py: using BVCI 21132 11:25:20.617640 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:20.629112 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:20.640309 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:20.651932 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:20.663494 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:20.674861 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:20.686578 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:20.698439 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:25:20.818738 tst ping.py:19: start network... 11:25:21.023639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:25:21.497551 run create_hlr_db(pid=31803): Launched 11:25:21.626958 bus /gobi_6: Setting Powered False 11:25:22.691208 run create_hlr_db(pid=31803): Terminated: ok {rc=0} 11:25:23.148902 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31805): Launched 11:25:23.475695 run osmo-hlr_10.42.42.2(pid=31806): Launched 11:25:23.601101 run osmo-stp_10.42.42.5: Starting osmo-stp 11:25:24.162893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31808): Launched 11:25:24.489721 run osmo-stp_10.42.42.5(pid=31809): Launched 11:25:24.614818 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:25:25.178055 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31811): Launched 11:25:25.303062 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:25:25.579996 run patchelf(pid=31812): Launched 11:25:25.763060 run osmo-stp_10.42.42.5(pid=31809): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31809)] 11:25:25.901960 run osmo-stp_10.42.42.5(pid=31809): stdout: | (launched: 2022-12-09_11:25:24.430167) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:26.042090 run osmo-stp_10.42.42.5(pid=31809): stderr: | 20221209112524621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112524621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112524621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112524621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112524622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112524622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112524622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:26.182001 run osmo-stp_10.42.42.5(pid=31809): stdout: | (launched: 2022-12-09_11:25:24.430167) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:26.315904 run osmo-stp_10.42.42.5(pid=31809): stderr: | 20221209112524621 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112524621 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112524621 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112524621 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112524622 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112524622 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112524622 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:26.474716 run patchelf(pid=31812): Terminating (SIGINT) 11:25:26.659713 run patchelf(pid=31812): Terminated: ok {rc=0} 11:25:26.793130 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31809): Process ended prematurely: osmo-stp_10.42.42.5(pid=31809) [trial-2359↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31809)] [trial-2359↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 11:25:26.802971 tst ping.py:22: Test FAILED (6.7 sec) 11:25:26.831969 run osmo-hlr_10.42.42.2(pid=31806): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31806)] 11:25:26.883651 run osmo-hlr_10.42.42.2(pid=31806): stdout: | (launched: 2022-12-09_11:25:23.415628) 11:25:26.937136 run osmo-hlr_10.42.42.2(pid=31806): stderr: | 20221209112523613 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112523613 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112523613 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112523613 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112523613 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112523613 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112523626 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112523635 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112523635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112523635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:25:26.990528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31805): Terminating (SIGTERM) 11:25:27.033537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31808): Terminating (SIGTERM) 11:25:27.076477 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31811): Terminating (SIGTERM) 11:25:27.120213 --- ParallelTerminationStrategy: PID 31805 died... 11:25:27.140536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31805): Terminated: ok {rc=0} 11:25:27.188578 --- ParallelTerminationStrategy: PID 31808 died... 11:25:27.208606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31808): Terminated: ok {rc=0} 11:25:27.256005 --- ParallelTerminationStrategy: PID 31811 died... 11:25:27.276046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31811): Terminated: ok {rc=0} 11:25:27.365281 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:25:28.455291 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:28.467407 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:25:28.507335 tst ping_idle_ping.py: using LAC 21132 11:25:28.629585 tst ping_idle_ping.py: using RAC 222 11:25:28.751025 tst ping_idle_ping.py: using CellId 21132 11:25:28.873413 tst ping_idle_ping.py: using BVCI 21133 11:25:28.985244 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:28.996123 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:29.006918 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:29.018195 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:29.029406 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:29.040733 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:29.052320 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:25:29.063715 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:25:29.192527 tst ping_idle_ping.py:24: start network... 11:25:29.414555 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:25:29.921381 run create_hlr_db(pid=31813): Launched 11:25:30.047140 bus /gobi_6: Setting Powered False 11:25:31.132787 run create_hlr_db(pid=31813): Terminated: ok {rc=0} 11:25:31.645737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31815): Launched 11:25:31.974168 run osmo-hlr_10.42.42.2(pid=31816): Launched 11:25:32.237068 run osmo-stp_10.42.42.5: Starting osmo-stp 11:25:32.803417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31818): Launched 11:25:33.130932 run osmo-stp_10.42.42.5(pid=31819): Launched 11:25:33.255489 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:25:33.823248 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31821): Launched 11:25:33.949449 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:25:34.226734 run patchelf(pid=31822): Launched 11:25:34.410090 run osmo-stp_10.42.42.5(pid=31819): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31819)] 11:25:34.549735 run osmo-stp_10.42.42.5(pid=31819): stdout: | (launched: 2022-12-09_11:25:33.070955) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:34.690640 run osmo-stp_10.42.42.5(pid=31819): stderr: | 20221209112533261 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112533261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112533261 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112533262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112533262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112533262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112533262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:34.831400 run osmo-stp_10.42.42.5(pid=31819): stdout: | (launched: 2022-12-09_11:25:33.070955) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:34.965986 run osmo-stp_10.42.42.5(pid=31819): stderr: | 20221209112533261 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112533261 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112533261 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112533262 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112533262 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112533262 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112533262 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:35.125797 run patchelf(pid=31822): Terminating (SIGINT) 11:25:35.311149 run patchelf(pid=31822): Terminated: ok {rc=0} 11:25:35.444865 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31819): Process ended prematurely: osmo-stp_10.42.42.5(pid=31819) [trial-2359↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31819)] [trial-2359↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 11:25:35.454658 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 11:25:35.483272 run osmo-hlr_10.42.42.2(pid=31816): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31816)] 11:25:35.534486 run osmo-hlr_10.42.42.2(pid=31816): stdout: | (launched: 2022-12-09_11:25:31.907209) 11:25:35.587512 run osmo-hlr_10.42.42.2(pid=31816): stderr: | 20221209112532135 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112532135 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112532136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112532136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112532136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112532136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112532150 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112532163 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112532163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112532163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:25:35.641230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31815): Terminating (SIGTERM) 11:25:35.683992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31818): Terminating (SIGTERM) 11:25:35.726849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31821): Terminating (SIGTERM) 11:25:35.769959 --- ParallelTerminationStrategy: PID 31815 died... 11:25:35.790393 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31815): Terminated: ok {rc=0} 11:25:35.837890 --- ParallelTerminationStrategy: PID 31818 died... 11:25:35.857834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31818): Terminated: ok {rc=0} 11:25:35.905270 --- ParallelTerminationStrategy: PID 31821 died... 11:25:35.924852 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31821): Terminated: ok {rc=0} 11:25:36.014674 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:25:37.305208 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:25:37.312073 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:25:37.334842 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:25:37.374808 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:25:37.463689 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:25:37.485508 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:25:37.524300 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:25:38.118001 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:25:38.168814 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:25:38.179942 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:25:38.235282 tst cs_paging_gprs_active.py: using LAC 21133 11:25:38.356050 tst cs_paging_gprs_active.py: using RAC 223 11:25:38.478106 tst cs_paging_gprs_active.py: using CellId 21133 11:25:38.598349 tst cs_paging_gprs_active.py: using BVCI 21134 11:25:38.710981 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:25:38.722050 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:25:38.732766 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:25:38.743694 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:25:38.754500 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:25:38.765358 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:25:38.776260 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:25:38.786983 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:25:38.798197 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:25:38.919927 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:25:39.042359 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:25:39.268632 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:25:39.604104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31826): Launched 11:25:39.894772 run iperf3-srv_10.42.42.10(pid=31827): Launched 11:25:40.018135 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:25:40.227960 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:25:40.541909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31828): Launched 11:25:40.812607 run iperf3-srv_10.42.42.10(pid=31829): Launched 11:25:40.929333 tst cs_paging_gprs_active.py:38: start network... 11:25:41.136761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:25:41.619606 run create_hlr_db(pid=31830): Launched 11:25:41.746259 bus /gobi_6: Setting Powered False 11:25:42.807965 run create_hlr_db(pid=31830): Terminated: ok {rc=0} 11:25:43.242254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31832): Launched 11:25:43.554529 run osmo-hlr_10.42.42.2(pid=31833): Launched 11:25:43.674035 run osmo-stp_10.42.42.5: Starting osmo-stp 11:25:44.208640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31835): Launched 11:25:44.519913 run osmo-stp_10.42.42.5(pid=31836): Launched 11:25:44.638638 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:25:45.174838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31838): Launched 11:25:45.293366 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:25:45.556525 run patchelf(pid=31839): Launched 11:25:45.731205 run osmo-stp_10.42.42.5(pid=31836): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31836)] 11:25:45.885077 run osmo-stp_10.42.42.5(pid=31836): stdout: | (launched: 2022-12-09_11:25:44.462811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:46.031998 run osmo-stp_10.42.42.5(pid=31836): stderr: | 20221209112544632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112544633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112544633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112544633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112544634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112544634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112544634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:46.169874 run osmo-stp_10.42.42.5(pid=31836): stdout: | (launched: 2022-12-09_11:25:44.462811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:46.302094 run osmo-stp_10.42.42.5(pid=31836): stderr: | 20221209112544632 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112544633 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112544633 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112544633 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112544634 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112544634 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112544634 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:46.458314 run patchelf(pid=31839): Terminating (SIGINT) 11:25:46.639237 run patchelf(pid=31839): Terminated: ok {rc=0} 11:25:46.769793 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31836): Process ended prematurely: osmo-stp_10.42.42.5(pid=31836) [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31836)] [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:25:46.780362 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 11:25:46.809632 run osmo-hlr_10.42.42.2(pid=31833): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31833)] 11:25:46.859672 run osmo-hlr_10.42.42.2(pid=31833): stdout: | (launched: 2022-12-09_11:25:43.496804) 11:25:46.911702 run osmo-hlr_10.42.42.2(pid=31833): stderr: | 20221209112543675 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112543675 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112543675 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112543675 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112543675 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112543675 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112543687 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112543695 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112543695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112543695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:25:46.963442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31826): Terminating (SIGTERM) 11:25:47.006058 run iperf3-srv_10.42.42.10(pid=31827): Terminating (SIGTERM) 11:25:47.051097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31828): Terminating (SIGTERM) 11:25:47.093689 run iperf3-srv_10.42.42.10(pid=31829): Terminating (SIGTERM) 11:25:47.135349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31832): Terminating (SIGTERM) 11:25:47.176516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31835): Terminating (SIGTERM) 11:25:47.217741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31838): Terminating (SIGTERM) 11:25:47.258369 --- ParallelTerminationStrategy: PID 31826 died... 11:25:47.277674 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31826): Terminated: ok {rc=0} 11:25:47.322719 --- ParallelTerminationStrategy: PID 31827 died... 11:25:47.341672 run iperf3-srv_10.42.42.10(pid=31827): Terminated {rc=256} 11:25:47.386244 --- ParallelTerminationStrategy: PID 31828 died... 11:25:47.405196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31828): Terminated: ok {rc=0} 11:25:47.450120 --- ParallelTerminationStrategy: PID 31829 died... 11:25:47.468891 run iperf3-srv_10.42.42.10(pid=31829): Terminated {rc=256} 11:25:47.513480 --- ParallelTerminationStrategy: PID 31832 died... 11:25:47.532376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31832): Terminated: ok {rc=0} 11:25:47.576729 --- ParallelTerminationStrategy: PID 31835 died... 11:25:47.595673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31835): Terminated: ok {rc=0} 11:25:47.640606 --- ParallelTerminationStrategy: PID 31838 died... 11:25:47.659639 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31838): Terminated: ok {rc=0} 11:25:47.747182 bus /gobi_0: Setting Powered False 11:25:48.847588 bus /gobi_0: Setting Powered False 11:25:49.961765 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:25:51.113573 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:25:51.125889 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:25:51.196485 tst iperf3.py: using LAC 21134 11:25:51.329310 tst iperf3.py: using RAC 224 11:25:51.460867 tst iperf3.py: using CellId 21134 11:25:51.590821 tst iperf3.py: using BVCI 21135 11:25:51.715050 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:25:51.726693 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:25:51.738251 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:25:51.749875 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:25:51.761446 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:25:51.772714 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:25:51.784392 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:25:51.795890 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:25:51.807634 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:25:51.931627 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:25:52.157782 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:25:52.493967 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31840): Launched 11:25:52.785637 run iperf3-srv_10.42.42.10(pid=31841): Launched 11:25:52.911121 tst iperf3.py:8: start network... 11:25:53.136258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:25:53.652573 run create_hlr_db(pid=31842): Launched 11:25:53.780436 bus /gobi_6: Setting Powered False 11:25:54.846196 run create_hlr_db(pid=31842): Terminated: ok {rc=0} 11:25:55.291940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31844): Launched 11:25:55.605062 run osmo-hlr_10.42.42.2(pid=31845): Launched 11:25:55.725175 run osmo-stp_10.42.42.5: Starting osmo-stp 11:25:56.301245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31847): Launched 11:25:56.634954 run osmo-stp_10.42.42.5(pid=31848): Launched 11:25:56.761955 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:25:57.335116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31850): Launched 11:25:57.462507 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:25:57.744879 run patchelf(pid=31851): Launched 11:25:57.930493 run osmo-stp_10.42.42.5(pid=31848): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31848)] 11:25:58.071455 run osmo-stp_10.42.42.5(pid=31848): stdout: | (launched: 2022-12-09_11:25:56.573471) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:58.213790 run osmo-stp_10.42.42.5(pid=31848): stderr: | 20221209112556769 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112556769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112556770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112556770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112556770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112556771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112556771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:58.356350 run osmo-stp_10.42.42.5(pid=31848): stdout: | (launched: 2022-12-09_11:25:56.573471) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:25:58.493235 run osmo-stp_10.42.42.5(pid=31848): stderr: | 20221209112556769 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112556769 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112556770 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112556770 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112556770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112556771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112556771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:25:58.655323 run patchelf(pid=31851): Terminating (SIGINT) 11:25:58.843008 run patchelf(pid=31851): Terminated: ok {rc=0} 11:25:58.979154 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31848): Process ended prematurely: osmo-stp_10.42.42.5(pid=31848) [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31848)] [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 11:25:58.989433 tst iperf3.py:8: Test FAILED (7.9 sec) 11:25:59.018967 run osmo-hlr_10.42.42.2(pid=31845): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31845)] 11:25:59.069821 run osmo-hlr_10.42.42.2(pid=31845): stdout: | (launched: 2022-12-09_11:25:55.547408) 11:25:59.122599 run osmo-hlr_10.42.42.2(pid=31845): stderr: | 20221209112555723 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112555723 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112555723 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112555723 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112555723 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112555723 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112555762 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112555772 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112555772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112555772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:25:59.176241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31840): Terminating (SIGTERM) 11:25:59.218750 run iperf3-srv_10.42.42.10(pid=31841): Terminating (SIGTERM) 11:25:59.261374 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31844): Terminating (SIGTERM) 11:25:59.304034 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31847): Terminating (SIGTERM) 11:25:59.346945 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31850): Terminating (SIGTERM) 11:25:59.390147 --- ParallelTerminationStrategy: PID 31840 died... 11:25:59.410564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31840): Terminated: ok {rc=0} 11:25:59.458389 --- ParallelTerminationStrategy: PID 31841 died... 11:25:59.478347 run iperf3-srv_10.42.42.10(pid=31841): Terminated {rc=256} 11:25:59.525715 --- ParallelTerminationStrategy: PID 31844 died... 11:25:59.545578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31844): Terminated: ok {rc=0} 11:25:59.592537 --- ParallelTerminationStrategy: PID 31847 died... 11:25:59.612344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31847): Terminated: ok {rc=0} 11:25:59.660055 --- ParallelTerminationStrategy: PID 31850 died... 11:25:59.679961 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31850): Terminated: ok {rc=0} 11:25:59.770067 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 11:26:00.947316 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:00.959527 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:26:01.019852 tst iperf3m4.py: using LAC 21135 11:26:01.184471 tst iperf3m4.py: using RAC 225 11:26:01.307214 tst iperf3m4.py: using CellId 21135 11:26:01.430303 tst iperf3m4.py: using BVCI 21136 11:26:01.566973 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:01.578585 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:01.590166 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:01.601512 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:01.613121 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:01.624349 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:01.635971 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:01.647207 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:01.658663 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:26:01.781640 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:26:01.917079 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:26:02.039799 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:26:02.195568 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:26:02.464294 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:26:02.801201 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31852): Launched 11:26:03.091339 run iperf3-srv_10.42.42.10(pid=31853): Launched 11:26:03.216338 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:26:03.440925 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:26:03.775915 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31854): Launched 11:26:04.066960 run iperf3-srv_10.42.42.10(pid=31855): Launched 11:26:04.192158 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:26:04.416838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:26:04.751758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31856): Launched 11:26:05.042292 run iperf3-srv_10.42.42.10(pid=31857): Launched 11:26:05.167438 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:26:05.391977 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:26:05.727110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31858): Launched 11:26:06.017914 run iperf3-srv_10.42.42.10(pid=31859): Launched 11:26:06.143000 tst iperf3m4.py:8: start network... 11:26:06.367142 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:26:06.883825 run create_hlr_db(pid=31860): Launched 11:26:07.011119 bus /gobi_6: Setting Powered False 11:26:08.076600 run create_hlr_db(pid=31860): Terminated: ok {rc=0} 11:26:08.520794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31862): Launched 11:26:08.833057 run osmo-hlr_10.42.42.2(pid=31863): Launched 11:26:08.950627 run osmo-stp_10.42.42.5: Starting osmo-stp 11:26:09.500931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31865): Launched 11:26:09.811564 run osmo-stp_10.42.42.5(pid=31866): Launched 11:26:09.929263 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:26:10.462467 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31868): Launched 11:26:10.581068 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:26:10.842684 run patchelf(pid=31869): Launched 11:26:11.016231 run osmo-stp_10.42.42.5(pid=31866): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31866)] 11:26:11.147612 run osmo-stp_10.42.42.5(pid=31866): stdout: | (launched: 2022-12-09_11:26:09.753727) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:11.280771 run osmo-stp_10.42.42.5(pid=31866): stderr: | 20221209112609923 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112609923 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112609923 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112609924 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112609924 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112609924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112609924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:11.413692 run osmo-stp_10.42.42.5(pid=31866): stdout: | (launched: 2022-12-09_11:26:09.753727) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:11.541309 run osmo-stp_10.42.42.5(pid=31866): stderr: | 20221209112609923 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112609923 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112609923 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112609924 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112609924 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112609924 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112609924 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:11.692380 run patchelf(pid=31869): Terminating (SIGINT) 11:26:11.868291 run patchelf(pid=31869): Terminated: ok {rc=0} 11:26:11.995624 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31866): Process ended prematurely: osmo-stp_10.42.42.5(pid=31866) [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31866)] [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:26:12.005167 tst iperf3m4.py:8: Test FAILED (11.1 sec) 11:26:12.033289 run osmo-hlr_10.42.42.2(pid=31863): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31863)] 11:26:12.081584 run osmo-hlr_10.42.42.2(pid=31863): stdout: | (launched: 2022-12-09_11:26:08.775187) 11:26:12.131677 run osmo-hlr_10.42.42.2(pid=31863): stderr: | 20221209112608949 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112608949 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112608949 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112608949 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112608949 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112608949 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112608962 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112608971 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112608971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112608971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:26:12.181984 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31852): Terminating (SIGTERM) 11:26:12.222309 run iperf3-srv_10.42.42.10(pid=31853): Terminating (SIGTERM) 11:26:12.262504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31854): Terminating (SIGTERM) 11:26:12.302963 run iperf3-srv_10.42.42.10(pid=31855): Terminating (SIGTERM) 11:26:12.343103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31856): Terminating (SIGTERM) 11:26:12.383166 run iperf3-srv_10.42.42.10(pid=31857): Terminating (SIGTERM) 11:26:12.423180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31858): Terminating (SIGTERM) 11:26:12.463313 run iperf3-srv_10.42.42.10(pid=31859): Terminating (SIGTERM) 11:26:12.503230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31862): Terminating (SIGTERM) 11:26:12.543286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31865): Terminating (SIGTERM) 11:26:12.583350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31868): Terminating (SIGTERM) 11:26:12.623677 --- ParallelTerminationStrategy: PID 31852 died... 11:26:12.643036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31852): Terminated: ok {rc=0} 11:26:12.687828 --- ParallelTerminationStrategy: PID 31853 died... 11:26:12.706657 run iperf3-srv_10.42.42.10(pid=31853): Terminated {rc=256} 11:26:12.751142 --- ParallelTerminationStrategy: PID 31854 died... 11:26:12.770132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31854): Terminated: ok {rc=0} 11:26:12.814667 --- ParallelTerminationStrategy: PID 31855 died... 11:26:12.833545 run iperf3-srv_10.42.42.10(pid=31855): Terminated {rc=256} 11:26:12.877929 --- ParallelTerminationStrategy: PID 31856 died... 11:26:12.896599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31856): Terminated: ok {rc=0} 11:26:12.941250 --- ParallelTerminationStrategy: PID 31857 died... 11:26:12.960023 run iperf3-srv_10.42.42.10(pid=31857): Terminated {rc=256} 11:26:13.004496 --- ParallelTerminationStrategy: PID 31858 died... 11:26:13.023430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31858): Terminated: ok {rc=0} 11:26:13.067898 --- ParallelTerminationStrategy: PID 31859 died... 11:26:13.086830 run iperf3-srv_10.42.42.10(pid=31859): Terminated {rc=256} 11:26:13.131193 --- ParallelTerminationStrategy: PID 31862 died... 11:26:13.150281 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31862): Terminated: ok {rc=0} 11:26:13.194913 --- ParallelTerminationStrategy: PID 31865 died... 11:26:13.213894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31865): Terminated: ok {rc=0} 11:26:13.258429 --- ParallelTerminationStrategy: PID 31868 died... 11:26:13.277413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31868): Terminated: ok {rc=0} 11:26:13.364312 bus /gobi_4: Setting Powered False 11:26:14.465632 bus /gobi_4: Setting Powered False 11:26:15.583182 bus /gobi_1: Setting Powered False 11:26:16.681327 bus /gobi_1: Setting Powered False 11:26:17.799785 bus /gobi_0: Setting Powered False 11:26:18.901547 bus /gobi_0: Setting Powered False 11:26:20.020754 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:26:21.125281 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:21.137431 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:26:21.200391 tst ping.py: using LAC 21136 11:26:21.328712 tst ping.py: using RAC 226 11:26:21.455942 tst ping.py: using CellId 21136 11:26:21.585390 tst ping.py: using BVCI 21137 11:26:21.706148 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:21.717627 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:21.728796 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:21.740385 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:21.751782 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:21.763248 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:21.774868 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:21.786434 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:26:21.907092 tst ping.py:19: start network... 11:26:22.128801 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:26:22.637102 run create_hlr_db(pid=31870): Launched 11:26:22.762243 bus /gobi_6: Setting Powered False 11:26:23.826886 run create_hlr_db(pid=31870): Terminated: ok {rc=0} 11:26:24.268694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31872): Launched 11:26:24.576251 run osmo-hlr_10.42.42.2(pid=31873): Launched 11:26:24.693685 run osmo-stp_10.42.42.5: Starting osmo-stp 11:26:25.253093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31875): Launched 11:26:25.559718 run osmo-stp_10.42.42.5(pid=31876): Launched 11:26:25.676363 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:26:26.205390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31878): Launched 11:26:26.323012 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:26:26.582400 run patchelf(pid=31879): Launched 11:26:26.754331 run osmo-stp_10.42.42.5(pid=31876): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31876)] 11:26:26.883746 run osmo-stp_10.42.42.5(pid=31876): stdout: | (launched: 2022-12-09_11:26:25.502834) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:27.014483 run osmo-stp_10.42.42.5(pid=31876): stderr: | 20221209112625675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112625675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112625675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112625676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112625676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112625676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112625676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:27.145357 run osmo-stp_10.42.42.5(pid=31876): stdout: | (launched: 2022-12-09_11:26:25.502834) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:27.269770 run osmo-stp_10.42.42.5(pid=31876): stderr: | 20221209112625675 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112625675 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112625675 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112625676 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112625676 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112625676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112625676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:27.418082 run patchelf(pid=31879): Terminating (SIGINT) 11:26:27.591054 run patchelf(pid=31879): Terminated: ok {rc=0} 11:26:27.716015 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31876): Process ended prematurely: osmo-stp_10.42.42.5(pid=31876) [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31876)] [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 11:26:27.724858 tst ping.py:22: Test FAILED (6.6 sec) 11:26:27.751633 run osmo-hlr_10.42.42.2(pid=31873): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31873)] 11:26:27.799828 run osmo-hlr_10.42.42.2(pid=31873): stdout: | (launched: 2022-12-09_11:26:24.519402) 11:26:27.849360 run osmo-hlr_10.42.42.2(pid=31873): stderr: | 20221209112624697 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112624697 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112624697 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112624697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112624697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112624697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112624709 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112624718 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112624718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112624718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:26:27.898980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31872): Terminating (SIGTERM) 11:26:27.938911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31875): Terminating (SIGTERM) 11:26:27.979308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31878): Terminating (SIGTERM) 11:26:28.019609 --- ParallelTerminationStrategy: PID 31872 died... 11:26:28.038892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31872): Terminated: ok {rc=0} 11:26:28.083185 --- ParallelTerminationStrategy: PID 31875 died... 11:26:28.101966 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31875): Terminated: ok {rc=0} 11:26:28.146037 --- ParallelTerminationStrategy: PID 31878 died... 11:26:28.164700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31878): Terminated: ok {rc=0} 11:26:28.251103 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 11:26:29.340386 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:29.352397 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:26:29.410471 tst ping_idle_ping.py: using LAC 21137 11:26:29.531668 tst ping_idle_ping.py: using RAC 227 11:26:29.652456 tst ping_idle_ping.py: using CellId 21137 11:26:29.779848 tst ping_idle_ping.py: using BVCI 21138 11:26:29.890938 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:29.901864 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:29.912449 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:29.923123 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:29.934173 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:29.944647 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:29.955417 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:26:29.966671 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:26:30.086688 tst ping_idle_ping.py:24: start network... 11:26:30.308139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:26:30.818059 run create_hlr_db(pid=31880): Launched 11:26:31.007778 bus /gobi_6: Setting Powered False 11:26:32.069133 run create_hlr_db(pid=31880): Terminated: ok {rc=0} 11:26:32.538502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31882): Launched 11:26:32.870013 run osmo-hlr_10.42.42.2(pid=31883): Launched 11:26:32.997760 run osmo-stp_10.42.42.5: Starting osmo-stp 11:26:33.566076 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31885): Launched 11:26:33.896512 run osmo-stp_10.42.42.5(pid=31886): Launched 11:26:34.021722 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:26:34.589795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31888): Launched 11:26:34.717381 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:26:34.997288 run patchelf(pid=31889): Launched 11:26:35.180198 run osmo-stp_10.42.42.5(pid=31886): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31886)] 11:26:35.319769 run osmo-stp_10.42.42.5(pid=31886): stdout: | (launched: 2022-12-09_11:26:33.836623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:35.460279 run osmo-stp_10.42.42.5(pid=31886): stderr: | 20221209112634031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112634031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112634032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112634032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112634033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112634033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112634033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:35.601111 run osmo-stp_10.42.42.5(pid=31886): stdout: | (launched: 2022-12-09_11:26:33.836623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:35.735929 run osmo-stp_10.42.42.5(pid=31886): stderr: | 20221209112634031 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112634031 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112634032 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112634032 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112634033 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112634033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112634033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:35.895494 run patchelf(pid=31889): Terminating (SIGINT) 11:26:36.081708 run patchelf(pid=31889): Terminated: ok {rc=0} 11:26:36.215663 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31886): Process ended prematurely: osmo-stp_10.42.42.5(pid=31886) [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31886)] [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 11:26:36.225312 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 11:26:36.254229 run osmo-hlr_10.42.42.2(pid=31883): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31883)] 11:26:36.305253 run osmo-hlr_10.42.42.2(pid=31883): stdout: | (launched: 2022-12-09_11:26:32.809942) 11:26:36.358210 run osmo-hlr_10.42.42.2(pid=31883): stderr: | 20221209112633008 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112633008 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112633008 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112633008 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112633008 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112633008 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112633020 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112633029 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112633029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112633029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:26:36.411416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31882): Terminating (SIGTERM) 11:26:36.454064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31885): Terminating (SIGTERM) 11:26:36.496545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31888): Terminating (SIGTERM) 11:26:36.539623 --- ParallelTerminationStrategy: PID 31882 died... 11:26:36.559666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31882): Terminated: ok {rc=0} 11:26:36.606582 --- ParallelTerminationStrategy: PID 31885 died... 11:26:36.626107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31885): Terminated: ok {rc=0} 11:26:36.673227 --- ParallelTerminationStrategy: PID 31888 died... 11:26:36.692656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31888): Terminated: ok {rc=0} 11:26:36.782007 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:26:38.075123 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:26:38.081700 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:26:38.104291 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 11:26:38.144208 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 11:26:38.233365 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:26:38.254788 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 11:26:38.294705 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 11:26:38.890787 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 11:26:38.944919 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:26:38.956373 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:26:39.014626 tst cs_paging_gprs_active.py: using LAC 21138 11:26:39.145524 tst cs_paging_gprs_active.py: using RAC 228 11:26:39.278696 tst cs_paging_gprs_active.py: using CellId 21138 11:26:39.409685 tst cs_paging_gprs_active.py: using BVCI 21139 11:26:39.534160 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:26:39.545582 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:26:39.556619 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:26:39.568036 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:26:39.579393 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:26:39.590837 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:26:39.602389 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:26:39.613690 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:26:39.625242 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:26:39.746279 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:26:39.865968 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:26:40.078660 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:26:40.393874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31895): Launched 11:26:40.666451 run iperf3-srv_10.42.42.10(pid=31896): Launched 11:26:40.784323 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:26:40.994568 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:26:41.327805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31897): Launched 11:26:41.619181 run iperf3-srv_10.42.42.10(pid=31898): Launched 11:26:41.747073 tst cs_paging_gprs_active.py:38: start network... 11:26:41.972869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:26:42.491536 run create_hlr_db(pid=31899): Launched 11:26:42.618802 bus /gobi_6: Setting Powered False 11:26:43.685109 run create_hlr_db(pid=31899): Terminated: ok {rc=0} 11:26:44.147967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31901): Launched 11:26:44.482805 run osmo-hlr_10.42.42.2(pid=31902): Launched 11:26:44.611014 run osmo-stp_10.42.42.5: Starting osmo-stp 11:26:45.187233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31904): Launched 11:26:45.521571 run osmo-stp_10.42.42.5(pid=31905): Launched 11:26:45.651452 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:26:46.256291 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31907): Launched 11:26:46.396899 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:26:46.685181 run patchelf(pid=31908): Launched 11:26:46.888912 run osmo-stp_10.42.42.5(pid=31905): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31905)] 11:26:47.034059 run osmo-stp_10.42.42.5(pid=31905): stdout: | (launched: 2022-12-09_11:26:45.460573) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:47.180141 run osmo-stp_10.42.42.5(pid=31905): stderr: | 20221209112645653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112645653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112645653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112645653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112645654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112645654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112645654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:47.323055 run osmo-stp_10.42.42.5(pid=31905): stdout: | (launched: 2022-12-09_11:26:45.460573) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:47.460508 run osmo-stp_10.42.42.5(pid=31905): stderr: | 20221209112645653 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112645653 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112645653 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112645653 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112645654 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112645654 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112645654 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:47.623752 run patchelf(pid=31908): Terminating (SIGINT) 11:26:47.814530 run patchelf(pid=31908): Terminated: ok {rc=0} 11:26:47.951035 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=31905): Process ended prematurely: osmo-stp_10.42.42.5(pid=31905) [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31905)] [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 11:26:47.961392 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 11:26:47.990967 run osmo-hlr_10.42.42.2(pid=31902): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31902)] 11:26:48.042439 run osmo-hlr_10.42.42.2(pid=31902): stdout: | (launched: 2022-12-09_11:26:44.421273) 11:26:48.095219 run osmo-hlr_10.42.42.2(pid=31902): stderr: | 20221209112644622 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112644622 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112644622 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112644622 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112644622 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112644622 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112644638 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112644648 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112644648 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112644648 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:26:48.147952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31895): Terminating (SIGTERM) 11:26:48.190895 run iperf3-srv_10.42.42.10(pid=31896): Terminating (SIGTERM) 11:26:48.233732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31897): Terminating (SIGTERM) 11:26:48.276435 run iperf3-srv_10.42.42.10(pid=31898): Terminating (SIGTERM) 11:26:48.318929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31901): Terminating (SIGTERM) 11:26:48.361532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31904): Terminating (SIGTERM) 11:26:48.404118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31907): Terminating (SIGTERM) 11:26:48.447084 --- ParallelTerminationStrategy: PID 31895 died... 11:26:48.467442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31895): Terminated: ok {rc=0} 11:26:48.515129 --- ParallelTerminationStrategy: PID 31896 died... 11:26:48.534852 run iperf3-srv_10.42.42.10(pid=31896): Terminated {rc=256} 11:26:48.581956 --- ParallelTerminationStrategy: PID 31897 died... 11:26:48.601706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31897): Terminated: ok {rc=0} 11:26:48.648798 --- ParallelTerminationStrategy: PID 31898 died... 11:26:48.669354 run iperf3-srv_10.42.42.10(pid=31898): Terminated {rc=256} 11:26:48.716782 --- ParallelTerminationStrategy: PID 31901 died... 11:26:48.736913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31901): Terminated: ok {rc=0} 11:26:48.784142 --- ParallelTerminationStrategy: PID 31904 died... 11:26:48.803945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31904): Terminated: ok {rc=0} 11:26:48.850917 --- ParallelTerminationStrategy: PID 31907 died... 11:26:48.870998 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31907): Terminated: ok {rc=0} 11:26:48.960379 bus /gobi_0: Setting Powered False 11:26:50.059397 bus /gobi_0: Setting Powered False 11:26:51.176776 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 11:26:52.328097 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:26:52.340368 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:26:52.407258 tst iperf3.py: using LAC 21139 11:26:52.537730 tst iperf3.py: using RAC 229 11:26:52.668730 tst iperf3.py: using CellId 21139 11:26:52.798329 tst iperf3.py: using BVCI 21140 11:26:52.920338 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:26:52.931876 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:26:52.943107 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:26:52.954585 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:26:52.966233 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:26:52.977597 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:26:52.989136 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:26:53.000467 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:26:53.012228 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:26:53.135813 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:26:53.362563 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:26:53.699644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31909): Launched 11:26:53.992313 run iperf3-srv_10.42.42.10(pid=31910): Launched 11:26:54.118540 tst iperf3.py:8: start network... 11:26:54.345048 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:26:54.864280 run create_hlr_db(pid=31911): Launched 11:26:54.991451 bus /gobi_6: Setting Powered False 11:26:56.057464 run create_hlr_db(pid=31911): Terminated: ok {rc=0} 11:26:56.504065 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31913): Launched 11:26:56.817809 run osmo-hlr_10.42.42.2(pid=31914): Launched 11:26:56.936288 run osmo-stp_10.42.42.5: Starting osmo-stp 11:26:57.475850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31916): Launched 11:26:57.789738 run osmo-stp_10.42.42.5(pid=31917): Launched 11:26:57.916147 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:26:58.458890 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31919): Launched 11:26:58.578684 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:26:58.842407 run patchelf(pid=31920): Launched 11:26:59.016090 run osmo-stp_10.42.42.5(pid=31917): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31917)] 11:26:59.148116 run osmo-stp_10.42.42.5(pid=31917): stdout: | (launched: 2022-12-09_11:26:57.732119) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:59.281577 run osmo-stp_10.42.42.5(pid=31917): stderr: | 20221209112657908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112657908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112657909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112657909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112657910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112657910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112657910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:59.415225 run osmo-stp_10.42.42.5(pid=31917): stdout: | (launched: 2022-12-09_11:26:57.732119) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:26:59.542753 run osmo-stp_10.42.42.5(pid=31917): stderr: | 20221209112657908 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112657908 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112657909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112657909 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112657910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112657910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112657910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:26:59.694165 run patchelf(pid=31920): Terminating (SIGINT) 11:26:59.870716 run patchelf(pid=31920): Terminated: ok {rc=0} 11:26:59.998430 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31917): Process ended prematurely: osmo-stp_10.42.42.5(pid=31917) [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31917)] [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 11:27:00.007957 tst iperf3.py:8: Test FAILED (7.7 sec) 11:27:00.035289 run osmo-hlr_10.42.42.2(pid=31914): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31914)] 11:27:00.083183 run osmo-hlr_10.42.42.2(pid=31914): stdout: | (launched: 2022-12-09_11:26:56.759992) 11:27:00.133468 run osmo-hlr_10.42.42.2(pid=31914): stderr: | 20221209112656936 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112656936 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112656936 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112656936 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112656936 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112656936 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112656948 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112656956 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112656957 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112656957 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:27:00.183482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31909): Terminating (SIGTERM) 11:27:00.224142 run iperf3-srv_10.42.42.10(pid=31910): Terminating (SIGTERM) 11:27:00.264259 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31913): Terminating (SIGTERM) 11:27:00.304339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31916): Terminating (SIGTERM) 11:27:00.344299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31919): Terminating (SIGTERM) 11:27:00.384521 --- ParallelTerminationStrategy: PID 31909 died... 11:27:00.403843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31909): Terminated: ok {rc=0} 11:27:00.448582 --- ParallelTerminationStrategy: PID 31910 died... 11:27:00.467366 run iperf3-srv_10.42.42.10(pid=31910): Terminated {rc=256} 11:27:00.511514 --- ParallelTerminationStrategy: PID 31913 died... 11:27:00.530367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31913): Terminated: ok {rc=0} 11:27:00.574677 --- ParallelTerminationStrategy: PID 31916 died... 11:27:00.593504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31916): Terminated: ok {rc=0} 11:27:00.637848 --- ParallelTerminationStrategy: PID 31919 died... 11:27:00.656837 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31919): Terminated: ok {rc=0} 11:27:00.743747 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 11:27:01.896736 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:01.910421 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:27:01.970931 tst iperf3m4.py: using LAC 21140 11:27:02.140317 tst iperf3m4.py: using RAC 230 11:27:02.271317 tst iperf3m4.py: using CellId 21140 11:27:02.395994 tst iperf3m4.py: using BVCI 21141 11:27:02.511736 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:02.522875 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:02.533549 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:02.544255 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:02.554932 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:02.565679 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:02.576467 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:02.587106 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:02.598069 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:27:02.716320 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:27:02.841459 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:27:02.964799 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:27:03.084239 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:27:03.294453 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:27:03.607232 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31921): Launched 11:27:03.880779 run iperf3-srv_10.42.42.10(pid=31922): Launched 11:27:03.997814 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:27:04.206243 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:27:04.519295 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31923): Launched 11:27:04.790833 run iperf3-srv_10.42.42.10(pid=31924): Launched 11:27:04.907788 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:27:05.115473 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:27:05.427996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31925): Launched 11:27:05.700822 run iperf3-srv_10.42.42.10(pid=31926): Launched 11:27:05.818016 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:27:06.026070 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:27:06.339808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31927): Launched 11:27:06.612404 run iperf3-srv_10.42.42.10(pid=31928): Launched 11:27:06.729702 tst iperf3m4.py:8: start network... 11:27:06.937850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:27:07.420190 run create_hlr_db(pid=31929): Launched 11:27:07.547051 bus /gobi_6: Setting Powered False 11:27:08.609230 run create_hlr_db(pid=31929): Terminated: ok {rc=0} 11:27:09.065345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31931): Launched 11:27:09.401783 run osmo-hlr_10.42.42.2(pid=31932): Launched 11:27:09.529081 run osmo-stp_10.42.42.5: Starting osmo-stp 11:27:10.110910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31934): Launched 11:27:10.445401 run osmo-stp_10.42.42.5(pid=31935): Launched 11:27:10.573417 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:27:11.154555 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31937): Launched 11:27:11.283301 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:27:11.566556 run patchelf(pid=31938): Launched 11:27:11.755859 run osmo-stp_10.42.42.5(pid=31935): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31935)] 11:27:11.897960 run osmo-stp_10.42.42.5(pid=31935): stdout: | (launched: 2022-12-09_11:27:10.383924) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:12.041429 run osmo-stp_10.42.42.5(pid=31935): stderr: | 20221209112710576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112710576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112710576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112710576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112710577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112710577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112710577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:12.184720 run osmo-stp_10.42.42.5(pid=31935): stdout: | (launched: 2022-12-09_11:27:10.383924) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:12.322456 run osmo-stp_10.42.42.5(pid=31935): stderr: | 20221209112710576 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112710576 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112710576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112710576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112710577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112710577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112710577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:12.485510 run patchelf(pid=31938): Terminating (SIGINT) 11:27:12.675023 run patchelf(pid=31938): Terminated: ok {rc=0} 11:27:12.812227 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=31935): Process ended prematurely: osmo-stp_10.42.42.5(pid=31935) [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31935)] [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 11:27:12.822735 tst iperf3m4.py:8: Test FAILED (11.0 sec) 11:27:12.852446 run osmo-hlr_10.42.42.2(pid=31932): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31932)] 11:27:12.903209 run osmo-hlr_10.42.42.2(pid=31932): stdout: | (launched: 2022-12-09_11:27:09.339994) 11:27:12.955877 run osmo-hlr_10.42.42.2(pid=31932): stderr: | 20221209112709539 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112709539 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112709539 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112709539 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112709539 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112709539 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112709552 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112709563 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112709563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112709563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:27:13.009071 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31921): Terminating (SIGTERM) 11:27:13.051944 run iperf3-srv_10.42.42.10(pid=31922): Terminating (SIGTERM) 11:27:13.094807 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31923): Terminating (SIGTERM) 11:27:13.137740 run iperf3-srv_10.42.42.10(pid=31924): Terminating (SIGTERM) 11:27:13.180116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31925): Terminating (SIGTERM) 11:27:13.223488 run iperf3-srv_10.42.42.10(pid=31926): Terminating (SIGTERM) 11:27:13.265865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31927): Terminating (SIGTERM) 11:27:13.308526 run iperf3-srv_10.42.42.10(pid=31928): Terminating (SIGTERM) 11:27:13.351655 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31931): Terminating (SIGTERM) 11:27:13.394616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31934): Terminating (SIGTERM) 11:27:13.437429 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31937): Terminating (SIGTERM) 11:27:13.481060 --- ParallelTerminationStrategy: PID 31921 died... 11:27:13.501735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31921): Terminated: ok {rc=0} 11:27:13.549413 --- ParallelTerminationStrategy: PID 31922 died... 11:27:13.569358 run iperf3-srv_10.42.42.10(pid=31922): Terminated {rc=256} 11:27:13.617165 --- ParallelTerminationStrategy: PID 31923 died... 11:27:13.637147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31923): Terminated: ok {rc=0} 11:27:13.684905 --- ParallelTerminationStrategy: PID 31924 died... 11:27:13.704906 run iperf3-srv_10.42.42.10(pid=31924): Terminated {rc=256} 11:27:13.752464 --- ParallelTerminationStrategy: PID 31925 died... 11:27:13.772428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31925): Terminated: ok {rc=0} 11:27:13.819933 --- ParallelTerminationStrategy: PID 31926 died... 11:27:13.839635 run iperf3-srv_10.42.42.10(pid=31926): Terminated {rc=256} 11:27:13.886875 --- ParallelTerminationStrategy: PID 31927 died... 11:27:13.906828 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=31927): Terminated: ok {rc=0} 11:27:13.954274 --- ParallelTerminationStrategy: PID 31928 died... 11:27:13.974327 run iperf3-srv_10.42.42.10(pid=31928): Terminated {rc=256} 11:27:14.021595 --- ParallelTerminationStrategy: PID 31931 died... 11:27:14.041713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31931): Terminated: ok {rc=0} 11:27:14.089204 --- ParallelTerminationStrategy: PID 31934 died... 11:27:14.109137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31934): Terminated: ok {rc=0} 11:27:14.156414 --- ParallelTerminationStrategy: PID 31937 died... 11:27:14.176329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31937): Terminated: ok {rc=0} 11:27:14.266482 bus /gobi_4: Setting Powered False 11:27:15.366484 bus /gobi_4: Setting Powered False 11:27:16.483859 bus /gobi_1: Setting Powered False 11:27:17.587973 bus /gobi_1: Setting Powered False 11:27:18.707248 bus /gobi_0: Setting Powered False 11:27:19.808207 bus /gobi_0: Setting Powered False 11:27:20.926232 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 11:27:22.030575 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:22.042995 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:27:22.107514 tst ping.py: using LAC 21141 11:27:22.236618 tst ping.py: using RAC 231 11:27:22.364251 tst ping.py: using CellId 21141 11:27:22.492374 tst ping.py: using BVCI 21142 11:27:22.612049 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:22.623638 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:22.634899 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:22.646389 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:22.657812 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:22.669239 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:22.681368 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:22.692639 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:27:22.811325 tst ping.py:19: start network... 11:27:23.017800 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:27:23.490674 run create_hlr_db(pid=31939): Launched 11:27:23.617287 bus /gobi_6: Setting Powered False 11:27:24.678859 run create_hlr_db(pid=31939): Terminated: ok {rc=0} 11:27:25.129541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31941): Launched 11:27:25.459896 run osmo-hlr_10.42.42.2(pid=31942): Launched 11:27:25.586162 run osmo-stp_10.42.42.5: Starting osmo-stp 11:27:26.154364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31944): Launched 11:27:26.484042 run osmo-stp_10.42.42.5(pid=31945): Launched 11:27:26.609271 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:27:27.176372 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31947): Launched 11:27:27.301788 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:27:27.578918 run patchelf(pid=31948): Launched 11:27:27.764124 run osmo-stp_10.42.42.5(pid=31945): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31945)] 11:27:27.903884 run osmo-stp_10.42.42.5(pid=31945): stdout: | (launched: 2022-12-09_11:27:26.423934) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:28.044482 run osmo-stp_10.42.42.5(pid=31945): stderr: | 20221209112726618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112726618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112726618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112726619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112726619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112726619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112726619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:28.184651 run osmo-stp_10.42.42.5(pid=31945): stdout: | (launched: 2022-12-09_11:27:26.423934) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:28.319590 run osmo-stp_10.42.42.5(pid=31945): stderr: | 20221209112726618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112726618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112726618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112726619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112726619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112726619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112726619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:28.479566 run patchelf(pid=31948): Terminating (SIGINT) 11:27:28.665175 run patchelf(pid=31948): Terminated: ok {rc=0} 11:27:28.799446 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=31945): Process ended prematurely: osmo-stp_10.42.42.5(pid=31945) [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31945)] [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 11:27:28.809191 tst ping.py:22: Test FAILED (6.8 sec) 11:27:28.839002 run osmo-hlr_10.42.42.2(pid=31942): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31942)] 11:27:28.890759 run osmo-hlr_10.42.42.2(pid=31942): stdout: | (launched: 2022-12-09_11:27:25.399781) 11:27:28.943907 run osmo-hlr_10.42.42.2(pid=31942): stderr: | 20221209112725598 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112725598 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112725598 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112725598 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112725598 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112725598 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112725610 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112725618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112725618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112725618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:27:28.997437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31941): Terminating (SIGTERM) 11:27:29.040406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31944): Terminating (SIGTERM) 11:27:29.083280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31947): Terminating (SIGTERM) 11:27:29.126380 --- ParallelTerminationStrategy: PID 31941 died... 11:27:29.146705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31941): Terminated: ok {rc=0} 11:27:29.194700 --- ParallelTerminationStrategy: PID 31944 died... 11:27:29.214678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31944): Terminated: ok {rc=0} 11:27:29.261945 --- ParallelTerminationStrategy: PID 31947 died... 11:27:29.281690 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31947): Terminated: ok {rc=0} 11:27:29.370702 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 11:27:30.459866 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:30.471555 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:27:30.529523 tst ping_idle_ping.py: using LAC 21142 11:27:30.649720 tst ping_idle_ping.py: using RAC 232 11:27:30.770271 tst ping_idle_ping.py: using CellId 21142 11:27:30.930568 tst ping_idle_ping.py: using BVCI 21143 11:27:31.063296 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:31.076071 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:31.089850 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:31.102408 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:31.116746 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:31.130909 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:31.145287 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:27:31.158449 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:27:31.286393 tst ping_idle_ping.py:24: start network... 11:27:31.516554 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:27:32.040859 run create_hlr_db(pid=31949): Launched 11:27:32.184385 bus /gobi_6: Setting Powered False 11:27:33.249600 run create_hlr_db(pid=31949): Terminated: ok {rc=0} 11:27:33.690638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31951): Launched 11:27:33.998971 run osmo-hlr_10.42.42.2(pid=31952): Launched 11:27:34.115492 run osmo-stp_10.42.42.5: Starting osmo-stp 11:27:34.656339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31954): Launched 11:27:34.964603 run osmo-stp_10.42.42.5(pid=31955): Launched 11:27:35.081924 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:27:35.614286 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31957): Launched 11:27:35.734532 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:27:35.996008 run patchelf(pid=31962): Launched 11:27:36.168103 run osmo-stp_10.42.42.5(pid=31955): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31955)] 11:27:36.298914 run osmo-stp_10.42.42.5(pid=31955): stdout: | (launched: 2022-12-09_11:27:34.907650) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:36.430752 run osmo-stp_10.42.42.5(pid=31955): stderr: | 20221209112735079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112735079 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112735079 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112735080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112735080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112735080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112735080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:36.563743 run osmo-stp_10.42.42.5(pid=31955): stdout: | (launched: 2022-12-09_11:27:34.907650) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:36.689965 run osmo-stp_10.42.42.5(pid=31955): stderr: | 20221209112735079 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112735079 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112735079 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112735080 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112735080 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112735080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112735080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:36.839326 run patchelf(pid=31962): Terminating (SIGINT) 11:27:37.014052 run patchelf(pid=31962): Terminated: ok {rc=0} 11:27:37.139945 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=31955): Process ended prematurely: osmo-stp_10.42.42.5(pid=31955) [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31955)] [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 11:27:37.149049 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 11:27:37.176222 run osmo-hlr_10.42.42.2(pid=31952): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31952)] 11:27:37.224649 run osmo-hlr_10.42.42.2(pid=31952): stdout: | (launched: 2022-12-09_11:27:33.942251) 11:27:37.275032 run osmo-hlr_10.42.42.2(pid=31952): stderr: | 20221209112734119 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112734119 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112734119 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112734119 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112734119 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112734119 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112734131 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112734140 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112734141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112734141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:27:37.326020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31951): Terminating (SIGTERM) 11:27:37.366598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31954): Terminating (SIGTERM) 11:27:37.407158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31957): Terminating (SIGTERM) 11:27:37.447828 --- ParallelTerminationStrategy: PID 31951 died... 11:27:37.467222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31951): Terminated: ok {rc=0} 11:27:37.511918 --- ParallelTerminationStrategy: PID 31954 died... 11:27:37.530939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31954): Terminated: ok {rc=0} 11:27:37.575682 --- ParallelTerminationStrategy: PID 31957 died... 11:27:37.594831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31957): Terminated: ok {rc=0} 11:27:37.682095 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:27:38.976295 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:27:38.985250 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:27:39.007692 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 11:27:39.043853 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:27:39.098739 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:27:39.120587 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 11:27:39.154862 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:27:39.716764 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2359 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 11:27:39.722826 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:27:39.734832 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:27:39.795414 tst switch_tch_pdch.py: using LAC 21143 11:27:39.926417 tst switch_tch_pdch.py: using RAC 233 11:27:40.054801 tst switch_tch_pdch.py: using CellId 21143 11:27:40.185173 tst switch_tch_pdch.py: using BVCI 21144 11:27:40.304268 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:27:40.316190 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:27:40.327795 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:27:40.340547 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:27:40.352230 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:27:40.364277 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:27:40.376241 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:27:40.388094 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:27:40.507425 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:27:40.632293 tst switch_tch_pdch.py:51: start network... 11:27:40.854761 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:27:41.361276 run create_hlr_db(pid=31966): Launched 11:27:41.485647 bus /gobi_6: Setting Powered False 11:27:42.550972 run create_hlr_db(pid=31966): Terminated: ok {rc=0} 11:27:43.008887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31968): Launched 11:27:43.338100 run osmo-hlr_10.42.42.2(pid=31969): Launched 11:27:43.465023 run osmo-stp_10.42.42.5: Starting osmo-stp 11:27:44.031759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31971): Launched 11:27:44.360837 run osmo-stp_10.42.42.5(pid=31972): Launched 11:27:44.486521 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:27:45.054020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31974): Launched 11:27:45.180043 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:27:45.457545 run patchelf(pid=31975): Launched 11:27:45.641804 run osmo-stp_10.42.42.5(pid=31972): ERR: Terminated: ERROR {rc=1} [trial-2359↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31972)] 11:27:45.782954 run osmo-stp_10.42.42.5(pid=31972): stdout: | (launched: 2022-12-09_11:27:44.301077) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:45.932743 run osmo-stp_10.42.42.5(pid=31972): stderr: | 20221209112744493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112744493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112744493 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112744493 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112744494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112744494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112744494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:46.077262 run osmo-stp_10.42.42.5(pid=31972): stdout: | (launched: 2022-12-09_11:27:44.301077) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:46.216202 run osmo-stp_10.42.42.5(pid=31972): stderr: | 20221209112744493 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112744493 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112744493 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112744493 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112744494 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112744494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112744494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:46.380892 run patchelf(pid=31975): Terminating (SIGINT) 11:27:46.594022 run patchelf(pid=31975): Terminated: ok {rc=0} 11:27:46.743966 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31972): Process ended prematurely: osmo-stp_10.42.42.5(pid=31972) [trial-2359↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31972)] [trial-2359↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 11:27:46.755199 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 11:27:46.788284 run osmo-hlr_10.42.42.2(pid=31969): ERR: Terminated: ERROR {rc=237} [trial-2359↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31969)] 11:27:46.842768 run osmo-hlr_10.42.42.2(pid=31969): stdout: | (launched: 2022-12-09_11:27:43.278127) 11:27:46.898662 run osmo-hlr_10.42.42.2(pid=31969): stderr: | 20221209112743476 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112743476 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112743476 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112743476 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112743476 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112743476 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112743490 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112743498 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112743498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112743498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:27:46.955194 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31968): Terminating (SIGTERM) 11:27:47.000585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31971): Terminating (SIGTERM) 11:27:47.043047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31974): Terminating (SIGTERM) 11:27:47.087254 --- ParallelTerminationStrategy: PID 31968 died... 11:27:47.108577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31968): Terminated: ok {rc=0} 11:27:47.157155 --- ParallelTerminationStrategy: PID 31971 died... 11:27:47.176766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31971): Terminated: ok {rc=0} 11:27:47.222653 --- ParallelTerminationStrategy: PID 31974 died... 11:27:47.242301 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31974): Terminated: ok {rc=0} 11:27:47.330544 bus /gobi_0: Setting Powered False 11:27:48.430836 bus /gobi_0: Setting Powered False 11:27:49.547687 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 11:27:50.785910 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:27:50.792179 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 11:27:50.813228 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 11:27:50.848248 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 11:27:50.901294 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 11:27:50.921911 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 11:27:50.955985 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 11:27:51.515474 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2359 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 11:27:51.523012 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:27:51.535321 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 11:27:51.594413 tst switch_tch_pdch.py: using LAC 21144 11:27:51.721937 tst switch_tch_pdch.py: using RAC 234 11:27:51.849308 tst switch_tch_pdch.py: using CellId 21144 11:27:51.999925 tst switch_tch_pdch.py: using BVCI 21145 11:27:52.121097 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:27:52.132491 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:27:52.143752 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:27:52.155215 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:27:52.166624 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:27:52.178011 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:27:52.189674 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:27:52.201122 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:27:52.319854 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:27:52.441769 tst switch_tch_pdch.py:51: start network... 11:27:52.664460 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:27:53.144925 run create_hlr_db(pid=31979): Launched 11:27:53.270360 bus /gobi_6: Setting Powered False 11:27:54.335842 run create_hlr_db(pid=31979): Terminated: ok {rc=0} 11:27:54.767692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31981): Launched 11:27:55.098375 run osmo-hlr_10.42.42.2(pid=31982): Launched 11:27:55.225316 run osmo-stp_10.42.42.5: Starting osmo-stp 11:27:55.762619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31984): Launched 11:27:56.093197 run osmo-stp_10.42.42.5(pid=31985): Launched 11:27:56.219760 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:27:56.759773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31987): Launched 11:27:56.887719 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:27:57.165882 run patchelf(pid=31988): Launched 11:27:57.348927 run osmo-stp_10.42.42.5(pid=31985): ERR: Terminated: ERROR {rc=1} [trial-2359↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31985)] 11:27:57.488570 run osmo-stp_10.42.42.5(pid=31985): stdout: | (launched: 2022-12-09_11:27:56.032912) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:57.629843 run osmo-stp_10.42.42.5(pid=31985): stderr: | 20221209112756225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112756226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112756226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112756226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112756227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112756227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112756227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:57.771644 run osmo-stp_10.42.42.5(pid=31985): stdout: | (launched: 2022-12-09_11:27:56.032912) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:27:57.906639 run osmo-stp_10.42.42.5(pid=31985): stderr: | 20221209112756225 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112756226 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112756226 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112756226 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112756227 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112756227 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112756227 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:27:58.066584 run patchelf(pid=31988): Terminating (SIGINT) 11:27:58.252469 run patchelf(pid=31988): Terminated: ok {rc=0} 11:27:58.386760 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=31985): Process ended prematurely: osmo-stp_10.42.42.5(pid=31985) [trial-2359↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31985)] [trial-2359↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 11:27:58.396539 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 11:27:58.425693 run osmo-hlr_10.42.42.2(pid=31982): ERR: Terminated: ERROR {rc=237} [trial-2359↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=31982)] 11:27:58.476887 run osmo-hlr_10.42.42.2(pid=31982): stdout: | (launched: 2022-12-09_11:27:55.038146) 11:27:58.530114 run osmo-hlr_10.42.42.2(pid=31982): stderr: | 20221209112755236 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112755236 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112755236 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112755236 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112755236 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112755237 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112755249 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112755258 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112755258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112755258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:27:58.583555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31981): Terminating (SIGTERM) 11:27:58.626427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31984): Terminating (SIGTERM) 11:27:58.669289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31987): Terminating (SIGTERM) 11:27:58.713051 --- ParallelTerminationStrategy: PID 31981 died... 11:27:58.733487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31981): Terminated: ok {rc=0} 11:27:58.781772 --- ParallelTerminationStrategy: PID 31984 died... 11:27:58.801874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=31984): Terminated: ok {rc=0} 11:27:58.850116 --- ParallelTerminationStrategy: PID 31987 died... 11:27:58.870276 run pcap-recorder_any(filters='host 10.42.42.6')(pid=31987): Terminated: ok {rc=0} 11:27:58.961157 bus /gobi_0: Setting Powered False 11:28:00.061330 bus /gobi_0: Setting Powered False 11:28:01.184072 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 nitb_sms:oc2g --------------------------------------------------------------------- 11:28:02.433795 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:28:02.437443 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 11:28:02.457822 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 11:28:02.464703 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 11:28:02.517060 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 11:28:02.538511 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 11:28:02.546000 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 11:28:03.081349 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 11:28:03.086497 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 11:28:03.097470 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 11:28:03.131871 tst mo_mt_sms.py: using LAC 21145 11:28:03.253159 tst mo_mt_sms.py: using RAC 235 11:28:03.375296 tst mo_mt_sms.py: using CellId 21145 11:28:03.498742 tst mo_mt_sms.py: using BVCI 21146 11:28:03.611989 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 11:28:03.732840 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 11:28:03.856523 tst mo_mt_sms.py:9: start nitb and bts... 11:28:04.079479 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:28:04.749830 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31992): Launched 11:28:05.081502 run osmo-nitb_10.42.42.2(pid=31993): Launched 11:28:05.264055 run osmo-nitb_10.42.42.2(pid=31993): ERR: Terminated: ERROR {rc=2} [trial-2359↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31993)] 11:28:05.412195 run osmo-nitb_10.42.42.2(pid=31993): stdout: | (launched: 2022-12-09_11:28:05.021232) 11:28:05.562205 run osmo-nitb_10.42.42.2(pid=31993): stderr: | (launched: 2022-12-09_11:28:05.070236) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:28:05.712206 run osmo-nitb_10.42.42.2(pid=31993): stdout: | (launched: 2022-12-09_11:28:05.021232) 11:28:05.855934 run osmo-nitb_10.42.42.2(pid=31993): stderr: | (launched: 2022-12-09_11:28:05.070236) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=31993): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31993) [trial-2359↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31993)] 11:28:06.205843 tst osmo-nitb_10.42.42.2(pid=31993): stdout: | (launched: 2022-12-09_11:28:05.021232) 11:28:06.338252 tst osmo-nitb_10.42.42.2(pid=31993): stderr: | (launched: 2022-12-09_11:28:05.070236) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:28:06.495304 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=31993): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31993) [trial-2359↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31993)] [trial-2359↪nitb_sms:oc2g↪mo_mt_sms.py:11] 11:28:06.504401 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 11:28:06.511358 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31992): Terminating (SIGTERM) 11:28:06.723232 --- ParallelTerminationStrategy: PID 31992 died... 11:28:06.745335 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=31992): Terminated: ok {rc=0} 11:28:06.834961 bus /sierra_3: Setting Powered False 11:28:07.934710 bus /sierra_3: Setting Powered False 11:28:09.051971 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 sms:oc2g --------------------------------------------------------------------- 11:28:10.236890 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:28:10.240795 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 11:28:10.261254 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 11:28:10.287830 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 11:28:10.339308 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 11:28:10.360009 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 11:28:10.386640 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 11:28:10.932302 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 sms:oc2g mo_mt_sms.py ---------------------------------------------- 11:28:10.937253 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:28:10.947666 tst sms:oc2g: Using 1 x bts (candidates: 1) 11:28:10.981470 tst mo_mt_sms.py: using LAC 21146 11:28:11.103877 tst mo_mt_sms.py: using RAC 236 11:28:11.225662 tst mo_mt_sms.py: using CellId 21146 11:28:11.351085 tst mo_mt_sms.py: using BVCI 21147 11:28:11.462441 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:28:11.473051 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:28:11.483464 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:28:11.493875 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:28:11.504480 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 11:28:11.514839 tst sms:oc2g: Using 1 x modem (candidates: 2) 11:28:11.634110 tst sms:oc2g: Using 1 x modem (candidates: 2) 11:28:11.752354 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:28:12.227436 run create_hlr_db(pid=31997): Launched 11:28:12.352199 bus /sierra_2: Setting Powered False 11:28:13.413815 run create_hlr_db(pid=31997): Terminated: ok {rc=0} 11:28:13.843309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31999): Launched 11:28:14.151384 run osmo-hlr_10.42.42.2(pid=32000): Launched 11:28:14.267667 run osmo-stp_10.42.42.5: Starting osmo-stp 11:28:14.795815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32002): Launched 11:28:15.106045 run osmo-stp_10.42.42.5(pid=32003): Launched 11:28:15.225552 run osmo-msc_10.42.42.6: Starting osmo-msc 11:28:15.780130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32005): Launched 11:28:16.093715 run osmo-msc_10.42.42.6(pid=32006): Launched 11:28:16.428535 run osmo-stp_10.42.42.5(pid=32003): ERR: Terminated: ERROR {rc=1} [trial-2359↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32003)] 11:28:16.697867 run osmo-stp_10.42.42.5(pid=32003): stdout: | (launched: 2022-12-09_11:28:15.048900) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:16.915520 run osmo-stp_10.42.42.5(pid=32003): stderr: | 20221209112815221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112815221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112815222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112815222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112815223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112815223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112815223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:17.076035 run osmo-stp_10.42.42.5(pid=32003): stdout: | (launched: 2022-12-09_11:28:15.048900) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:17.222061 run osmo-stp_10.42.42.5(pid=32003): stderr: | 20221209112815221 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112815221 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112815222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112815222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112815223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112815223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112815223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:17.385198 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=32003): Process ended prematurely: osmo-stp_10.42.42.5(pid=32003) [trial-2359↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32003)] [trial-2359↪sms:oc2g↪mo_mt_sms.py:16] 11:28:17.395384 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 11:28:17.426760 run osmo-hlr_10.42.42.2(pid=32000): ERR: Terminated: ERROR {rc=237} [trial-2359↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32000)] 11:28:17.480051 run osmo-hlr_10.42.42.2(pid=32000): stdout: | (launched: 2022-12-09_11:28:14.094906) 11:28:17.534058 run osmo-hlr_10.42.42.2(pid=32000): stderr: | 20221209112814269 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112814269 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112814269 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112814269 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112814269 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112814269 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112814281 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112814290 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112814291 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112814291 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:28:17.609376 run osmo-msc_10.42.42.6(pid=32006): ERR: Terminated: ERROR {rc=2} [trial-2359↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32006)] 11:28:17.661423 run osmo-msc_10.42.42.6(pid=32006): stdout: | (launched: 2022-12-09_11:28:16.033761) 11:28:17.715599 run osmo-msc_10.42.42.6(pid=32006): stderr: | 20221209112816446 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112816446 DLGLOBAL DEBUG validating counter group 0x7fa610af7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112816446 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112816446 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112816446 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112816446 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112816448 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112816449 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112816449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112816449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:28:17.769779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31999): Terminating (SIGTERM) 11:28:17.813340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32002): Terminating (SIGTERM) 11:28:17.857265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32005): Terminating (SIGTERM) 11:28:17.901521 --- ParallelTerminationStrategy: PID 31999 died... 11:28:17.922106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=31999): Terminated: ok {rc=0} 11:28:17.971473 --- ParallelTerminationStrategy: PID 32002 died... 11:28:17.991782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32002): Terminated: ok {rc=0} 11:28:18.041031 --- ParallelTerminationStrategy: PID 32005 died... 11:28:18.061330 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32005): Terminated: ok {rc=0} 11:28:18.153527 bus /sierra_3: Setting Powered False 11:28:19.253201 bus /sierra_3: Setting Powered False 11:28:20.373188 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 nitb_ussd:oc2g --------------------------------------------------------------------- 11:28:21.590998 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:28:21.595215 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 11:28:21.616819 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 11:28:21.624211 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 11:28:21.661661 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 11:28:21.683286 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 11:28:21.690707 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 11:28:22.209807 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2359 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 11:28:22.214944 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 11:28:22.226210 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 11:28:22.262585 tst assert_extension.py: using LAC 21147 11:28:22.393493 tst assert_extension.py: using RAC 237 11:28:22.515392 tst assert_extension.py: using CellId 21147 11:28:22.646373 tst assert_extension.py: using BVCI 21148 11:28:22.767078 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 11:28:22.886227 tst assert_extension.py:10: start nitb and bts... 11:28:23.093901 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:28:23.720696 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32011): Launched 11:28:24.029471 run osmo-nitb_10.42.42.2(pid=32012): Launched 11:28:24.200235 run osmo-nitb_10.42.42.2(pid=32012): ERR: Terminated: ERROR {rc=2} [trial-2359↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32012)] 11:28:24.339159 run osmo-nitb_10.42.42.2(pid=32012): stdout: | (launched: 2022-12-09_11:28:23.973055) 11:28:24.479925 run osmo-nitb_10.42.42.2(pid=32012): stderr: | (launched: 2022-12-09_11:28:24.018452) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:28:24.620491 run osmo-nitb_10.42.42.2(pid=32012): stdout: | (launched: 2022-12-09_11:28:23.973055) 11:28:24.754984 run osmo-nitb_10.42.42.2(pid=32012): stderr: | (launched: 2022-12-09_11:28:24.018452) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=32012): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32012) [trial-2359↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32012)] 11:28:25.145039 tst osmo-nitb_10.42.42.2(pid=32012): stdout: | (launched: 2022-12-09_11:28:23.973055) 11:28:25.269766 tst osmo-nitb_10.42.42.2(pid=32012): stderr: | (launched: 2022-12-09_11:28:24.018452) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:28:25.416313 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=32012): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32012) [trial-2359↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32012)] [trial-2359↪nitb_ussd:oc2g↪assert_extension.py:12] 11:28:25.424748 tst assert_extension.py:12: Test FAILED (3.2 sec) 11:28:25.431378 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32011): Terminating (SIGTERM) 11:28:25.642087 --- ParallelTerminationStrategy: PID 32011 died... 11:28:25.663375 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=32011): Terminated: ok {rc=0} 11:28:25.751590 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 ussd:oc2g --------------------------------------------------------------------- 11:28:26.919429 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:28:26.923565 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 11:28:26.944590 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 11:28:26.971037 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 11:28:27.006903 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 11:28:27.028684 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 11:28:27.056834 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 11:28:27.581777 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2359 ussd:oc2g assert_extension.py ---------------------------------------------- 11:28:27.586611 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:28:27.597242 tst ussd:oc2g: Using 1 x bts (candidates: 1) 11:28:27.631342 tst assert_extension.py: using LAC 21148 11:28:27.761251 tst assert_extension.py: using RAC 238 11:28:27.888803 tst assert_extension.py: using CellId 21148 11:28:28.016378 tst assert_extension.py: using BVCI 21149 11:28:28.135707 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:28:28.146925 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:28:28.158017 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:28:28.169161 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:28:28.180283 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 11:28:28.191437 tst ussd:oc2g: Using 1 x modem (candidates: 1) 11:28:28.307587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:28:28.782879 run create_hlr_db(pid=32016): Launched 11:28:28.909862 bus /sierra_2: Setting Powered False 11:28:29.971118 run create_hlr_db(pid=32016): Terminated: ok {rc=0} 11:28:30.422030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32018): Launched 11:28:30.752637 run osmo-hlr_10.42.42.2(pid=32019): Launched 11:28:30.892100 run osmo-stp_10.42.42.5: Starting osmo-stp 11:28:31.585603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32021): Launched 11:28:31.931378 run osmo-stp_10.42.42.5(pid=32022): Launched 11:28:32.208885 run osmo-msc_10.42.42.6: Starting osmo-msc 11:28:32.943158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32024): Launched 11:28:33.273439 run osmo-msc_10.42.42.6(pid=32025): Launched 11:28:33.459703 run osmo-stp_10.42.42.5(pid=32022): ERR: Terminated: ERROR {rc=1} [trial-2359↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32022)] 11:28:33.600279 run osmo-stp_10.42.42.5(pid=32022): stdout: | (launched: 2022-12-09_11:28:31.870246) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:33.740479 run osmo-stp_10.42.42.5(pid=32022): stderr: | 20221209112832222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112832224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112832225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112832228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112832231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112832231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112832231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:33.879618 run osmo-stp_10.42.42.5(pid=32022): stdout: | (launched: 2022-12-09_11:28:31.870246) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:34.011667 run osmo-stp_10.42.42.5(pid=32022): stderr: | 20221209112832222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112832224 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112832225 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112832228 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112832231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112832231 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112832231 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:34.169864 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=32022): Process ended prematurely: osmo-stp_10.42.42.5(pid=32022) [trial-2359↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32022)] [trial-2359↪ussd:oc2g↪assert_extension.py:17] 11:28:34.179039 tst assert_extension.py:17: Test FAILED (6.6 sec) 11:28:34.207939 run osmo-hlr_10.42.42.2(pid=32019): ERR: Terminated: ERROR {rc=237} [trial-2359↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32019)] 11:28:34.259799 run osmo-hlr_10.42.42.2(pid=32019): stdout: | (launched: 2022-12-09_11:28:30.691674) 11:28:34.313361 run osmo-hlr_10.42.42.2(pid=32019): stderr: | 20221209112830986 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112830986 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112830986 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112830986 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112830986 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112830986 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112831007 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112831024 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112831024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112831024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:28:34.387121 run osmo-msc_10.42.42.6(pid=32025): ERR: Terminated: ERROR {rc=2} [trial-2359↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32025)] 11:28:34.438799 run osmo-msc_10.42.42.6(pid=32025): stdout: | (launched: 2022-12-09_11:28:33.212844) 11:28:34.491823 run osmo-msc_10.42.42.6(pid=32025): stderr: | 20221209112833535 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112833536 DLGLOBAL DEBUG validating counter group 0x7fe14fed8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112833536 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112833536 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112833536 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112833536 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112833538 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112833538 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112833539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112833539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:28:34.545594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32018): Terminating (SIGTERM) 11:28:34.588355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32021): Terminating (SIGTERM) 11:28:34.631705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32024): Terminating (SIGTERM) 11:28:34.675068 --- ParallelTerminationStrategy: PID 32018 died... 11:28:34.695373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32018): Terminated: ok {rc=0} 11:28:34.744062 --- ParallelTerminationStrategy: PID 32021 died... 11:28:34.764127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32021): Terminated: ok {rc=0} 11:28:34.812717 --- ParallelTerminationStrategy: PID 32024 died... 11:28:34.832674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32024): Terminated: ok {rc=0} 11:28:34.923198 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 11:28:36.125231 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:28:36.132480 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 11:28:36.156077 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 11:28:36.184371 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 11:28:36.236641 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 11:28:36.258047 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 11:28:36.286932 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 11:28:36.839195 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 11:28:36.894493 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:36.906014 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:28:36.971864 tst mo_mt_call.py: using LAC 21149 11:28:37.104176 tst mo_mt_call.py: using RAC 239 11:28:37.235488 tst mo_mt_call.py: using CellId 21149 11:28:37.365352 tst mo_mt_call.py: using BVCI 21150 11:28:37.488827 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:37.501148 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:37.512484 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:37.524758 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:37.537156 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:37.549382 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:28:37.673160 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:28:37.795101 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:28:38.282316 run create_hlr_db(pid=32030): Launched 11:28:38.413599 bus /sierra_2: Setting Powered False 11:28:39.475702 run create_hlr_db(pid=32030): Terminated: ok {rc=0} 11:28:39.933221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32032): Launched 11:28:40.269244 run osmo-hlr_10.42.42.2(pid=32033): Launched 11:28:40.397142 run osmo-stp_10.42.42.5: Starting osmo-stp 11:28:40.980009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32035): Launched 11:28:41.316720 run osmo-stp_10.42.42.5(pid=32036): Launched 11:28:41.444389 run osmo-msc_10.42.42.6: Starting osmo-msc 11:28:42.050958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32038): Launched 11:28:42.386438 run osmo-msc_10.42.42.6(pid=32039): Launched 11:28:42.572512 run osmo-stp_10.42.42.5(pid=32036): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32036)] 11:28:42.715071 run osmo-stp_10.42.42.5(pid=32036): stdout: | (launched: 2022-12-09_11:28:41.254194) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:42.856798 run osmo-stp_10.42.42.5(pid=32036): stderr: | 20221209112841447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112841447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112841448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112841448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112841449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112841449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112841449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:42.996868 run osmo-stp_10.42.42.5(pid=32036): stdout: | (launched: 2022-12-09_11:28:41.254194) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:43.130048 run osmo-stp_10.42.42.5(pid=32036): stderr: | 20221209112841447 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112841447 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112841448 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112841448 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112841449 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112841449 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112841449 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:43.289911 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32036): Process ended prematurely: osmo-stp_10.42.42.5(pid=32036) [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32036)] [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 11:28:43.299666 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:28:43.328628 run osmo-hlr_10.42.42.2(pid=32033): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32033)] 11:28:43.379741 run osmo-hlr_10.42.42.2(pid=32033): stdout: | (launched: 2022-12-09_11:28:40.207954) 11:28:43.432489 run osmo-hlr_10.42.42.2(pid=32033): stderr: | 20221209112840407 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112840407 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112840408 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112840408 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112840408 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112840408 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112840424 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112840434 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112840434 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112840434 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:28:43.505639 run osmo-msc_10.42.42.6(pid=32039): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32039)] 11:28:43.556567 run osmo-msc_10.42.42.6(pid=32039): stdout: | (launched: 2022-12-09_11:28:42.324727) 11:28:43.609074 run osmo-msc_10.42.42.6(pid=32039): stderr: | 20221209112842647 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112842647 DLGLOBAL DEBUG validating counter group 0x7f1a4a1cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112842647 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112842647 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112842647 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112842647 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112842649 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112842650 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112842650 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112842650 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:28:43.662265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32032): Terminating (SIGTERM) 11:28:43.705073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32035): Terminating (SIGTERM) 11:28:43.748151 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32038): Terminating (SIGTERM) 11:28:43.791917 --- ParallelTerminationStrategy: PID 32032 died... 11:28:43.812359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32032): Terminated: ok {rc=0} 11:28:43.860055 --- ParallelTerminationStrategy: PID 32035 died... 11:28:43.879974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32035): Terminated: ok {rc=0} 11:28:43.927430 --- ParallelTerminationStrategy: PID 32038 died... 11:28:43.947514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32038): Terminated: ok {rc=0} 11:28:44.036898 bus /sierra_3: Setting Powered False 11:28:45.136073 bus /sierra_3: Setting Powered False 11:28:46.250995 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 11:28:47.394970 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:47.407093 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:28:47.464738 tst mo_mt_call_osmux.py: using LAC 21150 11:28:47.590117 tst mo_mt_call_osmux.py: using RAC 240 11:28:47.713745 tst mo_mt_call_osmux.py: using CellId 21150 11:28:47.837143 tst mo_mt_call_osmux.py: using BVCI 21151 11:28:47.952335 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:47.963583 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:47.974560 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:47.985406 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:47.996238 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:28:48.007146 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:28:48.126129 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:28:48.246200 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:28:48.729557 run create_hlr_db(pid=32041): Launched 11:28:48.858050 bus /sierra_2: Setting Powered False 11:28:49.919958 run create_hlr_db(pid=32041): Terminated: ok {rc=0} 11:28:50.355523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32043): Launched 11:28:50.668762 run osmo-hlr_10.42.42.2(pid=32044): Launched 11:28:50.788011 run osmo-stp_10.42.42.5: Starting osmo-stp 11:28:51.328536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32046): Launched 11:28:51.641731 run osmo-stp_10.42.42.5(pid=32047): Launched 11:28:51.760881 run osmo-msc_10.42.42.6: Starting osmo-msc 11:28:52.326198 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32049): Launched 11:28:52.641562 run osmo-msc_10.42.42.6(pid=32050): Launched 11:28:52.817489 run osmo-stp_10.42.42.5(pid=32047): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32047)] 11:28:52.950089 run osmo-stp_10.42.42.5(pid=32047): stdout: | (launched: 2022-12-09_11:28:51.584077) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:53.083042 run osmo-stp_10.42.42.5(pid=32047): stderr: | 20221209112851758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112851758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112851758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112851759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112851759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112851759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112851759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:53.214585 run osmo-stp_10.42.42.5(pid=32047): stdout: | (launched: 2022-12-09_11:28:51.584077) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:28:53.339297 run osmo-stp_10.42.42.5(pid=32047): stderr: | 20221209112851758 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112851758 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112851758 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112851759 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112851759 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112851759 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112851759 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:28:53.488572 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32047): Process ended prematurely: osmo-stp_10.42.42.5(pid=32047) [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32047)] [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 11:28:53.497628 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 11:28:53.524196 run osmo-hlr_10.42.42.2(pid=32044): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32044)] 11:28:53.572510 run osmo-hlr_10.42.42.2(pid=32044): stdout: | (launched: 2022-12-09_11:28:50.611037) 11:28:53.622497 run osmo-hlr_10.42.42.2(pid=32044): stderr: | 20221209112850791 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112850791 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112850791 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112850791 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112850791 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112850791 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112850804 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112850813 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112850813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112850813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:28:53.691825 run osmo-msc_10.42.42.6(pid=32050): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32050)] 11:28:53.739831 run osmo-msc_10.42.42.6(pid=32050): stdout: | (launched: 2022-12-09_11:28:52.583963) 11:28:53.789428 run osmo-msc_10.42.42.6(pid=32050): stderr: | 20221209112852858 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112852859 DLGLOBAL DEBUG validating counter group 0x7f98ed22bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112852859 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112852859 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112852859 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112852859 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112852861 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112852861 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112852862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112852862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:28:53.839607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32043): Terminating (SIGTERM) 11:28:53.879692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32046): Terminating (SIGTERM) 11:28:53.919780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32049): Terminating (SIGTERM) 11:28:53.960105 --- ParallelTerminationStrategy: PID 32043 died... 11:28:53.979485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32043): Terminated: ok {rc=0} 11:28:54.024633 --- ParallelTerminationStrategy: PID 32046 died... 11:28:54.043759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32046): Terminated: ok {rc=0} 11:28:54.089210 --- ParallelTerminationStrategy: PID 32049 died... 11:28:54.108207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32049): Terminated: ok {rc=0} 11:28:54.196330 bus /sierra_3: Setting Powered False 11:28:55.296473 bus /sierra_3: Setting Powered False 11:28:56.413344 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 11:28:57.652709 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:28:57.659923 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 11:28:57.681901 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 11:28:57.709578 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 11:28:57.763927 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 11:28:57.785139 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 11:28:57.813170 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 11:28:58.364914 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 11:28:58.420073 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:28:58.431891 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:28:58.489836 tst mo_mt_call.py: using LAC 21151 11:28:58.619812 tst mo_mt_call.py: using RAC 241 11:28:58.742808 tst mo_mt_call.py: using CellId 21151 11:28:58.866059 tst mo_mt_call.py: using BVCI 21152 11:28:58.979308 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:28:58.990775 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:28:59.001999 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:28:59.012939 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:28:59.023880 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:28:59.034862 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:28:59.156339 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:28:59.278737 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:28:59.800491 run create_hlr_db(pid=32055): Launched 11:28:59.928782 bus /sierra_2: Setting Powered False 11:29:00.995390 run create_hlr_db(pid=32055): Terminated: ok {rc=0} 11:29:01.536231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32057): Launched 11:29:01.889493 run osmo-hlr_10.42.42.2(pid=32058): Launched 11:29:02.163312 run osmo-stp_10.42.42.5: Starting osmo-stp 11:29:02.794614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32060): Launched 11:29:03.130658 run osmo-stp_10.42.42.5(pid=32061): Launched 11:29:03.260212 run osmo-msc_10.42.42.6: Starting osmo-msc 11:29:03.865809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32063): Launched 11:29:04.201535 run osmo-msc_10.42.42.6(pid=32064): Launched 11:29:04.390797 run osmo-stp_10.42.42.5(pid=32061): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32061)] 11:29:04.532852 run osmo-stp_10.42.42.5(pid=32061): stdout: | (launched: 2022-12-09_11:29:03.069581) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:04.675620 run osmo-stp_10.42.42.5(pid=32061): stderr: | 20221209112903263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112903263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112903263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112903264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112903264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112903264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112903264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:04.816760 run osmo-stp_10.42.42.5(pid=32061): stdout: | (launched: 2022-12-09_11:29:03.069581) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:04.950615 run osmo-stp_10.42.42.5(pid=32061): stderr: | 20221209112903263 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112903263 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112903263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112903264 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112903264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112903264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112903264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:05.110886 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32061): Process ended prematurely: osmo-stp_10.42.42.5(pid=32061) [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32061)] [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 11:29:05.120400 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 11:29:05.149173 run osmo-hlr_10.42.42.2(pid=32058): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32058)] 11:29:05.200819 run osmo-hlr_10.42.42.2(pid=32058): stdout: | (launched: 2022-12-09_11:29:01.827265) 11:29:05.254005 run osmo-hlr_10.42.42.2(pid=32058): stderr: | 20221209112902055 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112902055 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112902055 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112902055 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112902055 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112902056 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112902069 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112902083 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112902084 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112902084 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:05.327813 run osmo-msc_10.42.42.6(pid=32064): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32064)] 11:29:05.379292 run osmo-msc_10.42.42.6(pid=32064): stdout: | (launched: 2022-12-09_11:29:04.140000) 11:29:05.432307 run osmo-msc_10.42.42.6(pid=32064): stderr: | 20221209112904463 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112904463 DLGLOBAL DEBUG validating counter group 0x7fc2c4222c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112904463 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112904463 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112904463 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112904464 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112904465 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112904466 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112904466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112904466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:29:05.485678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32057): Terminating (SIGTERM) 11:29:05.528270 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32060): Terminating (SIGTERM) 11:29:05.571205 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32063): Terminating (SIGTERM) 11:29:05.614184 --- ParallelTerminationStrategy: PID 32057 died... 11:29:05.634546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32057): Terminated: ok {rc=0} 11:29:05.682171 --- ParallelTerminationStrategy: PID 32060 died... 11:29:05.701908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32060): Terminated: ok {rc=0} 11:29:05.749331 --- ParallelTerminationStrategy: PID 32063 died... 11:29:05.768942 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32063): Terminated: ok {rc=0} 11:29:05.858519 bus /sierra_3: Setting Powered False 11:29:06.955460 bus /sierra_3: Setting Powered False 11:29:08.072911 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 11:29:09.225172 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:29:09.237905 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:29:09.295762 tst mo_mt_call_osmux.py: using LAC 21152 11:29:09.428832 tst mo_mt_call_osmux.py: using RAC 242 11:29:09.561859 tst mo_mt_call_osmux.py: using CellId 21152 11:29:09.693180 tst mo_mt_call_osmux.py: using BVCI 21153 11:29:09.815821 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:29:09.827440 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:29:09.838929 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:29:09.850685 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:29:09.862204 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:29:09.873953 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:29:09.993488 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:29:10.120802 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:29:10.641987 run create_hlr_db(pid=32066): Launched 11:29:10.770147 bus /sierra_2: Setting Powered False 11:29:11.836409 run create_hlr_db(pid=32066): Terminated: ok {rc=0} 11:29:12.283496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32068): Launched 11:29:12.599527 run osmo-hlr_10.42.42.2(pid=32069): Launched 11:29:12.718020 run osmo-stp_10.42.42.5: Starting osmo-stp 11:29:13.277961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32071): Launched 11:29:13.596664 run osmo-stp_10.42.42.5(pid=32072): Launched 11:29:13.715950 run osmo-msc_10.42.42.6: Starting osmo-msc 11:29:14.280836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32074): Launched 11:29:14.594732 run osmo-msc_10.42.42.6(pid=32075): Launched 11:29:14.771098 run osmo-stp_10.42.42.5(pid=32072): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32072)] 11:29:14.902937 run osmo-stp_10.42.42.5(pid=32072): stdout: | (launched: 2022-12-09_11:29:13.538620) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:15.034862 run osmo-stp_10.42.42.5(pid=32072): stderr: | 20221209112913713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112913713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112913713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112913714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112913714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112913714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112913714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:15.164766 run osmo-stp_10.42.42.5(pid=32072): stdout: | (launched: 2022-12-09_11:29:13.538620) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:15.289352 run osmo-stp_10.42.42.5(pid=32072): stderr: | 20221209112913713 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112913713 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112913713 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112913714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112913714 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112913714 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112913714 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:15.437641 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32072): Process ended prematurely: osmo-stp_10.42.42.5(pid=32072) [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32072)] [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 11:29:15.446626 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:29:15.473483 run osmo-hlr_10.42.42.2(pid=32069): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32069)] 11:29:15.521514 run osmo-hlr_10.42.42.2(pid=32069): stdout: | (launched: 2022-12-09_11:29:12.541409) 11:29:15.571360 run osmo-hlr_10.42.42.2(pid=32069): stderr: | 20221209112912721 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112912721 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112912721 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112912721 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112912721 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112912721 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112912733 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112912741 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112912741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112912741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:15.640896 run osmo-msc_10.42.42.6(pid=32075): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32075)] 11:29:15.689196 run osmo-msc_10.42.42.6(pid=32075): stdout: | (launched: 2022-12-09_11:29:14.536835) 11:29:15.739127 run osmo-msc_10.42.42.6(pid=32075): stderr: | 20221209112914810 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112914810 DLGLOBAL DEBUG validating counter group 0x7f3c9cdbec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112914810 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112914810 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112914810 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112914811 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112914812 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112914813 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112914813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112914813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:29:15.789367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32068): Terminating (SIGTERM) 11:29:15.829917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32071): Terminating (SIGTERM) 11:29:15.878507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32074): Terminating (SIGTERM) 11:29:15.928187 --- ParallelTerminationStrategy: PID 32068 died... 11:29:15.949532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32068): Terminated: ok {rc=0} 11:29:16.001357 --- ParallelTerminationStrategy: PID 32071 died... 11:29:16.022384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32071): Terminated: ok {rc=0} 11:29:16.073310 --- ParallelTerminationStrategy: PID 32074 died... 11:29:16.094211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32074): Terminated: ok {rc=0} 11:29:16.188699 bus /sierra_3: Setting Powered False 11:29:17.296067 bus /sierra_3: Setting Powered False 11:29:18.414722 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 11:29:19.654166 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:29:19.661417 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 11:29:19.682317 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 11:29:19.708827 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 11:29:19.763272 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 11:29:19.784091 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 11:29:19.810752 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 11:29:20.359395 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 11:29:20.409429 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:20.420484 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:29:20.476667 tst mo_mt_call.py: using LAC 21153 11:29:20.600810 tst mo_mt_call.py: using RAC 243 11:29:20.724399 tst mo_mt_call.py: using CellId 21153 11:29:20.848541 tst mo_mt_call.py: using BVCI 21154 11:29:20.963857 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:20.974991 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:20.985846 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:20.996586 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:21.007525 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:21.018440 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:29:21.140599 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:29:21.260335 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:29:21.746938 run create_hlr_db(pid=32080): Launched 11:29:21.873938 bus /sierra_2: Setting Powered False 11:29:22.937085 run create_hlr_db(pid=32080): Terminated: ok {rc=0} 11:29:23.393621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32082): Launched 11:29:23.731479 run osmo-hlr_10.42.42.2(pid=32083): Launched 11:29:23.859046 run osmo-stp_10.42.42.5: Starting osmo-stp 11:29:24.435308 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32085): Launched 11:29:24.770810 run osmo-stp_10.42.42.5(pid=32086): Launched 11:29:24.898484 run osmo-msc_10.42.42.6: Starting osmo-msc 11:29:25.504182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32088): Launched 11:29:25.842291 run osmo-msc_10.42.42.6(pid=32089): Launched 11:29:26.029139 run osmo-stp_10.42.42.5(pid=32086): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32086)] 11:29:26.170767 run osmo-stp_10.42.42.5(pid=32086): stdout: | (launched: 2022-12-09_11:29:24.708732) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:26.312698 run osmo-stp_10.42.42.5(pid=32086): stderr: | 20221209112924901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112924902 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112924902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112924902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112924903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112924903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112924903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:26.452425 run osmo-stp_10.42.42.5(pid=32086): stdout: | (launched: 2022-12-09_11:29:24.708732) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:26.586038 run osmo-stp_10.42.42.5(pid=32086): stderr: | 20221209112924901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112924902 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112924902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112924902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112924903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112924903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112924903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:26.745995 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32086): Process ended prematurely: osmo-stp_10.42.42.5(pid=32086) [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32086)] [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 11:29:26.755674 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:29:26.784521 run osmo-hlr_10.42.42.2(pid=32083): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32083)] 11:29:26.835553 run osmo-hlr_10.42.42.2(pid=32083): stdout: | (launched: 2022-12-09_11:29:23.669469) 11:29:26.888644 run osmo-hlr_10.42.42.2(pid=32083): stderr: | 20221209112923869 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112923869 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112923869 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112923869 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112923869 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112923869 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112923881 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112923890 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112923890 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112923890 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:26.962552 run osmo-msc_10.42.42.6(pid=32089): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32089)] 11:29:27.013413 run osmo-msc_10.42.42.6(pid=32089): stdout: | (launched: 2022-12-09_11:29:25.780309) 11:29:27.065886 run osmo-msc_10.42.42.6(pid=32089): stderr: | 20221209112926104 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112926104 DLGLOBAL DEBUG validating counter group 0x7ffabc3f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112926104 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112926104 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112926104 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112926104 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112926106 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112926106 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112926107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112926107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:29:27.118826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32082): Terminating (SIGTERM) 11:29:27.161020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32085): Terminating (SIGTERM) 11:29:27.204277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32088): Terminating (SIGTERM) 11:29:27.247232 --- ParallelTerminationStrategy: PID 32082 died... 11:29:27.267467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32082): Terminated: ok {rc=0} 11:29:27.315177 --- ParallelTerminationStrategy: PID 32085 died... 11:29:27.335027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32085): Terminated: ok {rc=0} 11:29:27.382257 --- ParallelTerminationStrategy: PID 32088 died... 11:29:27.402079 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32088): Terminated: ok {rc=0} 11:29:27.491292 bus /sierra_3: Setting Powered False 11:29:28.591596 bus /sierra_3: Setting Powered False 11:29:29.708281 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 11:29:30.881086 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:30.894225 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:29:30.955833 tst mo_mt_call_osmux.py: using LAC 21154 11:29:31.102614 tst mo_mt_call_osmux.py: using RAC 244 11:29:31.237859 tst mo_mt_call_osmux.py: using CellId 21154 11:29:31.364631 tst mo_mt_call_osmux.py: using BVCI 21155 11:29:31.532351 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:31.548607 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:31.564318 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:31.579790 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:31.595764 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:29:31.611243 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:29:31.746002 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:29:31.899536 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:29:32.488598 run create_hlr_db(pid=32092): Launched 11:29:32.616662 bus /sierra_2: Setting Powered False 11:29:33.679229 run create_hlr_db(pid=32092): Terminated: ok {rc=0} 11:29:34.137964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32094): Launched 11:29:34.474807 run osmo-hlr_10.42.42.2(pid=32095): Launched 11:29:34.604691 run osmo-stp_10.42.42.5: Starting osmo-stp 11:29:35.181331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32097): Launched 11:29:35.518655 run osmo-stp_10.42.42.5(pid=32098): Launched 11:29:35.648383 run osmo-msc_10.42.42.6: Starting osmo-msc 11:29:36.255296 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32100): Launched 11:29:36.592543 run osmo-msc_10.42.42.6(pid=32101): Launched 11:29:36.780300 run osmo-stp_10.42.42.5(pid=32098): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32098)] 11:29:36.921689 run osmo-stp_10.42.42.5(pid=32098): stdout: | (launched: 2022-12-09_11:29:35.457333) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:37.063908 run osmo-stp_10.42.42.5(pid=32098): stderr: | 20221209112935650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112935650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112935650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112935651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112935651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112935651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112935651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:37.204343 run osmo-stp_10.42.42.5(pid=32098): stdout: | (launched: 2022-12-09_11:29:35.457333) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:37.338600 run osmo-stp_10.42.42.5(pid=32098): stderr: | 20221209112935650 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112935650 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112935650 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112935651 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112935651 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112935651 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112935651 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:37.499516 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32098): Process ended prematurely: osmo-stp_10.42.42.5(pid=32098) [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32098)] [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 11:29:37.509042 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 11:29:37.538726 run osmo-hlr_10.42.42.2(pid=32095): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32095)] 11:29:37.591613 run osmo-hlr_10.42.42.2(pid=32095): stdout: | (launched: 2022-12-09_11:29:34.413466) 11:29:37.645489 run osmo-hlr_10.42.42.2(pid=32095): stderr: | 20221209112934613 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112934613 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112934613 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112934613 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112934613 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112934614 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112934626 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112934635 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112934635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112934635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:37.719732 run osmo-msc_10.42.42.6(pid=32101): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32101)] 11:29:37.771471 run osmo-msc_10.42.42.6(pid=32101): stdout: | (launched: 2022-12-09_11:29:36.530583) 11:29:37.824719 run osmo-msc_10.42.42.6(pid=32101): stderr: | 20221209112936855 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112936855 DLGLOBAL DEBUG validating counter group 0x7f3be1602c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112936855 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112936855 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112936855 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112936855 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112936857 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112936858 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112936858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112936858 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:29:37.878332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32094): Terminating (SIGTERM) 11:29:37.921163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32097): Terminating (SIGTERM) 11:29:37.964054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32100): Terminating (SIGTERM) 11:29:38.007275 --- ParallelTerminationStrategy: PID 32094 died... 11:29:38.027737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32094): Terminated: ok {rc=0} 11:29:38.075471 --- ParallelTerminationStrategy: PID 32097 died... 11:29:38.095542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32097): Terminated: ok {rc=0} 11:29:38.143163 --- ParallelTerminationStrategy: PID 32100 died... 11:29:38.163150 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32100): Terminated: ok {rc=0} 11:29:38.253641 bus /sierra_3: Setting Powered False 11:29:39.354892 bus /sierra_3: Setting Powered False 11:29:40.473650 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 11:29:41.712671 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:29:41.720151 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 11:29:41.741001 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 11:29:41.768252 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 11:29:41.820190 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 11:29:41.840806 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 11:29:41.867270 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 11:29:42.418770 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 11:29:42.468616 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:42.479910 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:29:42.536047 tst mo_mt_call.py: using LAC 21155 11:29:42.660788 tst mo_mt_call.py: using RAC 245 11:29:42.784469 tst mo_mt_call.py: using CellId 21155 11:29:42.913384 tst mo_mt_call.py: using BVCI 21156 11:29:43.028045 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:43.039362 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:43.050291 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:43.061206 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:43.072083 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:43.083007 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:29:43.204187 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:29:43.331759 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:29:43.852890 run create_hlr_db(pid=32108): Launched 11:29:43.983003 bus /sierra_2: Setting Powered False 11:29:45.049128 run create_hlr_db(pid=32108): Terminated: ok {rc=0} 11:29:45.497379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32110): Launched 11:29:45.813964 run osmo-hlr_10.42.42.2(pid=32111): Launched 11:29:46.028105 run osmo-stp_10.42.42.5: Starting osmo-stp 11:29:46.678408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32113): Launched 11:29:47.010615 run osmo-stp_10.42.42.5(pid=32114): Launched 11:29:47.279496 run osmo-msc_10.42.42.6: Starting osmo-msc 11:29:47.932204 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32116): Launched 11:29:48.269436 run osmo-msc_10.42.42.6(pid=32117): Launched 11:29:48.456547 run osmo-stp_10.42.42.5(pid=32114): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32114)] 11:29:48.598645 run osmo-stp_10.42.42.5(pid=32114): stdout: | (launched: 2022-12-09_11:29:46.951346) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:48.740765 run osmo-stp_10.42.42.5(pid=32114): stderr: | 20221209112947288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112947289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112947291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112947292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112947292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112947292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112947292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:48.881807 run osmo-stp_10.42.42.5(pid=32114): stdout: | (launched: 2022-12-09_11:29:46.951346) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:49.015781 run osmo-stp_10.42.42.5(pid=32114): stderr: | 20221209112947288 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112947289 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112947291 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112947292 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112947292 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112947292 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112947292 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:49.175916 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32114): Process ended prematurely: osmo-stp_10.42.42.5(pid=32114) [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32114)] [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 11:29:49.185839 tst mo_mt_call.py:8: Test FAILED (6.8 sec) 11:29:49.214912 run osmo-hlr_10.42.42.2(pid=32111): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32111)] 11:29:49.266393 run osmo-hlr_10.42.42.2(pid=32111): stdout: | (launched: 2022-12-09_11:29:45.755635) 11:29:49.319755 run osmo-hlr_10.42.42.2(pid=32111): stderr: | 20221209112946062 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112946062 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112946062 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112946062 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112946062 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112946063 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112946084 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112946092 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112946092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112946097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:49.393708 run osmo-msc_10.42.42.6(pid=32117): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32117)] 11:29:49.445339 run osmo-msc_10.42.42.6(pid=32117): stdout: | (launched: 2022-12-09_11:29:48.207944) 11:29:49.498521 run osmo-msc_10.42.42.6(pid=32117): stderr: | 20221209112948532 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112948532 DLGLOBAL DEBUG validating counter group 0x7ff05800dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112948532 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112948532 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112948533 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112948533 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112948535 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112948535 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112948535 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112948535 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:29:49.552430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32110): Terminating (SIGTERM) 11:29:49.595388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32113): Terminating (SIGTERM) 11:29:49.638170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32116): Terminating (SIGTERM) 11:29:49.681399 --- ParallelTerminationStrategy: PID 32110 died... 11:29:49.701780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32110): Terminated: ok {rc=0} 11:29:49.750004 --- ParallelTerminationStrategy: PID 32113 died... 11:29:49.770117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32113): Terminated: ok {rc=0} 11:29:49.817997 --- ParallelTerminationStrategy: PID 32116 died... 11:29:49.837976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32116): Terminated: ok {rc=0} 11:29:49.927791 bus /sierra_3: Setting Powered False 11:29:51.029793 bus /sierra_3: Setting Powered False 11:29:52.148325 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 11:29:53.300786 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:53.313543 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:29:53.376204 tst mo_mt_call_osmux.py: using LAC 21156 11:29:53.498135 tst mo_mt_call_osmux.py: using RAC 246 11:29:53.621457 tst mo_mt_call_osmux.py: using CellId 21156 11:29:53.742205 tst mo_mt_call_osmux.py: using BVCI 21157 11:29:53.858075 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:53.869454 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:53.880397 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:53.891383 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:53.902317 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:29:53.913301 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:29:54.035477 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:29:54.156492 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:29:54.642503 run create_hlr_db(pid=32119): Launched 11:29:54.770529 bus /sierra_2: Setting Powered False 11:29:55.833980 run create_hlr_db(pid=32119): Terminated: ok {rc=0} 11:29:56.293340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32121): Launched 11:29:56.631527 run osmo-hlr_10.42.42.2(pid=32122): Launched 11:29:56.761726 run osmo-stp_10.42.42.5: Starting osmo-stp 11:29:57.339729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32124): Launched 11:29:57.677709 run osmo-stp_10.42.42.5(pid=32125): Launched 11:29:57.806837 run osmo-msc_10.42.42.6: Starting osmo-msc 11:29:58.417386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32127): Launched 11:29:58.755023 run osmo-msc_10.42.42.6(pid=32128): Launched 11:29:58.943747 run osmo-stp_10.42.42.5(pid=32125): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32125)] 11:29:59.085361 run osmo-stp_10.42.42.5(pid=32125): stdout: | (launched: 2022-12-09_11:29:57.615849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:59.227435 run osmo-stp_10.42.42.5(pid=32125): stderr: | 20221209112957811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112957811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112957811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112957812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112957812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112957812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112957812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:59.367693 run osmo-stp_10.42.42.5(pid=32125): stdout: | (launched: 2022-12-09_11:29:57.615849) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:29:59.500809 run osmo-stp_10.42.42.5(pid=32125): stderr: | 20221209112957811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209112957811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209112957811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209112957812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209112957812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209112957812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209112957812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:29:59.660814 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32125): Process ended prematurely: osmo-stp_10.42.42.5(pid=32125) [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32125)] [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 11:29:59.670609 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:29:59.699553 run osmo-hlr_10.42.42.2(pid=32122): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32122)] 11:29:59.751031 run osmo-hlr_10.42.42.2(pid=32122): stdout: | (launched: 2022-12-09_11:29:56.570509) 11:29:59.804198 run osmo-hlr_10.42.42.2(pid=32122): stderr: | 20221209112956769 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209112956769 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209112956770 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209112956770 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209112956770 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209112956770 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209112956782 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209112956790 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209112956790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209112956790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:29:59.877666 run osmo-msc_10.42.42.6(pid=32128): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32128)] 11:29:59.928845 run osmo-msc_10.42.42.6(pid=32128): stdout: | (launched: 2022-12-09_11:29:58.693399) 11:29:59.981639 run osmo-msc_10.42.42.6(pid=32128): stderr: | 20221209112959017 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209112959017 DLGLOBAL DEBUG validating counter group 0x7efccb952c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209112959017 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209112959017 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209112959017 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209112959018 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209112959019 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209112959020 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209112959020 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209112959020 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:30:00.034702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32121): Terminating (SIGTERM) 11:30:00.077376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32124): Terminating (SIGTERM) 11:30:00.120170 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32127): Terminating (SIGTERM) 11:30:00.163494 --- ParallelTerminationStrategy: PID 32121 died... 11:30:00.183953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32121): Terminated: ok {rc=0} 11:30:00.231642 --- ParallelTerminationStrategy: PID 32124 died... 11:30:00.251643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32124): Terminated: ok {rc=0} 11:30:00.299220 --- ParallelTerminationStrategy: PID 32127 died... 11:30:00.319252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32127): Terminated: ok {rc=0} 11:30:00.409520 bus /sierra_3: Setting Powered False 11:30:01.505763 bus /sierra_3: Setting Powered False 11:30:02.624348 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 11:30:03.867068 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:30:03.874655 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 11:30:03.897275 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 11:30:03.925484 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 11:30:03.976744 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 11:30:03.998201 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 11:30:04.026024 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 11:30:04.579200 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 11:30:04.632869 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:04.644486 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:30:04.704372 tst mo_mt_call.py: using LAC 21157 11:30:04.836518 tst mo_mt_call.py: using RAC 247 11:30:04.966546 tst mo_mt_call.py: using CellId 21157 11:30:05.096226 tst mo_mt_call.py: using BVCI 21158 11:30:05.218828 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:05.230478 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:05.241814 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:05.253555 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:05.265169 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:05.276758 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:30:05.395447 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:30:05.514892 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:30:06.002012 run create_hlr_db(pid=32136): Launched 11:30:06.132740 bus /sierra_2: Setting Powered False 11:30:07.195281 run create_hlr_db(pid=32136): Terminated: ok {rc=0} 11:30:07.654167 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32138): Launched 11:30:07.992567 run osmo-hlr_10.42.42.2(pid=32139): Launched 11:30:08.120731 run osmo-stp_10.42.42.5: Starting osmo-stp 11:30:08.699090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32141): Launched 11:30:09.036297 run osmo-stp_10.42.42.5(pid=32142): Launched 11:30:09.165538 run osmo-msc_10.42.42.6: Starting osmo-msc 11:30:09.773686 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32144): Launched 11:30:10.109993 run osmo-msc_10.42.42.6(pid=32145): Launched 11:30:10.296530 run osmo-stp_10.42.42.5(pid=32142): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32142)] 11:30:10.438451 run osmo-stp_10.42.42.5(pid=32142): stdout: | (launched: 2022-12-09_11:30:08.974937) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:10.580614 run osmo-stp_10.42.42.5(pid=32142): stderr: | 20221209113009169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113009169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113009169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113009170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113009170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113009170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113009170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:10.720688 run osmo-stp_10.42.42.5(pid=32142): stdout: | (launched: 2022-12-09_11:30:08.974937) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:10.854484 run osmo-stp_10.42.42.5(pid=32142): stderr: | 20221209113009169 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113009169 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113009169 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113009170 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113009170 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113009170 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113009170 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:11.014256 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32142): Process ended prematurely: osmo-stp_10.42.42.5(pid=32142) [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32142)] [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 11:30:11.023864 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:30:11.053150 run osmo-hlr_10.42.42.2(pid=32139): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32139)] 11:30:11.104392 run osmo-hlr_10.42.42.2(pid=32139): stdout: | (launched: 2022-12-09_11:30:07.930874) 11:30:11.157465 run osmo-hlr_10.42.42.2(pid=32139): stderr: | 20221209113008131 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113008131 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113008131 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113008131 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113008131 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113008131 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113008144 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113008153 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113008153 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113008153 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:30:11.231087 run osmo-msc_10.42.42.6(pid=32145): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32145)] 11:30:11.282314 run osmo-msc_10.42.42.6(pid=32145): stdout: | (launched: 2022-12-09_11:30:10.048227) 11:30:11.335124 run osmo-msc_10.42.42.6(pid=32145): stderr: | 20221209113010372 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113010373 DLGLOBAL DEBUG validating counter group 0x7fb9065ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113010373 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113010373 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113010373 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113010373 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113010375 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113010375 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113010375 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113010375 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:30:11.388342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32138): Terminating (SIGTERM) 11:30:11.431104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32141): Terminating (SIGTERM) 11:30:11.473705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32144): Terminating (SIGTERM) 11:30:11.516344 --- ParallelTerminationStrategy: PID 32138 died... 11:30:11.536786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32138): Terminated: ok {rc=0} 11:30:11.584243 --- ParallelTerminationStrategy: PID 32141 died... 11:30:11.604253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32141): Terminated: ok {rc=0} 11:30:11.651470 --- ParallelTerminationStrategy: PID 32144 died... 11:30:11.671220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32144): Terminated: ok {rc=0} 11:30:11.761844 bus /sierra_3: Setting Powered False 11:30:12.862633 bus /sierra_3: Setting Powered False 11:30:13.981750 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 11:30:15.135279 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:15.147539 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:30:15.205969 tst mo_mt_call_osmux.py: using LAC 21158 11:30:15.342500 tst mo_mt_call_osmux.py: using RAC 248 11:30:15.465371 tst mo_mt_call_osmux.py: using CellId 21158 11:30:15.594949 tst mo_mt_call_osmux.py: using BVCI 21159 11:30:15.710784 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:15.722155 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:15.733170 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:15.743927 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:15.755143 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:30:15.766101 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:30:15.898695 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:30:16.036103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:30:16.572109 run create_hlr_db(pid=32147): Launched 11:30:16.738447 bus /sierra_2: Setting Powered False 11:30:17.804925 run create_hlr_db(pid=32147): Terminated: ok {rc=0} 11:30:18.273544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32149): Launched 11:30:18.611292 run osmo-hlr_10.42.42.2(pid=32150): Launched 11:30:18.740106 run osmo-stp_10.42.42.5: Starting osmo-stp 11:30:19.316488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32152): Launched 11:30:19.654273 run osmo-stp_10.42.42.5(pid=32153): Launched 11:30:19.782207 run osmo-msc_10.42.42.6: Starting osmo-msc 11:30:20.388254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32155): Launched 11:30:20.725750 run osmo-msc_10.42.42.6(pid=32156): Launched 11:30:20.915790 run osmo-stp_10.42.42.5(pid=32153): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32153)] 11:30:21.058021 run osmo-stp_10.42.42.5(pid=32153): stdout: | (launched: 2022-12-09_11:30:19.592337) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:21.200703 run osmo-stp_10.42.42.5(pid=32153): stderr: | 20221209113019786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113019787 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113019787 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113019787 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113019788 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113019788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113019788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:21.341168 run osmo-stp_10.42.42.5(pid=32153): stdout: | (launched: 2022-12-09_11:30:19.592337) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:21.474988 run osmo-stp_10.42.42.5(pid=32153): stderr: | 20221209113019786 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113019787 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113019787 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113019787 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113019788 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113019788 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113019788 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:21.635344 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32153): Process ended prematurely: osmo-stp_10.42.42.5(pid=32153) [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32153)] [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 11:30:21.644837 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 11:30:21.673744 run osmo-hlr_10.42.42.2(pid=32150): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32150)] 11:30:21.725204 run osmo-hlr_10.42.42.2(pid=32150): stdout: | (launched: 2022-12-09_11:30:18.549951) 11:30:21.778767 run osmo-hlr_10.42.42.2(pid=32150): stderr: | 20221209113018750 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113018750 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113018750 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113018750 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113018750 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113018750 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113018763 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113018771 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113018771 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113018771 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:30:21.853276 run osmo-msc_10.42.42.6(pid=32156): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32156)] 11:30:21.904641 run osmo-msc_10.42.42.6(pid=32156): stdout: | (launched: 2022-12-09_11:30:20.664231) 11:30:21.957460 run osmo-msc_10.42.42.6(pid=32156): stderr: | 20221209113020988 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113020988 DLGLOBAL DEBUG validating counter group 0x7f91b3b3bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113020988 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113020988 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113020988 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113020989 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113020990 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113020991 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113020991 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113020991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:30:22.010824 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32149): Terminating (SIGTERM) 11:30:22.053395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32152): Terminating (SIGTERM) 11:30:22.095984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32155): Terminating (SIGTERM) 11:30:22.138901 --- ParallelTerminationStrategy: PID 32149 died... 11:30:22.159300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32149): Terminated: ok {rc=0} 11:30:22.206791 --- ParallelTerminationStrategy: PID 32152 died... 11:30:22.226768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32152): Terminated: ok {rc=0} 11:30:22.274253 --- ParallelTerminationStrategy: PID 32155 died... 11:30:22.294075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32155): Terminated: ok {rc=0} 11:30:22.382697 bus /sierra_3: Setting Powered False 11:30:23.482283 bus /sierra_3: Setting Powered False 11:30:24.598842 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:30:25.839351 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:30:25.846177 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:30:25.867116 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 11:30:25.893961 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:30:25.949300 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:30:25.969945 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 11:30:25.996028 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:30:26.545102 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 11:30:26.594943 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:26.606057 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:30:26.661629 tst mo_mt_call.py: using LAC 21159 11:30:26.783016 tst mo_mt_call.py: using RAC 249 11:30:26.905777 tst mo_mt_call.py: using CellId 21159 11:30:27.026325 tst mo_mt_call.py: using BVCI 21160 11:30:27.141617 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:27.152666 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:27.163620 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:27.174489 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:27.185414 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:27.196302 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:30:27.318114 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:30:27.441712 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:30:27.964335 run create_hlr_db(pid=32161): Launched 11:30:28.095185 bus /sierra_2: Setting Powered False 11:30:29.160599 run create_hlr_db(pid=32161): Terminated: ok {rc=0} 11:30:29.607334 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32163): Launched 11:30:29.922876 run osmo-hlr_10.42.42.2(pid=32164): Launched 11:30:30.042113 run osmo-stp_10.42.42.5: Starting osmo-stp 11:30:30.579960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32166): Launched 11:30:30.909097 run osmo-stp_10.42.42.5(pid=32167): Launched 11:30:31.198438 run osmo-msc_10.42.42.6: Starting osmo-msc 11:30:31.820064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32169): Launched 11:30:32.178571 run osmo-msc_10.42.42.6(pid=32170): Launched 11:30:32.405308 run osmo-stp_10.42.42.5(pid=32167): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32167)] 11:30:32.537317 run osmo-stp_10.42.42.5(pid=32167): stdout: | (launched: 2022-12-09_11:30:30.840000) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:32.668919 run osmo-stp_10.42.42.5(pid=32167): stderr: | 20221209113031081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113031082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113031082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113031082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113031083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113031083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113031083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:32.799640 run osmo-stp_10.42.42.5(pid=32167): stdout: | (launched: 2022-12-09_11:30:30.840000) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:32.923914 run osmo-stp_10.42.42.5(pid=32167): stderr: | 20221209113031081 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113031082 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113031082 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113031082 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113031083 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113031083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113031083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:33.072927 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32167): Process ended prematurely: osmo-stp_10.42.42.5(pid=32167) [trial-2359↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32167)] [trial-2359↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 11:30:33.081979 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 11:30:33.109023 run osmo-hlr_10.42.42.2(pid=32164): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32164)] 11:30:33.158089 run osmo-hlr_10.42.42.2(pid=32164): stdout: | (launched: 2022-12-09_11:30:29.864502) 11:30:33.208669 run osmo-hlr_10.42.42.2(pid=32164): stderr: | 20221209113030043 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113030043 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113030043 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113030043 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113030043 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113030043 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113030056 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113030065 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113030066 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113030066 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:30:33.279252 run osmo-msc_10.42.42.6(pid=32170): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32170)] 11:30:33.327948 run osmo-msc_10.42.42.6(pid=32170): stdout: | (launched: 2022-12-09_11:30:32.118480) 11:30:33.378216 run osmo-msc_10.42.42.6(pid=32170): stderr: | 20221209113032428 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113032429 DLGLOBAL DEBUG validating counter group 0x7fef04308c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113032429 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113032429 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113032429 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113032429 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113032432 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113032432 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113032432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113032432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:30:33.429120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32163): Terminating (SIGTERM) 11:30:33.469494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32166): Terminating (SIGTERM) 11:30:33.509926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32169): Terminating (SIGTERM) 11:30:33.550600 --- ParallelTerminationStrategy: PID 32163 died... 11:30:33.569984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32163): Terminated: ok {rc=0} 11:30:33.615116 --- ParallelTerminationStrategy: PID 32166 died... 11:30:33.634094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32166): Terminated: ok {rc=0} 11:30:33.678971 --- ParallelTerminationStrategy: PID 32169 died... 11:30:33.697830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32169): Terminated: ok {rc=0} 11:30:33.785813 bus /sierra_3: Setting Powered False 11:30:34.887980 bus /sierra_3: Setting Powered False 11:30:36.005302 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 11:30:37.160538 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:37.173252 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:30:37.232412 tst mo_mt_call_osmux.py: using LAC 21160 11:30:37.365580 tst mo_mt_call_osmux.py: using RAC 250 11:30:37.490620 tst mo_mt_call_osmux.py: using CellId 21160 11:30:37.615981 tst mo_mt_call_osmux.py: using BVCI 21161 11:30:37.732288 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:37.743766 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:37.754902 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:37.766453 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:37.778124 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:30:37.789715 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:30:37.907971 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:30:38.031406 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:30:38.554140 run create_hlr_db(pid=32172): Launched 11:30:38.684865 bus /sierra_2: Setting Powered False 11:30:39.751064 run create_hlr_db(pid=32172): Terminated: ok {rc=0} 11:30:40.201031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32174): Launched 11:30:40.515657 run osmo-hlr_10.42.42.2(pid=32175): Launched 11:30:40.634820 run osmo-stp_10.42.42.5: Starting osmo-stp 11:30:41.188874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32177): Launched 11:30:41.502673 run osmo-stp_10.42.42.5(pid=32178): Launched 11:30:41.622908 run osmo-msc_10.42.42.6: Starting osmo-msc 11:30:42.188846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32180): Launched 11:30:42.502928 run osmo-msc_10.42.42.6(pid=32181): Launched 11:30:42.680153 run osmo-stp_10.42.42.5(pid=32178): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32178)] 11:30:42.811877 run osmo-stp_10.42.42.5(pid=32178): stdout: | (launched: 2022-12-09_11:30:41.444838) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:42.943892 run osmo-stp_10.42.42.5(pid=32178): stderr: | 20221209113041618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113041618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113041618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113041619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113041619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113041619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113041619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:43.073657 run osmo-stp_10.42.42.5(pid=32178): stdout: | (launched: 2022-12-09_11:30:41.444838) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:43.197794 run osmo-stp_10.42.42.5(pid=32178): stderr: | 20221209113041618 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113041618 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113041618 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113041619 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113041619 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113041619 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113041619 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:43.345936 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32178): Process ended prematurely: osmo-stp_10.42.42.5(pid=32178) [trial-2359↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32178)] [trial-2359↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 11:30:43.354736 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:30:43.381463 run osmo-hlr_10.42.42.2(pid=32175): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32175)] 11:30:43.429583 run osmo-hlr_10.42.42.2(pid=32175): stdout: | (launched: 2022-12-09_11:30:40.457716) 11:30:43.479293 run osmo-hlr_10.42.42.2(pid=32175): stderr: | 20221209113040636 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113040636 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113040636 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113040637 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113040637 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113040637 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113040649 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113040657 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113040657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113040657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:30:43.549223 run osmo-msc_10.42.42.6(pid=32181): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32181)] 11:30:43.597531 run osmo-msc_10.42.42.6(pid=32181): stdout: | (launched: 2022-12-09_11:30:42.444893) 11:30:43.647657 run osmo-msc_10.42.42.6(pid=32181): stderr: | 20221209113042720 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113042720 DLGLOBAL DEBUG validating counter group 0x7faa82b40c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113042720 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113042720 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113042720 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113042720 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113042722 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113042723 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113042723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113042723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:30:43.697939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32174): Terminating (SIGTERM) 11:30:43.737945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32177): Terminating (SIGTERM) 11:30:43.778012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32180): Terminating (SIGTERM) 11:30:43.818412 --- ParallelTerminationStrategy: PID 32174 died... 11:30:43.837844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32174): Terminated: ok {rc=0} 11:30:43.882083 --- ParallelTerminationStrategy: PID 32177 died... 11:30:43.900915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32177): Terminated: ok {rc=0} 11:30:43.945558 --- ParallelTerminationStrategy: PID 32180 died... 11:30:43.964334 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32180): Terminated: ok {rc=0} 11:30:44.051559 bus /sierra_3: Setting Powered False 11:30:45.151098 bus /sierra_3: Setting Powered False 11:30:46.268027 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:30:47.505483 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:30:47.510985 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:30:47.531398 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 11:30:47.557839 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 11:30:47.610634 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:30:47.631725 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 11:30:47.658256 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 11:30:48.206202 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 11:30:48.256410 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:48.267551 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:30:48.324810 tst mo_mt_call.py: using LAC 21161 11:30:48.450240 tst mo_mt_call.py: using RAC 251 11:30:48.584366 tst mo_mt_call.py: using CellId 21161 11:30:48.708789 tst mo_mt_call.py: using BVCI 21162 11:30:48.824669 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:48.835932 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:48.846924 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:48.857732 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:48.868622 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:48.879404 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:30:49.001703 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:30:49.124696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:30:49.645485 run create_hlr_db(pid=32186): Launched 11:30:49.775998 bus /sierra_2: Setting Powered False 11:30:50.841325 run create_hlr_db(pid=32186): Terminated: ok {rc=0} 11:30:51.289555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32188): Launched 11:30:51.604703 run osmo-hlr_10.42.42.2(pid=32189): Launched 11:30:51.723653 run osmo-stp_10.42.42.5: Starting osmo-stp 11:30:52.263781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32191): Launched 11:30:52.578824 run osmo-stp_10.42.42.5(pid=32192): Launched 11:30:52.698841 run osmo-msc_10.42.42.6: Starting osmo-msc 11:30:53.265753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32194): Launched 11:30:53.579312 run osmo-msc_10.42.42.6(pid=32195): Launched 11:30:53.755781 run osmo-stp_10.42.42.5(pid=32192): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32192)] 11:30:53.888273 run osmo-stp_10.42.42.5(pid=32192): stdout: | (launched: 2022-12-09_11:30:52.520763) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:54.020557 run osmo-stp_10.42.42.5(pid=32192): stderr: | 20221209113052693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113052693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113052694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113052694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113052695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113052695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113052695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:54.152371 run osmo-stp_10.42.42.5(pid=32192): stdout: | (launched: 2022-12-09_11:30:52.520763) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:30:54.276615 run osmo-stp_10.42.42.5(pid=32192): stderr: | 20221209113052693 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113052693 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113052694 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113052694 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113052695 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113052695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113052695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:30:54.426072 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32192): Process ended prematurely: osmo-stp_10.42.42.5(pid=32192) [trial-2359↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32192)] [trial-2359↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 11:30:54.435150 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:30:54.462132 run osmo-hlr_10.42.42.2(pid=32189): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32189)] 11:30:54.510582 run osmo-hlr_10.42.42.2(pid=32189): stdout: | (launched: 2022-12-09_11:30:51.546490) 11:30:54.560499 run osmo-hlr_10.42.42.2(pid=32189): stderr: | 20221209113051726 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113051727 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113051727 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113051727 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113051727 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113051727 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113051742 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113051752 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113051752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113051752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:30:54.630507 run osmo-msc_10.42.42.6(pid=32195): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32195)] 11:30:54.678964 run osmo-msc_10.42.42.6(pid=32195): stdout: | (launched: 2022-12-09_11:30:53.521365) 11:30:54.729130 run osmo-msc_10.42.42.6(pid=32195): stderr: | 20221209113053796 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113053796 DLGLOBAL DEBUG validating counter group 0x7f6ccc7cac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113053796 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113053796 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113053796 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113053797 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113053798 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113053799 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113053799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113053799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:30:54.779270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32188): Terminating (SIGTERM) 11:30:54.819568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32191): Terminating (SIGTERM) 11:30:54.859873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32194): Terminating (SIGTERM) 11:30:54.900439 --- ParallelTerminationStrategy: PID 32188 died... 11:30:54.920037 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32188): Terminated: ok {rc=0} 11:30:54.965184 --- ParallelTerminationStrategy: PID 32191 died... 11:30:54.984224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32191): Terminated: ok {rc=0} 11:30:55.029148 --- ParallelTerminationStrategy: PID 32194 died... 11:30:55.048086 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32194): Terminated: ok {rc=0} 11:30:55.133893 bus /sierra_3: Setting Powered False 11:30:56.230558 bus /sierra_3: Setting Powered False 11:30:57.347284 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 11:30:58.501173 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:58.513453 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:30:58.574670 tst mo_mt_call_osmux.py: using LAC 21162 11:30:58.707654 tst mo_mt_call_osmux.py: using RAC 252 11:30:58.840583 tst mo_mt_call_osmux.py: using CellId 21162 11:30:58.971973 tst mo_mt_call_osmux.py: using BVCI 21163 11:30:59.094373 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:59.106045 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:59.117282 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:59.128634 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:59.140724 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:30:59.152284 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:30:59.271968 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:30:59.392215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:30:59.878925 run create_hlr_db(pid=32197): Launched 11:31:00.008872 bus /sierra_2: Setting Powered False 11:31:01.070276 run create_hlr_db(pid=32197): Terminated: ok {rc=0} 11:31:01.515580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32199): Launched 11:31:01.917898 run osmo-hlr_10.42.42.2(pid=32200): Launched 11:31:02.163715 run osmo-stp_10.42.42.5: Starting osmo-stp 11:31:02.761599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32202): Launched 11:31:03.099053 run osmo-stp_10.42.42.5(pid=32203): Launched 11:31:03.228845 run osmo-msc_10.42.42.6: Starting osmo-msc 11:31:03.840777 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32205): Launched 11:31:04.180484 run osmo-msc_10.42.42.6(pid=32206): Launched 11:31:04.371203 run osmo-stp_10.42.42.5(pid=32203): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32203)] 11:31:04.513509 run osmo-stp_10.42.42.5(pid=32203): stdout: | (launched: 2022-12-09_11:31:03.037541) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:04.657160 run osmo-stp_10.42.42.5(pid=32203): stderr: | 20221209113103231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113103231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113103231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113103232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113103232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113103232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113103232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:04.798404 run osmo-stp_10.42.42.5(pid=32203): stdout: | (launched: 2022-12-09_11:31:03.037541) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:04.932380 run osmo-stp_10.42.42.5(pid=32203): stderr: | 20221209113103231 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113103231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113103231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113103232 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113103232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113103232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113103232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:05.092627 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32203): Process ended prematurely: osmo-stp_10.42.42.5(pid=32203) [trial-2359↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32203)] [trial-2359↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 11:31:05.102772 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 11:31:05.131597 run osmo-hlr_10.42.42.2(pid=32200): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32200)] 11:31:05.183560 run osmo-hlr_10.42.42.2(pid=32200): stdout: | (launched: 2022-12-09_11:31:01.858599) 11:31:05.236691 run osmo-hlr_10.42.42.2(pid=32200): stderr: | 20221209113102193 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113102193 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113102193 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113102193 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113102193 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113102193 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113102204 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113102212 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113102213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113102213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:31:05.310869 run osmo-msc_10.42.42.6(pid=32206): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32206)] 11:31:05.362816 run osmo-msc_10.42.42.6(pid=32206): stdout: | (launched: 2022-12-09_11:31:04.118420) 11:31:05.416011 run osmo-msc_10.42.42.6(pid=32206): stderr: | 20221209113104441 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113104441 DLGLOBAL DEBUG validating counter group 0x7f7595fbcc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113104441 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113104441 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113104441 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113104442 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113104443 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113104444 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113104444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113104444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:31:05.469519 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32199): Terminating (SIGTERM) 11:31:05.512302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32202): Terminating (SIGTERM) 11:31:05.555223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32205): Terminating (SIGTERM) 11:31:05.598198 --- ParallelTerminationStrategy: PID 32199 died... 11:31:05.618592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32199): Terminated: ok {rc=0} 11:31:05.666371 --- ParallelTerminationStrategy: PID 32202 died... 11:31:05.686398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32202): Terminated: ok {rc=0} 11:31:05.733751 --- ParallelTerminationStrategy: PID 32205 died... 11:31:05.753782 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32205): Terminated: ok {rc=0} 11:31:05.843122 bus /sierra_3: Setting Powered False 11:31:06.943839 bus /sierra_3: Setting Powered False 11:31:08.063204 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 emergency:oc2g --------------------------------------------------------------------- 11:31:09.300821 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:31:09.305243 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 11:31:09.325845 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 11:31:09.352555 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 11:31:09.436378 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 11:31:09.457089 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 11:31:09.483669 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 11:31:10.066842 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2359 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 11:31:10.071744 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:31:10.082412 tst emergency:oc2g: Using 1 x bts (candidates: 1) 11:31:10.117457 tst emergency_mo_mt_call.py: using LAC 21163 11:31:10.241515 tst emergency_mo_mt_call.py: using RAC 253 11:31:10.363914 tst emergency_mo_mt_call.py: using CellId 21163 11:31:10.490030 tst emergency_mo_mt_call.py: using BVCI 21164 11:31:10.602732 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:31:10.613509 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:31:10.624020 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:31:10.634490 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:31:10.644918 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:31:10.655363 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:31:10.775729 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:31:10.899289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:31:11.412471 run create_hlr_db(pid=32211): Launched 11:31:11.540099 bus /sierra_2: Setting Powered False 11:31:12.605515 run create_hlr_db(pid=32211): Terminated: ok {rc=0} 11:31:13.049515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32213): Launched 11:31:13.360015 run osmo-hlr_10.42.42.2(pid=32214): Launched 11:31:13.477150 run osmo-stp_10.42.42.5: Starting osmo-stp 11:31:14.024268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32216): Launched 11:31:14.334794 run osmo-stp_10.42.42.5(pid=32217): Launched 11:31:14.462188 tst emergency_mo_mt_call.py: using MSISDN 7189 11:31:14.619161 run osmo-msc_10.42.42.6: Starting osmo-msc 11:31:15.175415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32219): Launched 11:31:15.485600 run osmo-msc_10.42.42.6(pid=32220): Launched 11:31:15.658520 run osmo-stp_10.42.42.5(pid=32217): ERR: Terminated: ERROR {rc=1} [trial-2359↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32217)] 11:31:15.789169 run osmo-stp_10.42.42.5(pid=32217): stdout: | (launched: 2022-12-09_11:31:14.277822) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:15.945422 run osmo-stp_10.42.42.5(pid=32217): stderr: | 20221209113114448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113114448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113114449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113114449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113114450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113114450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113114450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:16.090235 run osmo-stp_10.42.42.5(pid=32217): stdout: | (launched: 2022-12-09_11:31:14.277822) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:16.228067 run osmo-stp_10.42.42.5(pid=32217): stderr: | 20221209113114448 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113114448 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113114449 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113114449 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113114450 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113114450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113114450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:16.393099 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=32217): Process ended prematurely: osmo-stp_10.42.42.5(pid=32217) [trial-2359↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32217)] [trial-2359↪emergency:oc2g↪emergency_mo_mt_call.py:19] 11:31:16.403311 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 11:31:16.435127 run osmo-hlr_10.42.42.2(pid=32214): ERR: Terminated: ERROR {rc=237} [trial-2359↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32214)] 11:31:16.489298 run osmo-hlr_10.42.42.2(pid=32214): stdout: | (launched: 2022-12-09_11:31:13.303029) 11:31:16.546073 run osmo-hlr_10.42.42.2(pid=32214): stderr: | 20221209113113481 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113113481 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113113481 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113113481 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113113481 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113113482 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113113494 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113113502 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113113503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113113503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:31:16.623612 run osmo-msc_10.42.42.6(pid=32220): ERR: Terminated: ERROR {rc=2} [trial-2359↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32220)] 11:31:16.678684 run osmo-msc_10.42.42.6(pid=32220): stdout: | (launched: 2022-12-09_11:31:15.428338) 11:31:16.735535 run osmo-msc_10.42.42.6(pid=32220): stderr: | 20221209113115701 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113115701 DLGLOBAL DEBUG validating counter group 0x7f732524dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113115701 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113115702 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113115702 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113115702 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113115704 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113115704 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113115704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113115704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:31:16.792091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32213): Terminating (SIGTERM) 11:31:16.838545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32216): Terminating (SIGTERM) 11:31:16.886123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32219): Terminating (SIGTERM) 11:31:16.934780 --- ParallelTerminationStrategy: PID 32213 died... 11:31:16.956257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32213): Terminated: ok {rc=0} 11:31:17.010421 --- ParallelTerminationStrategy: PID 32216 died... 11:31:17.031833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32216): Terminated: ok {rc=0} 11:31:17.083112 --- ParallelTerminationStrategy: PID 32219 died... 11:31:17.104234 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32219): Terminated: ok {rc=0} 11:31:17.199354 bus /sierra_3: Setting Powered False 11:31:18.299557 bus /sierra_3: Setting Powered False 11:31:19.420113 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 11:31:20.509895 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:31:20.521552 tst emergency:oc2g: Using 1 x bts (candidates: 1) 11:31:20.558784 tst emergency_preemptive_call.py: using LAC 21164 11:31:20.682115 tst emergency_preemptive_call.py: using RAC 254 11:31:20.803936 tst emergency_preemptive_call.py: using CellId 21164 11:31:20.935654 tst emergency_preemptive_call.py: using BVCI 21165 11:31:21.057806 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:31:21.069482 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:31:21.080600 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:31:21.091936 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:31:21.103399 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 11:31:21.114843 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:31:21.236014 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:31:21.355962 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:31:21.476484 tst emergency:oc2g: Using 1 x modem (candidates: 4) 11:31:21.598785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:31:22.112468 run create_hlr_db(pid=32222): Launched 11:31:22.239920 bus /sierra_2: Setting Powered False 11:31:23.305965 run create_hlr_db(pid=32222): Terminated: ok {rc=0} 11:31:23.748489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32224): Launched 11:31:24.058237 run osmo-hlr_10.42.42.2(pid=32225): Launched 11:31:24.177576 run osmo-stp_10.42.42.5: Starting osmo-stp 11:31:24.713180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32227): Launched 11:31:25.019557 run osmo-stp_10.42.42.5(pid=32228): Launched 11:31:25.146476 tst emergency_preemptive_call.py: using MSISDN 7190 11:31:25.303084 run osmo-msc_10.42.42.6: Starting osmo-msc 11:31:25.855847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32230): Launched 11:31:26.163349 run osmo-msc_10.42.42.6(pid=32231): Launched 11:31:26.335319 run osmo-stp_10.42.42.5(pid=32228): ERR: Terminated: ERROR {rc=1} [trial-2359↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32228)] 11:31:26.464817 run osmo-stp_10.42.42.5(pid=32228): stdout: | (launched: 2022-12-09_11:31:24.962847) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:26.594669 run osmo-stp_10.42.42.5(pid=32228): stderr: | 20221209113125134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113125134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113125134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113125134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113125135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113125135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113125135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:26.722561 run osmo-stp_10.42.42.5(pid=32228): stdout: | (launched: 2022-12-09_11:31:24.962847) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:26.844233 run osmo-stp_10.42.42.5(pid=32228): stderr: | 20221209113125134 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113125134 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113125134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113125134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113125135 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113125135 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113125135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:26.989952 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=32228): Process ended prematurely: osmo-stp_10.42.42.5(pid=32228) [trial-2359↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32228)] [trial-2359↪emergency:oc2g↪emergency_preemptive_call.py:32] 11:31:26.998222 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 11:31:27.024733 run osmo-hlr_10.42.42.2(pid=32225): ERR: Terminated: ERROR {rc=237} [trial-2359↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32225)] 11:31:27.072881 run osmo-hlr_10.42.42.2(pid=32225): stdout: | (launched: 2022-12-09_11:31:24.001087) 11:31:27.122668 run osmo-hlr_10.42.42.2(pid=32225): stderr: | 20221209113124179 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113124179 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113124179 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113124179 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113124179 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113124179 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113124191 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113124201 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113124201 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113124201 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:31:27.192225 run osmo-msc_10.42.42.6(pid=32231): ERR: Terminated: ERROR {rc=2} [trial-2359↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=32231)] 11:31:27.240253 run osmo-msc_10.42.42.6(pid=32231): stdout: | (launched: 2022-12-09_11:31:26.106361) 11:31:27.290074 run osmo-msc_10.42.42.6(pid=32231): stderr: | 20221209113126379 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113126379 DLGLOBAL DEBUG validating counter group 0x7f06ff17ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113126379 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113126379 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113126379 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113126380 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113126382 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113126382 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113126382 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113126382 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:31:27.340282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32224): Terminating (SIGTERM) 11:31:27.379955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32227): Terminating (SIGTERM) 11:31:27.419830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32230): Terminating (SIGTERM) 11:31:27.460052 --- ParallelTerminationStrategy: PID 32224 died... 11:31:27.479423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32224): Terminated: ok {rc=0} 11:31:27.523789 --- ParallelTerminationStrategy: PID 32227 died... 11:31:27.542561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32227): Terminated: ok {rc=0} 11:31:27.586734 --- ParallelTerminationStrategy: PID 32230 died... 11:31:27.605617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=32230): Terminated: ok {rc=0} 11:31:27.689681 bus /sierra_9: Setting Powered False 11:31:28.786337 bus /sierra_9: Setting Powered False 11:31:29.902311 bus /sierra_8: Setting Powered False 11:31:31.001790 bus /sierra_8: Setting Powered False 11:31:32.128335 bus /sierra_3: Setting Powered False 11:31:33.233984 bus /sierra_3: Setting Powered False 11:31:34.352310 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:oc2g --------------------------------------------------------------------- 11:31:35.619148 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:31:35.623394 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 11:31:35.643835 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 11:31:35.682682 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 11:31:35.767902 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 11:31:35.788538 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 11:31:35.826843 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 11:31:36.421894 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 11:31:36.477174 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:31:36.488161 tst gprs:oc2g: Using 1 x bts (candidates: 1) 11:31:36.522731 tst cs_paging_gprs_active.py: using LAC 21165 11:31:36.653778 tst cs_paging_gprs_active.py: using RAC 255 11:31:36.787066 tst cs_paging_gprs_active.py: using CellId 21165 11:31:36.919820 tst cs_paging_gprs_active.py: using BVCI 21166 11:31:37.044562 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:31:37.055700 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:31:37.066607 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:31:37.077706 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:31:37.088582 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:31:37.099535 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:31:37.110733 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:31:37.122063 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:31:37.133444 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:31:37.255012 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:31:37.373846 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:31:37.586301 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:31:37.902727 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32236): Launched 11:31:38.178892 run iperf3-srv_10.42.42.10(pid=32237): Launched 11:31:38.298669 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:31:38.509769 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:31:38.824471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32238): Launched 11:31:39.098881 run iperf3-srv_10.42.42.10(pid=32239): Launched 11:31:39.219086 tst cs_paging_gprs_active.py:38: start network... 11:31:39.430248 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:31:39.917772 run create_hlr_db(pid=32240): Launched 11:31:40.049794 bus /sierra_2: Setting Powered False 11:31:41.115909 run create_hlr_db(pid=32240): Terminated: ok {rc=0} 11:31:41.585289 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32242): Launched 11:31:41.923828 run osmo-hlr_10.42.42.2(pid=32243): Launched 11:31:42.054336 run osmo-stp_10.42.42.5: Starting osmo-stp 11:31:42.640534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32245): Launched 11:31:42.979163 run osmo-stp_10.42.42.5(pid=32246): Launched 11:31:43.109628 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:31:43.690020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32248): Launched 11:31:43.821104 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:31:44.107222 run patchelf(pid=32249): Launched 11:31:44.296330 run osmo-stp_10.42.42.5(pid=32246): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32246)] 11:31:44.438912 run osmo-stp_10.42.42.5(pid=32246): stdout: | (launched: 2022-12-09_11:31:42.917717) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:44.583250 run osmo-stp_10.42.42.5(pid=32246): stderr: | 20221209113143109 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113143109 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113143110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113143110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113143111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113143111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113143111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:44.727323 run osmo-stp_10.42.42.5(pid=32246): stdout: | (launched: 2022-12-09_11:31:42.917717) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:44.866621 run osmo-stp_10.42.42.5(pid=32246): stderr: | 20221209113143109 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113143109 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113143110 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113143110 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113143111 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113143111 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113143111 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:45.030620 run patchelf(pid=32249): Terminating (SIGINT) 11:31:45.222231 run patchelf(pid=32249): Terminated: ok {rc=0} 11:31:45.359567 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32246): Process ended prematurely: osmo-stp_10.42.42.5(pid=32246) [trial-2359↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32246)] [trial-2359↪gprs:oc2g↪cs_paging_gprs_active.py:38] 11:31:45.370172 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 11:31:45.400555 run osmo-hlr_10.42.42.2(pid=32243): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32243)] 11:31:45.452552 run osmo-hlr_10.42.42.2(pid=32243): stdout: | (launched: 2022-12-09_11:31:41.861950) 11:31:45.506055 run osmo-hlr_10.42.42.2(pid=32243): stderr: | 20221209113142062 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113142062 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113142062 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113142062 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113142062 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113142062 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113142074 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113142083 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113142083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113142083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:31:45.560065 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32236): Terminating (SIGTERM) 11:31:45.603145 run iperf3-srv_10.42.42.10(pid=32237): Terminating (SIGTERM) 11:31:45.646502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32238): Terminating (SIGTERM) 11:31:45.689951 run iperf3-srv_10.42.42.10(pid=32239): Terminating (SIGTERM) 11:31:45.733140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32242): Terminating (SIGTERM) 11:31:45.776727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32245): Terminating (SIGTERM) 11:31:45.820527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32248): Terminating (SIGTERM) 11:31:45.902436 --- ParallelTerminationStrategy: PID 32236 died... 11:31:45.933333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32236): Terminated: ok {rc=0} 11:31:45.983133 --- ParallelTerminationStrategy: PID 32237 died... 11:31:46.007739 run iperf3-srv_10.42.42.10(pid=32237): Terminated {rc=256} 11:31:46.069483 --- ParallelTerminationStrategy: PID 32238 died... 11:31:46.096806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32238): Terminated: ok {rc=0} 11:31:46.154709 --- ParallelTerminationStrategy: PID 32239 died... 11:31:46.178625 run iperf3-srv_10.42.42.10(pid=32239): Terminated {rc=256} 11:31:46.232542 --- ParallelTerminationStrategy: PID 32242 died... 11:31:46.254452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32242): Terminated: ok {rc=0} 11:31:46.306043 --- ParallelTerminationStrategy: PID 32245 died... 11:31:46.328661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32245): Terminated: ok {rc=0} 11:31:46.379138 --- ParallelTerminationStrategy: PID 32248 died... 11:31:46.401518 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32248): Terminated: ok {rc=0} 11:31:46.500061 bus /gobi_0: Setting Powered False 11:31:47.618072 bus /gobi_0: Setting Powered False 11:31:48.736033 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:oc2g iperf3.py ---------------------------------------------- 11:31:49.890118 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:31:49.902087 tst gprs:oc2g: Using 1 x bts (candidates: 1) 11:31:49.942618 tst iperf3.py: using LAC 21166 11:31:50.065885 tst iperf3.py: using RAC 1 11:31:50.187558 tst iperf3.py: using CellId 21166 11:31:50.310590 tst iperf3.py: using BVCI 21167 11:31:50.426219 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:31:50.436737 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:31:50.447233 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:31:50.457594 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:31:50.467813 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:31:50.478097 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:31:50.488480 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:31:50.499267 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:31:50.510107 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:31:50.634152 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:31:50.862919 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:31:51.200726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32250): Launched 11:31:51.494496 run iperf3-srv_10.42.42.10(pid=32251): Launched 11:31:51.621677 tst iperf3.py:8: start network... 11:31:51.848739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:31:52.370496 run create_hlr_db(pid=32252): Launched 11:31:52.500396 bus /gobi_6: Setting Powered False 11:31:53.566876 run create_hlr_db(pid=32252): Terminated: ok {rc=0} 11:31:54.014626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32254): Launched 11:31:54.328930 run osmo-hlr_10.42.42.2(pid=32255): Launched 11:31:54.451057 run osmo-stp_10.42.42.5: Starting osmo-stp 11:31:54.991978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32257): Launched 11:31:55.307730 run osmo-stp_10.42.42.5(pid=32258): Launched 11:31:55.428565 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:31:55.971960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32260): Launched 11:31:56.092145 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:31:56.357623 run patchelf(pid=32261): Launched 11:31:56.532851 run osmo-stp_10.42.42.5(pid=32258): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32258)] 11:31:56.667136 run osmo-stp_10.42.42.5(pid=32258): stdout: | (launched: 2022-12-09_11:31:55.249616) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:56.801728 run osmo-stp_10.42.42.5(pid=32258): stderr: | 20221209113155421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113155422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113155422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113155422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113155423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113155423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113155423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:56.936411 run osmo-stp_10.42.42.5(pid=32258): stdout: | (launched: 2022-12-09_11:31:55.249616) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:31:57.065743 run osmo-stp_10.42.42.5(pid=32258): stderr: | 20221209113155421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113155422 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113155422 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113155422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113155423 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113155423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113155423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:31:57.218861 run patchelf(pid=32261): Terminating (SIGINT) 11:31:57.397543 run patchelf(pid=32261): Terminated: ok {rc=0} 11:31:57.526311 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32258): Process ended prematurely: osmo-stp_10.42.42.5(pid=32258) [trial-2359↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32258)] [trial-2359↪gprs:oc2g↪iperf3.py:8] 11:31:57.535869 tst iperf3.py:8: Test FAILED (7.7 sec) 11:31:57.563345 run osmo-hlr_10.42.42.2(pid=32255): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32255)] 11:31:57.611552 run osmo-hlr_10.42.42.2(pid=32255): stdout: | (launched: 2022-12-09_11:31:54.271111) 11:31:57.661680 run osmo-hlr_10.42.42.2(pid=32255): stderr: | 20221209113154448 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113154448 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113154448 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113154448 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113154448 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113154448 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113154463 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113154473 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113154473 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113154473 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:31:57.712296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32250): Terminating (SIGTERM) 11:31:57.752521 run iperf3-srv_10.42.42.10(pid=32251): Terminating (SIGTERM) 11:31:57.792581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32254): Terminating (SIGTERM) 11:31:57.832837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32257): Terminating (SIGTERM) 11:31:57.872870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32260): Terminating (SIGTERM) 11:31:57.913267 --- ParallelTerminationStrategy: PID 32250 died... 11:31:57.932605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32250): Terminated: ok {rc=0} 11:31:57.976878 --- ParallelTerminationStrategy: PID 32251 died... 11:31:57.996020 run iperf3-srv_10.42.42.10(pid=32251): Terminated {rc=256} 11:31:58.040293 --- ParallelTerminationStrategy: PID 32254 died... 11:31:58.059145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32254): Terminated: ok {rc=0} 11:31:58.103414 --- ParallelTerminationStrategy: PID 32257 died... 11:31:58.122259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32257): Terminated: ok {rc=0} 11:31:58.166530 --- ParallelTerminationStrategy: PID 32260 died... 11:31:58.185330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32260): Terminated: ok {rc=0} 11:31:58.271780 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:oc2g iperf3m4.py ---------------------------------------------- 11:31:59.422859 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:31:59.434318 tst gprs:oc2g: Using 1 x bts (candidates: 1) 11:31:59.470367 tst iperf3m4.py: using LAC 21167 11:31:59.594296 tst iperf3m4.py: using RAC 2 11:31:59.718702 tst iperf3m4.py: using CellId 21167 11:31:59.843755 tst iperf3m4.py: using BVCI 21168 11:31:59.968567 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:31:59.979848 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:31:59.991010 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:00.002535 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:00.013930 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:00.025804 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:00.037151 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:00.049380 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:00.061092 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:32:00.182620 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:32:00.306500 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:32:00.424476 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:32:00.546713 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:32:00.757710 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:32:01.139164 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32262): Launched 11:32:01.443493 run iperf3-srv_10.42.42.10(pid=32263): Launched 11:32:01.587873 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:32:01.823018 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:32:02.170391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32264): Launched 11:32:02.473691 run iperf3-srv_10.42.42.10(pid=32265): Launched 11:32:02.618362 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:32:02.845554 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:32:03.184506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32266): Launched 11:32:03.478978 run iperf3-srv_10.42.42.10(pid=32267): Launched 11:32:03.607170 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:32:03.833958 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:32:04.171935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32268): Launched 11:32:04.466769 run iperf3-srv_10.42.42.10(pid=32269): Launched 11:32:04.594713 tst iperf3m4.py:8: start network... 11:32:04.822108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:32:05.343819 run create_hlr_db(pid=32270): Launched 11:32:05.473077 bus /gobi_6: Setting Powered False 11:32:06.539388 run create_hlr_db(pid=32270): Terminated: ok {rc=0} 11:32:07.009295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32272): Launched 11:32:07.347710 run osmo-hlr_10.42.42.2(pid=32273): Launched 11:32:07.477821 run osmo-stp_10.42.42.5: Starting osmo-stp 11:32:08.058460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32275): Launched 11:32:08.396635 run osmo-stp_10.42.42.5(pid=32276): Launched 11:32:08.526051 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:32:09.107363 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32278): Launched 11:32:09.238265 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:32:09.522319 run patchelf(pid=32279): Launched 11:32:09.709516 run osmo-stp_10.42.42.5(pid=32276): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32276)] 11:32:09.852143 run osmo-stp_10.42.42.5(pid=32276): stdout: | (launched: 2022-12-09_11:32:08.334800) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:09.995953 run osmo-stp_10.42.42.5(pid=32276): stderr: | 20221209113208525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113208525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113208525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113208526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113208526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113208526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113208526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:10.139717 run osmo-stp_10.42.42.5(pid=32276): stdout: | (launched: 2022-12-09_11:32:08.334800) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:10.277490 run osmo-stp_10.42.42.5(pid=32276): stderr: | 20221209113208525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113208525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113208525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113208526 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113208526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113208526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113208526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:10.440662 run patchelf(pid=32279): Terminating (SIGINT) 11:32:10.630126 run patchelf(pid=32279): Terminated: ok {rc=0} 11:32:10.767230 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32276): Process ended prematurely: osmo-stp_10.42.42.5(pid=32276) [trial-2359↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32276)] [trial-2359↪gprs:oc2g↪iperf3m4.py:8] 11:32:10.777583 tst iperf3m4.py:8: Test FAILED (11.4 sec) 11:32:10.807038 run osmo-hlr_10.42.42.2(pid=32273): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32273)] 11:32:10.858961 run osmo-hlr_10.42.42.2(pid=32273): stdout: | (launched: 2022-12-09_11:32:07.285943) 11:32:10.912149 run osmo-hlr_10.42.42.2(pid=32273): stderr: | 20221209113207482 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113207482 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113207482 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113207482 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113207482 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113207482 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113207495 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113207505 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113207506 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113207506 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:32:10.965693 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32262): Terminating (SIGTERM) 11:32:11.008477 run iperf3-srv_10.42.42.10(pid=32263): Terminating (SIGTERM) 11:32:11.050969 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32264): Terminating (SIGTERM) 11:32:11.093761 run iperf3-srv_10.42.42.10(pid=32265): Terminating (SIGTERM) 11:32:11.136130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32266): Terminating (SIGTERM) 11:32:11.178648 run iperf3-srv_10.42.42.10(pid=32267): Terminating (SIGTERM) 11:32:11.221053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32268): Terminating (SIGTERM) 11:32:11.263742 run iperf3-srv_10.42.42.10(pid=32269): Terminating (SIGTERM) 11:32:11.306290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32272): Terminating (SIGTERM) 11:32:11.348889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32275): Terminating (SIGTERM) 11:32:11.391737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32278): Terminating (SIGTERM) 11:32:11.434904 --- ParallelTerminationStrategy: PID 32262 died... 11:32:11.455257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32262): Terminated: ok {rc=0} 11:32:11.503076 --- ParallelTerminationStrategy: PID 32263 died... 11:32:11.523136 run iperf3-srv_10.42.42.10(pid=32263): Terminated {rc=256} 11:32:11.570575 --- ParallelTerminationStrategy: PID 32264 died... 11:32:11.590673 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32264): Terminated: ok {rc=0} 11:32:11.638056 --- ParallelTerminationStrategy: PID 32265 died... 11:32:11.657974 run iperf3-srv_10.42.42.10(pid=32265): Terminated {rc=256} 11:32:11.705175 --- ParallelTerminationStrategy: PID 32266 died... 11:32:11.725169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32266): Terminated: ok {rc=0} 11:32:11.772507 --- ParallelTerminationStrategy: PID 32267 died... 11:32:11.792521 run iperf3-srv_10.42.42.10(pid=32267): Terminated {rc=256} 11:32:11.840440 --- ParallelTerminationStrategy: PID 32268 died... 11:32:11.860404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32268): Terminated: ok {rc=0} 11:32:11.908064 --- ParallelTerminationStrategy: PID 32269 died... 11:32:11.928215 run iperf3-srv_10.42.42.10(pid=32269): Terminated {rc=256} 11:32:11.975687 --- ParallelTerminationStrategy: PID 32272 died... 11:32:11.995817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32272): Terminated: ok {rc=0} 11:32:12.043274 --- ParallelTerminationStrategy: PID 32275 died... 11:32:12.063188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32275): Terminated: ok {rc=0} 11:32:12.110621 --- ParallelTerminationStrategy: PID 32278 died... 11:32:12.130742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32278): Terminated: ok {rc=0} 11:32:12.220011 bus /gobi_4: Setting Powered False 11:32:13.322006 bus /gobi_4: Setting Powered False 11:32:14.442964 bus /gobi_1: Setting Powered False 11:32:15.545622 bus /gobi_1: Setting Powered False 11:32:16.665330 bus /gobi_0: Setting Powered False 11:32:17.764851 bus /gobi_0: Setting Powered False 11:32:18.884268 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:oc2g ping.py ---------------------------------------------- 11:32:19.989695 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:20.001631 tst gprs:oc2g: Using 1 x bts (candidates: 1) 11:32:20.038436 tst ping.py: using LAC 21168 11:32:20.171426 tst ping.py: using RAC 3 11:32:20.301109 tst ping.py: using CellId 21168 11:32:20.429607 tst ping.py: using BVCI 21169 11:32:20.551954 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:20.563299 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:20.574401 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:20.585571 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:20.596674 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:20.607987 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:20.619640 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:20.630838 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:32:20.752943 tst ping.py:19: start network... 11:32:20.977277 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:32:21.487628 run create_hlr_db(pid=32280): Launched 11:32:21.612824 bus /gobi_6: Setting Powered False 11:32:22.678489 run create_hlr_db(pid=32280): Terminated: ok {rc=0} 11:32:23.140555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32282): Launched 11:32:23.473151 run osmo-hlr_10.42.42.2(pid=32283): Launched 11:32:23.599561 run osmo-stp_10.42.42.5: Starting osmo-stp 11:32:24.177383 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32285): Launched 11:32:24.510813 run osmo-stp_10.42.42.5(pid=32286): Launched 11:32:24.638713 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:32:25.208774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32288): Launched 11:32:25.335442 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:32:25.614463 run patchelf(pid=32289): Launched 11:32:25.798903 run osmo-stp_10.42.42.5(pid=32286): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32286)] 11:32:25.939857 run osmo-stp_10.42.42.5(pid=32286): stdout: | (launched: 2022-12-09_11:32:24.449855) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:26.080940 run osmo-stp_10.42.42.5(pid=32286): stderr: | 20221209113224644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113224644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113224645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113224645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113224645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113224645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113224646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:26.222368 run osmo-stp_10.42.42.5(pid=32286): stdout: | (launched: 2022-12-09_11:32:24.449855) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:26.357902 run osmo-stp_10.42.42.5(pid=32286): stderr: | 20221209113224644 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113224644 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113224645 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113224645 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113224645 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113224645 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113224646 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:26.518282 run patchelf(pid=32289): Terminating (SIGINT) 11:32:26.704896 run patchelf(pid=32289): Terminated: ok {rc=0} 11:32:26.840214 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32286): Process ended prematurely: osmo-stp_10.42.42.5(pid=32286) [trial-2359↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32286)] [trial-2359↪gprs:oc2g↪ping.py:22] 11:32:26.849966 tst ping.py:22: Test FAILED (6.9 sec) 11:32:26.879367 run osmo-hlr_10.42.42.2(pid=32283): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32283)] 11:32:26.930736 run osmo-hlr_10.42.42.2(pid=32283): stdout: | (launched: 2022-12-09_11:32:23.412276) 11:32:26.984091 run osmo-hlr_10.42.42.2(pid=32283): stderr: | 20221209113223612 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113223612 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113223612 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113223612 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113223612 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113223612 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113223625 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113223633 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113223633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113223633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:32:27.037764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32282): Terminating (SIGTERM) 11:32:27.081050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32285): Terminating (SIGTERM) 11:32:27.124244 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32288): Terminating (SIGTERM) 11:32:27.167756 --- ParallelTerminationStrategy: PID 32282 died... 11:32:27.188340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32282): Terminated: ok {rc=0} 11:32:27.236547 --- ParallelTerminationStrategy: PID 32285 died... 11:32:27.256670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32285): Terminated: ok {rc=0} 11:32:27.304574 --- ParallelTerminationStrategy: PID 32288 died... 11:32:27.324726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32288): Terminated: ok {rc=0} 11:32:27.414369 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 11:32:28.506174 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:28.517455 tst gprs:oc2g: Using 1 x bts (candidates: 1) 11:32:28.554262 tst ping_idle_ping.py: using LAC 21169 11:32:28.677468 tst ping_idle_ping.py: using RAC 4 11:32:28.800818 tst ping_idle_ping.py: using CellId 21169 11:32:28.929374 tst ping_idle_ping.py: using BVCI 21170 11:32:29.051950 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:29.063221 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:29.074582 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:29.086091 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:29.097616 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:29.108924 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:29.120353 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 11:32:29.131523 tst gprs:oc2g: Using 1 x modem (candidates: 4) 11:32:29.250334 tst ping_idle_ping.py:24: start network... 11:32:29.457927 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:32:29.939149 run create_hlr_db(pid=32290): Launched 11:32:30.065409 bus /gobi_6: Setting Powered False 11:32:31.130993 run create_hlr_db(pid=32290): Terminated: ok {rc=0} 11:32:31.613811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32292): Launched 11:32:31.935893 run osmo-hlr_10.42.42.2(pid=32293): Launched 11:32:32.185495 run osmo-stp_10.42.42.5: Starting osmo-stp 11:32:32.805507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32295): Launched 11:32:33.140149 run osmo-stp_10.42.42.5(pid=32296): Launched 11:32:33.268314 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:32:33.841591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32298): Launched 11:32:33.970879 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:32:34.252936 run patchelf(pid=32299): Launched 11:32:34.439673 run osmo-stp_10.42.42.5(pid=32296): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32296)] 11:32:34.580662 run osmo-stp_10.42.42.5(pid=32296): stdout: | (launched: 2022-12-09_11:32:33.079223) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:34.722957 run osmo-stp_10.42.42.5(pid=32296): stderr: | 20221209113233271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113233272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113233272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113233272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113233273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113233273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113233273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:34.865817 run osmo-stp_10.42.42.5(pid=32296): stdout: | (launched: 2022-12-09_11:32:33.079223) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:35.002019 run osmo-stp_10.42.42.5(pid=32296): stderr: | 20221209113233271 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113233272 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113233272 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113233272 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113233273 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113233273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113233273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:35.163105 run patchelf(pid=32299): Terminating (SIGINT) 11:32:35.351095 run patchelf(pid=32299): Terminated: ok {rc=0} 11:32:35.486318 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32296): Process ended prematurely: osmo-stp_10.42.42.5(pid=32296) [trial-2359↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32296)] [trial-2359↪gprs:oc2g↪ping_idle_ping.py:27] 11:32:35.496063 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 11:32:35.525305 run osmo-hlr_10.42.42.2(pid=32293): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32293)] 11:32:35.576525 run osmo-hlr_10.42.42.2(pid=32293): stdout: | (launched: 2022-12-09_11:32:31.877087) 11:32:35.629480 run osmo-hlr_10.42.42.2(pid=32293): stderr: | 20221209113232168 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113232168 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113232168 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113232168 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113232168 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113232168 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113232182 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113232198 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113232198 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113232199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:32:35.683093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32292): Terminating (SIGTERM) 11:32:35.725670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32295): Terminating (SIGTERM) 11:32:35.768644 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32298): Terminating (SIGTERM) 11:32:35.813824 --- ParallelTerminationStrategy: PID 32292 died... 11:32:35.836027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32292): Terminated: ok {rc=0} 11:32:35.881702 --- ParallelTerminationStrategy: PID 32295 died... 11:32:35.900423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32295): Terminated: ok {rc=0} 11:32:35.946272 --- ParallelTerminationStrategy: PID 32298 died... 11:32:35.965256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32298): Terminated: ok {rc=0} 11:32:36.054350 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 11:32:37.349728 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:32:37.355313 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:32:37.375970 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:32:37.413907 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:32:37.499775 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:32:37.520144 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:32:37.558263 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:32:38.152304 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:32:38.201679 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:38.212313 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:32:38.248939 tst cs_paging_gprs_active.py: using LAC 21170 11:32:38.372036 tst cs_paging_gprs_active.py: using RAC 5 11:32:38.496020 tst cs_paging_gprs_active.py: using CellId 21170 11:32:38.621044 tst cs_paging_gprs_active.py: using BVCI 21171 11:32:38.734975 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:38.745821 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:38.756357 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:38.767432 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:38.778439 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:38.789475 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:38.800612 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:38.811679 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:38.823009 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:32:38.946098 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:32:39.068370 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:32:39.292275 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:32:39.623564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32307): Launched 11:32:39.910787 run iperf3-srv_10.42.42.10(pid=32308): Launched 11:32:40.036018 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:32:40.258243 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:32:40.588364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32309): Launched 11:32:40.875877 run iperf3-srv_10.42.42.10(pid=32310): Launched 11:32:41.000159 tst cs_paging_gprs_active.py:38: start network... 11:32:41.222197 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:32:41.734383 run create_hlr_db(pid=32311): Launched 11:32:41.862704 bus /gobi_6: Setting Powered False 11:32:42.928093 run create_hlr_db(pid=32311): Terminated: ok {rc=0} 11:32:43.370808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32313): Launched 11:32:43.682384 run osmo-hlr_10.42.42.2(pid=32314): Launched 11:32:43.800203 run osmo-stp_10.42.42.5: Starting osmo-stp 11:32:44.332038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32316): Launched 11:32:44.641385 run osmo-stp_10.42.42.5(pid=32317): Launched 11:32:44.759906 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:32:45.296064 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32319): Launched 11:32:45.414043 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:32:45.675451 run patchelf(pid=32320): Launched 11:32:45.849434 run osmo-stp_10.42.42.5(pid=32317): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32317)] 11:32:45.985354 run osmo-stp_10.42.42.5(pid=32317): stdout: | (launched: 2022-12-09_11:32:44.584299) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:46.119434 run osmo-stp_10.42.42.5(pid=32317): stderr: | 20221209113244756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113244757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113244757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113244757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113244758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113244758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113244758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:46.257188 run osmo-stp_10.42.42.5(pid=32317): stdout: | (launched: 2022-12-09_11:32:44.584299) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:46.386312 run osmo-stp_10.42.42.5(pid=32317): stderr: | 20221209113244756 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113244757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113244757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113244757 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113244758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113244758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113244758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:46.539631 run patchelf(pid=32320): Terminating (SIGINT) 11:32:46.718023 run patchelf(pid=32320): Terminated: ok {rc=0} 11:32:46.846465 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32317): Process ended prematurely: osmo-stp_10.42.42.5(pid=32317) [trial-2359↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32317)] [trial-2359↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:32:46.857243 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 11:32:46.886002 run osmo-hlr_10.42.42.2(pid=32314): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32314)] 11:32:46.936185 run osmo-hlr_10.42.42.2(pid=32314): stdout: | (launched: 2022-12-09_11:32:43.625526) 11:32:46.988354 run osmo-hlr_10.42.42.2(pid=32314): stderr: | 20221209113243803 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113243803 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113243803 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113243803 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113243803 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113243803 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113243815 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113243826 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113243826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113243826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:32:47.040831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32307): Terminating (SIGTERM) 11:32:47.083645 run iperf3-srv_10.42.42.10(pid=32308): Terminating (SIGTERM) 11:32:47.128501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32309): Terminating (SIGTERM) 11:32:47.171013 run iperf3-srv_10.42.42.10(pid=32310): Terminating (SIGTERM) 11:32:47.215405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32313): Terminating (SIGTERM) 11:32:47.257340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32316): Terminating (SIGTERM) 11:32:47.298003 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32319): Terminating (SIGTERM) 11:32:47.338565 --- ParallelTerminationStrategy: PID 32307 died... 11:32:47.357809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32307): Terminated: ok {rc=0} 11:32:47.402642 --- ParallelTerminationStrategy: PID 32308 died... 11:32:47.421364 run iperf3-srv_10.42.42.10(pid=32308): Terminated {rc=256} 11:32:47.466287 --- ParallelTerminationStrategy: PID 32309 died... 11:32:47.485136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32309): Terminated: ok {rc=0} 11:32:47.529691 --- ParallelTerminationStrategy: PID 32310 died... 11:32:47.548447 run iperf3-srv_10.42.42.10(pid=32310): Terminated {rc=256} 11:32:47.593118 --- ParallelTerminationStrategy: PID 32313 died... 11:32:47.611881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32313): Terminated: ok {rc=0} 11:32:47.656258 --- ParallelTerminationStrategy: PID 32316 died... 11:32:47.675115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32316): Terminated: ok {rc=0} 11:32:47.719377 --- ParallelTerminationStrategy: PID 32319 died... 11:32:47.738329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32319): Terminated: ok {rc=0} 11:32:47.826229 bus /gobi_0: Setting Powered False 11:32:48.927934 bus /gobi_0: Setting Powered False 11:32:50.041805 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:32:51.191854 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:51.203921 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:32:51.242759 tst iperf3.py: using LAC 21171 11:32:51.374644 tst iperf3.py: using RAC 6 11:32:51.507609 tst iperf3.py: using CellId 21171 11:32:51.638732 tst iperf3.py: using BVCI 21172 11:32:51.759511 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:51.770892 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:51.782139 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:51.793581 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:51.804806 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:51.816079 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:51.827409 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:51.839012 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:32:51.850644 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:32:51.972438 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:32:52.195262 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:32:52.526633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32321): Launched 11:32:52.815328 run iperf3-srv_10.42.42.10(pid=32322): Launched 11:32:52.939159 tst iperf3.py:8: start network... 11:32:53.160754 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:32:53.670416 run create_hlr_db(pid=32323): Launched 11:32:53.798496 bus /gobi_6: Setting Powered False 11:32:54.863526 run create_hlr_db(pid=32323): Terminated: ok {rc=0} 11:32:55.306079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32325): Launched 11:32:55.616059 run osmo-hlr_10.42.42.2(pid=32326): Launched 11:32:55.735569 run osmo-stp_10.42.42.5: Starting osmo-stp 11:32:56.283878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32328): Launched 11:32:56.595430 run osmo-stp_10.42.42.5(pid=32329): Launched 11:32:56.713434 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:32:57.247635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32331): Launched 11:32:57.365779 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:32:57.626191 run patchelf(pid=32332): Launched 11:32:57.798134 run osmo-stp_10.42.42.5(pid=32329): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32329)] 11:32:57.929257 run osmo-stp_10.42.42.5(pid=32329): stdout: | (launched: 2022-12-09_11:32:56.538088) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:58.061698 run osmo-stp_10.42.42.5(pid=32329): stderr: | 20221209113256709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113256709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113256709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113256710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113256710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113256710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113256710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:58.194480 run osmo-stp_10.42.42.5(pid=32329): stdout: | (launched: 2022-12-09_11:32:56.538088) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:32:58.321240 run osmo-stp_10.42.42.5(pid=32329): stderr: | 20221209113256709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113256709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113256709 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113256710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113256710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113256710 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113256710 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:32:58.471268 run patchelf(pid=32332): Terminating (SIGINT) 11:32:58.645302 run patchelf(pid=32332): Terminated: ok {rc=0} 11:32:58.771312 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32329): Process ended prematurely: osmo-stp_10.42.42.5(pid=32329) [trial-2359↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32329)] [trial-2359↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 11:32:58.780845 tst iperf3.py:8: Test FAILED (7.6 sec) 11:32:58.808378 run osmo-hlr_10.42.42.2(pid=32326): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32326)] 11:32:58.856381 run osmo-hlr_10.42.42.2(pid=32326): stdout: | (launched: 2022-12-09_11:32:55.559085) 11:32:58.905926 run osmo-hlr_10.42.42.2(pid=32326): stderr: | 20221209113255735 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113255735 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113255735 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113255735 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113255736 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113255736 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113255748 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113255756 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113255756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113255756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:32:58.956007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32321): Terminating (SIGTERM) 11:32:58.996202 run iperf3-srv_10.42.42.10(pid=32322): Terminating (SIGTERM) 11:32:59.036330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32325): Terminating (SIGTERM) 11:32:59.077169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32328): Terminating (SIGTERM) 11:32:59.117584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32331): Terminating (SIGTERM) 11:32:59.157824 --- ParallelTerminationStrategy: PID 32321 died... 11:32:59.176907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32321): Terminated: ok {rc=0} 11:32:59.221583 --- ParallelTerminationStrategy: PID 32322 died... 11:32:59.240305 run iperf3-srv_10.42.42.10(pid=32322): Terminated {rc=256} 11:32:59.284758 --- ParallelTerminationStrategy: PID 32325 died... 11:32:59.303597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32325): Terminated: ok {rc=0} 11:32:59.348190 --- ParallelTerminationStrategy: PID 32328 died... 11:32:59.367145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32328): Terminated: ok {rc=0} 11:32:59.411849 --- ParallelTerminationStrategy: PID 32331 died... 11:32:59.430860 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32331): Terminated: ok {rc=0} 11:32:59.518284 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:33:00.668892 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:00.680313 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:33:00.717478 tst iperf3m4.py: using LAC 21172 11:33:00.838337 tst iperf3m4.py: using RAC 7 11:33:00.971201 tst iperf3m4.py: using CellId 21172 11:33:01.095056 tst iperf3m4.py: using BVCI 21173 11:33:01.211506 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:01.223181 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:01.234529 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:01.246012 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:01.257305 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:01.268599 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:01.280157 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:01.291469 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:01.302957 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:33:01.423929 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:33:01.546495 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:33:01.674221 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:33:01.800876 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:33:02.013359 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:33:02.330225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32334): Launched 11:33:02.631874 run iperf3-srv_10.42.42.10(pid=32335): Launched 11:33:02.755924 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:33:02.978390 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:33:03.309912 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32336): Launched 11:33:03.597325 run iperf3-srv_10.42.42.10(pid=32337): Launched 11:33:03.721280 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:33:03.944081 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:33:04.275385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32338): Launched 11:33:04.563858 run iperf3-srv_10.42.42.10(pid=32339): Launched 11:33:04.687492 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:33:04.909659 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:33:05.240490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32340): Launched 11:33:05.529932 run iperf3-srv_10.42.42.10(pid=32341): Launched 11:33:05.653586 tst iperf3m4.py:8: start network... 11:33:05.875430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:33:06.386835 run create_hlr_db(pid=32342): Launched 11:33:06.512218 bus /gobi_6: Setting Powered False 11:33:07.576579 run create_hlr_db(pid=32342): Terminated: ok {rc=0} 11:33:08.035645 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32344): Launched 11:33:08.368071 run osmo-hlr_10.42.42.2(pid=32345): Launched 11:33:08.493962 run osmo-stp_10.42.42.5: Starting osmo-stp 11:33:09.059921 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32347): Launched 11:33:09.391344 run osmo-stp_10.42.42.5(pid=32348): Launched 11:33:09.519171 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:33:10.087259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32350): Launched 11:33:10.216709 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:33:10.496416 run patchelf(pid=32351): Launched 11:33:10.682231 run osmo-stp_10.42.42.5(pid=32348): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32348)] 11:33:10.822270 run osmo-stp_10.42.42.5(pid=32348): stdout: | (launched: 2022-12-09_11:33:09.330834) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:10.964309 run osmo-stp_10.42.42.5(pid=32348): stderr: | 20221209113309518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113309518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113309518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113309518 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113309519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113309519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113309519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:11.106086 run osmo-stp_10.42.42.5(pid=32348): stdout: | (launched: 2022-12-09_11:33:09.330834) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:11.241730 run osmo-stp_10.42.42.5(pid=32348): stderr: | 20221209113309518 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113309518 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113309518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113309518 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113309519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113309519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113309519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:11.402172 run patchelf(pid=32351): Terminating (SIGINT) 11:33:11.588120 run patchelf(pid=32351): Terminated: ok {rc=0} 11:33:11.722907 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32348): Process ended prematurely: osmo-stp_10.42.42.5(pid=32348) [trial-2359↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32348)] [trial-2359↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 11:33:11.733402 tst iperf3m4.py:8: Test FAILED (11.1 sec) 11:33:11.763006 run osmo-hlr_10.42.42.2(pid=32345): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32345)] 11:33:11.814018 run osmo-hlr_10.42.42.2(pid=32345): stdout: | (launched: 2022-12-09_11:33:08.307513) 11:33:11.867332 run osmo-hlr_10.42.42.2(pid=32345): stderr: | 20221209113308503 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113308503 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113308503 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113308503 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113308503 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113308503 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113308516 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113308526 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113308526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113308526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:33:11.921062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32334): Terminating (SIGTERM) 11:33:11.964010 run iperf3-srv_10.42.42.10(pid=32335): Terminating (SIGTERM) 11:33:12.006702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32336): Terminating (SIGTERM) 11:33:12.049548 run iperf3-srv_10.42.42.10(pid=32337): Terminating (SIGTERM) 11:33:12.092513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32338): Terminating (SIGTERM) 11:33:12.136008 run iperf3-srv_10.42.42.10(pid=32339): Terminating (SIGTERM) 11:33:12.179018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32340): Terminating (SIGTERM) 11:33:12.221820 run iperf3-srv_10.42.42.10(pid=32341): Terminating (SIGTERM) 11:33:12.264493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32344): Terminating (SIGTERM) 11:33:12.307916 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32347): Terminating (SIGTERM) 11:33:12.350940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32350): Terminating (SIGTERM) 11:33:12.394006 --- ParallelTerminationStrategy: PID 32334 died... 11:33:12.414216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32334): Terminated: ok {rc=0} 11:33:12.462050 --- ParallelTerminationStrategy: PID 32335 died... 11:33:12.482044 run iperf3-srv_10.42.42.10(pid=32335): Terminated {rc=256} 11:33:12.529876 --- ParallelTerminationStrategy: PID 32336 died... 11:33:12.549702 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32336): Terminated: ok {rc=0} 11:33:12.597060 --- ParallelTerminationStrategy: PID 32337 died... 11:33:12.616683 run iperf3-srv_10.42.42.10(pid=32337): Terminated {rc=256} 11:33:12.663990 --- ParallelTerminationStrategy: PID 32338 died... 11:33:12.683989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32338): Terminated: ok {rc=0} 11:33:12.731210 --- ParallelTerminationStrategy: PID 32339 died... 11:33:12.750946 run iperf3-srv_10.42.42.10(pid=32339): Terminated {rc=256} 11:33:12.798042 --- ParallelTerminationStrategy: PID 32340 died... 11:33:12.817751 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32340): Terminated: ok {rc=0} 11:33:12.865346 --- ParallelTerminationStrategy: PID 32341 died... 11:33:12.885184 run iperf3-srv_10.42.42.10(pid=32341): Terminated {rc=256} 11:33:12.932484 --- ParallelTerminationStrategy: PID 32344 died... 11:33:12.952278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32344): Terminated: ok {rc=0} 11:33:13.000115 --- ParallelTerminationStrategy: PID 32347 died... 11:33:13.020099 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32347): Terminated: ok {rc=0} 11:33:13.067437 --- ParallelTerminationStrategy: PID 32350 died... 11:33:13.087533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32350): Terminated: ok {rc=0} 11:33:13.178852 bus /gobi_4: Setting Powered False 11:33:14.278570 bus /gobi_4: Setting Powered False 11:33:15.398488 bus /gobi_1: Setting Powered False 11:33:16.509141 bus /gobi_1: Setting Powered False 11:33:17.646287 bus /gobi_0: Setting Powered False 11:33:18.746768 bus /gobi_0: Setting Powered False 11:33:19.862226 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 11:33:20.966839 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:20.979064 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:33:21.018230 tst ping.py: using LAC 21173 11:33:21.146248 tst ping.py: using RAC 8 11:33:21.272924 tst ping.py: using CellId 21173 11:33:21.401507 tst ping.py: using BVCI 21174 11:33:21.520765 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:21.532223 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:21.543487 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:21.554965 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:21.566331 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:21.577668 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:21.589230 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:21.600763 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:33:21.718307 tst ping.py:19: start network... 11:33:21.922973 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:33:22.393736 run create_hlr_db(pid=32352): Launched 11:33:22.519011 bus /gobi_6: Setting Powered False 11:33:23.579088 run create_hlr_db(pid=32352): Terminated: ok {rc=0} 11:33:24.022895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32354): Launched 11:33:24.348191 run osmo-hlr_10.42.42.2(pid=32355): Launched 11:33:24.471045 run osmo-stp_10.42.42.5: Starting osmo-stp 11:33:25.031140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32357): Launched 11:33:25.357269 run osmo-stp_10.42.42.5(pid=32358): Launched 11:33:25.480560 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:33:26.039568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32360): Launched 11:33:26.165006 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:33:26.438881 run patchelf(pid=32361): Launched 11:33:26.620668 run osmo-stp_10.42.42.5(pid=32358): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32358)] 11:33:26.758722 run osmo-stp_10.42.42.5(pid=32358): stdout: | (launched: 2022-12-09_11:33:25.297851) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:26.898172 run osmo-stp_10.42.42.5(pid=32358): stderr: | 20221209113325490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113325490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113325490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113325491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113325491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113325491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113325491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:27.037904 run osmo-stp_10.42.42.5(pid=32358): stdout: | (launched: 2022-12-09_11:33:25.297851) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:27.170968 run osmo-stp_10.42.42.5(pid=32358): stderr: | 20221209113325490 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113325490 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113325490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113325491 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113325491 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113325491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113325491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:27.328828 run patchelf(pid=32361): Terminating (SIGINT) 11:33:27.512291 run patchelf(pid=32361): Terminated: ok {rc=0} 11:33:27.644575 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32358): Process ended prematurely: osmo-stp_10.42.42.5(pid=32358) [trial-2359↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32358)] [trial-2359↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 11:33:27.654383 tst ping.py:22: Test FAILED (6.7 sec) 11:33:27.683313 run osmo-hlr_10.42.42.2(pid=32355): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32355)] 11:33:27.734615 run osmo-hlr_10.42.42.2(pid=32355): stdout: | (launched: 2022-12-09_11:33:24.288729) 11:33:27.787819 run osmo-hlr_10.42.42.2(pid=32355): stderr: | 20221209113324487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113324487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113324487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113324487 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113324487 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113324487 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113324501 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113324510 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113324510 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113324510 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:33:27.841415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32354): Terminating (SIGTERM) 11:33:27.884171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32357): Terminating (SIGTERM) 11:33:27.926821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32360): Terminating (SIGTERM) 11:33:27.970390 --- ParallelTerminationStrategy: PID 32354 died... 11:33:27.990778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32354): Terminated: ok {rc=0} 11:33:28.038298 --- ParallelTerminationStrategy: PID 32357 died... 11:33:28.058296 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32357): Terminated: ok {rc=0} 11:33:28.105590 --- ParallelTerminationStrategy: PID 32360 died... 11:33:28.125448 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32360): Terminated: ok {rc=0} 11:33:28.215103 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:33:29.302288 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:29.314817 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:33:29.355900 tst ping_idle_ping.py: using LAC 21174 11:33:29.483709 tst ping_idle_ping.py: using RAC 9 11:33:29.610106 tst ping_idle_ping.py: using CellId 21174 11:33:29.739084 tst ping_idle_ping.py: using BVCI 21175 11:33:29.850591 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:29.861704 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:29.872592 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:29.883570 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:29.894354 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:29.905097 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:29.915826 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:33:29.926617 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:33:30.045634 tst ping_idle_ping.py:24: start network... 11:33:30.249363 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:33:30.722974 run create_hlr_db(pid=32362): Launched 11:33:30.851243 bus /gobi_6: Setting Powered False 11:33:31.927476 run create_hlr_db(pid=32362): Terminated: ok {rc=0} 11:33:32.414612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32364): Launched 11:33:32.742601 run osmo-hlr_10.42.42.2(pid=32365): Launched 11:33:32.870388 run osmo-stp_10.42.42.5: Starting osmo-stp 11:33:33.433813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32367): Launched 11:33:33.761385 run osmo-stp_10.42.42.5(pid=32368): Launched 11:33:33.886475 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:33:34.451156 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32370): Launched 11:33:34.578563 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:33:34.855092 run patchelf(pid=32371): Launched 11:33:35.036897 run osmo-stp_10.42.42.5(pid=32368): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32368)] 11:33:35.175844 run osmo-stp_10.42.42.5(pid=32368): stdout: | (launched: 2022-12-09_11:33:33.701429) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:35.315988 run osmo-stp_10.42.42.5(pid=32368): stderr: | 20221209113333892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113333892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113333893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113333893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113333894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113333894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113333894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:35.456300 run osmo-stp_10.42.42.5(pid=32368): stdout: | (launched: 2022-12-09_11:33:33.701429) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:35.590415 run osmo-stp_10.42.42.5(pid=32368): stderr: | 20221209113333892 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113333892 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113333893 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113333893 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113333894 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113333894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113333894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:35.749016 run patchelf(pid=32371): Terminating (SIGINT) 11:33:35.934370 run patchelf(pid=32371): Terminated: ok {rc=0} 11:33:36.067654 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32368): Process ended prematurely: osmo-stp_10.42.42.5(pid=32368) [trial-2359↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32368)] [trial-2359↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 11:33:36.077642 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 11:33:36.106876 run osmo-hlr_10.42.42.2(pid=32365): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32365)] 11:33:36.158498 run osmo-hlr_10.42.42.2(pid=32365): stdout: | (launched: 2022-12-09_11:33:32.683014) 11:33:36.211680 run osmo-hlr_10.42.42.2(pid=32365): stderr: | 20221209113332880 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113332880 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113332880 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113332880 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113332880 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113332880 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113332892 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113332901 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113332901 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113332901 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:33:36.265555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32364): Terminating (SIGTERM) 11:33:36.308865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32367): Terminating (SIGTERM) 11:33:36.352313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32370): Terminating (SIGTERM) 11:33:36.395888 --- ParallelTerminationStrategy: PID 32364 died... 11:33:36.416378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32364): Terminated: ok {rc=0} 11:33:36.464467 --- ParallelTerminationStrategy: PID 32367 died... 11:33:36.484590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32367): Terminated: ok {rc=0} 11:33:36.532581 --- ParallelTerminationStrategy: PID 32370 died... 11:33:36.552688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32370): Terminated: ok {rc=0} 11:33:36.643082 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:33:37.941720 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:33:37.948016 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:33:37.968997 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:33:38.007260 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:33:38.093971 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:33:38.114422 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:33:38.152538 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:33:38.746561 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:33:38.796340 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:38.807375 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:33:38.863336 tst cs_paging_gprs_active.py: using LAC 21175 11:33:38.987908 tst cs_paging_gprs_active.py: using RAC 10 11:33:39.111778 tst cs_paging_gprs_active.py: using CellId 21175 11:33:39.235861 tst cs_paging_gprs_active.py: using BVCI 21176 11:33:39.350627 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:39.361708 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:39.372587 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:39.383238 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:39.394007 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:39.404557 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:39.415335 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:39.425801 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:39.436444 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:33:39.556443 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:33:39.673520 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:33:39.883363 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:33:40.197706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32376): Launched 11:33:40.472159 run iperf3-srv_10.42.42.10(pid=32377): Launched 11:33:40.589748 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:33:40.798130 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:33:41.112001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32378): Launched 11:33:41.384484 run iperf3-srv_10.42.42.10(pid=32379): Launched 11:33:41.504520 tst cs_paging_gprs_active.py:38: start network... 11:33:41.713549 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:33:42.197311 run create_hlr_db(pid=32380): Launched 11:33:42.323628 bus /gobi_6: Setting Powered False 11:33:43.386264 run create_hlr_db(pid=32380): Terminated: ok {rc=0} 11:33:43.842781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32382): Launched 11:33:44.177319 run osmo-hlr_10.42.42.2(pid=32383): Launched 11:33:44.304765 run osmo-stp_10.42.42.5: Starting osmo-stp 11:33:44.878467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32385): Launched 11:33:45.195977 run osmo-stp_10.42.42.5(pid=32386): Launched 11:33:45.314388 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:33:45.872940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32388): Launched 11:33:46.006715 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:33:46.281745 run patchelf(pid=32389): Launched 11:33:46.471371 run osmo-stp_10.42.42.5(pid=32386): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32386)] 11:33:46.607415 run osmo-stp_10.42.42.5(pid=32386): stdout: | (launched: 2022-12-09_11:33:45.138372) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:46.743600 run osmo-stp_10.42.42.5(pid=32386): stderr: | 20221209113345309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113345309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113345310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113345310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113345311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113345311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113345311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:46.880011 run osmo-stp_10.42.42.5(pid=32386): stdout: | (launched: 2022-12-09_11:33:45.138372) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:47.009856 run osmo-stp_10.42.42.5(pid=32386): stderr: | 20221209113345309 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113345309 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113345310 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113345310 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113345311 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113345311 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113345311 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:47.163292 run patchelf(pid=32389): Terminating (SIGINT) 11:33:47.341969 run patchelf(pid=32389): Terminated: ok {rc=0} 11:33:47.470163 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32386): Process ended prematurely: osmo-stp_10.42.42.5(pid=32386) [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32386)] [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:33:47.479749 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 11:33:47.507568 run osmo-hlr_10.42.42.2(pid=32383): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32383)] 11:33:47.556187 run osmo-hlr_10.42.42.2(pid=32383): stdout: | (launched: 2022-12-09_11:33:44.116111) 11:33:47.606666 run osmo-hlr_10.42.42.2(pid=32383): stderr: | 20221209113344315 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113344315 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113344315 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113344315 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113344315 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113344315 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113344327 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113344336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113344336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113344336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:33:47.657400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32376): Terminating (SIGTERM) 11:33:47.698207 run iperf3-srv_10.42.42.10(pid=32377): Terminating (SIGTERM) 11:33:47.739255 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32378): Terminating (SIGTERM) 11:33:47.779846 run iperf3-srv_10.42.42.10(pid=32379): Terminating (SIGTERM) 11:33:47.820377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32382): Terminating (SIGTERM) 11:33:47.861386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32385): Terminating (SIGTERM) 11:33:47.902002 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32388): Terminating (SIGTERM) 11:33:47.942801 --- ParallelTerminationStrategy: PID 32376 died... 11:33:47.962178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32376): Terminated: ok {rc=0} 11:33:48.007039 --- ParallelTerminationStrategy: PID 32377 died... 11:33:48.025925 run iperf3-srv_10.42.42.10(pid=32377): Terminated {rc=256} 11:33:48.070459 --- ParallelTerminationStrategy: PID 32378 died... 11:33:48.089384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32378): Terminated: ok {rc=0} 11:33:48.134075 --- ParallelTerminationStrategy: PID 32379 died... 11:33:48.152826 run iperf3-srv_10.42.42.10(pid=32379): Terminated {rc=256} 11:33:48.197430 --- ParallelTerminationStrategy: PID 32382 died... 11:33:48.216373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32382): Terminated: ok {rc=0} 11:33:48.261074 --- ParallelTerminationStrategy: PID 32385 died... 11:33:48.279843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32385): Terminated: ok {rc=0} 11:33:48.324240 --- ParallelTerminationStrategy: PID 32388 died... 11:33:48.343126 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32388): Terminated: ok {rc=0} 11:33:48.428301 bus /gobi_0: Setting Powered False 11:33:49.526474 bus /gobi_0: Setting Powered False 11:33:50.646496 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:33:51.795054 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:51.806673 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:33:51.868382 tst iperf3.py: using LAC 21176 11:33:51.999950 tst iperf3.py: using RAC 11 11:33:52.128457 tst iperf3.py: using CellId 21176 11:33:52.258241 tst iperf3.py: using BVCI 21177 11:33:52.379895 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:52.391579 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:52.402928 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:52.414377 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:52.426293 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:52.437897 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:52.450255 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:52.462197 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:33:52.473982 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:33:52.593115 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:33:52.801237 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:33:53.113196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32390): Launched 11:33:53.383721 run iperf3-srv_10.42.42.10(pid=32391): Launched 11:33:53.499989 tst iperf3.py:8: start network... 11:33:53.707053 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:33:54.187053 run create_hlr_db(pid=32392): Launched 11:33:54.313975 bus /gobi_6: Setting Powered False 11:33:55.375635 run create_hlr_db(pid=32392): Terminated: ok {rc=0} 11:33:55.807977 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32394): Launched 11:33:56.119233 run osmo-hlr_10.42.42.2(pid=32395): Launched 11:33:56.236240 run osmo-stp_10.42.42.5: Starting osmo-stp 11:33:56.769336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32397): Launched 11:33:57.079172 run osmo-stp_10.42.42.5(pid=32398): Launched 11:33:57.196491 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:33:57.732489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32400): Launched 11:33:57.853204 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:33:58.115073 run patchelf(pid=32401): Launched 11:33:58.288928 run osmo-stp_10.42.42.5(pid=32398): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32398)] 11:33:58.419574 run osmo-stp_10.42.42.5(pid=32398): stdout: | (launched: 2022-12-09_11:33:57.022268) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:58.551713 run osmo-stp_10.42.42.5(pid=32398): stderr: | 20221209113357194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113357194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113357194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113357195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113357195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113357195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113357195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:58.684523 run osmo-stp_10.42.42.5(pid=32398): stdout: | (launched: 2022-12-09_11:33:57.022268) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:33:58.811487 run osmo-stp_10.42.42.5(pid=32398): stderr: | 20221209113357194 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113357194 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113357194 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113357195 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113357195 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113357195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113357195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:33:58.962154 run patchelf(pid=32401): Terminating (SIGINT) 11:33:59.136708 run patchelf(pid=32401): Terminated: ok {rc=0} 11:33:59.263432 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32398): Process ended prematurely: osmo-stp_10.42.42.5(pid=32398) [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32398)] [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 11:33:59.273201 tst iperf3.py:8: Test FAILED (7.5 sec) 11:33:59.300345 run osmo-hlr_10.42.42.2(pid=32395): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32395)] 11:33:59.348469 run osmo-hlr_10.42.42.2(pid=32395): stdout: | (launched: 2022-12-09_11:33:56.061395) 11:33:59.398355 run osmo-hlr_10.42.42.2(pid=32395): stderr: | 20221209113356242 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113356242 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113356242 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113356242 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113356242 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113356242 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113356258 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113356268 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113356269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113356269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:33:59.448632 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32390): Terminating (SIGTERM) 11:33:59.488735 run iperf3-srv_10.42.42.10(pid=32391): Terminating (SIGTERM) 11:33:59.528746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32394): Terminating (SIGTERM) 11:33:59.569990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32397): Terminating (SIGTERM) 11:33:59.609919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32400): Terminating (SIGTERM) 11:33:59.650138 --- ParallelTerminationStrategy: PID 32390 died... 11:33:59.669367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32390): Terminated: ok {rc=0} 11:33:59.713999 --- ParallelTerminationStrategy: PID 32391 died... 11:33:59.732599 run iperf3-srv_10.42.42.10(pid=32391): Terminated {rc=256} 11:33:59.776242 --- ParallelTerminationStrategy: PID 32394 died... 11:33:59.794773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32394): Terminated: ok {rc=0} 11:33:59.838679 --- ParallelTerminationStrategy: PID 32397 died... 11:33:59.857250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32397): Terminated: ok {rc=0} 11:33:59.901563 --- ParallelTerminationStrategy: PID 32400 died... 11:33:59.920229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32400): Terminated: ok {rc=0} 11:34:00.005743 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 11:34:01.193944 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:01.207245 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:34:01.269174 tst iperf3m4.py: using LAC 21177 11:34:01.404507 tst iperf3m4.py: using RAC 12 11:34:01.552207 tst iperf3m4.py: using CellId 21177 11:34:01.677274 tst iperf3m4.py: using BVCI 21178 11:34:01.799785 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:01.811857 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:01.823643 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:01.835459 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:01.848576 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:01.861154 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:01.873127 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:01.885844 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:01.898655 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:34:02.022206 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:34:02.179018 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:34:02.306259 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:34:02.429725 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:34:02.638695 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:34:02.952344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32402): Launched 11:34:03.225684 run iperf3-srv_10.42.42.10(pid=32403): Launched 11:34:03.343070 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:34:03.551167 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:34:03.865122 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32404): Launched 11:34:04.135724 run iperf3-srv_10.42.42.10(pid=32405): Launched 11:34:04.252453 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:34:04.459893 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:34:04.771068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32406): Launched 11:34:05.043969 run iperf3-srv_10.42.42.10(pid=32407): Launched 11:34:05.160564 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:34:05.367542 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:34:05.680499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32408): Launched 11:34:05.953689 run iperf3-srv_10.42.42.10(pid=32409): Launched 11:34:06.070682 tst iperf3m4.py:8: start network... 11:34:06.279648 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:34:06.763948 run create_hlr_db(pid=32410): Launched 11:34:06.890543 bus /gobi_6: Setting Powered False 11:34:07.951526 run create_hlr_db(pid=32410): Terminated: ok {rc=0} 11:34:08.384145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32412): Launched 11:34:08.694998 run osmo-hlr_10.42.42.2(pid=32413): Launched 11:34:08.812127 run osmo-stp_10.42.42.5: Starting osmo-stp 11:34:09.364596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32415): Launched 11:34:09.676590 run osmo-stp_10.42.42.5(pid=32416): Launched 11:34:09.795576 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:34:10.331268 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32418): Launched 11:34:10.450436 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:34:10.712897 run patchelf(pid=32419): Launched 11:34:10.885509 run osmo-stp_10.42.42.5(pid=32416): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32416)] 11:34:11.017441 run osmo-stp_10.42.42.5(pid=32416): stdout: | (launched: 2022-12-09_11:34:09.618777) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:11.150535 run osmo-stp_10.42.42.5(pid=32416): stderr: | 20221209113409788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113409788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113409788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113409789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113409789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113409790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113409790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:11.283327 run osmo-stp_10.42.42.5(pid=32416): stdout: | (launched: 2022-12-09_11:34:09.618777) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:11.410809 run osmo-stp_10.42.42.5(pid=32416): stderr: | 20221209113409788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113409788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113409788 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113409789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113409789 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113409790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113409790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:11.561950 run patchelf(pid=32419): Terminating (SIGINT) 11:34:11.738751 run patchelf(pid=32419): Terminated: ok {rc=0} 11:34:11.865861 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32416): Process ended prematurely: osmo-stp_10.42.42.5(pid=32416) [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32416)] [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:34:11.875313 tst iperf3m4.py:8: Test FAILED (10.7 sec) 11:34:11.905841 run osmo-hlr_10.42.42.2(pid=32413): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32413)] 11:34:11.955432 run osmo-hlr_10.42.42.2(pid=32413): stdout: | (launched: 2022-12-09_11:34:08.637697) 11:34:12.005569 run osmo-hlr_10.42.42.2(pid=32413): stderr: | 20221209113408813 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113408813 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113408813 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113408813 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113408814 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113408814 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113408825 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113408833 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113408833 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113408833 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:34:12.056142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32402): Terminating (SIGTERM) 11:34:12.096607 run iperf3-srv_10.42.42.10(pid=32403): Terminating (SIGTERM) 11:34:12.136840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32404): Terminating (SIGTERM) 11:34:12.177154 run iperf3-srv_10.42.42.10(pid=32405): Terminating (SIGTERM) 11:34:12.217422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32406): Terminating (SIGTERM) 11:34:12.257907 run iperf3-srv_10.42.42.10(pid=32407): Terminating (SIGTERM) 11:34:12.298275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32408): Terminating (SIGTERM) 11:34:12.338812 run iperf3-srv_10.42.42.10(pid=32409): Terminating (SIGTERM) 11:34:12.379133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32412): Terminating (SIGTERM) 11:34:12.419548 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32415): Terminating (SIGTERM) 11:34:12.460023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32418): Terminating (SIGTERM) 11:34:12.500554 --- ParallelTerminationStrategy: PID 32402 died... 11:34:12.519923 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32402): Terminated: ok {rc=0} 11:34:12.565586 --- ParallelTerminationStrategy: PID 32403 died... 11:34:12.584631 run iperf3-srv_10.42.42.10(pid=32403): Terminated {rc=256} 11:34:12.629212 --- ParallelTerminationStrategy: PID 32404 died... 11:34:12.648181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32404): Terminated: ok {rc=0} 11:34:12.692893 --- ParallelTerminationStrategy: PID 32405 died... 11:34:12.712371 run iperf3-srv_10.42.42.10(pid=32405): Terminated {rc=256} 11:34:12.756642 --- ParallelTerminationStrategy: PID 32406 died... 11:34:12.775445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32406): Terminated: ok {rc=0} 11:34:12.819867 --- ParallelTerminationStrategy: PID 32407 died... 11:34:12.838708 run iperf3-srv_10.42.42.10(pid=32407): Terminated {rc=256} 11:34:12.883112 --- ParallelTerminationStrategy: PID 32408 died... 11:34:12.901972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32408): Terminated: ok {rc=0} 11:34:12.946367 --- ParallelTerminationStrategy: PID 32409 died... 11:34:12.965393 run iperf3-srv_10.42.42.10(pid=32409): Terminated {rc=256} 11:34:13.009759 --- ParallelTerminationStrategy: PID 32412 died... 11:34:13.028783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32412): Terminated: ok {rc=0} 11:34:13.073614 --- ParallelTerminationStrategy: PID 32415 died... 11:34:13.092715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32415): Terminated: ok {rc=0} 11:34:13.137300 --- ParallelTerminationStrategy: PID 32418 died... 11:34:13.155972 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32418): Terminated: ok {rc=0} 11:34:13.243310 bus /gobi_4: Setting Powered False 11:34:14.345897 bus /gobi_4: Setting Powered False 11:34:15.463439 bus /gobi_1: Setting Powered False 11:34:16.563809 bus /gobi_1: Setting Powered False 11:34:17.699529 bus /gobi_0: Setting Powered False 11:34:18.800373 bus /gobi_0: Setting Powered False 11:34:19.920350 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:34:21.028358 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:21.040657 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:34:21.099809 tst ping.py: using LAC 21178 11:34:21.229548 tst ping.py: using RAC 13 11:34:21.356636 tst ping.py: using CellId 21178 11:34:21.486396 tst ping.py: using BVCI 21179 11:34:21.607039 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:21.618624 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:21.630066 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:21.641484 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:21.652922 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:21.664363 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:21.676103 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:21.687550 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:34:21.807827 tst ping.py:19: start network... 11:34:22.012570 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:34:22.484251 run create_hlr_db(pid=32420): Launched 11:34:22.608404 bus /gobi_6: Setting Powered False 11:34:23.669991 run create_hlr_db(pid=32420): Terminated: ok {rc=0} 11:34:24.118827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32422): Launched 11:34:24.446442 run osmo-hlr_10.42.42.2(pid=32423): Launched 11:34:24.571978 run osmo-stp_10.42.42.5: Starting osmo-stp 11:34:25.143110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32425): Launched 11:34:25.470289 run osmo-stp_10.42.42.5(pid=32426): Launched 11:34:25.595531 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:34:26.159996 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32428): Launched 11:34:26.284920 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:34:26.560426 run patchelf(pid=32429): Launched 11:34:26.742393 run osmo-stp_10.42.42.5(pid=32426): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32426)] 11:34:26.881381 run osmo-stp_10.42.42.5(pid=32426): stdout: | (launched: 2022-12-09_11:34:25.410706) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:27.021708 run osmo-stp_10.42.42.5(pid=32426): stderr: | 20221209113425603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113425603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113425603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113425603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113425604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113425604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113425604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:27.161897 run osmo-stp_10.42.42.5(pid=32426): stdout: | (launched: 2022-12-09_11:34:25.410706) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:27.295788 run osmo-stp_10.42.42.5(pid=32426): stderr: | 20221209113425603 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113425603 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113425603 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113425603 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113425604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113425604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113425604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:27.454205 run patchelf(pid=32429): Terminating (SIGINT) 11:34:27.639452 run patchelf(pid=32429): Terminated: ok {rc=0} 11:34:27.772779 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=32426): Process ended prematurely: osmo-stp_10.42.42.5(pid=32426) [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32426)] [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 11:34:27.782687 tst ping.py:22: Test FAILED (6.7 sec) 11:34:27.811764 run osmo-hlr_10.42.42.2(pid=32423): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32423)] 11:34:27.863123 run osmo-hlr_10.42.42.2(pid=32423): stdout: | (launched: 2022-12-09_11:34:24.386957) 11:34:27.916756 run osmo-hlr_10.42.42.2(pid=32423): stderr: | 20221209113424585 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113424585 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113424585 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113424585 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113424585 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113424585 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113424599 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113424609 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113424609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113424609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:34:27.970611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32422): Terminating (SIGTERM) 11:34:28.013912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32425): Terminating (SIGTERM) 11:34:28.057298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32428): Terminating (SIGTERM) 11:34:28.100914 --- ParallelTerminationStrategy: PID 32422 died... 11:34:28.121501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32422): Terminated: ok {rc=0} 11:34:28.169449 --- ParallelTerminationStrategy: PID 32425 died... 11:34:28.189369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32425): Terminated: ok {rc=0} 11:34:28.237156 --- ParallelTerminationStrategy: PID 32428 died... 11:34:28.257128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32428): Terminated: ok {rc=0} 11:34:28.346708 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 11:34:29.435445 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:29.447069 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:34:29.503128 tst ping_idle_ping.py: using LAC 21179 11:34:29.624449 tst ping_idle_ping.py: using RAC 14 11:34:29.744030 tst ping_idle_ping.py: using CellId 21179 11:34:29.862873 tst ping_idle_ping.py: using BVCI 21180 11:34:29.974864 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:29.985952 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:29.996503 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:30.007444 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:30.018319 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:30.029215 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:30.040082 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:34:30.050976 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:34:30.168204 tst ping_idle_ping.py:24: start network... 11:34:30.373636 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:34:30.855911 run create_hlr_db(pid=32430): Launched 11:34:31.002075 bus /gobi_6: Setting Powered False 11:34:32.062302 run create_hlr_db(pid=32430): Terminated: ok {rc=0} 11:34:32.511850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32432): Launched 11:34:32.838886 run osmo-hlr_10.42.42.2(pid=32433): Launched 11:34:32.965580 run osmo-stp_10.42.42.5: Starting osmo-stp 11:34:33.531535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32435): Launched 11:34:33.859901 run osmo-stp_10.42.42.5(pid=32436): Launched 11:34:33.985408 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:34:34.550631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32438): Launched 11:34:34.677766 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:34:34.954597 run patchelf(pid=32439): Launched 11:34:35.137429 run osmo-stp_10.42.42.5(pid=32436): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32436)] 11:34:35.276892 run osmo-stp_10.42.42.5(pid=32436): stdout: | (launched: 2022-12-09_11:34:33.799868) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:35.417697 run osmo-stp_10.42.42.5(pid=32436): stderr: | 20221209113433991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113433991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113433992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113433992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113433993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113433993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113433993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:35.558276 run osmo-stp_10.42.42.5(pid=32436): stdout: | (launched: 2022-12-09_11:34:33.799868) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:35.692018 run osmo-stp_10.42.42.5(pid=32436): stderr: | 20221209113433991 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113433991 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113433992 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113433992 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113433993 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113433993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113433993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:35.851261 run patchelf(pid=32439): Terminating (SIGINT) 11:34:36.037135 run patchelf(pid=32439): Terminated: ok {rc=0} 11:34:36.170985 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=32436): Process ended prematurely: osmo-stp_10.42.42.5(pid=32436) [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32436)] [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 11:34:36.180668 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 11:34:36.209853 run osmo-hlr_10.42.42.2(pid=32433): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32433)] 11:34:36.261276 run osmo-hlr_10.42.42.2(pid=32433): stdout: | (launched: 2022-12-09_11:34:32.779387) 11:34:36.314432 run osmo-hlr_10.42.42.2(pid=32433): stderr: | 20221209113432977 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113432977 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113432978 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113432978 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113432978 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113432978 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113432990 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113432999 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113432999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113432999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:34:36.368221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32432): Terminating (SIGTERM) 11:34:36.411358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32435): Terminating (SIGTERM) 11:34:36.454401 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32438): Terminating (SIGTERM) 11:34:36.497654 --- ParallelTerminationStrategy: PID 32432 died... 11:34:36.517947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32432): Terminated: ok {rc=0} 11:34:36.565677 --- ParallelTerminationStrategy: PID 32435 died... 11:34:36.585677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32435): Terminated: ok {rc=0} 11:34:36.633202 --- ParallelTerminationStrategy: PID 32438 died... 11:34:36.653133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32438): Terminated: ok {rc=0} 11:34:36.743888 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:34:38.046521 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:34:38.053140 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:34:38.074891 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 11:34:38.114968 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 11:34:38.204022 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:34:38.225288 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 11:34:38.264858 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 11:34:38.861847 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 11:34:38.915631 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:38.927047 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:34:38.985626 tst cs_paging_gprs_active.py: using LAC 21180 11:34:39.115828 tst cs_paging_gprs_active.py: using RAC 15 11:34:39.237420 tst cs_paging_gprs_active.py: using CellId 21180 11:34:39.357061 tst cs_paging_gprs_active.py: using BVCI 21181 11:34:39.469982 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:39.481111 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:39.491781 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:39.502700 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:39.513238 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:39.523781 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:39.534527 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:39.545047 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:39.555735 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:34:39.676438 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:34:39.798862 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:34:40.025306 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:34:40.358655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32444): Launched 11:34:40.648485 run iperf3-srv_10.42.42.10(pid=32445): Launched 11:34:40.773899 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:34:40.998716 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:34:41.333832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32446): Launched 11:34:41.606756 run iperf3-srv_10.42.42.10(pid=32447): Launched 11:34:41.723774 tst cs_paging_gprs_active.py:38: start network... 11:34:41.933374 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:34:42.416775 run create_hlr_db(pid=32449): Launched 11:34:42.544314 bus /gobi_6: Setting Powered False 11:34:43.606775 run create_hlr_db(pid=32449): Terminated: ok {rc=0} 11:34:44.042898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32451): Launched 11:34:44.355841 run osmo-hlr_10.42.42.2(pid=32452): Launched 11:34:44.475298 run osmo-stp_10.42.42.5: Starting osmo-stp 11:34:45.011729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32454): Launched 11:34:45.324458 run osmo-stp_10.42.42.5(pid=32455): Launched 11:34:45.443602 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:34:45.985636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32457): Launched 11:34:46.126044 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:34:46.397636 run patchelf(pid=32458): Launched 11:34:46.599071 run osmo-stp_10.42.42.5(pid=32455): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32455)] 11:34:46.746788 run osmo-stp_10.42.42.5(pid=32455): stdout: | (launched: 2022-12-09_11:34:45.266623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:46.894236 run osmo-stp_10.42.42.5(pid=32455): stderr: | 20221209113445440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113445440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113445440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113445440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113445441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113445441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113445441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:47.044023 run osmo-stp_10.42.42.5(pid=32455): stdout: | (launched: 2022-12-09_11:34:45.266623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:47.187321 run osmo-stp_10.42.42.5(pid=32455): stderr: | 20221209113445440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113445440 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113445440 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113445440 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113445441 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113445441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113445441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:47.353172 run patchelf(pid=32458): Terminating (SIGINT) 11:34:47.543015 run patchelf(pid=32458): Terminated: ok {rc=0} 11:34:47.679395 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=32455): Process ended prematurely: osmo-stp_10.42.42.5(pid=32455) [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32455)] [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 11:34:47.690238 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 11:34:47.720195 run osmo-hlr_10.42.42.2(pid=32452): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32452)] 11:34:47.772287 run osmo-hlr_10.42.42.2(pid=32452): stdout: | (launched: 2022-12-09_11:34:44.298331) 11:34:47.825968 run osmo-hlr_10.42.42.2(pid=32452): stderr: | 20221209113444476 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113444476 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113444476 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113444476 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113444476 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113444476 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113444489 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113444497 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113444497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113444497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:34:47.880035 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32444): Terminating (SIGTERM) 11:34:47.923865 run iperf3-srv_10.42.42.10(pid=32445): Terminating (SIGTERM) 11:34:47.967175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32446): Terminating (SIGTERM) 11:34:48.010426 run iperf3-srv_10.42.42.10(pid=32447): Terminating (SIGTERM) 11:34:48.053792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32451): Terminating (SIGTERM) 11:34:48.097248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32454): Terminating (SIGTERM) 11:34:48.140501 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32457): Terminating (SIGTERM) 11:34:48.184389 --- ParallelTerminationStrategy: PID 32444 died... 11:34:48.204997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32444): Terminated: ok {rc=0} 11:34:48.252871 --- ParallelTerminationStrategy: PID 32445 died... 11:34:48.273171 run iperf3-srv_10.42.42.10(pid=32445): Terminated {rc=256} 11:34:48.320629 --- ParallelTerminationStrategy: PID 32446 died... 11:34:48.340672 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32446): Terminated: ok {rc=0} 11:34:48.388146 --- ParallelTerminationStrategy: PID 32447 died... 11:34:48.407908 run iperf3-srv_10.42.42.10(pid=32447): Terminated {rc=256} 11:34:48.455472 --- ParallelTerminationStrategy: PID 32451 died... 11:34:48.475322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32451): Terminated: ok {rc=0} 11:34:48.523097 --- ParallelTerminationStrategy: PID 32454 died... 11:34:48.543191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32454): Terminated: ok {rc=0} 11:34:48.590902 --- ParallelTerminationStrategy: PID 32457 died... 11:34:48.611030 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32457): Terminated: ok {rc=0} 11:34:48.701832 bus /gobi_0: Setting Powered False 11:34:49.803333 bus /gobi_0: Setting Powered False 11:34:50.921981 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 11:34:52.067465 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:52.078969 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:34:52.138253 tst iperf3.py: using LAC 21181 11:34:52.261710 tst iperf3.py: using RAC 16 11:34:52.393056 tst iperf3.py: using CellId 21181 11:34:52.524823 tst iperf3.py: using BVCI 21182 11:34:52.647679 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:52.659378 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:52.670739 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:52.682608 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:52.694233 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:52.705988 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:52.717674 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:52.729108 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:34:52.740537 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:34:52.860106 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:34:53.087103 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:34:53.420320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32459): Launched 11:34:53.709590 run iperf3-srv_10.42.42.10(pid=32460): Launched 11:34:53.834822 tst iperf3.py:8: start network... 11:34:54.060392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:34:54.576928 run create_hlr_db(pid=32461): Launched 11:34:54.703211 bus /gobi_6: Setting Powered False 11:34:55.768303 run create_hlr_db(pid=32461): Terminated: ok {rc=0} 11:34:56.230571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32463): Launched 11:34:56.562685 run osmo-hlr_10.42.42.2(pid=32464): Launched 11:34:56.691581 run osmo-stp_10.42.42.5: Starting osmo-stp 11:34:57.261396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32466): Launched 11:34:57.593952 run osmo-stp_10.42.42.5(pid=32467): Launched 11:34:57.721832 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:34:58.294499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32469): Launched 11:34:58.423787 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:34:58.704250 run patchelf(pid=32470): Launched 11:34:58.889173 run osmo-stp_10.42.42.5(pid=32467): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32467)] 11:34:59.030548 run osmo-stp_10.42.42.5(pid=32467): stdout: | (launched: 2022-12-09_11:34:57.533477) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:59.172757 run osmo-stp_10.42.42.5(pid=32467): stderr: | 20221209113457727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113457727 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113457727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113457728 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113457728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113457728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113457728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:59.315204 run osmo-stp_10.42.42.5(pid=32467): stdout: | (launched: 2022-12-09_11:34:57.533477) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:34:59.451607 run osmo-stp_10.42.42.5(pid=32467): stderr: | 20221209113457727 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113457727 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113457727 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113457728 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113457728 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113457728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113457728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:34:59.613101 run patchelf(pid=32470): Terminating (SIGINT) 11:34:59.800303 run patchelf(pid=32470): Terminated: ok {rc=0} 11:34:59.936623 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32467): Process ended prematurely: osmo-stp_10.42.42.5(pid=32467) [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32467)] [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 11:34:59.947102 tst iperf3.py:8: Test FAILED (7.9 sec) 11:34:59.976678 run osmo-hlr_10.42.42.2(pid=32464): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32464)] 11:35:00.028193 run osmo-hlr_10.42.42.2(pid=32464): stdout: | (launched: 2022-12-09_11:34:56.502365) 11:35:00.081530 run osmo-hlr_10.42.42.2(pid=32464): stderr: | 20221209113456700 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113456700 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113456700 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113456700 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113456700 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113456700 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113456713 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113456722 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113456723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113456723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:35:00.135501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32459): Terminating (SIGTERM) 11:35:00.178684 run iperf3-srv_10.42.42.10(pid=32460): Terminating (SIGTERM) 11:35:00.221720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32463): Terminating (SIGTERM) 11:35:00.264849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32466): Terminating (SIGTERM) 11:35:00.308166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32469): Terminating (SIGTERM) 11:35:00.351562 --- ParallelTerminationStrategy: PID 32459 died... 11:35:00.372007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32459): Terminated: ok {rc=0} 11:35:00.420474 --- ParallelTerminationStrategy: PID 32460 died... 11:35:00.440473 run iperf3-srv_10.42.42.10(pid=32460): Terminated {rc=256} 11:35:00.488029 --- ParallelTerminationStrategy: PID 32463 died... 11:35:00.507979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32463): Terminated: ok {rc=0} 11:35:00.555863 --- ParallelTerminationStrategy: PID 32466 died... 11:35:00.575874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32466): Terminated: ok {rc=0} 11:35:00.623738 --- ParallelTerminationStrategy: PID 32469 died... 11:35:00.643682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32469): Terminated: ok {rc=0} 11:35:00.733655 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 11:35:01.945892 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:01.968437 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:35:02.050146 tst iperf3m4.py: using LAC 21182 11:35:02.196897 tst iperf3m4.py: using RAC 17 11:35:02.362420 tst iperf3m4.py: using CellId 21182 11:35:02.503459 tst iperf3m4.py: using BVCI 21183 11:35:02.625423 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:02.637128 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:02.648602 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:02.659980 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:02.671651 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:02.683676 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:02.695292 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:02.706958 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:02.718768 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:35:02.842475 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:35:02.968662 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:35:03.088576 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:35:03.208255 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:35:03.418133 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:35:03.730618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32481): Launched 11:35:04.002626 run iperf3-srv_10.42.42.10(pid=32482): Launched 11:35:04.121565 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:35:04.328601 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:35:04.642484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32483): Launched 11:35:04.915183 run iperf3-srv_10.42.42.10(pid=32484): Launched 11:35:05.031935 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:35:05.239143 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:35:05.550514 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32485): Launched 11:35:05.824331 run iperf3-srv_10.42.42.10(pid=32486): Launched 11:35:05.940713 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:35:06.147886 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:35:06.458614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32487): Launched 11:35:06.731117 run iperf3-srv_10.42.42.10(pid=32488): Launched 11:35:06.847867 tst iperf3m4.py:8: start network... 11:35:07.055152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:35:07.536054 run create_hlr_db(pid=32489): Launched 11:35:07.663297 bus /gobi_6: Setting Powered False 11:35:08.724503 run create_hlr_db(pid=32489): Terminated: ok {rc=0} 11:35:09.158913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32491): Launched 11:35:09.470468 run osmo-hlr_10.42.42.2(pid=32492): Launched 11:35:09.587503 run osmo-stp_10.42.42.5: Starting osmo-stp 11:35:10.127481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32494): Launched 11:35:10.439604 run osmo-stp_10.42.42.5(pid=32495): Launched 11:35:10.557378 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:35:11.091545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32497): Launched 11:35:11.210628 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:35:11.472790 run patchelf(pid=32498): Launched 11:35:11.645783 run osmo-stp_10.42.42.5(pid=32495): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32495)] 11:35:11.777212 run osmo-stp_10.42.42.5(pid=32495): stdout: | (launched: 2022-12-09_11:35:10.382338) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:11.910287 run osmo-stp_10.42.42.5(pid=32495): stderr: | 20221209113510550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113510550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113510551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113510551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113510552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113510552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113510552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:12.043333 run osmo-stp_10.42.42.5(pid=32495): stdout: | (launched: 2022-12-09_11:35:10.382338) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:12.171549 run osmo-stp_10.42.42.5(pid=32495): stderr: | 20221209113510550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113510550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113510551 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113510551 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113510552 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113510552 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113510552 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:12.322287 run patchelf(pid=32498): Terminating (SIGINT) 11:35:12.498460 run patchelf(pid=32498): Terminated: ok {rc=0} 11:35:12.627905 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=32495): Process ended prematurely: osmo-stp_10.42.42.5(pid=32495) [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32495)] [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 11:35:12.638283 tst iperf3m4.py:8: Test FAILED (10.8 sec) 11:35:12.667050 run osmo-hlr_10.42.42.2(pid=32492): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=32492)] 11:35:12.717482 run osmo-hlr_10.42.42.2(pid=32492): stdout: | (launched: 2022-12-09_11:35:09.412337) 11:35:12.769735 run osmo-hlr_10.42.42.2(pid=32492): stderr: | 20221209113509588 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113509588 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113509589 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113509589 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113509589 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113509589 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113509600 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113509610 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113509610 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113509610 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:35:12.822386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32481): Terminating (SIGTERM) 11:35:12.864536 run iperf3-srv_10.42.42.10(pid=32482): Terminating (SIGTERM) 11:35:12.906584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32483): Terminating (SIGTERM) 11:35:12.949400 run iperf3-srv_10.42.42.10(pid=32484): Terminating (SIGTERM) 11:35:12.990572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32485): Terminating (SIGTERM) 11:35:13.032490 run iperf3-srv_10.42.42.10(pid=32486): Terminating (SIGTERM) 11:35:13.073936 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32487): Terminating (SIGTERM) 11:35:13.115952 run iperf3-srv_10.42.42.10(pid=32488): Terminating (SIGTERM) 11:35:13.157565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32491): Terminating (SIGTERM) 11:35:13.199247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32494): Terminating (SIGTERM) 11:35:13.240782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32497): Terminating (SIGTERM) 11:35:13.282472 --- ParallelTerminationStrategy: PID 32481 died... 11:35:13.302180 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32481): Terminated: ok {rc=0} 11:35:13.348420 --- ParallelTerminationStrategy: PID 32482 died... 11:35:13.368383 run iperf3-srv_10.42.42.10(pid=32482): Terminated {rc=256} 11:35:13.415087 --- ParallelTerminationStrategy: PID 32483 died... 11:35:13.434940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32483): Terminated: ok {rc=0} 11:35:13.481665 --- ParallelTerminationStrategy: PID 32484 died... 11:35:13.501344 run iperf3-srv_10.42.42.10(pid=32484): Terminated {rc=256} 11:35:13.547454 --- ParallelTerminationStrategy: PID 32485 died... 11:35:13.566929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32485): Terminated: ok {rc=0} 11:35:13.613683 --- ParallelTerminationStrategy: PID 32486 died... 11:35:13.633240 run iperf3-srv_10.42.42.10(pid=32486): Terminated {rc=256} 11:35:13.679156 --- ParallelTerminationStrategy: PID 32487 died... 11:35:13.698762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=32487): Terminated: ok {rc=0} 11:35:13.744938 --- ParallelTerminationStrategy: PID 32488 died... 11:35:13.764473 run iperf3-srv_10.42.42.10(pid=32488): Terminated {rc=256} 11:35:13.810187 --- ParallelTerminationStrategy: PID 32491 died... 11:35:13.829788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=32491): Terminated: ok {rc=0} 11:35:13.875668 --- ParallelTerminationStrategy: PID 32494 died... 11:35:13.895302 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=32494): Terminated: ok {rc=0} 11:35:13.942259 --- ParallelTerminationStrategy: PID 32497 died... 11:35:13.961776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=32497): Terminated: ok {rc=0} 11:35:14.050889 bus /gobi_4: Setting Powered False 11:35:15.152281 bus /gobi_4: Setting Powered False 11:35:16.267570 bus /gobi_1: Setting Powered False 11:35:17.366307 bus /gobi_1: Setting Powered False 11:35:18.484516 bus /gobi_0: Setting Powered False 11:35:19.585212 bus /gobi_0: Setting Powered False 11:35:20.705883 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 11:35:21.811840 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:21.823969 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:35:21.884374 tst ping.py: using LAC 21183 11:35:22.014392 tst ping.py: using RAC 18 11:35:22.141454 tst ping.py: using CellId 21183 11:35:22.268481 tst ping.py: using BVCI 21184 11:35:22.381264 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:22.392346 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:22.403171 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:22.414664 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:22.426054 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:22.437506 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:22.448882 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:22.460117 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:35:22.577226 tst ping.py:19: start network... 11:35:22.782103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:35:23.260935 run create_hlr_db(pid=452): Launched 11:35:23.427568 bus /gobi_6: Setting Powered False 11:35:24.492591 run create_hlr_db(pid=452): Terminated: ok {rc=0} 11:35:24.964543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=572): Launched 11:35:25.309456 run osmo-hlr_10.42.42.2(pid=573): Launched 11:35:25.559836 run osmo-stp_10.42.42.5: Starting osmo-stp 11:35:26.244358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=575): Launched 11:35:26.592716 run osmo-stp_10.42.42.5(pid=576): Launched 11:35:26.842306 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:35:27.498900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=578): Launched 11:35:27.639829 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:35:27.927703 run patchelf(pid=579): Launched 11:35:28.131490 run osmo-stp_10.42.42.5(pid=576): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=576)] 11:35:28.279221 run osmo-stp_10.42.42.5(pid=576): stdout: | (launched: 2022-12-09_11:35:26.531642) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:28.426435 run osmo-stp_10.42.42.5(pid=576): stderr: | 20221209113526824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113526825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113526825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113526825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113526826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113526826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113526826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:28.572555 run osmo-stp_10.42.42.5(pid=576): stdout: | (launched: 2022-12-09_11:35:26.531642) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:28.714033 run osmo-stp_10.42.42.5(pid=576): stderr: | 20221209113526824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113526825 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113526825 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113526825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113526826 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113526826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113526826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:28.880176 run patchelf(pid=579): Terminating (SIGINT) 11:35:29.067734 run patchelf(pid=579): Terminated: ok {rc=0} 11:35:29.202899 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=576): Process ended prematurely: osmo-stp_10.42.42.5(pid=576) [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=576)] [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 11:35:29.213030 tst ping.py:22: Test FAILED (7.4 sec) 11:35:29.243608 run osmo-hlr_10.42.42.2(pid=573): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=573)] 11:35:29.296570 run osmo-hlr_10.42.42.2(pid=573): stdout: | (launched: 2022-12-09_11:35:25.249725) 11:35:29.351264 run osmo-hlr_10.42.42.2(pid=573): stderr: | 20221209113525556 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113525556 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113525556 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113525556 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113525556 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113525556 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113525575 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113525593 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113525593 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113525593 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:35:29.406343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=572): Terminating (SIGTERM) 11:35:29.451033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=575): Terminating (SIGTERM) 11:35:29.495649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=578): Terminating (SIGTERM) 11:35:29.540219 --- ParallelTerminationStrategy: PID 572 died... 11:35:29.561336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=572): Terminated: ok {rc=0} 11:35:29.610790 --- ParallelTerminationStrategy: PID 575 died... 11:35:29.631462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=575): Terminated: ok {rc=0} 11:35:29.680654 --- ParallelTerminationStrategy: PID 578 died... 11:35:29.701427 run pcap-recorder_any(filters='host 10.42.42.6')(pid=578): Terminated: ok {rc=0} 11:35:29.793224 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 11:35:30.897470 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:30.917084 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:35:31.003620 tst ping_idle_ping.py: using LAC 21184 11:35:31.136264 tst ping_idle_ping.py: using RAC 19 11:35:31.305382 tst ping_idle_ping.py: using CellId 21184 11:35:31.453710 tst ping_idle_ping.py: using BVCI 21185 11:35:31.574240 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:31.586282 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:31.597707 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:31.609196 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:31.620469 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:31.631913 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:31.643730 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:35:31.655536 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:35:31.775431 tst ping_idle_ping.py:24: start network... 11:35:31.987051 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:35:32.530757 run create_hlr_db(pid=581): Launched 11:35:32.657530 bus /gobi_6: Setting Powered False 11:35:33.721921 run create_hlr_db(pid=581): Terminated: ok {rc=0} 11:35:34.163434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=583): Launched 11:35:34.495510 run osmo-hlr_10.42.42.2(pid=584): Launched 11:35:34.622168 run osmo-stp_10.42.42.5: Starting osmo-stp 11:35:35.192883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=586): Launched 11:35:35.523386 run osmo-stp_10.42.42.5(pid=587): Launched 11:35:35.648430 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:35:36.216667 run pcap-recorder_any(filters='host 10.42.42.6')(pid=589): Launched 11:35:36.343060 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:35:36.621813 run patchelf(pid=590): Launched 11:35:36.805146 run osmo-stp_10.42.42.5(pid=587): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=587)] 11:35:36.945822 run osmo-stp_10.42.42.5(pid=587): stdout: | (launched: 2022-12-09_11:35:35.462524) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:37.087236 run osmo-stp_10.42.42.5(pid=587): stderr: | 20221209113535657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113535658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113535658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113535658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113535659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113535659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113535659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:37.228623 run osmo-stp_10.42.42.5(pid=587): stdout: | (launched: 2022-12-09_11:35:35.462524) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:37.363827 run osmo-stp_10.42.42.5(pid=587): stderr: | 20221209113535657 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113535658 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113535658 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113535658 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113535659 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113535659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113535659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:37.524128 run patchelf(pid=590): Terminating (SIGINT) 11:35:37.710083 run patchelf(pid=590): Terminated: ok {rc=0} 11:35:37.844092 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=587): Process ended prematurely: osmo-stp_10.42.42.5(pid=587) [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=587)] [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 11:35:37.853926 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 11:35:37.883164 run osmo-hlr_10.42.42.2(pid=584): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=584)] 11:35:37.934782 run osmo-hlr_10.42.42.2(pid=584): stdout: | (launched: 2022-12-09_11:35:34.434788) 11:35:37.988066 run osmo-hlr_10.42.42.2(pid=584): stderr: | 20221209113534636 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113534636 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113534636 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113534636 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113534636 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113534636 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113534654 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113534662 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113534662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113534662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:35:38.041896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=583): Terminating (SIGTERM) 11:35:38.085774 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=586): Terminating (SIGTERM) 11:35:38.129140 run pcap-recorder_any(filters='host 10.42.42.6')(pid=589): Terminating (SIGTERM) 11:35:38.172250 --- ParallelTerminationStrategy: PID 583 died... 11:35:38.192684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=583): Terminated: ok {rc=0} 11:35:38.240492 --- ParallelTerminationStrategy: PID 586 died... 11:35:38.260448 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=586): Terminated: ok {rc=0} 11:35:38.307942 --- ParallelTerminationStrategy: PID 589 died... 11:35:38.328094 run pcap-recorder_any(filters='host 10.42.42.6')(pid=589): Terminated: ok {rc=0} 11:35:38.418372 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:35:39.727446 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:35:39.735010 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:35:39.756354 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 11:35:39.794758 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:35:39.850051 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:35:39.871575 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 11:35:39.908371 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:35:40.465975 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2359 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 11:35:40.471434 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:35:40.483222 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:35:40.543353 tst switch_tch_pdch.py: using LAC 21185 11:35:40.672027 tst switch_tch_pdch.py: using RAC 20 11:35:40.800007 tst switch_tch_pdch.py: using CellId 21185 11:35:40.929631 tst switch_tch_pdch.py: using BVCI 21186 11:35:41.050681 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:35:41.062579 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:35:41.074073 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:35:41.087526 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:35:41.099366 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:35:41.110777 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:35:41.122387 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:35:41.134063 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:35:41.255416 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:35:41.378503 tst switch_tch_pdch.py:51: start network... 11:35:41.586484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:35:42.064193 run create_hlr_db(pid=594): Launched 11:35:42.189888 bus /gobi_6: Setting Powered False 11:35:43.251186 run create_hlr_db(pid=594): Terminated: ok {rc=0} 11:35:43.701117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=596): Launched 11:35:44.028524 run osmo-hlr_10.42.42.2(pid=597): Launched 11:35:44.152938 run osmo-stp_10.42.42.5: Starting osmo-stp 11:35:44.727646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=599): Launched 11:35:45.055993 run osmo-stp_10.42.42.5(pid=600): Launched 11:35:45.181801 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:35:45.747691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=602): Launched 11:35:45.880521 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:35:46.181805 run patchelf(pid=603): Launched 11:35:46.370844 run osmo-stp_10.42.42.5(pid=600): ERR: Terminated: ERROR {rc=1} [trial-2359↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=600)] 11:35:46.506794 run osmo-stp_10.42.42.5(pid=600): stdout: | (launched: 2022-12-09_11:35:44.995460) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:46.643199 run osmo-stp_10.42.42.5(pid=600): stderr: | 20221209113545189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113545189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113545190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113545190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113545190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113545191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113545191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:46.779716 run osmo-stp_10.42.42.5(pid=600): stdout: | (launched: 2022-12-09_11:35:44.995460) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:46.909393 run osmo-stp_10.42.42.5(pid=600): stderr: | 20221209113545189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113545189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113545190 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113545190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113545190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113545191 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113545191 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:47.064073 run patchelf(pid=603): Terminating (SIGINT) 11:35:47.242796 run patchelf(pid=603): Terminated: ok {rc=0} 11:35:47.369109 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=600): Process ended prematurely: osmo-stp_10.42.42.5(pid=600) [trial-2359↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=600)] [trial-2359↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 11:35:47.378312 tst switch_tch_pdch.py:54: Test FAILED (6.9 sec) 11:35:47.405917 run osmo-hlr_10.42.42.2(pid=597): ERR: Terminated: ERROR {rc=237} [trial-2359↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=597)] 11:35:47.454561 run osmo-hlr_10.42.42.2(pid=597): stdout: | (launched: 2022-12-09_11:35:43.967484) 11:35:47.505339 run osmo-hlr_10.42.42.2(pid=597): stderr: | 20221209113544169 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113544169 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113544169 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113544169 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113544169 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113544169 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113544185 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113544195 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113544195 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113544195 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:35:47.556222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=596): Terminating (SIGTERM) 11:35:47.596495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=599): Terminating (SIGTERM) 11:35:47.636674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=602): Terminating (SIGTERM) 11:35:47.677090 --- ParallelTerminationStrategy: PID 596 died... 11:35:47.696377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=596): Terminated: ok {rc=0} 11:35:47.741118 --- ParallelTerminationStrategy: PID 599 died... 11:35:47.759812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=599): Terminated: ok {rc=0} 11:35:47.804128 --- ParallelTerminationStrategy: PID 602 died... 11:35:47.823124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=602): Terminated: ok {rc=0} 11:35:47.909785 bus /gobi_0: Setting Powered False 11:35:49.011313 bus /gobi_0: Setting Powered False 11:35:50.128035 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 11:35:51.386698 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:35:51.392224 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 11:35:51.412545 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 11:35:51.446732 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 11:35:51.499050 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 11:35:51.519506 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 11:35:51.553610 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 11:35:52.109462 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2359 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 11:35:52.114433 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:35:52.125530 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 11:35:52.186614 tst switch_tch_pdch.py: using LAC 21186 11:35:52.305158 tst switch_tch_pdch.py: using RAC 21 11:35:52.426850 tst switch_tch_pdch.py: using CellId 21186 11:35:52.547955 tst switch_tch_pdch.py: using BVCI 21187 11:35:52.658640 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:35:52.669733 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:35:52.680478 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:35:52.691217 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:35:52.701915 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:35:52.712553 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:35:52.723586 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:35:52.734360 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:35:52.856547 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:35:52.976386 tst switch_tch_pdch.py:51: start network... 11:35:53.182664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:35:53.631741 run create_hlr_db(pid=609): Launched 11:35:53.757444 bus /gobi_6: Setting Powered False 11:35:54.818383 run create_hlr_db(pid=609): Terminated: ok {rc=0} 11:35:55.239360 run pcap-recorder_any(filters='host 10.42.42.2')(pid=611): Launched 11:35:55.568777 run osmo-hlr_10.42.42.2(pid=612): Launched 11:35:55.695766 run osmo-stp_10.42.42.5: Starting osmo-stp 11:35:56.237450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=614): Launched 11:35:56.566930 run osmo-stp_10.42.42.5(pid=615): Launched 11:35:56.693271 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:35:57.229653 run pcap-recorder_any(filters='host 10.42.42.6')(pid=617): Launched 11:35:57.356931 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:35:57.634336 run patchelf(pid=618): Launched 11:35:57.817109 run osmo-stp_10.42.42.5(pid=615): ERR: Terminated: ERROR {rc=1} [trial-2359↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=615)] 11:35:57.956474 run osmo-stp_10.42.42.5(pid=615): stdout: | (launched: 2022-12-09_11:35:56.506203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:58.096492 run osmo-stp_10.42.42.5(pid=615): stderr: | 20221209113556699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113556699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113556699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113556700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113556700 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113556700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113556700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:58.236329 run osmo-stp_10.42.42.5(pid=615): stdout: | (launched: 2022-12-09_11:35:56.506203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:35:58.370237 run osmo-stp_10.42.42.5(pid=615): stderr: | 20221209113556699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113556699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113556699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113556700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113556700 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113556700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113556700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:35:58.529441 run patchelf(pid=618): Terminating (SIGINT) 11:35:58.713939 run patchelf(pid=618): Terminated: ok {rc=0} 11:35:58.847046 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=615): Process ended prematurely: osmo-stp_10.42.42.5(pid=615) [trial-2359↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=615)] [trial-2359↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 11:35:58.856762 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 11:35:58.885762 run osmo-hlr_10.42.42.2(pid=612): ERR: Terminated: ERROR {rc=237} [trial-2359↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=612)] 11:35:58.937528 run osmo-hlr_10.42.42.2(pid=612): stdout: | (launched: 2022-12-09_11:35:55.508267) 11:35:58.991084 run osmo-hlr_10.42.42.2(pid=612): stderr: | 20221209113555709 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113555709 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113555709 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113555709 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113555709 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113555709 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113555721 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113555730 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113555730 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113555730 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:35:59.044800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=611): Terminating (SIGTERM) 11:35:59.088027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=614): Terminating (SIGTERM) 11:35:59.131252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=617): Terminating (SIGTERM) 11:35:59.174308 --- ParallelTerminationStrategy: PID 611 died... 11:35:59.194622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=611): Terminated: ok {rc=0} 11:35:59.242592 --- ParallelTerminationStrategy: PID 614 died... 11:35:59.262500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=614): Terminated: ok {rc=0} 11:35:59.309843 --- ParallelTerminationStrategy: PID 617 died... 11:35:59.329598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=617): Terminated: ok {rc=0} 11:35:59.419506 bus /gobi_0: Setting Powered False 11:36:00.520458 bus /gobi_0: Setting Powered False 11:36:01.651629 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 nitb_sms:trx-b200 --------------------------------------------------------------------- 11:36:02.911274 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:36:02.915504 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 11:36:02.951139 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 11:36:02.958275 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 11:36:03.011277 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 11:36:03.044364 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 11:36:03.051202 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 11:36:03.592741 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 11:36:03.597987 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 11:36:03.608717 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 11:36:03.656882 tst mo_mt_sms.py: using LAC 21187 11:36:03.777611 tst mo_mt_sms.py: using RAC 22 11:36:03.897148 tst mo_mt_sms.py: using CellId 21187 11:36:04.016219 tst mo_mt_sms.py: using BVCI 21188 11:36:04.127643 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 11:36:04.247810 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 11:36:04.363613 tst mo_mt_sms.py:9: start nitb and bts... 11:36:04.571946 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:36:05.199356 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=623): Launched 11:36:05.508342 run osmo-nitb_10.42.42.2(pid=624): Launched 11:36:05.679081 run osmo-nitb_10.42.42.2(pid=624): ERR: Terminated: ERROR {rc=2} [trial-2359↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=624)] 11:36:05.816919 run osmo-nitb_10.42.42.2(pid=624): stdout: | (launched: 2022-12-09_11:36:05.451250) 11:36:05.956890 run osmo-nitb_10.42.42.2(pid=624): stderr: | (launched: 2022-12-09_11:36:05.496769) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:36:06.096820 run osmo-nitb_10.42.42.2(pid=624): stdout: | (launched: 2022-12-09_11:36:05.451250) 11:36:06.231270 run osmo-nitb_10.42.42.2(pid=624): stderr: | (launched: 2022-12-09_11:36:05.496769) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=624): Process ended prematurely: osmo-nitb_10.42.42.2(pid=624) [trial-2359↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=624)] 11:36:06.625163 tst osmo-nitb_10.42.42.2(pid=624): stdout: | (launched: 2022-12-09_11:36:05.451250) 11:36:06.749409 tst osmo-nitb_10.42.42.2(pid=624): stderr: | (launched: 2022-12-09_11:36:05.496769) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:36:06.895853 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=624): Process ended prematurely: osmo-nitb_10.42.42.2(pid=624) [trial-2359↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=624)] [trial-2359↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 11:36:06.904483 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 11:36:06.911265 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=623): Terminating (SIGTERM) 11:36:07.120684 --- ParallelTerminationStrategy: PID 623 died... 11:36:07.143060 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=623): Terminated: ok {rc=0} 11:36:07.230132 bus /sierra_3: Setting Powered False 11:36:08.333149 bus /sierra_3: Setting Powered False 11:36:09.451730 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 sms:trx-b200 --------------------------------------------------------------------- 11:36:10.652341 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:36:10.656238 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 11:36:10.689219 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 11:36:10.715870 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 11:36:10.767661 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 11:36:10.800362 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 11:36:10.826730 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 11:36:11.374264 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 11:36:11.379168 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:36:11.389892 tst sms:trx-b200: Using 1 x bts (candidates: 1) 11:36:11.436684 tst mo_mt_sms.py: using LAC 21188 11:36:11.557225 tst mo_mt_sms.py: using RAC 23 11:36:11.677836 tst mo_mt_sms.py: using CellId 21188 11:36:11.811025 tst mo_mt_sms.py: using BVCI 21189 11:36:11.933805 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:36:11.945185 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:36:11.956283 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:36:11.967871 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:36:11.979388 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 11:36:11.990974 tst sms:trx-b200: Using 1 x modem (candidates: 2) 11:36:12.109957 tst sms:trx-b200: Using 1 x modem (candidates: 2) 11:36:12.232237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:36:12.708935 run create_hlr_db(pid=628): Launched 11:36:12.835040 bus /sierra_2: Setting Powered False 11:36:13.896355 run create_hlr_db(pid=628): Terminated: ok {rc=0} 11:36:14.326523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=630): Launched 11:36:14.636216 run osmo-hlr_10.42.42.2(pid=631): Launched 11:36:14.752612 run osmo-stp_10.42.42.5: Starting osmo-stp 11:36:15.295945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=633): Launched 11:36:15.604572 run osmo-stp_10.42.42.5(pid=634): Launched 11:36:15.720495 run osmo-msc_10.42.42.6: Starting osmo-msc 11:36:16.353138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=636): Launched 11:36:16.706661 run osmo-msc_10.42.42.6(pid=637): Launched 11:36:17.090332 run osmo-stp_10.42.42.5(pid=634): ERR: Terminated: ERROR {rc=1} [trial-2359↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=634)] 11:36:17.264335 run osmo-stp_10.42.42.5(pid=634): stdout: | (launched: 2022-12-09_11:36:15.547367) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:17.411504 run osmo-stp_10.42.42.5(pid=634): stderr: | 20221209113615720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113615720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113615721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113615721 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113615722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113615722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113615722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:17.549943 run osmo-stp_10.42.42.5(pid=634): stdout: | (launched: 2022-12-09_11:36:15.547367) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:17.681173 run osmo-stp_10.42.42.5(pid=634): stderr: | 20221209113615720 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113615720 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113615721 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113615721 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113615722 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113615722 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113615722 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:17.836739 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=634): Process ended prematurely: osmo-stp_10.42.42.5(pid=634) [trial-2359↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=634)] [trial-2359↪sms:trx-b200↪mo_mt_sms.py:16] 11:36:17.845971 tst mo_mt_sms.py:16: Test FAILED (6.5 sec) 11:36:17.874564 run osmo-hlr_10.42.42.2(pid=631): ERR: Terminated: ERROR {rc=237} [trial-2359↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=631)] 11:36:17.926336 run osmo-hlr_10.42.42.2(pid=631): stdout: | (launched: 2022-12-09_11:36:14.578605) 11:36:17.980256 run osmo-hlr_10.42.42.2(pid=631): stderr: | 20221209113614759 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113614759 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113614759 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113614759 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113614759 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113614760 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113614771 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113614782 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113614783 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113614783 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:36:18.054490 run osmo-msc_10.42.42.6(pid=637): ERR: Terminated: ERROR {rc=2} [trial-2359↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=637)] 11:36:18.105990 run osmo-msc_10.42.42.6(pid=637): stdout: | (launched: 2022-12-09_11:36:16.640784) 11:36:18.159202 run osmo-msc_10.42.42.6(pid=637): stderr: | 20221209113617116 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113617116 DLGLOBAL DEBUG validating counter group 0x7f71b69efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113617116 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113617125 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113617125 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113617125 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113617128 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113617128 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113617129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113617129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:36:18.212565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=630): Terminating (SIGTERM) 11:36:18.255679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=633): Terminating (SIGTERM) 11:36:18.298914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=636): Terminating (SIGTERM) 11:36:18.342820 --- ParallelTerminationStrategy: PID 630 died... 11:36:18.363174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=630): Terminated: ok {rc=0} 11:36:18.410951 --- ParallelTerminationStrategy: PID 633 died... 11:36:18.430853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=633): Terminated: ok {rc=0} 11:36:18.478348 --- ParallelTerminationStrategy: PID 636 died... 11:36:18.498266 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=636): Terminated: ok {rc=0} 11:36:18.587023 bus /sierra_3: Setting Powered False 11:36:19.683364 bus /sierra_3: Setting Powered False 11:36:20.800249 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 nitb_ussd:trx-b200 --------------------------------------------------------------------- 11:36:22.060652 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:36:22.065870 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 11:36:22.100898 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 11:36:22.108108 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 11:36:22.143328 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 11:36:22.177680 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 11:36:22.184735 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 11:36:22.706919 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2359 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 11:36:22.712119 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 11:36:22.723346 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 11:36:22.773733 tst assert_extension.py: using LAC 21189 11:36:22.902874 tst assert_extension.py: using RAC 24 11:36:23.031535 tst assert_extension.py: using CellId 21189 11:36:23.152741 tst assert_extension.py: using BVCI 21190 11:36:23.264202 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 11:36:23.386355 tst assert_extension.py:10: start nitb and bts... 11:36:23.609238 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:36:24.280081 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=642): Launched 11:36:24.609994 run osmo-nitb_10.42.42.2(pid=643): Launched 11:36:24.793190 run osmo-nitb_10.42.42.2(pid=643): ERR: Terminated: ERROR {rc=2} [trial-2359↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=643)] 11:36:24.940035 run osmo-nitb_10.42.42.2(pid=643): stdout: | (launched: 2022-12-09_11:36:24.549482) 11:36:25.088062 run osmo-nitb_10.42.42.2(pid=643): stderr: | (launched: 2022-12-09_11:36:24.597958) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:36:25.236326 run osmo-nitb_10.42.42.2(pid=643): stdout: | (launched: 2022-12-09_11:36:24.549482) 11:36:25.378063 run osmo-nitb_10.42.42.2(pid=643): stderr: | (launched: 2022-12-09_11:36:24.597958) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=643): Process ended prematurely: osmo-nitb_10.42.42.2(pid=643) [trial-2359↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=643)] 11:36:25.735519 tst osmo-nitb_10.42.42.2(pid=643): stdout: | (launched: 2022-12-09_11:36:24.549482) 11:36:25.867705 tst osmo-nitb_10.42.42.2(pid=643): stderr: | (launched: 2022-12-09_11:36:24.597958) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:36:26.025060 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=643): Process ended prematurely: osmo-nitb_10.42.42.2(pid=643) [trial-2359↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=643)] [trial-2359↪nitb_ussd:trx-b200↪assert_extension.py:12] 11:36:26.034283 tst assert_extension.py:12: Test FAILED (3.3 sec) 11:36:26.041530 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=642): Terminating (SIGTERM) 11:36:26.253107 --- ParallelTerminationStrategy: PID 642 died... 11:36:26.274589 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=642): Terminated: ok {rc=0} 11:36:26.365533 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 ussd:trx-b200 --------------------------------------------------------------------- 11:36:27.548826 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:36:27.552819 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 11:36:27.586897 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 11:36:27.614162 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 11:36:27.652162 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 11:36:27.686960 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 11:36:27.714067 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 11:36:28.240368 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2359 ussd:trx-b200 assert_extension.py ---------------------------------------------- 11:36:28.246399 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:36:28.258021 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 11:36:28.307506 tst assert_extension.py: using LAC 21190 11:36:28.436610 tst assert_extension.py: using RAC 25 11:36:28.565210 tst assert_extension.py: using CellId 21190 11:36:28.691677 tst assert_extension.py: using BVCI 21191 11:36:28.810822 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:36:28.822037 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:36:28.832939 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:36:28.844016 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:36:28.855267 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 11:36:28.866493 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 11:36:28.983502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:36:29.457729 run create_hlr_db(pid=647): Launched 11:36:29.584234 bus /sierra_2: Setting Powered False 11:36:30.645505 run create_hlr_db(pid=647): Terminated: ok {rc=0} 11:36:31.117691 run pcap-recorder_any(filters='host 10.42.42.2')(pid=649): Launched 11:36:31.436930 run osmo-hlr_10.42.42.2(pid=650): Launched 11:36:31.676940 run osmo-stp_10.42.42.5: Starting osmo-stp 11:36:32.445582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=652): Launched 11:36:32.766972 run osmo-stp_10.42.42.5(pid=653): Launched 11:36:32.885836 run osmo-msc_10.42.42.6: Starting osmo-msc 11:36:33.440725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=655): Launched 11:36:33.747683 run osmo-msc_10.42.42.6(pid=656): Launched 11:36:33.919669 run osmo-stp_10.42.42.5(pid=653): ERR: Terminated: ERROR {rc=1} [trial-2359↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=653)] 11:36:34.048696 run osmo-stp_10.42.42.5(pid=653): stdout: | (launched: 2022-12-09_11:36:32.709085) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:34.178508 run osmo-stp_10.42.42.5(pid=653): stderr: | 20221209113632881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113632881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113632882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113632882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113632882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113632883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113632883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:34.306099 run osmo-stp_10.42.42.5(pid=653): stdout: | (launched: 2022-12-09_11:36:32.709085) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:34.427874 run osmo-stp_10.42.42.5(pid=653): stderr: | 20221209113632881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113632881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113632882 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113632882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113632882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113632883 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113632883 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:34.573443 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=653): Process ended prematurely: osmo-stp_10.42.42.5(pid=653) [trial-2359↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=653)] [trial-2359↪ussd:trx-b200↪assert_extension.py:17] 11:36:34.581937 tst assert_extension.py:17: Test FAILED (6.3 sec) 11:36:34.607850 run osmo-hlr_10.42.42.2(pid=650): ERR: Terminated: ERROR {rc=237} [trial-2359↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=650)] 11:36:34.655850 run osmo-hlr_10.42.42.2(pid=650): stdout: | (launched: 2022-12-09_11:36:31.378214) 11:36:34.706009 run osmo-hlr_10.42.42.2(pid=650): stderr: | 20221209113631619 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113631619 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113631619 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113631619 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113631619 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113631619 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113631636 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113631662 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113631662 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113631662 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:36:34.776362 run osmo-msc_10.42.42.6(pid=656): ERR: Terminated: ERROR {rc=2} [trial-2359↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=656)] 11:36:34.824915 run osmo-msc_10.42.42.6(pid=656): stdout: | (launched: 2022-12-09_11:36:33.690392) 11:36:34.875108 run osmo-msc_10.42.42.6(pid=656): stderr: | 20221209113633966 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113633966 DLGLOBAL DEBUG validating counter group 0x7f74312a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113633966 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113633966 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113633966 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113633966 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113633968 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113633968 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113633969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113633969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:36:34.926058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=649): Terminating (SIGTERM) 11:36:34.966419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=652): Terminating (SIGTERM) 11:36:35.006583 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=655): Terminating (SIGTERM) 11:36:35.047013 --- ParallelTerminationStrategy: PID 649 died... 11:36:35.066525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=649): Terminated: ok {rc=0} 11:36:35.111268 --- ParallelTerminationStrategy: PID 652 died... 11:36:35.130179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=652): Terminated: ok {rc=0} 11:36:35.174764 --- ParallelTerminationStrategy: PID 655 died... 11:36:35.193667 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=655): Terminated: ok {rc=0} 11:36:35.282146 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 11:36:36.497102 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:36:36.503585 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 11:36:36.536587 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 11:36:36.563295 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 11:36:36.616036 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 11:36:36.649698 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 11:36:36.675963 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 11:36:37.230190 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 11:36:37.285706 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:37.297547 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:36:37.369155 tst mo_mt_call.py: using LAC 21191 11:36:37.501123 tst mo_mt_call.py: using RAC 26 11:36:37.632116 tst mo_mt_call.py: using CellId 21191 11:36:37.764165 tst mo_mt_call.py: using BVCI 21192 11:36:37.886055 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:37.897676 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:37.909060 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:37.920717 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:37.932657 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:37.944790 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:36:38.065452 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:36:38.189230 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:36:38.707935 run create_hlr_db(pid=661): Launched 11:36:38.837337 bus /sierra_2: Setting Powered False 11:36:39.903151 run create_hlr_db(pid=661): Terminated: ok {rc=0} 11:36:40.351135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=663): Launched 11:36:40.664897 run osmo-hlr_10.42.42.2(pid=664): Launched 11:36:40.783877 run osmo-stp_10.42.42.5: Starting osmo-stp 11:36:41.322857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=666): Launched 11:36:41.637084 run osmo-stp_10.42.42.5(pid=667): Launched 11:36:41.755895 run osmo-msc_10.42.42.6: Starting osmo-msc 11:36:42.321733 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=669): Launched 11:36:42.637854 run osmo-msc_10.42.42.6(pid=670): Launched 11:36:42.814611 run osmo-stp_10.42.42.5(pid=667): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=667)] 11:36:42.946849 run osmo-stp_10.42.42.5(pid=667): stdout: | (launched: 2022-12-09_11:36:41.578689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:43.078501 run osmo-stp_10.42.42.5(pid=667): stderr: | 20221209113641753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113641753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113641753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113641753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113641754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113641754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113641754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:43.208126 run osmo-stp_10.42.42.5(pid=667): stdout: | (launched: 2022-12-09_11:36:41.578689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:43.331846 run osmo-stp_10.42.42.5(pid=667): stderr: | 20221209113641753 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113641753 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113641753 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113641753 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113641754 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113641754 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113641754 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:43.480104 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=667): Process ended prematurely: osmo-stp_10.42.42.5(pid=667) [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=667)] [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 11:36:43.489092 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:36:43.515510 run osmo-hlr_10.42.42.2(pid=664): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=664)] 11:36:43.563812 run osmo-hlr_10.42.42.2(pid=664): stdout: | (launched: 2022-12-09_11:36:40.606488) 11:36:43.613763 run osmo-hlr_10.42.42.2(pid=664): stderr: | 20221209113640785 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113640785 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113640785 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113640785 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113640785 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113640785 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113640797 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113640806 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113640806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113640806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:36:43.683346 run osmo-msc_10.42.42.6(pid=670): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=670)] 11:36:43.731397 run osmo-msc_10.42.42.6(pid=670): stdout: | (launched: 2022-12-09_11:36:42.579141) 11:36:43.781391 run osmo-msc_10.42.42.6(pid=670): stderr: | 20221209113642853 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113642853 DLGLOBAL DEBUG validating counter group 0x7ff626b78c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113642853 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113642853 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113642854 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113642854 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113642855 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113642856 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113642856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113642856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:36:43.831745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=663): Terminating (SIGTERM) 11:36:43.871749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=666): Terminating (SIGTERM) 11:36:43.911844 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=669): Terminating (SIGTERM) 11:36:43.951965 --- ParallelTerminationStrategy: PID 663 died... 11:36:43.971133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=663): Terminated: ok {rc=0} 11:36:44.015437 --- ParallelTerminationStrategy: PID 666 died... 11:36:44.034056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=666): Terminated: ok {rc=0} 11:36:44.079178 --- ParallelTerminationStrategy: PID 669 died... 11:36:44.097917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=669): Terminated: ok {rc=0} 11:36:44.185280 bus /sierra_3: Setting Powered False 11:36:45.288170 bus /sierra_3: Setting Powered False 11:36:46.412395 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 11:36:47.579638 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:47.592125 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:36:47.664705 tst mo_mt_call_osmux.py: using LAC 21192 11:36:47.796315 tst mo_mt_call_osmux.py: using RAC 27 11:36:47.927240 tst mo_mt_call_osmux.py: using CellId 21192 11:36:48.060291 tst mo_mt_call_osmux.py: using BVCI 21193 11:36:48.182329 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:48.194086 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:48.205518 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:48.217152 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:48.228785 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:36:48.240405 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:36:48.361547 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:36:48.485438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:36:49.004065 run create_hlr_db(pid=672): Launched 11:36:49.132888 bus /sierra_2: Setting Powered False 11:36:50.197332 run create_hlr_db(pid=672): Terminated: ok {rc=0} 11:36:50.662745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=674): Launched 11:36:50.997251 run osmo-hlr_10.42.42.2(pid=675): Launched 11:36:51.124849 run osmo-stp_10.42.42.5: Starting osmo-stp 11:36:51.705794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=677): Launched 11:36:52.040727 run osmo-stp_10.42.42.5(pid=678): Launched 11:36:52.168878 run osmo-msc_10.42.42.6: Starting osmo-msc 11:36:52.771857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=680): Launched 11:36:53.108891 run osmo-msc_10.42.42.6(pid=681): Launched 11:36:53.296172 run osmo-stp_10.42.42.5(pid=678): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=678)] 11:36:53.436401 run osmo-stp_10.42.42.5(pid=678): stdout: | (launched: 2022-12-09_11:36:51.979265) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:53.577620 run osmo-stp_10.42.42.5(pid=678): stderr: | 20221209113652176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113652176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113652176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113652177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113652177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113652177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113652177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:53.716699 run osmo-stp_10.42.42.5(pid=678): stdout: | (launched: 2022-12-09_11:36:51.979265) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:36:53.848923 run osmo-stp_10.42.42.5(pid=678): stderr: | 20221209113652176 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113652176 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113652176 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113652177 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113652177 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113652177 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113652177 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:36:54.007590 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=678): Process ended prematurely: osmo-stp_10.42.42.5(pid=678) [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=678)] [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 11:36:54.017384 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 11:36:54.045842 run osmo-hlr_10.42.42.2(pid=675): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=675)] 11:36:54.097380 run osmo-hlr_10.42.42.2(pid=675): stdout: | (launched: 2022-12-09_11:36:50.935293) 11:36:54.150066 run osmo-hlr_10.42.42.2(pid=675): stderr: | 20221209113651136 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113651136 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113651136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113651136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113651136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113651136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113651148 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113651157 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113651157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113651157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:36:54.223637 run osmo-msc_10.42.42.6(pid=681): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=681)] 11:36:54.274869 run osmo-msc_10.42.42.6(pid=681): stdout: | (launched: 2022-12-09_11:36:53.047130) 11:36:54.327851 run osmo-msc_10.42.42.6(pid=681): stderr: | 20221209113653373 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113653373 DLGLOBAL DEBUG validating counter group 0x7f40739aac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113653373 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113653373 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113653373 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113653374 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113653375 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113653376 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113653376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113653376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:36:54.380805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=674): Terminating (SIGTERM) 11:36:54.423358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=677): Terminating (SIGTERM) 11:36:54.466126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=680): Terminating (SIGTERM) 11:36:54.508925 --- ParallelTerminationStrategy: PID 674 died... 11:36:54.529265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=674): Terminated: ok {rc=0} 11:36:54.576647 --- ParallelTerminationStrategy: PID 677 died... 11:36:54.596458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=677): Terminated: ok {rc=0} 11:36:54.643673 --- ParallelTerminationStrategy: PID 680 died... 11:36:54.663445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=680): Terminated: ok {rc=0} 11:36:54.752734 bus /sierra_3: Setting Powered False 11:36:55.853703 bus /sierra_3: Setting Powered False 11:36:56.974588 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 11:36:58.227076 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:36:58.233605 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 11:36:58.266993 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 11:36:58.293567 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 11:36:58.346712 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 11:36:58.380924 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 11:36:58.407744 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 11:36:58.955680 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 11:36:59.005713 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:59.016779 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:36:59.085898 tst mo_mt_call.py: using LAC 21193 11:36:59.207711 tst mo_mt_call.py: using RAC 28 11:36:59.331182 tst mo_mt_call.py: using CellId 21193 11:36:59.455772 tst mo_mt_call.py: using BVCI 21194 11:36:59.570200 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:59.581472 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:59.592334 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:59.603356 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:59.614435 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:36:59.625432 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:36:59.744237 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:36:59.864799 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:00.350447 run create_hlr_db(pid=686): Launched 11:37:00.479840 bus /sierra_2: Setting Powered False 11:37:01.540543 run create_hlr_db(pid=686): Terminated: ok {rc=0} 11:37:02.022541 run pcap-recorder_any(filters='host 10.42.42.2')(pid=688): Launched 11:37:02.373955 run osmo-hlr_10.42.42.2(pid=689): Launched 11:37:02.505936 run osmo-stp_10.42.42.5: Starting osmo-stp 11:37:03.085643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=691): Launched 11:37:03.423508 run osmo-stp_10.42.42.5(pid=692): Launched 11:37:03.552432 run osmo-msc_10.42.42.6: Starting osmo-msc 11:37:04.155841 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=694): Launched 11:37:04.492004 run osmo-msc_10.42.42.6(pid=695): Launched 11:37:04.679237 run osmo-stp_10.42.42.5(pid=692): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=692)] 11:37:04.819807 run osmo-stp_10.42.42.5(pid=692): stdout: | (launched: 2022-12-09_11:37:03.361492) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:04.961761 run osmo-stp_10.42.42.5(pid=692): stderr: | 20221209113703555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113703555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113703555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113703556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113703556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113703556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113703556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:05.101457 run osmo-stp_10.42.42.5(pid=692): stdout: | (launched: 2022-12-09_11:37:03.361492) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:05.233940 run osmo-stp_10.42.42.5(pid=692): stderr: | 20221209113703555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113703555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113703555 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113703556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113703556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113703556 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113703556 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:05.392405 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=692): Process ended prematurely: osmo-stp_10.42.42.5(pid=692) [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=692)] [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 11:37:05.402344 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:37:05.430873 run osmo-hlr_10.42.42.2(pid=689): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=689)] 11:37:05.482520 run osmo-hlr_10.42.42.2(pid=689): stdout: | (launched: 2022-12-09_11:37:02.311675) 11:37:05.535427 run osmo-hlr_10.42.42.2(pid=689): stderr: | 20221209113702515 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113702516 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113702516 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113702516 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113702516 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113702516 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113702554 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113702563 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113702563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113702563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:05.608809 run osmo-msc_10.42.42.6(pid=695): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=695)] 11:37:05.659869 run osmo-msc_10.42.42.6(pid=695): stdout: | (launched: 2022-12-09_11:37:04.430282) 11:37:05.712547 run osmo-msc_10.42.42.6(pid=695): stderr: | 20221209113704755 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113704755 DLGLOBAL DEBUG validating counter group 0x7f20d5553c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113704755 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113704755 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113704755 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113704756 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113704757 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113704758 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113704758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113704758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:37:05.765778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=688): Terminating (SIGTERM) 11:37:05.808675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=691): Terminating (SIGTERM) 11:37:05.851849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=694): Terminating (SIGTERM) 11:37:05.894965 --- ParallelTerminationStrategy: PID 688 died... 11:37:05.915280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=688): Terminated: ok {rc=0} 11:37:05.963782 --- ParallelTerminationStrategy: PID 691 died... 11:37:05.984019 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=691): Terminated: ok {rc=0} 11:37:06.031681 --- ParallelTerminationStrategy: PID 694 died... 11:37:06.051574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=694): Terminated: ok {rc=0} 11:37:06.141016 bus /sierra_3: Setting Powered False 11:37:07.242742 bus /sierra_3: Setting Powered False 11:37:08.363608 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 11:37:09.513123 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:37:09.525137 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:37:09.595758 tst mo_mt_call_osmux.py: using LAC 21194 11:37:09.718829 tst mo_mt_call_osmux.py: using RAC 29 11:37:09.843716 tst mo_mt_call_osmux.py: using CellId 21194 11:37:09.967973 tst mo_mt_call_osmux.py: using BVCI 21195 11:37:10.082477 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:37:10.093888 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:37:10.104911 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:37:10.115992 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:37:10.127139 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:37:10.138517 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:37:10.257433 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:37:10.381609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:10.901327 run create_hlr_db(pid=697): Launched 11:37:11.030389 bus /sierra_2: Setting Powered False 11:37:12.095512 run create_hlr_db(pid=697): Terminated: ok {rc=0} 11:37:12.544243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=699): Launched 11:37:12.863376 run osmo-hlr_10.42.42.2(pid=700): Launched 11:37:12.982848 run osmo-stp_10.42.42.5: Starting osmo-stp 11:37:13.537699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=702): Launched 11:37:13.853458 run osmo-stp_10.42.42.5(pid=703): Launched 11:37:13.973467 run osmo-msc_10.42.42.6: Starting osmo-msc 11:37:14.547768 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=705): Launched 11:37:14.863492 run osmo-msc_10.42.42.6(pid=706): Launched 11:37:15.039030 run osmo-stp_10.42.42.5(pid=703): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=703)] 11:37:15.172677 run osmo-stp_10.42.42.5(pid=703): stdout: | (launched: 2022-12-09_11:37:13.794907) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:15.304299 run osmo-stp_10.42.42.5(pid=703): stderr: | 20221209113713970 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113713970 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113713970 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113713971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113713971 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113713971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113713971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:15.434668 run osmo-stp_10.42.42.5(pid=703): stdout: | (launched: 2022-12-09_11:37:13.794907) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:15.558276 run osmo-stp_10.42.42.5(pid=703): stderr: | 20221209113713970 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113713970 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113713970 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113713971 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113713971 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113713971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113713971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:15.706417 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=703): Process ended prematurely: osmo-stp_10.42.42.5(pid=703) [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=703)] [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 11:37:15.715286 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:37:15.742074 run osmo-hlr_10.42.42.2(pid=700): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=700)] 11:37:15.790573 run osmo-hlr_10.42.42.2(pid=700): stdout: | (launched: 2022-12-09_11:37:12.804668) 11:37:15.854822 run osmo-hlr_10.42.42.2(pid=700): stderr: | 20221209113712985 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113712985 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113712985 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113712985 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113712985 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113712985 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113712997 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113713005 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113713006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113713006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:15.941899 run osmo-msc_10.42.42.6(pid=706): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=706)] 11:37:15.992208 run osmo-msc_10.42.42.6(pid=706): stdout: | (launched: 2022-12-09_11:37:14.805223) 11:37:16.043530 run osmo-msc_10.42.42.6(pid=706): stderr: | 20221209113715077 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113715077 DLGLOBAL DEBUG validating counter group 0x7f8ce77efc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113715077 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113715077 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113715077 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113715078 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113715079 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113715080 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113715080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113715080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:37:16.094678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=699): Terminating (SIGTERM) 11:37:16.136287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=702): Terminating (SIGTERM) 11:37:16.179010 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=705): Terminating (SIGTERM) 11:37:16.220575 --- ParallelTerminationStrategy: PID 699 died... 11:37:16.240189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=699): Terminated: ok {rc=0} 11:37:16.285743 --- ParallelTerminationStrategy: PID 702 died... 11:37:16.305155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=702): Terminated: ok {rc=0} 11:37:16.350537 --- ParallelTerminationStrategy: PID 705 died... 11:37:16.369895 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=705): Terminated: ok {rc=0} 11:37:16.456474 bus /sierra_3: Setting Powered False 11:37:17.554478 bus /sierra_3: Setting Powered False 11:37:18.671293 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 11:37:19.930085 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:37:19.938478 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 11:37:19.972387 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 11:37:19.999228 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 11:37:20.049866 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 11:37:20.082526 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 11:37:20.108879 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 11:37:20.664854 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 11:37:20.719195 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:20.731053 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:37:20.801326 tst mo_mt_call.py: using LAC 21195 11:37:20.930514 tst mo_mt_call.py: using RAC 30 11:37:21.060396 tst mo_mt_call.py: using CellId 21195 11:37:21.190181 tst mo_mt_call.py: using BVCI 21196 11:37:21.313948 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:21.325660 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:21.337126 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:21.348799 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:21.360553 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:21.372270 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:37:21.493899 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:37:21.615349 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:22.104233 run create_hlr_db(pid=712): Launched 11:37:22.234290 bus /sierra_2: Setting Powered False 11:37:23.296577 run create_hlr_db(pid=712): Terminated: ok {rc=0} 11:37:23.755323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=714): Launched 11:37:24.091058 run osmo-hlr_10.42.42.2(pid=715): Launched 11:37:24.219906 run osmo-stp_10.42.42.5: Starting osmo-stp 11:37:24.797476 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=717): Launched 11:37:25.136762 run osmo-stp_10.42.42.5(pid=718): Launched 11:37:25.265158 run osmo-msc_10.42.42.6: Starting osmo-msc 11:37:25.870977 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=720): Launched 11:37:26.207301 run osmo-msc_10.42.42.6(pid=721): Launched 11:37:26.394744 run osmo-stp_10.42.42.5(pid=718): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=718)] 11:37:26.535769 run osmo-stp_10.42.42.5(pid=718): stdout: | (launched: 2022-12-09_11:37:25.074691) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:26.677680 run osmo-stp_10.42.42.5(pid=718): stderr: | 20221209113725269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113725270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113725270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113725270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113725272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113725273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113725273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:26.817203 run osmo-stp_10.42.42.5(pid=718): stdout: | (launched: 2022-12-09_11:37:25.074691) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:26.949816 run osmo-stp_10.42.42.5(pid=718): stderr: | 20221209113725269 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113725270 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113725270 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113725270 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113725272 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113725273 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113725273 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:27.109207 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=718): Process ended prematurely: osmo-stp_10.42.42.5(pid=718) [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=718)] [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 11:37:27.119234 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:37:27.148080 run osmo-hlr_10.42.42.2(pid=715): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=715)] 11:37:27.199426 run osmo-hlr_10.42.42.2(pid=715): stdout: | (launched: 2022-12-09_11:37:24.029461) 11:37:27.252499 run osmo-hlr_10.42.42.2(pid=715): stderr: | 20221209113724230 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113724230 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113724230 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113724230 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113724230 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113724230 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113724243 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113724251 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113724251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113724251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:27.325726 run osmo-msc_10.42.42.6(pid=721): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=721)] 11:37:27.376828 run osmo-msc_10.42.42.6(pid=721): stdout: | (launched: 2022-12-09_11:37:26.145560) 11:37:27.429382 run osmo-msc_10.42.42.6(pid=721): stderr: | 20221209113726469 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113726470 DLGLOBAL DEBUG validating counter group 0x7f78021e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113726470 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113726470 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113726470 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113726470 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113726472 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113726472 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113726472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113726472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:37:27.482586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=714): Terminating (SIGTERM) 11:37:27.525684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=717): Terminating (SIGTERM) 11:37:27.568724 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=720): Terminating (SIGTERM) 11:37:27.612071 --- ParallelTerminationStrategy: PID 714 died... 11:37:27.632463 run pcap-recorder_any(filters='host 10.42.42.2')(pid=714): Terminated: ok {rc=0} 11:37:27.680062 --- ParallelTerminationStrategy: PID 717 died... 11:37:27.700011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=717): Terminated: ok {rc=0} 11:37:27.747802 --- ParallelTerminationStrategy: PID 720 died... 11:37:27.767953 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=720): Terminated: ok {rc=0} 11:37:27.858519 bus /sierra_3: Setting Powered False 11:37:28.959757 bus /sierra_3: Setting Powered False 11:37:30.078722 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 11:37:31.232003 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:31.245662 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:37:31.321514 tst mo_mt_call_osmux.py: using LAC 21196 11:37:31.447914 tst mo_mt_call_osmux.py: using RAC 31 11:37:31.576841 tst mo_mt_call_osmux.py: using CellId 21196 11:37:31.732158 tst mo_mt_call_osmux.py: using BVCI 21197 11:37:31.889166 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:31.901373 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:31.913397 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:31.925099 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:31.936555 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:37:31.948098 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:37:32.073746 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:37:32.206095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:32.730679 run create_hlr_db(pid=723): Launched 11:37:32.861568 bus /sierra_2: Setting Powered False 11:37:33.927273 run create_hlr_db(pid=723): Terminated: ok {rc=0} 11:37:34.375787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=725): Launched 11:37:34.714006 run osmo-hlr_10.42.42.2(pid=726): Launched 11:37:34.843301 run osmo-stp_10.42.42.5: Starting osmo-stp 11:37:35.424429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=728): Launched 11:37:35.758895 run osmo-stp_10.42.42.5(pid=729): Launched 11:37:35.893863 run osmo-msc_10.42.42.6: Starting osmo-msc 11:37:36.500879 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=732): Launched 11:37:36.836883 run osmo-msc_10.42.42.6(pid=733): Launched 11:37:37.024353 run osmo-stp_10.42.42.5(pid=729): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=729)] 11:37:37.165622 run osmo-stp_10.42.42.5(pid=729): stdout: | (launched: 2022-12-09_11:37:35.696916) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:37.307498 run osmo-stp_10.42.42.5(pid=729): stderr: | 20221209113735899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113735899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113735899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113735899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113735900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113735900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113735900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:37.447420 run osmo-stp_10.42.42.5(pid=729): stdout: | (launched: 2022-12-09_11:37:35.696916) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:37.580165 run osmo-stp_10.42.42.5(pid=729): stderr: | 20221209113735899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113735899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113735899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113735899 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113735900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113735900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113735900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:37.739302 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=729): Process ended prematurely: osmo-stp_10.42.42.5(pid=729) [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=729)] [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 11:37:37.749050 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 11:37:37.777678 run osmo-hlr_10.42.42.2(pid=726): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=726)] 11:37:37.828707 run osmo-hlr_10.42.42.2(pid=726): stdout: | (launched: 2022-12-09_11:37:34.651666) 11:37:37.881690 run osmo-hlr_10.42.42.2(pid=726): stderr: | 20221209113734854 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113734854 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113734854 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113734854 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113734854 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113734854 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113734872 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113734882 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113734882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113734882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:37.955102 run osmo-msc_10.42.42.6(pid=733): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=733)] 11:37:38.006530 run osmo-msc_10.42.42.6(pid=733): stdout: | (launched: 2022-12-09_11:37:36.774873) 11:37:38.059237 run osmo-msc_10.42.42.6(pid=733): stderr: | 20221209113737102 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113737103 DLGLOBAL DEBUG validating counter group 0x7fbc79a85c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113737103 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113737103 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113737103 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113737103 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113737105 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113737105 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113737105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113737105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:37:38.112422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=725): Terminating (SIGTERM) 11:37:38.155253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=728): Terminating (SIGTERM) 11:37:38.198050 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=732): Terminating (SIGTERM) 11:37:38.240995 --- ParallelTerminationStrategy: PID 725 died... 11:37:38.261225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=725): Terminated: ok {rc=0} 11:37:38.308424 --- ParallelTerminationStrategy: PID 728 died... 11:37:38.328240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=728): Terminated: ok {rc=0} 11:37:38.375516 --- ParallelTerminationStrategy: PID 732 died... 11:37:38.395247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=732): Terminated: ok {rc=0} 11:37:38.484141 bus /sierra_3: Setting Powered False 11:37:39.584895 bus /sierra_3: Setting Powered False 11:37:40.702322 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 11:37:41.949948 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:37:41.956366 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 11:37:41.989516 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 11:37:42.016123 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 11:37:42.067970 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 11:37:42.100922 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 11:37:42.127452 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 11:37:42.679328 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 11:37:42.729131 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:42.740278 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:37:42.809632 tst mo_mt_call.py: using LAC 21197 11:37:42.933321 tst mo_mt_call.py: using RAC 32 11:37:43.055636 tst mo_mt_call.py: using CellId 21197 11:37:43.192347 tst mo_mt_call.py: using BVCI 21198 11:37:43.316237 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:43.328092 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:43.339706 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:43.351614 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:43.363474 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:43.375172 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:37:43.497191 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:37:43.616619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:44.104265 run create_hlr_db(pid=738): Launched 11:37:44.233919 bus /sierra_2: Setting Powered False 11:37:45.296094 run create_hlr_db(pid=738): Terminated: ok {rc=0} 11:37:45.756405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=740): Launched 11:37:46.113692 run osmo-hlr_10.42.42.2(pid=741): Launched 11:37:46.301456 run osmo-stp_10.42.42.5: Starting osmo-stp 11:37:47.007999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=743): Launched 11:37:47.341313 run osmo-stp_10.42.42.5(pid=744): Launched 11:37:47.461878 run osmo-msc_10.42.42.6: Starting osmo-msc 11:37:48.035091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=746): Launched 11:37:48.351493 run osmo-msc_10.42.42.6(pid=747): Launched 11:37:48.526379 run osmo-stp_10.42.42.5(pid=744): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=744)] 11:37:48.661354 run osmo-stp_10.42.42.5(pid=744): stdout: | (launched: 2022-12-09_11:37:47.282665) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:48.793220 run osmo-stp_10.42.42.5(pid=744): stderr: | 20221209113747456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113747456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113747457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113747457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113747458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113747458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113747458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:48.923414 run osmo-stp_10.42.42.5(pid=744): stdout: | (launched: 2022-12-09_11:37:47.282665) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:49.047772 run osmo-stp_10.42.42.5(pid=744): stderr: | 20221209113747456 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113747456 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113747457 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113747457 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113747458 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113747458 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113747458 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:49.196334 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=744): Process ended prematurely: osmo-stp_10.42.42.5(pid=744) [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=744)] [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 11:37:49.205295 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 11:37:49.232002 run osmo-hlr_10.42.42.2(pid=741): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=741)] 11:37:49.280347 run osmo-hlr_10.42.42.2(pid=741): stdout: | (launched: 2022-12-09_11:37:46.048096) 11:37:49.330580 run osmo-hlr_10.42.42.2(pid=741): stderr: | 20221209113746419 DDB[0;m DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113746419 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113746419 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113746419 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113746419 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113746419 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113746435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113746443 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113746443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113746443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:49.401175 run osmo-msc_10.42.42.6(pid=747): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=747)] 11:37:49.449580 run osmo-msc_10.42.42.6(pid=747): stdout: | (launched: 2022-12-09_11:37:48.292877) 11:37:49.499779 run osmo-msc_10.42.42.6(pid=747): stderr: | 20221209113748568 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113748568 DLGLOBAL DEBUG validating counter group 0x7f4cad0f9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113748568 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113748568 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113748568 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113748568 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113748570 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113748570 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113748571 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113748571 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:37:49.550402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=740): Terminating (SIGTERM) 11:37:49.590420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=743): Terminating (SIGTERM) 11:37:49.631474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=746): Terminating (SIGTERM) 11:37:49.672073 --- ParallelTerminationStrategy: PID 740 died... 11:37:49.691470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=740): Terminated: ok {rc=0} 11:37:49.736133 --- ParallelTerminationStrategy: PID 743 died... 11:37:49.754953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=743): Terminated: ok {rc=0} 11:37:49.800102 --- ParallelTerminationStrategy: PID 746 died... 11:37:49.819211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=746): Terminated: ok {rc=0} 11:37:49.905225 bus /sierra_3: Setting Powered False 11:37:51.006247 bus /sierra_3: Setting Powered False 11:37:52.126912 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 11:37:53.280458 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:53.293268 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:37:53.366790 tst mo_mt_call_osmux.py: using LAC 21198 11:37:53.502325 tst mo_mt_call_osmux.py: using RAC 33 11:37:53.633599 tst mo_mt_call_osmux.py: using CellId 21198 11:37:53.760759 tst mo_mt_call_osmux.py: using BVCI 21199 11:37:53.875802 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:53.886913 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:53.897950 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:53.908729 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:53.919698 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:37:53.930643 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:37:54.048780 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:37:54.171320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:37:54.691428 run create_hlr_db(pid=749): Launched 11:37:54.819963 bus /sierra_2: Setting Powered False 11:37:55.885983 run create_hlr_db(pid=749): Terminated: ok {rc=0} 11:37:56.335640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=751): Launched 11:37:56.651452 run osmo-hlr_10.42.42.2(pid=752): Launched 11:37:56.773550 run osmo-stp_10.42.42.5: Starting osmo-stp 11:37:57.316434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=754): Launched 11:37:57.630455 run osmo-stp_10.42.42.5(pid=755): Launched 11:37:57.751028 run osmo-msc_10.42.42.6: Starting osmo-msc 11:37:58.318094 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=757): Launched 11:37:58.631991 run osmo-msc_10.42.42.6(pid=758): Launched 11:37:58.807713 run osmo-stp_10.42.42.5(pid=755): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=755)] 11:37:58.949481 run osmo-stp_10.42.42.5(pid=755): stdout: | (launched: 2022-12-09_11:37:57.572101) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:59.094411 run osmo-stp_10.42.42.5(pid=755): stderr: | 20221209113757747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113757748 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113757748 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113757748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113757749 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113757749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113757749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:59.225290 run osmo-stp_10.42.42.5(pid=755): stdout: | (launched: 2022-12-09_11:37:57.572101) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:37:59.349542 run osmo-stp_10.42.42.5(pid=755): stderr: | 20221209113757747 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113757748 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113757748 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113757748 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113757749 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113757749 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113757749 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:37:59.499432 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=755): Process ended prematurely: osmo-stp_10.42.42.5(pid=755) [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=755)] [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 11:37:59.508453 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:37:59.535184 run osmo-hlr_10.42.42.2(pid=752): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=752)] 11:37:59.583568 run osmo-hlr_10.42.42.2(pid=752): stdout: | (launched: 2022-12-09_11:37:56.592805) 11:37:59.633888 run osmo-hlr_10.42.42.2(pid=752): stderr: | 20221209113756772 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113756772 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113756772 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113756772 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113756772 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113756772 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113756787 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113756796 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113756796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113756796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:37:59.703729 run osmo-msc_10.42.42.6(pid=758): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=758)] 11:37:59.752071 run osmo-msc_10.42.42.6(pid=758): stdout: | (launched: 2022-12-09_11:37:58.573867) 11:37:59.802103 run osmo-msc_10.42.42.6(pid=758): stderr: | 20221209113758848 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113758848 DLGLOBAL DEBUG validating counter group 0x7ffa5cae4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113758848 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113758848 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113758848 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113758849 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113758850 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113758851 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113758851 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113758851 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:37:59.852654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=751): Terminating (SIGTERM) 11:37:59.892993 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=754): Terminating (SIGTERM) 11:37:59.933253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=757): Terminating (SIGTERM) 11:37:59.973865 --- ParallelTerminationStrategy: PID 751 died... 11:37:59.993405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=751): Terminated: ok {rc=0} 11:38:00.038245 --- ParallelTerminationStrategy: PID 754 died... 11:38:00.057210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=754): Terminated: ok {rc=0} 11:38:00.101779 --- ParallelTerminationStrategy: PID 757 died... 11:38:00.120639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=757): Terminated: ok {rc=0} 11:38:00.207213 bus /sierra_3: Setting Powered False 11:38:01.321314 bus /sierra_3: Setting Powered False 11:38:02.462693 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 11:38:03.725390 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:38:03.733724 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 11:38:03.768377 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 11:38:03.795594 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 11:38:03.847520 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 11:38:03.881567 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 11:38:03.909530 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 11:38:04.461357 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 11:38:04.513815 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:04.526246 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:38:04.598399 tst mo_mt_call.py: using LAC 21199 11:38:04.725504 tst mo_mt_call.py: using RAC 34 11:38:04.850969 tst mo_mt_call.py: using CellId 21199 11:38:04.982578 tst mo_mt_call.py: using BVCI 21200 11:38:05.102295 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:05.114522 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:05.126616 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:05.139676 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:05.151906 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:05.164043 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:38:05.286489 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:38:05.408194 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:38:05.904855 run create_hlr_db(pid=1063): Launched 11:38:06.076361 bus /sierra_2: Setting Powered False 11:38:07.140851 run create_hlr_db(pid=1063): Terminated: ok {rc=0} 11:38:07.590487 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1065): Launched 11:38:07.924495 run osmo-hlr_10.42.42.2(pid=1066): Launched 11:38:08.176650 run osmo-stp_10.42.42.5: Starting osmo-stp 11:38:08.912124 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1068): Launched 11:38:09.251671 run osmo-stp_10.42.42.5(pid=1069): Launched 11:38:09.492632 run osmo-msc_10.42.42.6: Starting osmo-msc 11:38:10.242355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1071): Launched 11:38:10.582181 run osmo-msc_10.42.42.6(pid=1072): Launched 11:38:10.939957 run osmo-stp_10.42.42.5(pid=1069): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1069)] 11:38:11.220666 run osmo-stp_10.42.42.5(pid=1069): stdout: | (launched: 2022-12-09_11:38:09.191019) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:11.507845 run osmo-stp_10.42.42.5(pid=1069): stderr: | 20221209113809524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113809525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113809525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113809525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113809526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113809526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113809526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:11.679672 run osmo-stp_10.42.42.5(pid=1069): stdout: | (launched: 2022-12-09_11:38:09.191019) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:11.808539 run osmo-stp_10.42.42.5(pid=1069): stderr: | 20221209113809524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113809525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113809525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113809525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113809526 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113809526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113809526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:11.962581 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1069): Process ended prematurely: osmo-stp_10.42.42.5(pid=1069) [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1069)] [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 11:38:11.972858 tst mo_mt_call.py:8: Test FAILED (7.5 sec) 11:38:12.001112 run osmo-hlr_10.42.42.2(pid=1066): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1066)] 11:38:12.052173 run osmo-hlr_10.42.42.2(pid=1066): stdout: | (launched: 2022-12-09_11:38:07.865290) 11:38:12.104498 run osmo-hlr_10.42.42.2(pid=1066): stderr: | 20221209113808207 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113808207 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113808207 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113808207 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113808207 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113808207 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113808225 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113808242 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113808242 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113808242 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:38:12.178095 run osmo-msc_10.42.42.6(pid=1072): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1072)] 11:38:12.229139 run osmo-msc_10.42.42.6(pid=1072): stdout: | (launched: 2022-12-09_11:38:10.520389) 11:38:12.282273 run osmo-msc_10.42.42.6(pid=1072): stderr: | 20221209113811125 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113811125 DLGLOBAL DEBUG validating counter group 0x7fec0da3fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113811125 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113811126 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113811126 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113811126 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113811129 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113811129 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113811129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113811129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:38:12.336753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1065): Terminating (SIGTERM) 11:38:12.379049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1068): Terminating (SIGTERM) 11:38:12.423175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1071): Terminating (SIGTERM) 11:38:12.467733 --- ParallelTerminationStrategy: PID 1065 died... 11:38:12.487758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1065): Terminated: ok {rc=0} 11:38:12.537317 --- ParallelTerminationStrategy: PID 1068 died... 11:38:12.556891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1068): Terminated: ok {rc=0} 11:38:12.603975 --- ParallelTerminationStrategy: PID 1071 died... 11:38:12.624047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1071): Terminated: ok {rc=0} 11:38:12.713118 bus /sierra_3: Setting Powered False 11:38:13.817604 bus /sierra_3: Setting Powered False 11:38:14.937053 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 11:38:16.107988 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:16.123754 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:38:16.211027 tst mo_mt_call_osmux.py: using LAC 21200 11:38:16.351728 tst mo_mt_call_osmux.py: using RAC 35 11:38:16.507644 tst mo_mt_call_osmux.py: using CellId 21200 11:38:16.655970 tst mo_mt_call_osmux.py: using BVCI 21201 11:38:16.809255 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:16.821463 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:16.833674 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:16.845676 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:16.857612 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:38:16.869525 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:38:16.993234 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:38:17.135414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:38:17.737130 run create_hlr_db(pid=1074): Launched 11:38:17.933479 bus /sierra_2: Setting Powered False 11:38:19.000415 run create_hlr_db(pid=1074): Terminated: ok {rc=0} 11:38:19.487258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1076): Launched 11:38:19.846980 run osmo-hlr_10.42.42.2(pid=1077): Launched 11:38:20.107317 run osmo-stp_10.42.42.5: Starting osmo-stp 11:38:20.806207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1079): Launched 11:38:21.166680 run osmo-stp_10.42.42.5(pid=1080): Launched 11:38:21.434241 run osmo-msc_10.42.42.6: Starting osmo-msc 11:38:22.127249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1082): Launched 11:38:22.488564 run osmo-msc_10.42.42.6(pid=1083): Launched 11:38:22.873941 run osmo-stp_10.42.42.5(pid=1080): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1080)] 11:38:23.172040 run osmo-stp_10.42.42.5(pid=1080): stdout: | (launched: 2022-12-09_11:38:21.102350) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:23.333135 run osmo-stp_10.42.42.5(pid=1080): stderr: | 20221209113821402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113821402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113821402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113821403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113821403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113821403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113821403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:23.479357 run osmo-stp_10.42.42.5(pid=1080): stdout: | (launched: 2022-12-09_11:38:21.102350) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:23.619258 run osmo-stp_10.42.42.5(pid=1080): stderr: | 20221209113821402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113821402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113821402 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113821403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113821403 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113821403 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113821403 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:23.786714 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1080): Process ended prematurely: osmo-stp_10.42.42.5(pid=1080) [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1080)] [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 11:38:23.797660 tst mo_mt_call_osmux.py:8: Test FAILED (7.7 sec) 11:38:23.830173 run osmo-hlr_10.42.42.2(pid=1077): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1077)] 11:38:23.885589 run osmo-hlr_10.42.42.2(pid=1077): stdout: | (launched: 2022-12-09_11:38:19.784060) 11:38:23.943052 run osmo-hlr_10.42.42.2(pid=1077): stderr: | 20221209113820093 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113820093 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113820093 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113820094 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113820094 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113820094 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113820137 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113820154 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113820154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113820154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:38:24.023303 run osmo-msc_10.42.42.6(pid=1083): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1083)] 11:38:24.072460 run osmo-msc_10.42.42.6(pid=1083): stdout: | (launched: 2022-12-09_11:38:22.424712) 11:38:24.122725 run osmo-msc_10.42.42.6(pid=1083): stderr: | 20221209113822927 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113822927 DLGLOBAL DEBUG validating counter group 0x7f459efedc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113822928 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113822928 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113822928 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113822928 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113822938 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113822939 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113822939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113822939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:38:24.173134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1076): Terminating (SIGTERM) 11:38:24.213939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1079): Terminating (SIGTERM) 11:38:24.254642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1082): Terminating (SIGTERM) 11:38:24.295314 --- ParallelTerminationStrategy: PID 1076 died... 11:38:24.314730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1076): Terminated: ok {rc=0} 11:38:24.359291 --- ParallelTerminationStrategy: PID 1079 died... 11:38:24.378137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1079): Terminated: ok {rc=0} 11:38:24.422434 --- ParallelTerminationStrategy: PID 1082 died... 11:38:24.442431 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1082): Terminated: ok {rc=0} 11:38:24.530483 bus /sierra_3: Setting Powered False 11:38:25.631708 bus /sierra_3: Setting Powered False 11:38:26.748308 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:38:28.001246 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:38:28.007725 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:38:28.040746 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 11:38:28.067570 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:38:28.118880 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:38:28.151618 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 11:38:28.177947 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:38:28.734602 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 11:38:28.791258 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:28.803162 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:38:28.876719 tst mo_mt_call.py: using LAC 21201 11:38:29.010156 tst mo_mt_call.py: using RAC 36 11:38:29.143529 tst mo_mt_call.py: using CellId 21201 11:38:29.267709 tst mo_mt_call.py: using BVCI 21202 11:38:29.391135 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:29.402872 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:29.414413 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:29.426291 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:29.438123 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:29.450041 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:38:29.571490 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:38:29.691297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:38:30.178877 run create_hlr_db(pid=1088): Launched 11:38:30.309049 bus /sierra_2: Setting Powered False 11:38:31.373770 run create_hlr_db(pid=1088): Terminated: ok {rc=0} 11:38:31.824533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1090): Launched 11:38:32.261603 run osmo-hlr_10.42.42.2(pid=1091): Launched 11:38:32.406466 run osmo-stp_10.42.42.5: Starting osmo-stp 11:38:32.945528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1093): Launched 11:38:33.261134 run osmo-stp_10.42.42.5(pid=1094): Launched 11:38:33.379746 run osmo-msc_10.42.42.6: Starting osmo-msc 11:38:33.947521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1096): Launched 11:38:34.262737 run osmo-msc_10.42.42.6(pid=1097): Launched 11:38:34.439276 run osmo-stp_10.42.42.5(pid=1094): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1094)] 11:38:34.571890 run osmo-stp_10.42.42.5(pid=1094): stdout: | (launched: 2022-12-09_11:38:33.202466) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:34.705251 run osmo-stp_10.42.42.5(pid=1094): stderr: | 20221209113833378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113833378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113833378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113833379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113833379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113833379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113833379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:34.836024 run osmo-stp_10.42.42.5(pid=1094): stdout: | (launched: 2022-12-09_11:38:33.202466) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:34.959992 run osmo-stp_10.42.42.5(pid=1094): stderr: | 20221209113833378 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113833378 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113833378 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113833379 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113833379 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113833379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113833379 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:35.108612 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1094): Process ended prematurely: osmo-stp_10.42.42.5(pid=1094) [trial-2359↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1094)] [trial-2359↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 11:38:35.117696 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:38:35.144072 run osmo-hlr_10.42.42.2(pid=1091): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1091)] 11:38:35.192267 run osmo-hlr_10.42.42.2(pid=1091): stdout: | (launched: 2022-12-09_11:38:32.199124) 11:38:35.242115 run osmo-hlr_10.42.42.2(pid=1091): stderr: | 20221209113832403 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113832403 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113832403 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113832403 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113832403 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113832403 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113832415 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113832424 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113832424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113832424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:38:35.311678 run osmo-msc_10.42.42.6(pid=1097): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1097)] 11:38:35.359827 run osmo-msc_10.42.42.6(pid=1097): stdout: | (launched: 2022-12-09_11:38:34.204046) 11:38:35.409598 run osmo-msc_10.42.42.6(pid=1097): stderr: | 20221209113834481 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113834481 DLGLOBAL DEBUG validating counter group 0x7f094404dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113834481 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113834481 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113834482 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113834482 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113834483 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113834484 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113834484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113834484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:38:35.459671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1090): Terminating (SIGTERM) 11:38:35.499634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1093): Terminating (SIGTERM) 11:38:35.539805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1096): Terminating (SIGTERM) 11:38:35.580099 --- ParallelTerminationStrategy: PID 1090 died... 11:38:35.599383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1090): Terminated: ok {rc=0} 11:38:35.643545 --- ParallelTerminationStrategy: PID 1093 died... 11:38:35.662258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1093): Terminated: ok {rc=0} 11:38:35.706382 --- ParallelTerminationStrategy: PID 1096 died... 11:38:35.725419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1096): Terminated: ok {rc=0} 11:38:35.812193 bus /sierra_3: Setting Powered False 11:38:36.913651 bus /sierra_3: Setting Powered False 11:38:38.028810 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 11:38:39.175471 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:39.187437 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:38:39.309351 tst mo_mt_call_osmux.py: using LAC 21202 11:38:39.436498 tst mo_mt_call_osmux.py: using RAC 37 11:38:39.559082 tst mo_mt_call_osmux.py: using CellId 21202 11:38:39.682329 tst mo_mt_call_osmux.py: using BVCI 21203 11:38:39.798681 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:39.810036 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:39.821106 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:39.832119 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:39.843259 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:38:39.854404 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:38:39.976222 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:38:40.101103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:38:40.623230 run create_hlr_db(pid=1099): Launched 11:38:40.754856 bus /sierra_2: Setting Powered False 11:38:41.820840 run create_hlr_db(pid=1099): Terminated: ok {rc=0} 11:38:42.289102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1101): Launched 11:38:42.627023 run osmo-hlr_10.42.42.2(pid=1102): Launched 11:38:42.756772 run osmo-stp_10.42.42.5: Starting osmo-stp 11:38:43.339587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1104): Launched 11:38:43.677619 run osmo-stp_10.42.42.5(pid=1105): Launched 11:38:43.806051 run osmo-msc_10.42.42.6: Starting osmo-msc 11:38:44.412412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1107): Launched 11:38:44.749553 run osmo-msc_10.42.42.6(pid=1108): Launched 11:38:44.940772 run osmo-stp_10.42.42.5(pid=1105): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1105)] 11:38:45.083323 run osmo-stp_10.42.42.5(pid=1105): stdout: | (launched: 2022-12-09_11:38:43.615605) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:45.225794 run osmo-stp_10.42.42.5(pid=1105): stderr: | 20221209113843811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113843811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113843811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113843812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113843812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113843812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113843812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:45.365933 run osmo-stp_10.42.42.5(pid=1105): stdout: | (launched: 2022-12-09_11:38:43.615605) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:45.499059 run osmo-stp_10.42.42.5(pid=1105): stderr: | 20221209113843811 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113843811 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113843811 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113843812 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113843812 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113843812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113843812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:45.658993 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1105): Process ended prematurely: osmo-stp_10.42.42.5(pid=1105) [trial-2359↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1105)] [trial-2359↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 11:38:45.668404 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 11:38:45.697282 run osmo-hlr_10.42.42.2(pid=1102): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1102)] 11:38:45.748546 run osmo-hlr_10.42.42.2(pid=1102): stdout: | (launched: 2022-12-09_11:38:42.565229) 11:38:45.801674 run osmo-hlr_10.42.42.2(pid=1102): stderr: | 20221209113842765 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113842765 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113842765 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113842765 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113842766 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113842766 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113842780 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113842790 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113842790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113842790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:38:45.876759 run osmo-msc_10.42.42.6(pid=1108): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1108)] 11:38:45.936720 run osmo-msc_10.42.42.6(pid=1108): stdout: | (launched: 2022-12-09_11:38:44.687338) 11:38:46.009522 run osmo-msc_10.42.42.6(pid=1108): stderr: | 20221209113845012 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113845013 DLGLOBAL DEBUG validating counter group 0x7f1584beec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113845013 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113845013 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113845013 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113845013 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113845015 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113845015 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113845015 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113845015 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:38:46.065201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1101): Terminating (SIGTERM) 11:38:46.115766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1104): Terminating (SIGTERM) 11:38:46.169248 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1107): Terminating (SIGTERM) 11:38:46.223658 --- ParallelTerminationStrategy: PID 1101 died... 11:38:46.246556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1101): Terminated: ok {rc=0} 11:38:46.298123 --- ParallelTerminationStrategy: PID 1104 died... 11:38:46.319477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1104): Terminated: ok {rc=0} 11:38:46.369937 --- ParallelTerminationStrategy: PID 1107 died... 11:38:46.391259 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1107): Terminated: ok {rc=0} 11:38:46.483702 bus /sierra_3: Setting Powered False 11:38:47.584707 bus /sierra_3: Setting Powered False 11:38:48.702378 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:38:49.959978 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:38:49.966739 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:38:50.002478 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 11:38:50.030580 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 11:38:50.082325 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:38:50.116627 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 11:38:50.144298 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 11:38:50.699739 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 11:38:50.755323 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:50.766901 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:38:50.838218 tst mo_mt_call.py: using LAC 21203 11:38:50.968052 tst mo_mt_call.py: using RAC 38 11:38:51.098709 tst mo_mt_call.py: using CellId 21203 11:38:51.230705 tst mo_mt_call.py: using BVCI 21204 11:38:51.354720 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:51.366264 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:51.377543 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:51.389152 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:51.400568 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:38:51.412103 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:38:51.537134 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:38:51.659975 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:38:52.180396 run create_hlr_db(pid=1114): Launched 11:38:52.309413 bus /sierra_2: Setting Powered False 11:38:53.372284 run create_hlr_db(pid=1114): Terminated: ok {rc=0} 11:38:53.821361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1116): Launched 11:38:54.139538 run osmo-hlr_10.42.42.2(pid=1117): Launched 11:38:54.261378 run osmo-stp_10.42.42.5: Starting osmo-stp 11:38:54.816638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1120): Launched 11:38:55.132918 run osmo-stp_10.42.42.5(pid=1121): Launched 11:38:55.253844 run osmo-msc_10.42.42.6: Starting osmo-msc 11:38:55.821770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1123): Launched 11:38:56.139601 run osmo-msc_10.42.42.6(pid=1128): Launched 11:38:56.316381 run osmo-stp_10.42.42.5(pid=1121): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1121)] 11:38:56.448739 run osmo-stp_10.42.42.5(pid=1121): stdout: | (launched: 2022-12-09_11:38:55.073742) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:56.580699 run osmo-stp_10.42.42.5(pid=1121): stderr: | 20221209113855249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113855249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113855249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113855249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113855252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113855252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113855252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:56.710968 run osmo-stp_10.42.42.5(pid=1121): stdout: | (launched: 2022-12-09_11:38:55.073742) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:38:56.834936 run osmo-stp_10.42.42.5(pid=1121): stderr: | 20221209113855249 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113855249 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113855249 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113855249 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113855252 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113855252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113855252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:38:56.983461 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1121): Process ended prematurely: osmo-stp_10.42.42.5(pid=1121) [trial-2359↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1121)] [trial-2359↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 11:38:56.992375 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:38:57.018785 run osmo-hlr_10.42.42.2(pid=1117): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1117)] 11:38:57.066831 run osmo-hlr_10.42.42.2(pid=1117): stdout: | (launched: 2022-12-09_11:38:54.079823) 11:38:57.116741 run osmo-hlr_10.42.42.2(pid=1117): stderr: | 20221209113854257 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113854258 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113854258 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113854258 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113854258 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113854258 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113854270 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113854280 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113854280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113854280 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:38:57.186624 run osmo-msc_10.42.42.6(pid=1128): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1128)] 11:38:57.235021 run osmo-msc_10.42.42.6(pid=1128): stdout: | (launched: 2022-12-09_11:38:56.079951) 11:38:57.284860 run osmo-msc_10.42.42.6(pid=1128): stderr: | 20221209113856357 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113856357 DLGLOBAL DEBUG validating counter group 0x7f5d805f2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113856358 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113856358 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113856358 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113856358 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113856360 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113856360 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113856360 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113856360 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:38:57.334970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1116): Terminating (SIGTERM) 11:38:57.374975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1120): Terminating (SIGTERM) 11:38:57.414932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1123): Terminating (SIGTERM) 11:38:57.454916 --- ParallelTerminationStrategy: PID 1116 died... 11:38:57.474222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1116): Terminated: ok {rc=0} 11:38:57.518572 --- ParallelTerminationStrategy: PID 1120 died... 11:38:57.537316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1120): Terminated: ok {rc=0} 11:38:57.581405 --- ParallelTerminationStrategy: PID 1123 died... 11:38:57.600186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1123): Terminated: ok {rc=0} 11:38:57.684814 bus /sierra_3: Setting Powered False 11:38:58.782884 bus /sierra_3: Setting Powered False 11:38:59.900741 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 11:39:01.049935 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:39:01.062742 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:39:01.134720 tst mo_mt_call_osmux.py: using LAC 21204 11:39:01.285793 tst mo_mt_call_osmux.py: using RAC 39 11:39:01.413871 tst mo_mt_call_osmux.py: using CellId 21204 11:39:01.549090 tst mo_mt_call_osmux.py: using BVCI 21205 11:39:01.675930 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:39:01.688467 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:39:01.701796 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:39:01.715365 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:39:01.727783 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:39:01.742054 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:39:01.892889 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:39:02.038618 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:39:02.582502 run create_hlr_db(pid=1130): Launched 11:39:02.712242 bus /sierra_2: Setting Powered False 11:39:03.778226 run create_hlr_db(pid=1130): Terminated: ok {rc=0} 11:39:04.245900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1132): Launched 11:39:04.582190 run osmo-hlr_10.42.42.2(pid=1133): Launched 11:39:04.709573 run osmo-stp_10.42.42.5: Starting osmo-stp 11:39:05.291098 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1140): Launched 11:39:05.629325 run osmo-stp_10.42.42.5(pid=1141): Launched 11:39:05.758700 run osmo-msc_10.42.42.6: Starting osmo-msc 11:39:06.366092 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1144): Launched 11:39:06.702620 run osmo-msc_10.42.42.6(pid=1145): Launched 11:39:06.890479 run osmo-stp_10.42.42.5(pid=1141): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1141)] 11:39:07.032290 run osmo-stp_10.42.42.5(pid=1141): stdout: | (launched: 2022-12-09_11:39:05.567059) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:07.174336 run osmo-stp_10.42.42.5(pid=1141): stderr: | 20221209113905764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113905764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113905765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113905765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113905766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113905766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113905766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:07.314581 run osmo-stp_10.42.42.5(pid=1141): stdout: | (launched: 2022-12-09_11:39:05.567059) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:07.447644 run osmo-stp_10.42.42.5(pid=1141): stderr: | 20221209113905764 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113905764 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113905765 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113905765 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113905766 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113905766 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113905766 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:07.607355 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1141): Process ended prematurely: osmo-stp_10.42.42.5(pid=1141) [trial-2359↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1141)] [trial-2359↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 11:39:07.617171 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 11:39:07.646320 run osmo-hlr_10.42.42.2(pid=1133): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1133)] 11:39:07.697665 run osmo-hlr_10.42.42.2(pid=1133): stdout: | (launched: 2022-12-09_11:39:04.519980) 11:39:07.751091 run osmo-hlr_10.42.42.2(pid=1133): stderr: | 20221209113904722 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113904722 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113904722 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113904722 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113904722 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113904722 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113904735 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113904743 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113904743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113904744 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:39:07.825019 run osmo-msc_10.42.42.6(pid=1145): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1145)] 11:39:07.876388 run osmo-msc_10.42.42.6(pid=1145): stdout: | (launched: 2022-12-09_11:39:06.640177) 11:39:07.929573 run osmo-msc_10.42.42.6(pid=1145): stderr: | 20221209113906966 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113906967 DLGLOBAL DEBUG validating counter group 0x7efefa4acc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113906967 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113906967 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113906967 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113906967 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113906970 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113906971 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113906971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113906971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:39:07.983079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1132): Terminating (SIGTERM) 11:39:08.026569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1140): Terminating (SIGTERM) 11:39:08.069681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1144): Terminating (SIGTERM) 11:39:08.112801 --- ParallelTerminationStrategy: PID 1132 died... 11:39:08.133265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1132): Terminated: ok {rc=0} 11:39:08.180846 --- ParallelTerminationStrategy: PID 1140 died... 11:39:08.201368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1140): Terminated: ok {rc=0} 11:39:08.249241 --- ParallelTerminationStrategy: PID 1144 died... 11:39:08.269160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1144): Terminated: ok {rc=0} 11:39:08.358568 bus /sierra_3: Setting Powered False 11:39:09.459476 bus /sierra_3: Setting Powered False 11:39:10.578225 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 11:39:11.839410 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:39:11.845265 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 11:39:11.880740 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 11:39:11.909240 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 11:39:11.963980 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 11:39:11.999254 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 11:39:12.027491 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 11:39:12.574782 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 11:39:12.628812 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:39:12.640590 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 11:39:12.691921 tst mo_mt_call.py: using LAC 21205 11:39:12.823826 tst mo_mt_call.py: using RAC 40 11:39:12.954568 tst mo_mt_call.py: using CellId 21205 11:39:13.100783 tst mo_mt_call.py: using BVCI 21206 11:39:13.224078 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:39:13.235868 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:39:13.247270 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:39:13.258881 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:39:13.270601 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:39:13.282397 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 11:39:13.404722 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 11:39:13.527841 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:39:14.047592 run create_hlr_db(pid=1150): Launched 11:39:14.176796 bus /sierra_2: Setting Powered False 11:39:15.242515 run create_hlr_db(pid=1150): Terminated: ok {rc=0} 11:39:15.691959 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1152): Launched 11:39:16.027077 run osmo-hlr_10.42.42.2(pid=1153): Launched 11:39:16.274534 run osmo-stp_10.42.42.5: Starting osmo-stp 11:39:16.989686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1155): Launched 11:39:17.322410 run osmo-stp_10.42.42.5(pid=1156): Launched 11:39:17.464132 run osmo-msc_10.42.42.6: Starting osmo-msc 11:39:18.074908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1158): Launched 11:39:18.411559 run osmo-msc_10.42.42.6(pid=1159): Launched 11:39:18.599777 run osmo-stp_10.42.42.5(pid=1156): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1156)] 11:39:18.740672 run osmo-stp_10.42.42.5(pid=1156): stdout: | (launched: 2022-12-09_11:39:17.263079) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:18.882254 run osmo-stp_10.42.42.5(pid=1156): stderr: | 20221209113917470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113917470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113917470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113917471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113917471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113917471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113917471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:19.022198 run osmo-stp_10.42.42.5(pid=1156): stdout: | (launched: 2022-12-09_11:39:17.263079) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:19.155445 run osmo-stp_10.42.42.5(pid=1156): stderr: | 20221209113917470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113917470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113917470 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113917471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113917471 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113917471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113917471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:19.314645 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1156): Process ended prematurely: osmo-stp_10.42.42.5(pid=1156) [trial-2359↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1156)] [trial-2359↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 11:39:19.324587 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 11:39:19.353279 run osmo-hlr_10.42.42.2(pid=1153): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1153)] 11:39:19.404865 run osmo-hlr_10.42.42.2(pid=1153): stdout: | (launched: 2022-12-09_11:39:15.967660) 11:39:19.457699 run osmo-hlr_10.42.42.2(pid=1153): stderr: | 20221209113916335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113916335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113916335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113916335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113916336 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113916336 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113916368 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113916376 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113916376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113916376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:39:19.530899 run osmo-msc_10.42.42.6(pid=1159): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1159)] 11:39:19.582200 run osmo-msc_10.42.42.6(pid=1159): stdout: | (launched: 2022-12-09_11:39:18.349435) 11:39:19.634966 run osmo-msc_10.42.42.6(pid=1159): stderr: | 20221209113918673 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113918673 DLGLOBAL DEBUG validating counter group 0x7f1556967c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113918673 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113918673 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113918673 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113918673 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113918675 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113918675 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113918676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113918676 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:39:19.688100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1152): Terminating (SIGTERM) 11:39:19.731111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1155): Terminating (SIGTERM) 11:39:19.774313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1158): Terminating (SIGTERM) 11:39:19.817494 --- ParallelTerminationStrategy: PID 1152 died... 11:39:19.837886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1152): Terminated: ok {rc=0} 11:39:19.885633 --- ParallelTerminationStrategy: PID 1155 died... 11:39:19.905526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1155): Terminated: ok {rc=0} 11:39:19.952764 --- ParallelTerminationStrategy: PID 1158 died... 11:39:19.972626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1158): Terminated: ok {rc=0} 11:39:20.062823 bus /sierra_3: Setting Powered False 11:39:21.163833 bus /sierra_3: Setting Powered False 11:39:22.282732 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 11:39:23.429343 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:39:23.441062 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 11:39:23.491816 tst mo_mt_call_osmux.py: using LAC 21206 11:39:23.616542 tst mo_mt_call_osmux.py: using RAC 41 11:39:23.741545 tst mo_mt_call_osmux.py: using CellId 21206 11:39:23.870701 tst mo_mt_call_osmux.py: using BVCI 21207 11:39:23.985274 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:39:23.996413 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:39:24.007342 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:39:24.018197 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:39:24.029047 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 11:39:24.039917 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 11:39:24.158579 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 11:39:24.282496 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:39:24.803161 run create_hlr_db(pid=1161): Launched 11:39:24.930962 bus /sierra_2: Setting Powered False 11:39:25.997217 run create_hlr_db(pid=1161): Terminated: ok {rc=0} 11:39:26.447009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1163): Launched 11:39:26.764868 run osmo-hlr_10.42.42.2(pid=1164): Launched 11:39:26.883534 run osmo-stp_10.42.42.5: Starting osmo-stp 11:39:27.427002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1166): Launched 11:39:27.743237 run osmo-stp_10.42.42.5(pid=1167): Launched 11:39:27.863396 run osmo-msc_10.42.42.6: Starting osmo-msc 11:39:28.434247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1169): Launched 11:39:28.750766 run osmo-msc_10.42.42.6(pid=1170): Launched 11:39:28.928493 run osmo-stp_10.42.42.5(pid=1167): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1167)] 11:39:29.061469 run osmo-stp_10.42.42.5(pid=1167): stdout: | (launched: 2022-12-09_11:39:27.684830) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:29.193471 run osmo-stp_10.42.42.5(pid=1167): stderr: | 20221209113927857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113927857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113927858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113927858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113927858 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113927858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113927859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:29.323369 run osmo-stp_10.42.42.5(pid=1167): stdout: | (launched: 2022-12-09_11:39:27.684830) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:29.447185 run osmo-stp_10.42.42.5(pid=1167): stderr: | 20221209113927857 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113927857 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113927858 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113927858 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113927858 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113927858 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113927859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:29.595938 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1167): Process ended prematurely: osmo-stp_10.42.42.5(pid=1167) [trial-2359↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1167)] [trial-2359↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 11:39:29.604714 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:39:29.631214 run osmo-hlr_10.42.42.2(pid=1164): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1164)] 11:39:29.679544 run osmo-hlr_10.42.42.2(pid=1164): stdout: | (launched: 2022-12-09_11:39:26.706127) 11:39:29.729673 run osmo-hlr_10.42.42.2(pid=1164): stderr: | 20221209113926884 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113926884 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113926884 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113926884 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113926885 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113926885 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113926895 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113926904 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113926904 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113926904 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:39:29.799542 run osmo-msc_10.42.42.6(pid=1170): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1170)] 11:39:29.847872 run osmo-msc_10.42.42.6(pid=1170): stdout: | (launched: 2022-12-09_11:39:28.692022) 11:39:29.897660 run osmo-msc_10.42.42.6(pid=1170): stderr: | 20221209113928966 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113928966 DLGLOBAL DEBUG validating counter group 0x7f6b14c4fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113928966 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113928966 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113928966 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113928966 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113928968 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113928969 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113928969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113928969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:39:29.948007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1163): Terminating (SIGTERM) 11:39:29.988278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1166): Terminating (SIGTERM) 11:39:30.028344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1169): Terminating (SIGTERM) 11:39:30.068777 --- ParallelTerminationStrategy: PID 1163 died... 11:39:30.087612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1163): Terminated: ok {rc=0} 11:39:30.131995 --- ParallelTerminationStrategy: PID 1166 died... 11:39:30.150686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1166): Terminated: ok {rc=0} 11:39:30.195741 --- ParallelTerminationStrategy: PID 1169 died... 11:39:30.214502 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1169): Terminated: ok {rc=0} 11:39:30.299998 bus /sierra_3: Setting Powered False 11:39:31.396039 bus /sierra_3: Setting Powered False 11:39:32.509019 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 11:39:33.759078 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:39:33.765707 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 11:39:33.800935 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 11:39:33.828654 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 11:39:33.882753 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 11:39:33.917935 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 11:39:33.945116 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 11:39:34.496103 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 11:39:34.549371 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:39:34.561370 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:39:34.614178 tst mo_mt_call.py: using LAC 21207 11:39:34.743523 tst mo_mt_call.py: using RAC 42 11:39:34.870916 tst mo_mt_call.py: using CellId 21207 11:39:34.999634 tst mo_mt_call.py: using BVCI 21208 11:39:35.120477 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:39:35.132311 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:39:35.144233 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:39:35.155990 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:39:35.167929 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:39:35.179797 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:39:35.296337 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:39:35.417110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:39:35.922433 run create_hlr_db(pid=1177): Launched 11:39:36.047330 bus /sierra_2: Setting Powered False 11:39:37.112254 run create_hlr_db(pid=1177): Terminated: ok {rc=0} 11:39:37.546791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1179): Launched 11:39:37.851671 run osmo-hlr_10.42.42.2(pid=1180): Launched 11:39:37.967667 run osmo-stp_10.42.42.5: Starting osmo-stp 11:39:38.491534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1182): Launched 11:39:38.795831 run osmo-stp_10.42.42.5(pid=1183): Launched 11:39:38.911070 run osmo-msc_10.42.42.6: Starting osmo-msc 11:39:39.459885 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1185): Launched 11:39:39.764546 run osmo-msc_10.42.42.6(pid=1186): Launched 11:39:39.934233 run osmo-stp_10.42.42.5(pid=1183): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1183)] 11:39:40.064480 run osmo-stp_10.42.42.5(pid=1183): stdout: | (launched: 2022-12-09_11:39:38.739023) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:40.192897 run osmo-stp_10.42.42.5(pid=1183): stderr: | 20221209113938909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113938909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113938909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113938910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113938910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113938910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113938910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:40.320594 run osmo-stp_10.42.42.5(pid=1183): stdout: | (launched: 2022-12-09_11:39:38.739023) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:40.440745 run osmo-stp_10.42.42.5(pid=1183): stderr: | 20221209113938909 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113938909 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113938909 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113938910 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113938910 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113938910 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113938910 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:40.584933 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1183): Process ended prematurely: osmo-stp_10.42.42.5(pid=1183) [trial-2359↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1183)] [trial-2359↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 11:39:40.593747 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 11:39:40.620022 run osmo-hlr_10.42.42.2(pid=1180): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1180)] 11:39:40.667677 run osmo-hlr_10.42.42.2(pid=1180): stdout: | (launched: 2022-12-09_11:39:37.794744) 11:39:40.717246 run osmo-hlr_10.42.42.2(pid=1180): stderr: | 20221209113937972 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113937972 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113937972 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113937972 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113937973 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113937973 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113937986 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113937994 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113937995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113937995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:39:40.786138 run osmo-msc_10.42.42.6(pid=1186): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1186)] 11:39:40.833874 run osmo-msc_10.42.42.6(pid=1186): stdout: | (launched: 2022-12-09_11:39:39.707945) 11:39:40.883193 run osmo-msc_10.42.42.6(pid=1186): stderr: | 20221209113939983 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113939983 DLGLOBAL DEBUG validating counter group 0x7f546bcafc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113939983 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113939983 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113939983 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113939983 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113939985 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113939985 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113939986 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113939986 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:39:40.932700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1179): Terminating (SIGTERM) 11:39:40.972416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1182): Terminating (SIGTERM) 11:39:41.012038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1185): Terminating (SIGTERM) 11:39:41.052017 --- ParallelTerminationStrategy: PID 1179 died... 11:39:41.071064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1179): Terminated: ok {rc=0} 11:39:41.115239 --- ParallelTerminationStrategy: PID 1182 died... 11:39:41.133888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1182): Terminated: ok {rc=0} 11:39:41.177720 --- ParallelTerminationStrategy: PID 1185 died... 11:39:41.196348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1185): Terminated: ok {rc=0} 11:39:41.280566 bus /sierra_3: Setting Powered False 11:39:42.379308 bus /sierra_3: Setting Powered False 11:39:43.495589 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 11:39:44.645388 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:39:44.657705 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:39:44.716248 tst mo_mt_call_osmux.py: using LAC 21208 11:39:44.836504 tst mo_mt_call_osmux.py: using RAC 43 11:39:44.954345 tst mo_mt_call_osmux.py: using CellId 21208 11:39:45.074259 tst mo_mt_call_osmux.py: using BVCI 21209 11:39:45.185571 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:39:45.197149 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:39:45.208445 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:39:45.219510 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:39:45.230638 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:39:45.241665 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:39:45.360169 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:39:45.481241 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:39:45.980918 run create_hlr_db(pid=1188): Launched 11:39:46.126393 bus /sierra_2: Setting Powered False 11:39:47.189741 run create_hlr_db(pid=1188): Terminated: ok {rc=0} 11:39:47.646980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1190): Launched 11:39:47.973641 run osmo-hlr_10.42.42.2(pid=1191): Launched 11:39:48.099318 run osmo-stp_10.42.42.5: Starting osmo-stp 11:39:48.658254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1193): Launched 11:39:48.982558 run osmo-stp_10.42.42.5(pid=1194): Launched 11:39:49.106657 run osmo-msc_10.42.42.6: Starting osmo-msc 11:39:49.694463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1196): Launched 11:39:50.020332 run osmo-msc_10.42.42.6(pid=1197): Launched 11:39:50.201656 run osmo-stp_10.42.42.5(pid=1194): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1194)] 11:39:50.339093 run osmo-stp_10.42.42.5(pid=1194): stdout: | (launched: 2022-12-09_11:39:48.922921) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:50.476832 run osmo-stp_10.42.42.5(pid=1194): stderr: | 20221209113949115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113949115 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113949115 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113949116 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113949116 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113949116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113949116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:50.613840 run osmo-stp_10.42.42.5(pid=1194): stdout: | (launched: 2022-12-09_11:39:48.922921) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:39:50.742617 run osmo-stp_10.42.42.5(pid=1194): stderr: | 20221209113949115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209113949115 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209113949115 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209113949116 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209113949116 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209113949116 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209113949116 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:39:50.897404 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1194): Process ended prematurely: osmo-stp_10.42.42.5(pid=1194) [trial-2359↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1194)] [trial-2359↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 11:39:50.906852 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:39:50.934876 run osmo-hlr_10.42.42.2(pid=1191): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1191)] 11:39:50.985379 run osmo-hlr_10.42.42.2(pid=1191): stdout: | (launched: 2022-12-09_11:39:47.913521) 11:39:51.038318 run osmo-hlr_10.42.42.2(pid=1191): stderr: | 20221209113948111 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113948112 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113948112 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113948112 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113948112 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113948112 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113948124 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113948133 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113948134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113948134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:39:51.111058 run osmo-msc_10.42.42.6(pid=1197): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1197)] 11:39:51.161483 run osmo-msc_10.42.42.6(pid=1197): stdout: | (launched: 2022-12-09_11:39:49.960041) 11:39:51.213651 run osmo-msc_10.42.42.6(pid=1197): stderr: | 20221209113950282 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209113950282 DLGLOBAL DEBUG validating counter group 0x7f5440f32c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209113950282 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209113950282 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209113950282 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209113950283 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209113950284 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209113950285 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209113950285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209113950285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:39:51.266455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1190): Terminating (SIGTERM) 11:39:51.308831 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1193): Terminating (SIGTERM) 11:39:51.351373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1196): Terminating (SIGTERM) 11:39:51.394026 --- ParallelTerminationStrategy: PID 1190 died... 11:39:51.413943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1190): Terminated: ok {rc=0} 11:39:51.460609 --- ParallelTerminationStrategy: PID 1193 died... 11:39:51.480182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1193): Terminated: ok {rc=0} 11:39:51.526859 --- ParallelTerminationStrategy: PID 1196 died... 11:39:51.546371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1196): Terminated: ok {rc=0} 11:39:51.635018 bus /sierra_3: Setting Powered False 11:39:52.734814 bus /sierra_3: Setting Powered False 11:39:53.853875 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 emergency:trx-b200 --------------------------------------------------------------------- 11:39:55.107961 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:39:55.112184 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 11:39:55.147992 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 11:39:55.176802 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 11:39:55.262627 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 11:39:55.296360 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 11:39:55.323168 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 11:39:55.905117 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2359 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 11:39:55.910184 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:39:55.920924 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 11:39:55.975696 tst emergency_mo_mt_call.py: using LAC 21209 11:39:56.093178 tst emergency_mo_mt_call.py: using RAC 44 11:39:56.209085 tst emergency_mo_mt_call.py: using CellId 21209 11:39:56.328912 tst emergency_mo_mt_call.py: using BVCI 21210 11:39:56.438967 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:39:56.449685 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:39:56.460064 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:39:56.470588 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:39:56.481016 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:39:56.491399 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:39:56.609256 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:39:56.725589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:39:57.187454 run create_hlr_db(pid=1204): Launched 11:39:57.308247 bus /sierra_2: Setting Powered False 11:39:58.368228 run create_hlr_db(pid=1204): Terminated: ok {rc=0} 11:39:58.786927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1206): Launched 11:39:59.084406 run osmo-hlr_10.42.42.2(pid=1207): Launched 11:39:59.196300 run osmo-stp_10.42.42.5: Starting osmo-stp 11:39:59.727352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1209): Launched 11:40:00.025257 run osmo-stp_10.42.42.5(pid=1210): Launched 11:40:00.147972 tst emergency_mo_mt_call.py: using MSISDN 7191 11:40:00.301169 run osmo-msc_10.42.42.6: Starting osmo-msc 11:40:00.848316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1212): Launched 11:40:01.213654 run osmo-msc_10.42.42.6(pid=1213): Launched 11:40:01.556236 run osmo-stp_10.42.42.5(pid=1210): ERR: Terminated: ERROR {rc=1} [trial-2359↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1210)] 11:40:01.833418 run osmo-stp_10.42.42.5(pid=1210): stdout: | (launched: 2022-12-09_11:39:59.969762) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:02.033480 run osmo-stp_10.42.42.5(pid=1210): stderr: | 20221209114000143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114000143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114000143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114000143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114000144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114000144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114000144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:02.170737 run osmo-stp_10.42.42.5(pid=1210): stdout: | (launched: 2022-12-09_11:39:59.969762) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:02.298749 run osmo-stp_10.42.42.5(pid=1210): stderr: | 20221209114000143 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114000143 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114000143 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114000143 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114000144 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114000144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114000144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:02.450093 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=1210): Process ended prematurely: osmo-stp_10.42.42.5(pid=1210) [trial-2359↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1210)] [trial-2359↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 11:40:02.459281 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 11:40:02.488264 run osmo-hlr_10.42.42.2(pid=1207): ERR: Terminated: ERROR {rc=237} [trial-2359↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1207)] 11:40:02.539424 run osmo-hlr_10.42.42.2(pid=1207): stdout: | (launched: 2022-12-09_11:39:59.028760) 11:40:02.592403 run osmo-hlr_10.42.42.2(pid=1207): stderr: | 20221209113959206 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209113959206 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209113959206 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209113959206 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209113959206 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209113959206 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209113959219 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209113959229 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209113959229 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209113959229 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:40:02.665941 run osmo-msc_10.42.42.6(pid=1213): ERR: Terminated: ERROR {rc=2} [trial-2359↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1213)] 11:40:02.717327 run osmo-msc_10.42.42.6(pid=1213): stdout: | (launched: 2022-12-09_11:40:01.141356) 11:40:02.770136 run osmo-msc_10.42.42.6(pid=1213): stderr: | 20221209114001655 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209114001655 DLGLOBAL DEBUG validating counter group 0x7f3309f34c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209114001655 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209114001655 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209114001655 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209114001655 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209114001657 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209114001658 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209114001658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209114001658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:40:02.823192 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1206): Terminating (SIGTERM) 11:40:02.865971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1209): Terminating (SIGTERM) 11:40:02.909013 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1212): Terminating (SIGTERM) 11:40:02.952428 --- ParallelTerminationStrategy: PID 1206 died... 11:40:02.972700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1206): Terminated: ok {rc=0} 11:40:03.020878 --- ParallelTerminationStrategy: PID 1209 died... 11:40:03.041335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1209): Terminated: ok {rc=0} 11:40:03.089530 --- ParallelTerminationStrategy: PID 1212 died... 11:40:03.109559 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1212): Terminated: ok {rc=0} 11:40:03.199136 bus /sierra_3: Setting Powered False 11:40:04.297771 bus /sierra_3: Setting Powered False 11:40:05.415209 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 11:40:06.502003 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:40:06.513685 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 11:40:06.567268 tst emergency_preemptive_call.py: using LAC 21210 11:40:06.685026 tst emergency_preemptive_call.py: using RAC 45 11:40:06.800530 tst emergency_preemptive_call.py: using CellId 21210 11:40:06.915869 tst emergency_preemptive_call.py: using BVCI 21211 11:40:07.024239 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:40:07.035122 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:40:07.045503 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:40:07.055932 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:40:07.066363 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 11:40:07.076647 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:40:07.194166 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:40:07.313815 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:40:07.429130 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 11:40:07.547134 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:40:08.004728 run create_hlr_db(pid=1218): Launched 11:40:08.124072 bus /sierra_2: Setting Powered False 11:40:09.182514 run create_hlr_db(pid=1218): Terminated: ok {rc=0} 11:40:09.593568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1220): Launched 11:40:09.887691 run osmo-hlr_10.42.42.2(pid=1221): Launched 11:40:09.998058 run osmo-stp_10.42.42.5: Starting osmo-stp 11:40:10.516298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1223): Launched 11:40:10.807505 run osmo-stp_10.42.42.5(pid=1224): Launched 11:40:10.927344 tst emergency_preemptive_call.py: using MSISDN 7192 11:40:11.074784 run osmo-msc_10.42.42.6: Starting osmo-msc 11:40:11.599608 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1226): Launched 11:40:11.891630 run osmo-msc_10.42.42.6(pid=1227): Launched 11:40:12.056148 run osmo-stp_10.42.42.5(pid=1224): ERR: Terminated: ERROR {rc=1} [trial-2359↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1224)] 11:40:12.180008 run osmo-stp_10.42.42.5(pid=1224): stdout: | (launched: 2022-12-09_11:40:10.754253) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:12.303800 run osmo-stp_10.42.42.5(pid=1224): stderr: | 20221209114010921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114010921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114010922 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114010922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114010922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114010923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114010923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:12.425846 run osmo-stp_10.42.42.5(pid=1224): stdout: | (launched: 2022-12-09_11:40:10.754253) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:12.546567 run osmo-stp_10.42.42.5(pid=1224): stderr: | 20221209114010921 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114010921 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114010922 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114010922 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114010922 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114010923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114010923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:12.685673 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=1224): Process ended prematurely: osmo-stp_10.42.42.5(pid=1224) [trial-2359↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1224)] [trial-2359↪emergency:trx-b200↪emergency_preemptive_call.py:32] 11:40:12.693777 tst emergency_preemptive_call.py:32: Test FAILED (6.2 sec) 11:40:12.719693 run osmo-hlr_10.42.42.2(pid=1221): ERR: Terminated: ERROR {rc=237} [trial-2359↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1221)] 11:40:12.767229 run osmo-hlr_10.42.42.2(pid=1221): stdout: | (launched: 2022-12-09_11:40:09.833745) 11:40:12.817276 run osmo-hlr_10.42.42.2(pid=1221): stderr: | 20221209114010004 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114010004 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114010004 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114010004 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114010004 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114010004 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114010016 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114010026 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114010026 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114010026 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:40:12.886384 run osmo-msc_10.42.42.6(pid=1227): ERR: Terminated: ERROR {rc=2} [trial-2359↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1227)] 11:40:12.934236 run osmo-msc_10.42.42.6(pid=1227): stdout: | (launched: 2022-12-09_11:40:11.837689) 11:40:12.983941 run osmo-msc_10.42.42.6(pid=1227): stderr: | 20221209114012108 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209114012108 DLGLOBAL DEBUG validating counter group 0x7f60ce974c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209114012109 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209114012109 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209114012109 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209114012109 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209114012111 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209114012111 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209114012112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209114012112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:40:13.033899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1220): Terminating (SIGTERM) 11:40:13.073700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1223): Terminating (SIGTERM) 11:40:13.113455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1226): Terminating (SIGTERM) 11:40:13.153412 --- ParallelTerminationStrategy: PID 1220 died... 11:40:13.172368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1220): Terminated: ok {rc=0} 11:40:13.216605 --- ParallelTerminationStrategy: PID 1223 died... 11:40:13.235313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1223): Terminated: ok {rc=0} 11:40:13.279018 --- ParallelTerminationStrategy: PID 1226 died... 11:40:13.297562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1226): Terminated: ok {rc=0} 11:40:13.383442 bus /sierra_9: Setting Powered False 11:40:14.483153 bus /sierra_9: Setting Powered False 11:40:15.596891 bus /sierra_8: Setting Powered False 11:40:16.692345 bus /sierra_8: Setting Powered False 11:40:17.807629 bus /sierra_3: Setting Powered False 11:40:18.906715 bus /sierra_3: Setting Powered False 11:40:20.024846 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-b200 --------------------------------------------------------------------- 11:40:21.312499 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:40:21.317095 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 11:40:21.351730 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 11:40:21.390815 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 11:40:21.476570 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 11:40:21.510265 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 11:40:21.549653 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 11:40:22.144068 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 11:40:22.197246 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:22.208063 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 11:40:22.256402 tst cs_paging_gprs_active.py: using LAC 21211 11:40:22.381329 tst cs_paging_gprs_active.py: using RAC 46 11:40:22.506090 tst cs_paging_gprs_active.py: using CellId 21211 11:40:22.631422 tst cs_paging_gprs_active.py: using BVCI 21212 11:40:22.743660 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:22.754446 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:22.764920 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:22.775431 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:22.785840 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:22.796302 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:22.806898 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:22.817120 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:22.827572 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:40:22.945998 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:40:23.061667 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:40:23.263949 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:23.565615 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1234): Launched 11:40:23.829738 run iperf3-srv_10.42.42.10(pid=1235): Launched 11:40:23.944202 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:40:24.146320 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:24.449705 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1236): Launched 11:40:24.714776 run iperf3-srv_10.42.42.10(pid=1237): Launched 11:40:24.828317 tst cs_paging_gprs_active.py:38: start network... 11:40:25.029289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:40:25.494800 run create_hlr_db(pid=1238): Launched 11:40:25.619431 bus /sierra_2: Setting Powered False 11:40:26.679392 run create_hlr_db(pid=1238): Terminated: ok {rc=0} 11:40:27.098062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1240): Launched 11:40:27.399141 run osmo-hlr_10.42.42.2(pid=1241): Launched 11:40:27.515356 run osmo-stp_10.42.42.5: Starting osmo-stp 11:40:28.030759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1243): Launched 11:40:28.330907 run osmo-stp_10.42.42.5(pid=1244): Launched 11:40:28.447518 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:40:28.974228 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1246): Launched 11:40:29.091274 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:40:29.350000 run patchelf(pid=1247): Launched 11:40:29.522186 run osmo-stp_10.42.42.5(pid=1244): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1244)] 11:40:29.652177 run osmo-stp_10.42.42.5(pid=1244): stdout: | (launched: 2022-12-09_11:40:28.276112) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:29.783705 run osmo-stp_10.42.42.5(pid=1244): stderr: | 20221209114028444 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114028444 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114028445 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114028445 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114028445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114028446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114028446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:29.914828 run osmo-stp_10.42.42.5(pid=1244): stdout: | (launched: 2022-12-09_11:40:28.276112) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:30.040940 run osmo-stp_10.42.42.5(pid=1244): stderr: | 20221209114028444 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114028444 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114028445 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114028445 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114028445 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114028446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114028446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:30.190580 run patchelf(pid=1247): Terminating (SIGINT) 11:40:30.364490 run patchelf(pid=1247): Terminated: ok {rc=0} 11:40:30.489659 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1244): Process ended prematurely: osmo-stp_10.42.42.5(pid=1244) [trial-2359↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1244)] [trial-2359↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 11:40:30.499093 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 11:40:30.526382 run osmo-hlr_10.42.42.2(pid=1241): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1241)] 11:40:30.574080 run osmo-hlr_10.42.42.2(pid=1241): stdout: | (launched: 2022-12-09_11:40:27.344302) 11:40:30.623546 run osmo-hlr_10.42.42.2(pid=1241): stderr: | 20221209114027516 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114027516 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114027516 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114027516 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114027516 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114027516 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114027530 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114027539 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114027540 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114027540 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:40:30.674694 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1234): Terminating (SIGTERM) 11:40:30.714798 run iperf3-srv_10.42.42.10(pid=1235): Terminating (SIGTERM) 11:40:30.754829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1236): Terminating (SIGTERM) 11:40:30.794923 run iperf3-srv_10.42.42.10(pid=1237): Terminating (SIGTERM) 11:40:30.846881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1240): Terminating (SIGTERM) 11:40:30.907105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1243): Terminating (SIGTERM) 11:40:30.955561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1246): Terminating (SIGTERM) 11:40:31.002581 --- ParallelTerminationStrategy: PID 1234 died... 11:40:31.024150 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1234): Terminated: ok {rc=0} 11:40:31.076683 --- ParallelTerminationStrategy: PID 1235 died... 11:40:31.098026 run iperf3-srv_10.42.42.10(pid=1235): Terminated {rc=256} 11:40:31.149442 --- ParallelTerminationStrategy: PID 1236 died... 11:40:31.169871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1236): Terminated: ok {rc=0} 11:40:31.219905 --- ParallelTerminationStrategy: PID 1237 died... 11:40:31.240688 run iperf3-srv_10.42.42.10(pid=1237): Terminated {rc=256} 11:40:31.291095 --- ParallelTerminationStrategy: PID 1240 died... 11:40:31.312176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1240): Terminated: ok {rc=0} 11:40:31.363485 --- ParallelTerminationStrategy: PID 1243 died... 11:40:31.384808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1243): Terminated: ok {rc=0} 11:40:31.435698 --- ParallelTerminationStrategy: PID 1246 died... 11:40:31.456451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1246): Terminated: ok {rc=0} 11:40:31.557001 bus /gobi_0: Setting Powered False 11:40:32.668350 bus /gobi_0: Setting Powered False 11:40:33.786157 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-b200 iperf3.py ---------------------------------------------- 11:40:34.935961 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:34.947971 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 11:40:35.001670 tst iperf3.py: using LAC 21212 11:40:35.132472 tst iperf3.py: using RAC 47 11:40:35.262343 tst iperf3.py: using CellId 21212 11:40:35.390920 tst iperf3.py: using BVCI 21213 11:40:35.510943 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:35.522194 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:35.533067 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:35.544263 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:35.555520 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:35.566829 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:35.578185 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:35.589861 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:35.601406 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:40:35.719604 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:40:35.925856 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:36.233837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1248): Launched 11:40:36.501654 run iperf3-srv_10.42.42.10(pid=1249): Launched 11:40:36.618379 tst iperf3.py:8: start network... 11:40:36.825448 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:40:37.302073 run create_hlr_db(pid=1250): Launched 11:40:37.428078 bus /gobi_6: Setting Powered False 11:40:38.489377 run create_hlr_db(pid=1250): Terminated: ok {rc=0} 11:40:38.935877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1252): Launched 11:40:39.265348 run osmo-hlr_10.42.42.2(pid=1253): Launched 11:40:39.391297 run osmo-stp_10.42.42.5: Starting osmo-stp 11:40:39.957605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1255): Launched 11:40:40.289381 run osmo-stp_10.42.42.5(pid=1256): Launched 11:40:40.415379 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:40:40.986265 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1259): Launched 11:40:41.113198 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:40:41.390043 run patchelf(pid=1260): Launched 11:40:41.572907 run osmo-stp_10.42.42.5(pid=1256): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1256)] 11:40:41.711786 run osmo-stp_10.42.42.5(pid=1256): stdout: | (launched: 2022-12-09_11:40:40.229101) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:41.851779 run osmo-stp_10.42.42.5(pid=1256): stderr: | 20221209114040421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114040421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114040421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114040422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114040422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114040422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114040422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:41.992635 run osmo-stp_10.42.42.5(pid=1256): stdout: | (launched: 2022-12-09_11:40:40.229101) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:42.127941 run osmo-stp_10.42.42.5(pid=1256): stderr: | 20221209114040421 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114040421 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114040421 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114040422 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114040422 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114040422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114040422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:42.287632 run patchelf(pid=1260): Terminating (SIGINT) 11:40:42.472850 run patchelf(pid=1260): Terminated: ok {rc=0} 11:40:42.607103 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1256): Process ended prematurely: osmo-stp_10.42.42.5(pid=1256) [trial-2359↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1256)] [trial-2359↪gprs:trx-b200↪iperf3.py:8] 11:40:42.617295 tst iperf3.py:8: Test FAILED (7.7 sec) 11:40:42.646703 run osmo-hlr_10.42.42.2(pid=1253): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1253)] 11:40:42.697324 run osmo-hlr_10.42.42.2(pid=1253): stdout: | (launched: 2022-12-09_11:40:39.205719) 11:40:42.749718 run osmo-hlr_10.42.42.2(pid=1253): stderr: | 20221209114039402 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114039402 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114039402 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114039402 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114039402 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114039402 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114039414 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114039423 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114039423 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114039423 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:40:42.802372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1248): Terminating (SIGTERM) 11:40:42.844486 run iperf3-srv_10.42.42.10(pid=1249): Terminating (SIGTERM) 11:40:42.886738 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1252): Terminating (SIGTERM) 11:40:42.928852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1255): Terminating (SIGTERM) 11:40:42.971044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1259): Terminating (SIGTERM) 11:40:43.013365 --- ParallelTerminationStrategy: PID 1248 died... 11:40:43.033420 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1248): Terminated: ok {rc=0} 11:40:43.080537 --- ParallelTerminationStrategy: PID 1249 died... 11:40:43.100172 run iperf3-srv_10.42.42.10(pid=1249): Terminated {rc=256} 11:40:43.147146 --- ParallelTerminationStrategy: PID 1252 died... 11:40:43.166817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1252): Terminated: ok {rc=0} 11:40:43.213549 --- ParallelTerminationStrategy: PID 1255 died... 11:40:43.233239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1255): Terminated: ok {rc=0} 11:40:43.280134 --- ParallelTerminationStrategy: PID 1259 died... 11:40:43.299718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1259): Terminated: ok {rc=0} 11:40:43.388318 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 11:40:44.537442 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:44.548657 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 11:40:44.598454 tst iperf3m4.py: using LAC 21213 11:40:44.719534 tst iperf3m4.py: using RAC 48 11:40:44.850446 tst iperf3m4.py: using CellId 21213 11:40:44.971528 tst iperf3m4.py: using BVCI 21214 11:40:45.085360 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:45.096025 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:45.106643 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:45.117841 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:45.128783 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:45.139768 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:45.150696 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:45.161666 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:40:45.172555 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:40:45.290352 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:40:45.411861 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:40:45.533690 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:40:45.654750 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:40:45.881343 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:46.251241 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1261): Launched 11:40:46.530822 run iperf3-srv_10.42.42.10(pid=1262): Launched 11:40:46.663462 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:40:46.872531 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:47.264098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1263): Launched 11:40:47.542688 run iperf3-srv_10.42.42.10(pid=1264): Launched 11:40:47.658624 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:40:47.864445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:48.171937 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1265): Launched 11:40:48.439729 run iperf3-srv_10.42.42.10(pid=1266): Launched 11:40:48.555215 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:40:48.759605 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:40:49.067094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1267): Launched 11:40:49.334700 run iperf3-srv_10.42.42.10(pid=1268): Launched 11:40:49.450416 tst iperf3m4.py:8: start network... 11:40:49.654562 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:40:50.131051 run create_hlr_db(pid=1269): Launched 11:40:50.256911 bus /gobi_6: Setting Powered False 11:40:51.318573 run create_hlr_db(pid=1269): Terminated: ok {rc=0} 11:40:51.745968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1271): Launched 11:40:52.054004 run osmo-hlr_10.42.42.2(pid=1272): Launched 11:40:52.170056 run osmo-stp_10.42.42.5: Starting osmo-stp 11:40:52.696825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1274): Launched 11:40:53.005644 run osmo-stp_10.42.42.5(pid=1275): Launched 11:40:53.124286 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:40:53.661792 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1277): Launched 11:40:53.789659 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:40:54.069822 run patchelf(pid=1278): Launched 11:40:54.257346 run osmo-stp_10.42.42.5(pid=1275): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1275)] 11:40:54.398689 run osmo-stp_10.42.42.5(pid=1275): stdout: | (launched: 2022-12-09_11:40:52.948716) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:54.540913 run osmo-stp_10.42.42.5(pid=1275): stderr: | 20221209114053118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114053118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114053118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114053119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114053119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114053119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114053119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:54.683351 run osmo-stp_10.42.42.5(pid=1275): stdout: | (launched: 2022-12-09_11:40:52.948716) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:40:54.820113 run osmo-stp_10.42.42.5(pid=1275): stderr: | 20221209114053118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114053118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114053118 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114053119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114053119 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114053119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114053119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:40:54.982902 run patchelf(pid=1278): Terminating (SIGINT) 11:40:55.171294 run patchelf(pid=1278): Terminated: ok {rc=0} 11:40:55.307291 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1275): Process ended prematurely: osmo-stp_10.42.42.5(pid=1275) [trial-2359↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1275)] [trial-2359↪gprs:trx-b200↪iperf3m4.py:8] 11:40:55.317803 tst iperf3m4.py:8: Test FAILED (10.8 sec) 11:40:55.347512 run osmo-hlr_10.42.42.2(pid=1272): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1272)] 11:40:55.398412 run osmo-hlr_10.42.42.2(pid=1272): stdout: | (launched: 2022-12-09_11:40:51.997348) 11:40:55.451013 run osmo-hlr_10.42.42.2(pid=1272): stderr: | 20221209114052172 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114052173 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114052173 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114052173 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114052173 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114052173 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114052185 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114052194 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114052194 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114052194 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:40:55.503978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1261): Terminating (SIGTERM) 11:40:55.546651 run iperf3-srv_10.42.42.10(pid=1262): Terminating (SIGTERM) 11:40:55.589142 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1263): Terminating (SIGTERM) 11:40:55.631645 run iperf3-srv_10.42.42.10(pid=1264): Terminating (SIGTERM) 11:40:55.674064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1265): Terminating (SIGTERM) 11:40:55.716469 run iperf3-srv_10.42.42.10(pid=1266): Terminating (SIGTERM) 11:40:55.758522 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1267): Terminating (SIGTERM) 11:40:55.801425 run iperf3-srv_10.42.42.10(pid=1268): Terminating (SIGTERM) 11:40:55.843730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1271): Terminating (SIGTERM) 11:40:55.886428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1274): Terminating (SIGTERM) 11:40:55.928846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1277): Terminating (SIGTERM) 11:40:55.971745 --- ParallelTerminationStrategy: PID 1261 died... 11:40:55.992053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1261): Terminated: ok {rc=0} 11:40:56.039367 --- ParallelTerminationStrategy: PID 1262 died... 11:40:56.059025 run iperf3-srv_10.42.42.10(pid=1262): Terminated {rc=256} 11:40:56.106406 --- ParallelTerminationStrategy: PID 1263 died... 11:40:56.126176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1263): Terminated: ok {rc=0} 11:40:56.173055 --- ParallelTerminationStrategy: PID 1264 died... 11:40:56.192725 run iperf3-srv_10.42.42.10(pid=1264): Terminated {rc=256} 11:40:56.239615 --- ParallelTerminationStrategy: PID 1265 died... 11:40:56.259272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1265): Terminated: ok {rc=0} 11:40:56.306379 --- ParallelTerminationStrategy: PID 1266 died... 11:40:56.326016 run iperf3-srv_10.42.42.10(pid=1266): Terminated {rc=256} 11:40:56.373164 --- ParallelTerminationStrategy: PID 1267 died... 11:40:56.392691 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1267): Terminated: ok {rc=0} 11:40:56.439732 --- ParallelTerminationStrategy: PID 1268 died... 11:40:56.459472 run iperf3-srv_10.42.42.10(pid=1268): Terminated {rc=256} 11:40:56.506843 --- ParallelTerminationStrategy: PID 1271 died... 11:40:56.526682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1271): Terminated: ok {rc=0} 11:40:56.573771 --- ParallelTerminationStrategy: PID 1274 died... 11:40:56.593690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1274): Terminated: ok {rc=0} 11:40:56.641027 --- ParallelTerminationStrategy: PID 1277 died... 11:40:56.660858 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1277): Terminated: ok {rc=0} 11:40:56.750323 bus /gobi_4: Setting Powered False 11:40:57.851167 bus /gobi_4: Setting Powered False 11:40:58.969259 bus /gobi_1: Setting Powered False 11:41:00.070758 bus /gobi_1: Setting Powered False 11:41:01.188309 bus /gobi_0: Setting Powered False 11:41:02.288154 bus /gobi_0: Setting Powered False 11:41:03.410302 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-b200 ping.py ---------------------------------------------- 11:41:04.514428 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:41:04.526000 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 11:41:04.575750 tst ping.py: using LAC 21214 11:41:04.696279 tst ping.py: using RAC 49 11:41:04.815814 tst ping.py: using CellId 21214 11:41:04.937790 tst ping.py: using BVCI 21215 11:41:05.047910 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:41:05.058646 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:41:05.069228 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:41:05.079788 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:41:05.090276 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:41:05.100778 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:41:05.111380 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:41:05.121886 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:41:05.239179 tst ping.py:19: start network... 11:41:05.460261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:41:05.962193 run create_hlr_db(pid=1279): Launched 11:41:06.086768 bus /gobi_6: Setting Powered False 11:41:07.151425 run create_hlr_db(pid=1279): Terminated: ok {rc=0} 11:41:07.604748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1281): Launched 11:41:07.929655 run osmo-hlr_10.42.42.2(pid=1282): Launched 11:41:08.054923 run osmo-stp_10.42.42.5: Starting osmo-stp 11:41:08.620447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1284): Launched 11:41:08.946744 run osmo-stp_10.42.42.5(pid=1285): Launched 11:41:09.071187 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:41:09.630666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1287): Launched 11:41:09.757102 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:41:10.031135 run patchelf(pid=1288): Launched 11:41:10.214745 run osmo-stp_10.42.42.5(pid=1285): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1285)] 11:41:10.352911 run osmo-stp_10.42.42.5(pid=1285): stdout: | (launched: 2022-12-09_11:41:08.886623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:10.492022 run osmo-stp_10.42.42.5(pid=1285): stderr: | 20221209114109077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114109077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114109078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114109078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114109078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114109079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114109079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:10.631249 run osmo-stp_10.42.42.5(pid=1285): stdout: | (launched: 2022-12-09_11:41:08.886623) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:10.764335 run osmo-stp_10.42.42.5(pid=1285): stderr: | 20221209114109077 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114109077 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114109078 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114109078 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114109078 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114109079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114109079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:10.922357 run patchelf(pid=1288): Terminating (SIGINT) 11:41:11.107568 run patchelf(pid=1288): Terminated: ok {rc=0} 11:41:11.240390 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1285): Process ended prematurely: osmo-stp_10.42.42.5(pid=1285) [trial-2359↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1285)] [trial-2359↪gprs:trx-b200↪ping.py:22] 11:41:11.250227 tst ping.py:22: Test FAILED (6.7 sec) 11:41:11.279302 run osmo-hlr_10.42.42.2(pid=1282): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1282)] 11:41:11.330201 run osmo-hlr_10.42.42.2(pid=1282): stdout: | (launched: 2022-12-09_11:41:07.870393) 11:41:11.383189 run osmo-hlr_10.42.42.2(pid=1282): stderr: | 20221209114108068 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114108068 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114108068 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114108068 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114108068 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114108068 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114108080 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114108088 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114108088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114108089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:41:11.436337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1281): Terminating (SIGTERM) 11:41:11.479176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1284): Terminating (SIGTERM) 11:41:11.521826 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1287): Terminating (SIGTERM) 11:41:11.564585 --- ParallelTerminationStrategy: PID 1281 died... 11:41:11.584809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1281): Terminated: ok {rc=0} 11:41:11.632036 --- ParallelTerminationStrategy: PID 1284 died... 11:41:11.651786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1284): Terminated: ok {rc=0} 11:41:11.698756 --- ParallelTerminationStrategy: PID 1287 died... 11:41:11.718539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1287): Terminated: ok {rc=0} 11:41:11.807133 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 11:41:12.896340 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:41:12.908273 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 11:41:12.959437 tst ping_idle_ping.py: using LAC 21215 11:41:13.079829 tst ping_idle_ping.py: using RAC 50 11:41:13.208247 tst ping_idle_ping.py: using CellId 21215 11:41:13.335583 tst ping_idle_ping.py: using BVCI 21216 11:41:13.454806 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:41:13.466034 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:41:13.477120 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:41:13.488337 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:41:13.499456 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:41:13.510620 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:41:13.521984 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 11:41:13.533187 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 11:41:13.653600 tst ping_idle_ping.py:24: start network... 11:41:13.872787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:41:14.377830 run create_hlr_db(pid=1289): Launched 11:41:14.503604 bus /gobi_6: Setting Powered False 11:41:15.567824 run create_hlr_db(pid=1289): Terminated: ok {rc=0} 11:41:16.029670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1291): Launched 11:41:16.349792 run osmo-hlr_10.42.42.2(pid=1292): Launched 11:41:16.666275 run osmo-stp_10.42.42.5: Starting osmo-stp 11:41:17.233432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1294): Launched 11:41:17.553628 run osmo-stp_10.42.42.5(pid=1295): Launched 11:41:17.672113 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:41:18.200104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1297): Launched 11:41:18.317340 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:41:18.575032 run patchelf(pid=1298): Launched 11:41:18.744628 run osmo-stp_10.42.42.5(pid=1295): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1295)] 11:41:18.873921 run osmo-stp_10.42.42.5(pid=1295): stdout: | (launched: 2022-12-09_11:41:17.497404) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:19.004282 run osmo-stp_10.42.42.5(pid=1295): stderr: | 20221209114117668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114117668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114117668 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114117668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114117669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114117669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114117669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:19.135329 run osmo-stp_10.42.42.5(pid=1295): stdout: | (launched: 2022-12-09_11:41:17.497404) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:19.259351 run osmo-stp_10.42.42.5(pid=1295): stderr: | 20221209114117668 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114117668 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114117668 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114117668 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114117669 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114117669 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114117669 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:19.406866 run patchelf(pid=1298): Terminating (SIGINT) 11:41:19.578886 run patchelf(pid=1298): Terminated: ok {rc=0} 11:41:19.703160 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1295): Process ended prematurely: osmo-stp_10.42.42.5(pid=1295) [trial-2359↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1295)] [trial-2359↪gprs:trx-b200↪ping_idle_ping.py:27] 11:41:19.711978 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 11:41:19.739006 run osmo-hlr_10.42.42.2(pid=1292): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1292)] 11:41:19.786682 run osmo-hlr_10.42.42.2(pid=1292): stdout: | (launched: 2022-12-09_11:41:16.289185) 11:41:19.836240 run osmo-hlr_10.42.42.2(pid=1292): stderr: | 20221209114116500 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114116500 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114116500 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114116500 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114116500 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114116500 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114116521 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114116541 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114116542 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114116542 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:41:19.886347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1291): Terminating (SIGTERM) 11:41:19.926825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1294): Terminating (SIGTERM) 11:41:19.966719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1297): Terminating (SIGTERM) 11:41:20.006917 --- ParallelTerminationStrategy: PID 1291 died... 11:41:20.026158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1291): Terminated: ok {rc=0} 11:41:20.070120 --- ParallelTerminationStrategy: PID 1294 died... 11:41:20.088723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1294): Terminated: ok {rc=0} 11:41:20.133058 --- ParallelTerminationStrategy: PID 1297 died... 11:41:20.151729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1297): Terminated: ok {rc=0} 11:41:20.238512 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 11:41:21.555517 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:41:21.561484 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:41:21.596817 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:41:21.636478 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:41:21.725806 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:41:21.759550 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:41:21.798883 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:41:22.392366 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:41:22.442312 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:22.453385 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:41:22.504078 tst cs_paging_gprs_active.py: using LAC 21216 11:41:22.628037 tst cs_paging_gprs_active.py: using RAC 51 11:41:22.751834 tst cs_paging_gprs_active.py: using CellId 21216 11:41:22.875959 tst cs_paging_gprs_active.py: using BVCI 21217 11:41:22.990166 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:23.000939 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:23.011684 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:23.022315 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:23.032800 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:23.043405 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:23.054344 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:23.064904 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:23.075702 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:41:23.198110 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:41:23.320003 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:41:23.529194 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:23.842757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1302): Launched 11:41:24.115516 run iperf3-srv_10.42.42.10(pid=1303): Launched 11:41:24.232758 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:41:24.440434 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:24.751732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1304): Launched 11:41:25.022338 run iperf3-srv_10.42.42.10(pid=1305): Launched 11:41:25.141590 tst cs_paging_gprs_active.py:38: start network... 11:41:25.349113 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:41:25.828354 run create_hlr_db(pid=1306): Launched 11:41:25.954559 bus /gobi_6: Setting Powered False 11:41:27.016461 run create_hlr_db(pid=1306): Terminated: ok {rc=0} 11:41:27.448082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1308): Launched 11:41:27.759961 run osmo-hlr_10.42.42.2(pid=1309): Launched 11:41:27.878674 run osmo-stp_10.42.42.5: Starting osmo-stp 11:41:28.427544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1311): Launched 11:41:28.738592 run osmo-stp_10.42.42.5(pid=1312): Launched 11:41:28.859629 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:41:29.391851 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1314): Launched 11:41:29.510676 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:41:29.771739 run patchelf(pid=1315): Launched 11:41:29.945261 run osmo-stp_10.42.42.5(pid=1312): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1312)] 11:41:30.075828 run osmo-stp_10.42.42.5(pid=1312): stdout: | (launched: 2022-12-09_11:41:28.681605) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:30.208072 run osmo-stp_10.42.42.5(pid=1312): stderr: | 20221209114128850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114128851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114128851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114128851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114128852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114128852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114128852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:30.340030 run osmo-stp_10.42.42.5(pid=1312): stdout: | (launched: 2022-12-09_11:41:28.681605) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:30.467058 run osmo-stp_10.42.42.5(pid=1312): stderr: | 20221209114128850 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114128851 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114128851 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114128851 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114128852 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114128852 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114128852 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:30.617383 run patchelf(pid=1315): Terminating (SIGINT) 11:41:30.793314 run patchelf(pid=1315): Terminated: ok {rc=0} 11:41:30.936123 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1312): Process ended prematurely: osmo-stp_10.42.42.5(pid=1312) [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1312)] [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:41:30.946386 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 11:41:30.974251 run osmo-hlr_10.42.42.2(pid=1309): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1309)] 11:41:31.023132 run osmo-hlr_10.42.42.2(pid=1309): stdout: | (launched: 2022-12-09_11:41:27.702821) 11:41:31.074378 run osmo-hlr_10.42.42.2(pid=1309): stderr: | 20221209114127879 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114127879 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114127879 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114127879 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114127879 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114127879 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114127891 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114127901 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114127902 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114127902 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:41:31.126203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1302): Terminating (SIGTERM) 11:41:31.168915 run iperf3-srv_10.42.42.10(pid=1303): Terminating (SIGTERM) 11:41:31.211366 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1304): Terminating (SIGTERM) 11:41:31.252997 run iperf3-srv_10.42.42.10(pid=1305): Terminating (SIGTERM) 11:41:31.295311 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1308): Terminating (SIGTERM) 11:41:31.336651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1311): Terminating (SIGTERM) 11:41:31.378185 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1314): Terminating (SIGTERM) 11:41:31.420628 --- ParallelTerminationStrategy: PID 1302 died... 11:41:31.440154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1302): Terminated: ok {rc=0} 11:41:31.485277 --- ParallelTerminationStrategy: PID 1303 died... 11:41:31.504425 run iperf3-srv_10.42.42.10(pid=1303): Terminated {rc=256} 11:41:31.550870 --- ParallelTerminationStrategy: PID 1304 died... 11:41:31.570787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1304): Terminated: ok {rc=0} 11:41:31.615972 --- ParallelTerminationStrategy: PID 1305 died... 11:41:31.635035 run iperf3-srv_10.42.42.10(pid=1305): Terminated {rc=256} 11:41:31.679768 --- ParallelTerminationStrategy: PID 1308 died... 11:41:31.698915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1308): Terminated: ok {rc=0} 11:41:31.743678 --- ParallelTerminationStrategy: PID 1311 died... 11:41:31.763607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1311): Terminated: ok {rc=0} 11:41:31.808653 --- ParallelTerminationStrategy: PID 1314 died... 11:41:31.828104 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1314): Terminated: ok {rc=0} 11:41:31.913823 bus /gobi_0: Setting Powered False 11:41:33.009984 bus /gobi_0: Setting Powered False 11:41:34.124398 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:41:35.272226 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:35.283724 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:41:35.336563 tst iperf3.py: using LAC 21217 11:41:35.457771 tst iperf3.py: using RAC 52 11:41:35.580095 tst iperf3.py: using CellId 21217 11:41:35.703309 tst iperf3.py: using BVCI 21218 11:41:35.817790 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:35.828569 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:35.839419 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:35.850035 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:35.860460 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:35.870991 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:35.881697 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:35.892178 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:35.902877 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:41:36.023818 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:41:36.247453 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:36.579787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1316): Launched 11:41:36.869542 run iperf3-srv_10.42.42.10(pid=1317): Launched 11:41:36.995330 tst iperf3.py:8: start network... 11:41:37.221021 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:41:37.736030 run create_hlr_db(pid=1318): Launched 11:41:37.862623 bus /gobi_6: Setting Powered False 11:41:38.927613 run create_hlr_db(pid=1318): Terminated: ok {rc=0} 11:41:39.370104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1320): Launched 11:41:39.679904 run osmo-hlr_10.42.42.2(pid=1321): Launched 11:41:39.797472 run osmo-stp_10.42.42.5: Starting osmo-stp 11:41:40.348705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1323): Launched 11:41:40.657956 run osmo-stp_10.42.42.5(pid=1324): Launched 11:41:40.774901 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:41:41.305931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1326): Launched 11:41:41.424425 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:41:41.684349 run patchelf(pid=1327): Launched 11:41:41.856347 run osmo-stp_10.42.42.5(pid=1324): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1324)] 11:41:41.987075 run osmo-stp_10.42.42.5(pid=1324): stdout: | (launched: 2022-12-09_11:41:40.600730) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:42.119002 run osmo-stp_10.42.42.5(pid=1324): stderr: | 20221209114140771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114140772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114140772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114140772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114140773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114140773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114140773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:42.251033 run osmo-stp_10.42.42.5(pid=1324): stdout: | (launched: 2022-12-09_11:41:40.600730) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:42.377608 run osmo-stp_10.42.42.5(pid=1324): stderr: | 20221209114140771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114140772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114140772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114140772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114140773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114140773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114140773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:42.527481 run patchelf(pid=1327): Terminating (SIGINT) 11:41:42.702501 run patchelf(pid=1327): Terminated: ok {rc=0} 11:41:42.828479 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1324): Process ended prematurely: osmo-stp_10.42.42.5(pid=1324) [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1324)] [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 11:41:42.838084 tst iperf3.py:8: Test FAILED (7.6 sec) 11:41:42.865251 run osmo-hlr_10.42.42.2(pid=1321): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1321)] 11:41:42.912819 run osmo-hlr_10.42.42.2(pid=1321): stdout: | (launched: 2022-12-09_11:41:39.622821) 11:41:42.962551 run osmo-hlr_10.42.42.2(pid=1321): stderr: | 20221209114139802 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114139802 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114139802 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114139802 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114139802 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114139802 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114139814 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114139824 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114139825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114139825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:41:43.012707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1316): Terminating (SIGTERM) 11:41:43.052309 run iperf3-srv_10.42.42.10(pid=1317): Terminating (SIGTERM) 11:41:43.092020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1320): Terminating (SIGTERM) 11:41:43.131915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1323): Terminating (SIGTERM) 11:41:43.171594 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1326): Terminating (SIGTERM) 11:41:43.211757 --- ParallelTerminationStrategy: PID 1316 died... 11:41:43.231133 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1316): Terminated: ok {rc=0} 11:41:43.275785 --- ParallelTerminationStrategy: PID 1317 died... 11:41:43.294546 run iperf3-srv_10.42.42.10(pid=1317): Terminated {rc=256} 11:41:43.338526 --- ParallelTerminationStrategy: PID 1320 died... 11:41:43.357346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1320): Terminated: ok {rc=0} 11:41:43.401247 --- ParallelTerminationStrategy: PID 1323 died... 11:41:43.419813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1323): Terminated: ok {rc=0} 11:41:43.464027 --- ParallelTerminationStrategy: PID 1326 died... 11:41:43.482732 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1326): Terminated: ok {rc=0} 11:41:43.566987 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:41:44.718013 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:44.730286 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:41:44.783749 tst iperf3m4.py: using LAC 21218 11:41:44.915010 tst iperf3m4.py: using RAC 53 11:41:45.050446 tst iperf3m4.py: using CellId 21218 11:41:45.184716 tst iperf3m4.py: using BVCI 21219 11:41:45.307462 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:45.319002 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:45.330251 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:45.341706 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:45.353358 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:45.364598 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:45.376286 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:45.387718 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:41:45.399397 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:41:45.518978 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:41:45.643148 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:41:45.762305 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:41:45.910194 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:41:46.140442 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:46.485868 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1328): Launched 11:41:46.795044 run iperf3-srv_10.42.42.10(pid=1329): Launched 11:41:46.950960 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:41:47.180672 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:47.517416 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1330): Launched 11:41:47.808034 run iperf3-srv_10.42.42.10(pid=1331): Launched 11:41:47.933208 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:41:48.156554 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:48.488115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1332): Launched 11:41:48.776898 run iperf3-srv_10.42.42.10(pid=1333): Launched 11:41:48.902035 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:41:49.125156 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:41:49.457879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1334): Launched 11:41:49.746986 run iperf3-srv_10.42.42.10(pid=1335): Launched 11:41:49.872368 tst iperf3m4.py:8: start network... 11:41:50.095566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:41:50.607939 run create_hlr_db(pid=1336): Launched 11:41:50.735020 bus /gobi_6: Setting Powered False 11:41:51.800412 run create_hlr_db(pid=1336): Terminated: ok {rc=0} 11:41:52.260931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1338): Launched 11:41:52.594528 run osmo-hlr_10.42.42.2(pid=1339): Launched 11:41:52.723098 run osmo-stp_10.42.42.5: Starting osmo-stp 11:41:53.294167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1341): Launched 11:41:53.626725 run osmo-stp_10.42.42.5(pid=1342): Launched 11:41:53.754808 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:41:54.325995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1344): Launched 11:41:54.453794 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:41:54.733316 run patchelf(pid=1345): Launched 11:41:54.918448 run osmo-stp_10.42.42.5(pid=1342): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1342)] 11:41:55.058642 run osmo-stp_10.42.42.5(pid=1342): stdout: | (launched: 2022-12-09_11:41:53.566601) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:55.201130 run osmo-stp_10.42.42.5(pid=1342): stderr: | 20221209114153754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114153754 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114153755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114153755 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114153755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114153756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114153756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:55.343163 run osmo-stp_10.42.42.5(pid=1342): stdout: | (launched: 2022-12-09_11:41:53.566601) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:41:55.479177 run osmo-stp_10.42.42.5(pid=1342): stderr: | 20221209114153754 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114153754 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114153755 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114153755 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114153755 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114153756 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114153756 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:41:55.640348 run patchelf(pid=1345): Terminating (SIGINT) 11:41:55.827234 run patchelf(pid=1345): Terminated: ok {rc=0} 11:41:55.962704 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1342): Process ended prematurely: osmo-stp_10.42.42.5(pid=1342) [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1342)] [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 11:41:55.972891 tst iperf3m4.py:8: Test FAILED (11.3 sec) 11:41:56.002871 run osmo-hlr_10.42.42.2(pid=1339): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1339)] 11:41:56.053945 run osmo-hlr_10.42.42.2(pid=1339): stdout: | (launched: 2022-12-09_11:41:52.533986) 11:41:56.107518 run osmo-hlr_10.42.42.2(pid=1339): stderr: | 20221209114152729 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114152729 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114152729 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114152730 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114152730 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114152730 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114152743 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114152751 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114152752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114152752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:41:56.161272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1328): Terminating (SIGTERM) 11:41:56.204034 run iperf3-srv_10.42.42.10(pid=1329): Terminating (SIGTERM) 11:41:56.246685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1330): Terminating (SIGTERM) 11:41:56.289531 run iperf3-srv_10.42.42.10(pid=1331): Terminating (SIGTERM) 11:41:56.332130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1332): Terminating (SIGTERM) 11:41:56.375109 run iperf3-srv_10.42.42.10(pid=1333): Terminating (SIGTERM) 11:41:56.417843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1334): Terminating (SIGTERM) 11:41:56.460634 run iperf3-srv_10.42.42.10(pid=1335): Terminating (SIGTERM) 11:41:56.503188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1338): Terminating (SIGTERM) 11:41:56.545948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1341): Terminating (SIGTERM) 11:41:56.588753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1344): Terminating (SIGTERM) 11:41:56.631853 --- ParallelTerminationStrategy: PID 1328 died... 11:41:56.652293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1328): Terminated: ok {rc=0} 11:41:56.699516 --- ParallelTerminationStrategy: PID 1329 died... 11:41:56.719314 run iperf3-srv_10.42.42.10(pid=1329): Terminated {rc=256} 11:41:56.766365 --- ParallelTerminationStrategy: PID 1330 died... 11:41:56.786067 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1330): Terminated: ok {rc=0} 11:41:56.833056 --- ParallelTerminationStrategy: PID 1331 died... 11:41:56.853074 run iperf3-srv_10.42.42.10(pid=1331): Terminated {rc=256} 11:41:56.900104 --- ParallelTerminationStrategy: PID 1332 died... 11:41:56.919842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1332): Terminated: ok {rc=0} 11:41:56.967154 --- ParallelTerminationStrategy: PID 1333 died... 11:41:56.986887 run iperf3-srv_10.42.42.10(pid=1333): Terminated {rc=256} 11:41:57.034291 --- ParallelTerminationStrategy: PID 1334 died... 11:41:57.054252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1334): Terminated: ok {rc=0} 11:41:57.101620 --- ParallelTerminationStrategy: PID 1335 died... 11:41:57.121433 run iperf3-srv_10.42.42.10(pid=1335): Terminated {rc=256} 11:41:57.168415 --- ParallelTerminationStrategy: PID 1338 died... 11:41:57.188063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1338): Terminated: ok {rc=0} 11:41:57.235130 --- ParallelTerminationStrategy: PID 1341 died... 11:41:57.254896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1341): Terminated: ok {rc=0} 11:41:57.301867 --- ParallelTerminationStrategy: PID 1344 died... 11:41:57.321727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1344): Terminated: ok {rc=0} 11:41:57.411354 bus /gobi_4: Setting Powered False 11:41:58.512290 bus /gobi_4: Setting Powered False 11:41:59.629126 bus /gobi_1: Setting Powered False 11:42:00.729672 bus /gobi_1: Setting Powered False 11:42:01.849216 bus /gobi_0: Setting Powered False 11:42:02.952015 bus /gobi_0: Setting Powered False 11:42:04.070043 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 11:42:05.175152 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:42:05.187462 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:42:05.244365 tst ping.py: using LAC 21219 11:42:05.371258 tst ping.py: using RAC 54 11:42:05.498548 tst ping.py: using CellId 21219 11:42:05.625981 tst ping.py: using BVCI 21220 11:42:05.744424 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:42:05.755915 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:42:05.767168 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:42:05.778615 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:42:05.789993 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:42:05.801370 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:42:05.812868 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:42:05.824351 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:42:05.946221 tst ping.py:19: start network... 11:42:06.150257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:42:06.618979 run create_hlr_db(pid=1352): Launched 11:42:06.743772 bus /gobi_6: Setting Powered False 11:42:07.805372 run create_hlr_db(pid=1352): Terminated: ok {rc=0} 11:42:08.251261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1354): Launched 11:42:08.578145 run osmo-hlr_10.42.42.2(pid=1355): Launched 11:42:08.702989 run osmo-stp_10.42.42.5: Starting osmo-stp 11:42:09.269950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1357): Launched 11:42:09.595736 run osmo-stp_10.42.42.5(pid=1358): Launched 11:42:09.719287 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:42:10.279946 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1360): Launched 11:42:10.405726 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:42:10.680135 run patchelf(pid=1361): Launched 11:42:10.862596 run osmo-stp_10.42.42.5(pid=1358): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1358)] 11:42:11.000784 run osmo-stp_10.42.42.5(pid=1358): stdout: | (launched: 2022-12-09_11:42:09.536428) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:11.140429 run osmo-stp_10.42.42.5(pid=1358): stderr: | 20221209114209728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114209728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114209728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114209729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114209729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114209729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114209729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:11.279837 run osmo-stp_10.42.42.5(pid=1358): stdout: | (launched: 2022-12-09_11:42:09.536428) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:11.413128 run osmo-stp_10.42.42.5(pid=1358): stderr: | 20221209114209728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114209728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114209728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114209729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114209729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114209729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114209729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:11.571253 run patchelf(pid=1361): Terminating (SIGINT) 11:42:11.755041 run patchelf(pid=1361): Terminated: ok {rc=0} 11:42:11.887712 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1358): Process ended prematurely: osmo-stp_10.42.42.5(pid=1358) [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1358)] [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 11:42:11.897530 tst ping.py:22: Test FAILED (6.7 sec) 11:42:11.926553 run osmo-hlr_10.42.42.2(pid=1355): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1355)] 11:42:11.977778 run osmo-hlr_10.42.42.2(pid=1355): stdout: | (launched: 2022-12-09_11:42:08.518693) 11:42:12.030597 run osmo-hlr_10.42.42.2(pid=1355): stderr: | 20221209114208715 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114208715 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114208715 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114208715 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114208716 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114208716 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114208728 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114208737 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114208738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114208738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:42:12.083793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1354): Terminating (SIGTERM) 11:42:12.127173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1357): Terminating (SIGTERM) 11:42:12.170025 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1360): Terminating (SIGTERM) 11:42:12.213313 --- ParallelTerminationStrategy: PID 1354 died... 11:42:12.233791 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1354): Terminated: ok {rc=0} 11:42:12.281411 --- ParallelTerminationStrategy: PID 1357 died... 11:42:12.301369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1357): Terminated: ok {rc=0} 11:42:12.348577 --- ParallelTerminationStrategy: PID 1360 died... 11:42:12.368455 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1360): Terminated: ok {rc=0} 11:42:12.458373 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:42:13.547936 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:42:13.559941 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:42:13.612351 tst ping_idle_ping.py: using LAC 21220 11:42:13.733720 tst ping_idle_ping.py: using RAC 55 11:42:13.853054 tst ping_idle_ping.py: using CellId 21220 11:42:13.974875 tst ping_idle_ping.py: using BVCI 21221 11:42:14.087144 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:42:14.098285 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:42:14.108923 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:42:14.120249 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:42:14.131217 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:42:14.142117 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:42:14.153188 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:42:14.163934 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:42:14.283835 tst ping_idle_ping.py:24: start network... 11:42:14.503846 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:42:15.010096 run create_hlr_db(pid=1362): Launched 11:42:15.135959 bus /gobi_6: Setting Powered False 11:42:16.205643 run create_hlr_db(pid=1362): Terminated: ok {rc=0} 11:42:16.669279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1364): Launched 11:42:17.013556 run osmo-hlr_10.42.42.2(pid=1365): Launched 11:42:17.196053 run osmo-stp_10.42.42.5: Starting osmo-stp 11:42:17.723664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1367): Launched 11:42:18.029209 run osmo-stp_10.42.42.5(pid=1368): Launched 11:42:18.145435 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:42:18.671460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1370): Launched 11:42:18.788662 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:42:19.045551 run patchelf(pid=1371): Launched 11:42:19.216316 run osmo-stp_10.42.42.5(pid=1368): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1368)] 11:42:19.346408 run osmo-stp_10.42.42.5(pid=1368): stdout: | (launched: 2022-12-09_11:42:17.973238) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:19.477239 run osmo-stp_10.42.42.5(pid=1368): stderr: | 20221209114218144 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114218144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114218144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114218145 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114218145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114218145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114218145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:19.608749 run osmo-stp_10.42.42.5(pid=1368): stdout: | (launched: 2022-12-09_11:42:17.973238) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:19.734340 run osmo-stp_10.42.42.5(pid=1368): stderr: | 20221209114218144 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114218144 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114218144 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114218145 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114218145 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114218145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114218145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:19.882794 run patchelf(pid=1371): Terminating (SIGINT) 11:42:20.056809 run patchelf(pid=1371): Terminated: ok {rc=0} 11:42:20.182410 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1368): Process ended prematurely: osmo-stp_10.42.42.5(pid=1368) [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1368)] [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 11:42:20.191337 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 11:42:20.218318 run osmo-hlr_10.42.42.2(pid=1365): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1365)] 11:42:20.266278 run osmo-hlr_10.42.42.2(pid=1365): stdout: | (launched: 2022-12-09_11:42:16.951616) 11:42:20.316006 run osmo-hlr_10.42.42.2(pid=1365): stderr: | 20221209114217196 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114217196 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114217196 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114217196 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114217196 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114217196 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114217213 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114217222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114217223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114217223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:42:20.366268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1364): Terminating (SIGTERM) 11:42:20.406215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1367): Terminating (SIGTERM) 11:42:20.446350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1370): Terminating (SIGTERM) 11:42:20.486825 --- ParallelTerminationStrategy: PID 1364 died... 11:42:20.506230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1364): Terminated: ok {rc=0} 11:42:20.550787 --- ParallelTerminationStrategy: PID 1367 died... 11:42:20.569512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1367): Terminated: ok {rc=0} 11:42:20.614149 --- ParallelTerminationStrategy: PID 1370 died... 11:42:20.633065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1370): Terminated: ok {rc=0} 11:42:20.720381 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:42:22.032237 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:42:22.038717 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:42:22.072096 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:42:22.110547 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:42:22.197762 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:42:22.230267 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:42:22.268130 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:42:22.862053 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:42:22.911518 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:22.922684 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:42:22.992320 tst cs_paging_gprs_active.py: using LAC 21221 11:42:23.115544 tst cs_paging_gprs_active.py: using RAC 56 11:42:23.237074 tst cs_paging_gprs_active.py: using CellId 21221 11:42:23.360269 tst cs_paging_gprs_active.py: using BVCI 21222 11:42:23.474766 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:23.485693 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:23.496284 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:23.506996 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:23.518144 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:23.529111 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:23.540764 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:23.551705 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:23.562804 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:42:23.684466 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:42:23.805313 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:42:24.015313 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:42:24.326485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1376): Launched 11:42:24.599473 run iperf3-srv_10.42.42.10(pid=1377): Launched 11:42:24.717366 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:42:24.925522 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:42:25.237592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1378): Launched 11:42:25.510726 run iperf3-srv_10.42.42.10(pid=1379): Launched 11:42:25.629783 tst cs_paging_gprs_active.py:38: start network... 11:42:25.836063 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:42:26.315446 run create_hlr_db(pid=1380): Launched 11:42:26.442900 bus /gobi_6: Setting Powered False 11:42:27.504724 run create_hlr_db(pid=1380): Terminated: ok {rc=0} 11:42:27.936449 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1382): Launched 11:42:28.246787 run osmo-hlr_10.42.42.2(pid=1383): Launched 11:42:28.366714 run osmo-stp_10.42.42.5: Starting osmo-stp 11:42:28.897914 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1385): Launched 11:42:29.207789 run osmo-stp_10.42.42.5(pid=1386): Launched 11:42:29.326223 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:42:29.858908 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1388): Launched 11:42:29.977992 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:42:30.240610 run patchelf(pid=1389): Launched 11:42:30.414723 run osmo-stp_10.42.42.5(pid=1386): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1386)] 11:42:30.546071 run osmo-stp_10.42.42.5(pid=1386): stdout: | (launched: 2022-12-09_11:42:29.151176) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:30.678598 run osmo-stp_10.42.42.5(pid=1386): stderr: | 20221209114229317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114229317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114229318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114229318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114229318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114229318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114229319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:30.811006 run osmo-stp_10.42.42.5(pid=1386): stdout: | (launched: 2022-12-09_11:42:29.151176) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:30.945638 run osmo-stp_10.42.42.5(pid=1386): stderr: | 20221209114229317 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114229317 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114229318 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114229318 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114229318 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114229318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114229319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:31.101205 run patchelf(pid=1389): Terminating (SIGINT) 11:42:31.283207 run patchelf(pid=1389): Terminated: ok {rc=0} 11:42:31.413476 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1386): Process ended prematurely: osmo-stp_10.42.42.5(pid=1386) [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1386)] [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:42:31.423863 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 11:42:31.452797 run osmo-hlr_10.42.42.2(pid=1383): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1383)] 11:42:31.502366 run osmo-hlr_10.42.42.2(pid=1383): stdout: | (launched: 2022-12-09_11:42:28.189754) 11:42:31.553559 run osmo-hlr_10.42.42.2(pid=1383): stderr: | 20221209114228367 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114228367 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114228367 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114228367 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114228367 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114228367 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114228379 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114228387 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114228387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114228387 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:42:31.605992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1376): Terminating (SIGTERM) 11:42:31.648590 run iperf3-srv_10.42.42.10(pid=1377): Terminating (SIGTERM) 11:42:31.691719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1378): Terminating (SIGTERM) 11:42:31.733226 run iperf3-srv_10.42.42.10(pid=1379): Terminating (SIGTERM) 11:42:31.774217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1382): Terminating (SIGTERM) 11:42:31.815435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1385): Terminating (SIGTERM) 11:42:31.856299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1388): Terminating (SIGTERM) 11:42:31.897505 --- ParallelTerminationStrategy: PID 1376 died... 11:42:31.916793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1376): Terminated: ok {rc=0} 11:42:31.962829 --- ParallelTerminationStrategy: PID 1377 died... 11:42:31.982189 run iperf3-srv_10.42.42.10(pid=1377): Terminated {rc=256} 11:42:32.027411 --- ParallelTerminationStrategy: PID 1378 died... 11:42:32.046939 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1378): Terminated: ok {rc=0} 11:42:32.092344 --- ParallelTerminationStrategy: PID 1379 died... 11:42:32.111603 run iperf3-srv_10.42.42.10(pid=1379): Terminated {rc=256} 11:42:32.157183 --- ParallelTerminationStrategy: PID 1382 died... 11:42:32.176344 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1382): Terminated: ok {rc=0} 11:42:32.221628 --- ParallelTerminationStrategy: PID 1385 died... 11:42:32.241332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1385): Terminated: ok {rc=0} 11:42:32.286523 --- ParallelTerminationStrategy: PID 1388 died... 11:42:32.305623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1388): Terminated: ok {rc=0} 11:42:32.392653 bus /gobi_0: Setting Powered False 11:42:33.494090 bus /gobi_0: Setting Powered False 11:42:34.611049 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:42:35.759995 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:35.771790 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:42:35.845659 tst iperf3.py: using LAC 21222 11:42:35.976941 tst iperf3.py: using RAC 57 11:42:36.107594 tst iperf3.py: using CellId 21222 11:42:36.240499 tst iperf3.py: using BVCI 21223 11:42:36.361772 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:36.373402 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:36.384805 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:36.396505 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:36.408050 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:36.419621 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:36.431385 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:36.442871 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:36.454667 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:42:36.578480 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:42:36.801829 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:42:37.133609 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1390): Launched 11:42:37.424382 run iperf3-srv_10.42.42.10(pid=1391): Launched 11:42:37.549965 tst iperf3.py:8: start network... 11:42:37.773700 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:42:38.286024 run create_hlr_db(pid=1392): Launched 11:42:38.414358 bus /gobi_6: Setting Powered False 11:42:39.479482 run create_hlr_db(pid=1392): Terminated: ok {rc=0} 11:42:39.921235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1394): Launched 11:42:40.231101 run osmo-hlr_10.42.42.2(pid=1395): Launched 11:42:40.349834 run osmo-stp_10.42.42.5: Starting osmo-stp 11:42:40.883867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1397): Launched 11:42:41.193310 run osmo-stp_10.42.42.5(pid=1398): Launched 11:42:41.311100 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:42:41.845750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1400): Launched 11:42:41.965310 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:42:42.227235 run patchelf(pid=1401): Launched 11:42:42.399459 run osmo-stp_10.42.42.5(pid=1398): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1398)] 11:42:42.530210 run osmo-stp_10.42.42.5(pid=1398): stdout: | (launched: 2022-12-09_11:42:41.136052) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:42.662181 run osmo-stp_10.42.42.5(pid=1398): stderr: | 20221209114241305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114241306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114241306 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114241306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114241307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114241307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114241307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:42.793945 run osmo-stp_10.42.42.5(pid=1398): stdout: | (launched: 2022-12-09_11:42:41.136052) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:42.920389 run osmo-stp_10.42.42.5(pid=1398): stderr: | 20221209114241305 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114241306 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114241306 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114241306 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114241307 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114241307 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114241307 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:43.070533 run patchelf(pid=1401): Terminating (SIGINT) 11:42:43.245193 run patchelf(pid=1401): Terminated: ok {rc=0} 11:42:43.371172 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1398): Process ended prematurely: osmo-stp_10.42.42.5(pid=1398) [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1398)] [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 11:42:43.380638 tst iperf3.py:8: Test FAILED (7.7 sec) 11:42:43.408091 run osmo-hlr_10.42.42.2(pid=1395): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1395)] 11:42:43.455940 run osmo-hlr_10.42.42.2(pid=1395): stdout: | (launched: 2022-12-09_11:42:40.174345) 11:42:43.505936 run osmo-hlr_10.42.42.2(pid=1395): stderr: | 20221209114240350 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114240350 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114240350 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114240350 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114240350 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114240350 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114240362 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114240370 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114240370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114240370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:42:43.556174 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1390): Terminating (SIGTERM) 11:42:43.596244 run iperf3-srv_10.42.42.10(pid=1391): Terminating (SIGTERM) 11:42:43.636225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1394): Terminating (SIGTERM) 11:42:43.676259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1397): Terminating (SIGTERM) 11:42:43.716891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1400): Terminating (SIGTERM) 11:42:43.757485 --- ParallelTerminationStrategy: PID 1390 died... 11:42:43.776669 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1390): Terminated: ok {rc=0} 11:42:43.821188 --- ParallelTerminationStrategy: PID 1391 died... 11:42:43.839853 run iperf3-srv_10.42.42.10(pid=1391): Terminated {rc=256} 11:42:43.884509 --- ParallelTerminationStrategy: PID 1394 died... 11:42:43.903484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1394): Terminated: ok {rc=0} 11:42:43.948135 --- ParallelTerminationStrategy: PID 1397 died... 11:42:43.967126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1397): Terminated: ok {rc=0} 11:42:44.011752 --- ParallelTerminationStrategy: PID 1400 died... 11:42:44.030641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1400): Terminated: ok {rc=0} 11:42:44.116142 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 11:42:45.261711 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:45.273422 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:42:45.342938 tst iperf3m4.py: using LAC 21223 11:42:45.469552 tst iperf3m4.py: using RAC 58 11:42:45.600400 tst iperf3m4.py: using CellId 21223 11:42:45.730885 tst iperf3m4.py: using BVCI 21224 11:42:45.870109 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:45.885052 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:45.909255 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:45.922024 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:45.933905 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:45.946560 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:45.959399 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:45.972207 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:42:45.985203 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:42:46.117470 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:42:46.245074 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:42:46.369877 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:42:46.525312 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:42:46.779288 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:42:47.109814 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1402): Launched 11:42:47.392937 run iperf3-srv_10.42.42.10(pid=1403): Launched 11:42:47.511087 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:42:47.719359 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:42:48.031908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1404): Launched 11:42:48.303618 run iperf3-srv_10.42.42.10(pid=1405): Launched 11:42:48.420730 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:42:48.627535 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:42:48.938856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1406): Launched 11:42:49.211913 run iperf3-srv_10.42.42.10(pid=1407): Launched 11:42:49.328788 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:42:49.535418 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:42:49.852504 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1408): Launched 11:42:50.145289 run iperf3-srv_10.42.42.10(pid=1409): Launched 11:42:50.272440 tst iperf3m4.py:8: start network... 11:42:50.495902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:42:51.009953 run create_hlr_db(pid=1410): Launched 11:42:51.137159 bus /gobi_6: Setting Powered False 11:42:52.201881 run create_hlr_db(pid=1410): Terminated: ok {rc=0} 11:42:52.644543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1412): Launched 11:42:52.955955 run osmo-hlr_10.42.42.2(pid=1413): Launched 11:42:53.074020 run osmo-stp_10.42.42.5: Starting osmo-stp 11:42:53.611497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1415): Launched 11:42:53.923526 run osmo-stp_10.42.42.5(pid=1416): Launched 11:42:54.041944 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:42:54.575048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1418): Launched 11:42:54.695768 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:42:54.958045 run patchelf(pid=1419): Launched 11:42:55.133454 run osmo-stp_10.42.42.5(pid=1416): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1416)] 11:42:55.265200 run osmo-stp_10.42.42.5(pid=1416): stdout: | (launched: 2022-12-09_11:42:53.866618) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:55.398790 run osmo-stp_10.42.42.5(pid=1416): stderr: | 20221209114254035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114254035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114254035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114254036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114254036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114254036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114254036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:55.531934 run osmo-stp_10.42.42.5(pid=1416): stdout: | (launched: 2022-12-09_11:42:53.866618) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:42:55.659977 run osmo-stp_10.42.42.5(pid=1416): stderr: | 20221209114254035 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114254035 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114254035 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114254036 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114254036 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114254036 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114254036 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:42:55.812701 run patchelf(pid=1419): Terminating (SIGINT) 11:42:55.989405 run patchelf(pid=1419): Terminated: ok {rc=0} 11:42:56.116764 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1416): Process ended prematurely: osmo-stp_10.42.42.5(pid=1416) [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1416)] [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:42:56.126434 tst iperf3m4.py:8: Test FAILED (10.9 sec) 11:42:56.154387 run osmo-hlr_10.42.42.2(pid=1413): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1413)] 11:42:56.203143 run osmo-hlr_10.42.42.2(pid=1413): stdout: | (launched: 2022-12-09_11:42:52.899106) 11:42:56.253492 run osmo-hlr_10.42.42.2(pid=1413): stderr: | 20221209114253073 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114253073 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114253073 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114253073 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114253073 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114253074 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114253086 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114253094 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114253094 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114253094 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:42:56.304173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1402): Terminating (SIGTERM) 11:42:56.345381 run iperf3-srv_10.42.42.10(pid=1403): Terminating (SIGTERM) 11:42:56.385753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1404): Terminating (SIGTERM) 11:42:56.426366 run iperf3-srv_10.42.42.10(pid=1405): Terminating (SIGTERM) 11:42:56.467062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1406): Terminating (SIGTERM) 11:42:56.507885 run iperf3-srv_10.42.42.10(pid=1407): Terminating (SIGTERM) 11:42:56.548558 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1408): Terminating (SIGTERM) 11:42:56.589477 run iperf3-srv_10.42.42.10(pid=1409): Terminating (SIGTERM) 11:42:56.630160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1412): Terminating (SIGTERM) 11:42:56.670944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1415): Terminating (SIGTERM) 11:42:56.711673 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1418): Terminating (SIGTERM) 11:42:56.752707 --- ParallelTerminationStrategy: PID 1402 died... 11:42:56.776110 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1402): Terminated: ok {rc=0} 11:42:56.828838 --- ParallelTerminationStrategy: PID 1403 died... 11:42:56.849545 run iperf3-srv_10.42.42.10(pid=1403): Terminated {rc=256} 11:42:56.898618 --- ParallelTerminationStrategy: PID 1404 died... 11:42:56.920921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1404): Terminated: ok {rc=0} 11:42:56.971205 --- ParallelTerminationStrategy: PID 1405 died... 11:42:56.992477 run iperf3-srv_10.42.42.10(pid=1405): Terminated {rc=256} 11:42:57.042857 --- ParallelTerminationStrategy: PID 1406 died... 11:42:57.063520 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1406): Terminated: ok {rc=0} 11:42:57.112786 --- ParallelTerminationStrategy: PID 1407 died... 11:42:57.133401 run iperf3-srv_10.42.42.10(pid=1407): Terminated {rc=256} 11:42:57.182166 --- ParallelTerminationStrategy: PID 1408 died... 11:42:57.202529 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1408): Terminated: ok {rc=0} 11:42:57.251264 --- ParallelTerminationStrategy: PID 1409 died... 11:42:57.271334 run iperf3-srv_10.42.42.10(pid=1409): Terminated {rc=256} 11:42:57.319903 --- ParallelTerminationStrategy: PID 1412 died... 11:42:57.340046 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1412): Terminated: ok {rc=0} 11:42:57.388815 --- ParallelTerminationStrategy: PID 1415 died... 11:42:57.409349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1415): Terminated: ok {rc=0} 11:42:57.458187 --- ParallelTerminationStrategy: PID 1418 died... 11:42:57.478237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1418): Terminated: ok {rc=0} 11:42:57.569306 bus /gobi_4: Setting Powered False 11:42:58.673328 bus /gobi_4: Setting Powered False 11:42:59.792138 bus /gobi_1: Setting Powered False 11:43:00.914002 bus /gobi_1: Setting Powered False 11:43:02.051760 bus /gobi_0: Setting Powered False 11:43:03.150592 bus /gobi_0: Setting Powered False 11:43:04.270049 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:43:05.376450 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:43:05.388336 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:43:05.458583 tst ping.py: using LAC 21224 11:43:05.577473 tst ping.py: using RAC 59 11:43:05.707477 tst ping.py: using CellId 21224 11:43:05.835109 tst ping.py: using BVCI 21225 11:43:05.954175 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:43:05.965865 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:43:05.977344 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:43:05.988821 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:43:06.000178 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:43:06.011646 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:43:06.023283 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:43:06.034784 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:43:06.152902 tst ping.py:19: start network... 11:43:06.358156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:43:06.829571 run create_hlr_db(pid=1420): Launched 11:43:06.956149 bus /gobi_6: Setting Powered False 11:43:08.017572 run create_hlr_db(pid=1420): Terminated: ok {rc=0} 11:43:08.443082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1422): Launched 11:43:08.747612 run osmo-hlr_10.42.42.2(pid=1423): Launched 11:43:08.863094 run osmo-stp_10.42.42.5: Starting osmo-stp 11:43:09.388061 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1425): Launched 11:43:09.692173 run osmo-stp_10.42.42.5(pid=1426): Launched 11:43:09.820792 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:43:10.383714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1428): Launched 11:43:10.509717 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:43:10.785036 run patchelf(pid=1429): Launched 11:43:10.966390 run osmo-stp_10.42.42.5(pid=1426): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1426)] 11:43:11.104567 run osmo-stp_10.42.42.5(pid=1426): stdout: | (launched: 2022-12-09_11:43:09.636173) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:11.244208 run osmo-stp_10.42.42.5(pid=1426): stderr: | 20221209114309821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114309821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114309822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114309822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114309822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114309822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114309823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:11.383795 run osmo-stp_10.42.42.5(pid=1426): stdout: | (launched: 2022-12-09_11:43:09.636173) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:11.517056 run osmo-stp_10.42.42.5(pid=1426): stderr: | 20221209114309821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114309821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114309822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114309822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114309822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114309822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114309823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:11.674882 run patchelf(pid=1429): Terminating (SIGINT) 11:43:11.858754 run patchelf(pid=1429): Terminated: ok {rc=0} 11:43:11.991650 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1426): Process ended prematurely: osmo-stp_10.42.42.5(pid=1426) [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1426)] [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 11:43:12.001399 tst ping.py:22: Test FAILED (6.6 sec) 11:43:12.031055 run osmo-hlr_10.42.42.2(pid=1423): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1423)] 11:43:12.082217 run osmo-hlr_10.42.42.2(pid=1423): stdout: | (launched: 2022-12-09_11:43:08.691807) 11:43:12.135330 run osmo-hlr_10.42.42.2(pid=1423): stderr: | 20221209114308867 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114308867 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114308867 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114308867 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114308867 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114308867 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114308882 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114308892 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114308892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114308892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:43:12.189120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1422): Terminating (SIGTERM) 11:43:12.231492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1425): Terminating (SIGTERM) 11:43:12.274138 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1428): Terminating (SIGTERM) 11:43:12.316841 --- ParallelTerminationStrategy: PID 1422 died... 11:43:12.337248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1422): Terminated: ok {rc=0} 11:43:12.384632 --- ParallelTerminationStrategy: PID 1425 died... 11:43:12.404552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1425): Terminated: ok {rc=0} 11:43:12.451982 --- ParallelTerminationStrategy: PID 1428 died... 11:43:12.471905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1428): Terminated: ok {rc=0} 11:43:12.561578 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 11:43:13.649968 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:43:13.662328 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:43:13.736117 tst ping_idle_ping.py: using LAC 21225 11:43:13.868320 tst ping_idle_ping.py: using RAC 60 11:43:13.994640 tst ping_idle_ping.py: using CellId 21225 11:43:14.120606 tst ping_idle_ping.py: using BVCI 21226 11:43:14.239990 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:43:14.251731 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:43:14.263209 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:43:14.274730 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:43:14.286222 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:43:14.298018 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:43:14.309834 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:43:14.321528 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:43:14.440544 tst ping_idle_ping.py:24: start network... 11:43:14.647587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:43:15.126870 run create_hlr_db(pid=1430): Launched 11:43:15.251882 bus /gobi_6: Setting Powered False 11:43:16.314193 run create_hlr_db(pid=1430): Terminated: ok {rc=0} 11:43:16.750370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1432): Launched 11:43:17.073376 run osmo-hlr_10.42.42.2(pid=1433): Launched 11:43:17.243797 run osmo-stp_10.42.42.5: Starting osmo-stp 11:43:17.785290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1435): Launched 11:43:18.091148 run osmo-stp_10.42.42.5(pid=1436): Launched 11:43:18.206997 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:43:18.730737 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1438): Launched 11:43:18.849192 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:43:19.105137 run patchelf(pid=1439): Launched 11:43:19.275818 run osmo-stp_10.42.42.5(pid=1436): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1436)] 11:43:19.406503 run osmo-stp_10.42.42.5(pid=1436): stdout: | (launched: 2022-12-09_11:43:18.035559) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:19.537631 run osmo-stp_10.42.42.5(pid=1436): stderr: | 20221209114318204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114318204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114318205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114318205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114318206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114318206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114318206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:19.668697 run osmo-stp_10.42.42.5(pid=1436): stdout: | (launched: 2022-12-09_11:43:18.035559) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:19.794093 run osmo-stp_10.42.42.5(pid=1436): stderr: | 20221209114318204 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114318204 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114318205 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114318205 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114318206 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114318206 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114318206 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:19.942448 run patchelf(pid=1439): Terminating (SIGINT) 11:43:20.116220 run patchelf(pid=1439): Terminated: ok {rc=0} 11:43:20.241523 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1436): Process ended prematurely: osmo-stp_10.42.42.5(pid=1436) [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1436)] [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 11:43:20.250453 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 11:43:20.277440 run osmo-hlr_10.42.42.2(pid=1433): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1433)] 11:43:20.326022 run osmo-hlr_10.42.42.2(pid=1433): stdout: | (launched: 2022-12-09_11:43:17.016683) 11:43:20.376051 run osmo-hlr_10.42.42.2(pid=1433): stderr: | 20221209114317243 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114317243 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114317243 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114317243 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114317243 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114317244 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114317255 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114317263 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114317264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114317264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:43:20.426761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1432): Terminating (SIGTERM) 11:43:20.467743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1435): Terminating (SIGTERM) 11:43:20.508413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1438): Terminating (SIGTERM) 11:43:20.548904 --- ParallelTerminationStrategy: PID 1432 died... 11:43:20.568187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1432): Terminated: ok {rc=0} 11:43:20.613120 --- ParallelTerminationStrategy: PID 1435 died... 11:43:20.631933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1435): Terminated: ok {rc=0} 11:43:20.676249 --- ParallelTerminationStrategy: PID 1438 died... 11:43:20.695118 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1438): Terminated: ok {rc=0} 11:43:20.780269 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:43:22.092249 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:43:22.099098 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:43:22.134753 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 11:43:22.175353 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 11:43:22.265593 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:43:22.299491 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 11:43:22.338419 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 11:43:22.935420 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 11:43:22.990385 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:23.002115 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:43:23.074779 tst cs_paging_gprs_active.py: using LAC 21226 11:43:23.205369 tst cs_paging_gprs_active.py: using RAC 61 11:43:23.334701 tst cs_paging_gprs_active.py: using CellId 21226 11:43:23.465404 tst cs_paging_gprs_active.py: using BVCI 21227 11:43:23.579220 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:23.590379 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:23.601171 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:23.611899 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:23.622767 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:23.633565 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:23.644389 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:23.655039 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:23.666014 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:43:23.788656 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:43:23.911411 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:43:24.137367 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:43:24.472264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1443): Launched 11:43:24.763493 run iperf3-srv_10.42.42.10(pid=1444): Launched 11:43:24.889902 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:43:25.114531 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:43:25.449474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1445): Launched 11:43:25.742001 run iperf3-srv_10.42.42.10(pid=1446): Launched 11:43:25.867700 tst cs_paging_gprs_active.py:38: start network... 11:43:26.092038 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:43:26.608029 run create_hlr_db(pid=1447): Launched 11:43:26.736092 bus /gobi_6: Setting Powered False 11:43:27.801174 run create_hlr_db(pid=1447): Terminated: ok {rc=0} 11:43:28.243752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1449): Launched 11:43:28.556113 run osmo-hlr_10.42.42.2(pid=1450): Launched 11:43:28.675967 run osmo-stp_10.42.42.5: Starting osmo-stp 11:43:29.208545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1452): Launched 11:43:29.518335 run osmo-stp_10.42.42.5(pid=1453): Launched 11:43:29.638347 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:43:30.173745 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1455): Launched 11:43:30.293325 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:43:30.558702 run patchelf(pid=1456): Launched 11:43:30.733338 run osmo-stp_10.42.42.5(pid=1453): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1453)] 11:43:30.872239 run osmo-stp_10.42.42.5(pid=1453): stdout: | (launched: 2022-12-09_11:43:29.461575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:31.012282 run osmo-stp_10.42.42.5(pid=1453): stderr: | 20221209114329631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114329631 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114329631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114329632 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114329632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114329632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114329632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:31.153397 run osmo-stp_10.42.42.5(pid=1453): stdout: | (launched: 2022-12-09_11:43:29.461575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:31.287252 run osmo-stp_10.42.42.5(pid=1453): stderr: | 20221209114329631 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114329631 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114329631 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114329632 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114329632 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114329632 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114329632 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:31.442857 run patchelf(pid=1456): Terminating (SIGINT) 11:43:31.623775 run patchelf(pid=1456): Terminated: ok {rc=0} 11:43:31.754113 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1453): Process ended prematurely: osmo-stp_10.42.42.5(pid=1453) [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1453)] [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 11:43:31.764242 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 11:43:31.793050 run osmo-hlr_10.42.42.2(pid=1450): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1450)] 11:43:31.842182 run osmo-hlr_10.42.42.2(pid=1450): stdout: | (launched: 2022-12-09_11:43:28.498182) 11:43:31.893859 run osmo-hlr_10.42.42.2(pid=1450): stderr: | 20221209114328674 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114328674 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114328674 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114328674 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114328674 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114328675 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114328687 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114328695 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114328695 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114328695 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:43:31.945725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1443): Terminating (SIGTERM) 11:43:31.987614 run iperf3-srv_10.42.42.10(pid=1444): Terminating (SIGTERM) 11:43:32.031802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1445): Terminating (SIGTERM) 11:43:32.074076 run iperf3-srv_10.42.42.10(pid=1446): Terminating (SIGTERM) 11:43:32.119819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1449): Terminating (SIGTERM) 11:43:32.161432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1452): Terminating (SIGTERM) 11:43:32.201956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1455): Terminating (SIGTERM) 11:43:32.242614 --- ParallelTerminationStrategy: PID 1443 died... 11:43:32.262165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1443): Terminated: ok {rc=0} 11:43:32.306347 --- ParallelTerminationStrategy: PID 1444 died... 11:43:32.324876 run iperf3-srv_10.42.42.10(pid=1444): Terminated {rc=256} 11:43:32.368839 --- ParallelTerminationStrategy: PID 1445 died... 11:43:32.387961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1445): Terminated: ok {rc=0} 11:43:32.431922 --- ParallelTerminationStrategy: PID 1446 died... 11:43:32.450625 run iperf3-srv_10.42.42.10(pid=1446): Terminated {rc=256} 11:43:32.494647 --- ParallelTerminationStrategy: PID 1449 died... 11:43:32.513285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1449): Terminated: ok {rc=0} 11:43:32.557219 --- ParallelTerminationStrategy: PID 1452 died... 11:43:32.576054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1452): Terminated: ok {rc=0} 11:43:32.620199 --- ParallelTerminationStrategy: PID 1455 died... 11:43:32.638912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1455): Terminated: ok {rc=0} 11:43:32.725159 bus /gobi_0: Setting Powered False 11:43:33.826082 bus /gobi_0: Setting Powered False 11:43:34.943002 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 11:43:36.090643 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:36.102264 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:43:36.175597 tst iperf3.py: using LAC 21227 11:43:36.297168 tst iperf3.py: using RAC 62 11:43:36.423134 tst iperf3.py: using CellId 21227 11:43:36.546528 tst iperf3.py: using BVCI 21228 11:43:36.660252 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:36.671166 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:36.681922 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:36.692601 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:36.703278 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:36.714027 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:36.724721 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:36.735323 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:36.746155 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:43:36.863582 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:43:37.071340 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:43:37.381441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1457): Launched 11:43:37.653709 run iperf3-srv_10.42.42.10(pid=1458): Launched 11:43:37.771383 tst iperf3.py:8: start network... 11:43:37.979455 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:43:38.462042 run create_hlr_db(pid=1459): Launched 11:43:38.587880 bus /gobi_6: Setting Powered False 11:43:39.652711 run create_hlr_db(pid=1459): Terminated: ok {rc=0} 11:43:40.112836 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1461): Launched 11:43:40.444542 run osmo-hlr_10.42.42.2(pid=1462): Launched 11:43:40.571368 run osmo-stp_10.42.42.5: Starting osmo-stp 11:43:41.147683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1464): Launched 11:43:41.479726 run osmo-stp_10.42.42.5(pid=1465): Launched 11:43:41.606934 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:43:42.178036 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1467): Launched 11:43:42.306127 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:43:42.586092 run patchelf(pid=1468): Launched 11:43:42.770830 run osmo-stp_10.42.42.5(pid=1465): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1465)] 11:43:42.911224 run osmo-stp_10.42.42.5(pid=1465): stdout: | (launched: 2022-12-09_11:43:41.419154) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:43.052337 run osmo-stp_10.42.42.5(pid=1465): stderr: | 20221209114341611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114341611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114341611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114341611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114341612 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114341612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114341612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:43.194081 run osmo-stp_10.42.42.5(pid=1465): stdout: | (launched: 2022-12-09_11:43:41.419154) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:43.329574 run osmo-stp_10.42.42.5(pid=1465): stderr: | 20221209114341611 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114341611 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114341611 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114341611 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114341612 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114341612 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114341612 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:43.490438 run patchelf(pid=1468): Terminating (SIGINT) 11:43:43.676873 run patchelf(pid=1468): Terminated: ok {rc=0} 11:43:43.811997 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1465): Process ended prematurely: osmo-stp_10.42.42.5(pid=1465) [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1465)] [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 11:43:43.822368 tst iperf3.py:8: Test FAILED (7.8 sec) 11:43:43.852055 run osmo-hlr_10.42.42.2(pid=1462): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1462)] 11:43:43.903311 run osmo-hlr_10.42.42.2(pid=1462): stdout: | (launched: 2022-12-09_11:43:40.384077) 11:43:43.956246 run osmo-hlr_10.42.42.2(pid=1462): stderr: | 20221209114340583 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114340583 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114340583 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114340583 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114340583 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114340584 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114340597 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114340605 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114340605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114340605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:43:44.009442 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1457): Terminating (SIGTERM) 11:43:44.052122 run iperf3-srv_10.42.42.10(pid=1458): Terminating (SIGTERM) 11:43:44.094937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1461): Terminating (SIGTERM) 11:43:44.137511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1464): Terminating (SIGTERM) 11:43:44.180275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1467): Terminating (SIGTERM) 11:43:44.223422 --- ParallelTerminationStrategy: PID 1457 died... 11:43:44.243612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1457): Terminated: ok {rc=0} 11:43:44.290941 --- ParallelTerminationStrategy: PID 1458 died... 11:43:44.310593 run iperf3-srv_10.42.42.10(pid=1458): Terminated {rc=256} 11:43:44.357506 --- ParallelTerminationStrategy: PID 1461 died... 11:43:44.377257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1461): Terminated: ok {rc=0} 11:43:44.424225 --- ParallelTerminationStrategy: PID 1464 died... 11:43:44.444010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1464): Terminated: ok {rc=0} 11:43:44.491067 --- ParallelTerminationStrategy: PID 1467 died... 11:43:44.510887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1467): Terminated: ok {rc=0} 11:43:44.600522 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 11:43:45.749371 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:45.761233 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:43:45.837379 tst iperf3m4.py: using LAC 21228 11:43:45.972839 tst iperf3m4.py: using RAC 63 11:43:46.102573 tst iperf3m4.py: using CellId 21228 11:43:46.255787 tst iperf3m4.py: using BVCI 21229 11:43:46.408724 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:46.423703 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:46.438510 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:46.453556 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:46.467667 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:46.481694 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:46.497951 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:46.511404 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:43:46.523918 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:43:46.647623 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:43:46.785768 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:43:46.932698 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:43:47.083627 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:43:47.319589 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:43:47.656383 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1469): Launched 11:43:47.946837 run iperf3-srv_10.42.42.10(pid=1470): Launched 11:43:48.072602 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:43:48.297687 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:43:48.630637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1471): Launched 11:43:48.921168 run iperf3-srv_10.42.42.10(pid=1472): Launched 11:43:49.046782 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:43:49.270863 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:43:49.603541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1473): Launched 11:43:49.893122 run iperf3-srv_10.42.42.10(pid=1474): Launched 11:43:50.018147 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:43:50.242935 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:43:50.576113 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1475): Launched 11:43:50.865166 run iperf3-srv_10.42.42.10(pid=1476): Launched 11:43:50.990057 tst iperf3m4.py:8: start network... 11:43:51.213654 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:43:51.729338 run create_hlr_db(pid=1477): Launched 11:43:51.856037 bus /gobi_6: Setting Powered False 11:43:52.921191 run create_hlr_db(pid=1477): Terminated: ok {rc=0} 11:43:53.363826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1479): Launched 11:43:53.674891 run osmo-hlr_10.42.42.2(pid=1480): Launched 11:43:53.792245 run osmo-stp_10.42.42.5: Starting osmo-stp 11:43:54.325695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1482): Launched 11:43:54.636582 run osmo-stp_10.42.42.5(pid=1483): Launched 11:43:54.754300 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:43:55.286605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1485): Launched 11:43:55.405690 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:43:55.667657 run patchelf(pid=1486): Launched 11:43:55.841792 run osmo-stp_10.42.42.5(pid=1483): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1483)] 11:43:55.974247 run osmo-stp_10.42.42.5(pid=1483): stdout: | (launched: 2022-12-09_11:43:54.579282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:56.107655 run osmo-stp_10.42.42.5(pid=1483): stderr: | 20221209114354749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114354749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114354749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114354750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114354750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114354750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114354750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:56.241501 run osmo-stp_10.42.42.5(pid=1483): stdout: | (launched: 2022-12-09_11:43:54.579282) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:43:56.370551 run osmo-stp_10.42.42.5(pid=1483): stderr: | 20221209114354749 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114354749 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114354749 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114354750 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114354750 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114354750 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114354750 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:43:56.522363 run patchelf(pid=1486): Terminating (SIGINT) 11:43:56.699073 run patchelf(pid=1486): Terminated: ok {rc=0} 11:43:56.826995 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1483): Process ended prematurely: osmo-stp_10.42.42.5(pid=1483) [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1483)] [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 11:43:56.836494 tst iperf3m4.py:8: Test FAILED (11.1 sec) 11:43:56.864573 run osmo-hlr_10.42.42.2(pid=1480): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1480)] 11:43:56.913148 run osmo-hlr_10.42.42.2(pid=1480): stdout: | (launched: 2022-12-09_11:43:53.617461) 11:43:56.963021 run osmo-hlr_10.42.42.2(pid=1480): stderr: | 20221209114353791 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114353791 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114353791 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114353791 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114353791 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114353791 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114353808 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114353817 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114353817 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114353817 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:43:57.013349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1469): Terminating (SIGTERM) 11:43:57.054027 run iperf3-srv_10.42.42.10(pid=1470): Terminating (SIGTERM) 11:43:57.094612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1471): Terminating (SIGTERM) 11:43:57.135245 run iperf3-srv_10.42.42.10(pid=1472): Terminating (SIGTERM) 11:43:57.175714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1473): Terminating (SIGTERM) 11:43:57.216338 run iperf3-srv_10.42.42.10(pid=1474): Terminating (SIGTERM) 11:43:57.258657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1475): Terminating (SIGTERM) 11:43:57.300283 run iperf3-srv_10.42.42.10(pid=1476): Terminating (SIGTERM) 11:43:57.341002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1479): Terminating (SIGTERM) 11:43:57.381688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1482): Terminating (SIGTERM) 11:43:57.422319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1485): Terminating (SIGTERM) 11:43:57.463211 --- ParallelTerminationStrategy: PID 1469 died... 11:43:57.482850 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1469): Terminated: ok {rc=0} 11:43:57.528170 --- ParallelTerminationStrategy: PID 1470 died... 11:43:57.547234 run iperf3-srv_10.42.42.10(pid=1470): Terminated {rc=256} 11:43:57.592256 --- ParallelTerminationStrategy: PID 1471 died... 11:43:57.611361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1471): Terminated: ok {rc=0} 11:43:57.657088 --- ParallelTerminationStrategy: PID 1472 died... 11:43:57.675917 run iperf3-srv_10.42.42.10(pid=1472): Terminated {rc=256} 11:43:57.720409 --- ParallelTerminationStrategy: PID 1473 died... 11:43:57.739399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1473): Terminated: ok {rc=0} 11:43:57.783882 --- ParallelTerminationStrategy: PID 1474 died... 11:43:57.802685 run iperf3-srv_10.42.42.10(pid=1474): Terminated {rc=256} 11:43:57.847210 --- ParallelTerminationStrategy: PID 1475 died... 11:43:57.866262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1475): Terminated: ok {rc=0} 11:43:57.910936 --- ParallelTerminationStrategy: PID 1476 died... 11:43:57.929924 run iperf3-srv_10.42.42.10(pid=1476): Terminated {rc=256} 11:43:57.974359 --- ParallelTerminationStrategy: PID 1479 died... 11:43:57.993390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1479): Terminated: ok {rc=0} 11:43:58.037774 --- ParallelTerminationStrategy: PID 1482 died... 11:43:58.056677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1482): Terminated: ok {rc=0} 11:43:58.101423 --- ParallelTerminationStrategy: PID 1485 died... 11:43:58.120396 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1485): Terminated: ok {rc=0} 11:43:58.208670 bus /gobi_4: Setting Powered False 11:43:59.311360 bus /gobi_4: Setting Powered False 11:44:00.430608 bus /gobi_1: Setting Powered False 11:44:01.531796 bus /gobi_1: Setting Powered False 11:44:02.652789 bus /gobi_0: Setting Powered False 11:44:03.752538 bus /gobi_0: Setting Powered False 11:44:04.873795 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 11:44:05.979083 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:44:05.991469 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:44:06.065425 tst ping.py: using LAC 21229 11:44:06.196139 tst ping.py: using RAC 64 11:44:06.325630 tst ping.py: using CellId 21229 11:44:06.451133 tst ping.py: using BVCI 21230 11:44:06.563629 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:44:06.574785 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:44:06.585710 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:44:06.597057 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:44:06.608347 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:44:06.619691 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:44:06.631111 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:44:06.642446 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:44:06.759374 tst ping.py:19: start network... 11:44:06.965810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:44:07.439917 run create_hlr_db(pid=1488): Launched 11:44:07.565122 bus /gobi_6: Setting Powered False 11:44:08.626567 run create_hlr_db(pid=1488): Terminated: ok {rc=0} 11:44:09.077978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1490): Launched 11:44:09.408220 run osmo-hlr_10.42.42.2(pid=1491): Launched 11:44:09.534368 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:10.112793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1493): Launched 11:44:10.442072 run osmo-stp_10.42.42.5(pid=1494): Launched 11:44:10.567457 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:44:11.135850 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1496): Launched 11:44:11.262458 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:44:11.540177 run patchelf(pid=1497): Launched 11:44:11.723627 run osmo-stp_10.42.42.5(pid=1494): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1494)] 11:44:11.863443 run osmo-stp_10.42.42.5(pid=1494): stdout: | (launched: 2022-12-09_11:44:10.381582) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:12.004056 run osmo-stp_10.42.42.5(pid=1494): stderr: | 20221209114410574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114410574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114410575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114410575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114410575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114410575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114410576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:12.144153 run osmo-stp_10.42.42.5(pid=1494): stdout: | (launched: 2022-12-09_11:44:10.381582) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:12.278969 run osmo-stp_10.42.42.5(pid=1494): stderr: | 20221209114410574 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114410574 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114410575 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114410575 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114410575 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114410575 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114410576 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:12.438176 run patchelf(pid=1497): Terminating (SIGINT) 11:44:12.623301 run patchelf(pid=1497): Terminated: ok {rc=0} 11:44:12.757269 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1494): Process ended prematurely: osmo-stp_10.42.42.5(pid=1494) [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1494)] [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 11:44:12.766975 tst ping.py:22: Test FAILED (6.8 sec) 11:44:12.796089 run osmo-hlr_10.42.42.2(pid=1491): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1491)] 11:44:12.847212 run osmo-hlr_10.42.42.2(pid=1491): stdout: | (launched: 2022-12-09_11:44:09.347834) 11:44:12.900033 run osmo-hlr_10.42.42.2(pid=1491): stderr: | 20221209114409547 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114409548 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114409548 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114409548 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114409548 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114409548 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114409560 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114409568 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114409568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114409568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:12.953241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1490): Terminating (SIGTERM) 11:44:12.995950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1493): Terminating (SIGTERM) 11:44:13.038751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1496): Terminating (SIGTERM) 11:44:13.081723 --- ParallelTerminationStrategy: PID 1490 died... 11:44:13.102049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1490): Terminated: ok {rc=0} 11:44:13.149408 --- ParallelTerminationStrategy: PID 1493 died... 11:44:13.169537 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1493): Terminated: ok {rc=0} 11:44:13.216624 --- ParallelTerminationStrategy: PID 1496 died... 11:44:13.236318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1496): Terminated: ok {rc=0} 11:44:13.325706 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 11:44:14.413789 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:44:14.426102 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:44:14.500842 tst ping_idle_ping.py: using LAC 21230 11:44:14.631532 tst ping_idle_ping.py: using RAC 65 11:44:14.761439 tst ping_idle_ping.py: using CellId 21230 11:44:14.882971 tst ping_idle_ping.py: using BVCI 21231 11:44:14.996042 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:44:15.007198 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:44:15.018193 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:44:15.029270 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:44:15.039981 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:44:15.050718 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:44:15.061612 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:44:15.072256 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:44:15.191241 tst ping_idle_ping.py:24: start network... 11:44:15.396655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:44:15.884649 run create_hlr_db(pid=1498): Launched 11:44:16.057933 bus /gobi_6: Setting Powered False 11:44:17.135624 run create_hlr_db(pid=1498): Terminated: ok {rc=0} 11:44:17.572748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1500): Launched 11:44:17.885840 run osmo-hlr_10.42.42.2(pid=1501): Launched 11:44:18.009095 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:18.550735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1503): Launched 11:44:18.857642 run osmo-stp_10.42.42.5(pid=1504): Launched 11:44:18.974767 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:44:19.507670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1506): Launched 11:44:19.626164 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:44:19.885198 run patchelf(pid=1507): Launched 11:44:20.056823 run osmo-stp_10.42.42.5(pid=1504): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1504)] 11:44:20.187403 run osmo-stp_10.42.42.5(pid=1504): stdout: | (launched: 2022-12-09_11:44:18.801469) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:20.319033 run osmo-stp_10.42.42.5(pid=1504): stderr: | 20221209114418971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114418971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114418972 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114418972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114418973 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114418973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114418973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:20.450678 run osmo-stp_10.42.42.5(pid=1504): stdout: | (launched: 2022-12-09_11:44:18.801469) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:20.576639 run osmo-stp_10.42.42.5(pid=1504): stderr: | 20221209114418971 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114418971 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114418972 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114418972 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114418973 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114418973 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114418973 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:20.725611 run patchelf(pid=1507): Terminating (SIGINT) 11:44:20.899864 run patchelf(pid=1507): Terminated: ok {rc=0} 11:44:21.025243 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1504): Process ended prematurely: osmo-stp_10.42.42.5(pid=1504) [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1504)] [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 11:44:21.034235 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 11:44:21.061357 run osmo-hlr_10.42.42.2(pid=1501): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1501)] 11:44:21.109704 run osmo-hlr_10.42.42.2(pid=1501): stdout: | (launched: 2022-12-09_11:44:17.825544) 11:44:21.159831 run osmo-hlr_10.42.42.2(pid=1501): stderr: | 20221209114418007 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114418007 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114418007 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114418007 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114418008 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114418008 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114418020 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114418028 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114418029 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114418029 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:21.210430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1500): Terminating (SIGTERM) 11:44:21.251177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1503): Terminating (SIGTERM) 11:44:21.292008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1506): Terminating (SIGTERM) 11:44:21.332584 --- ParallelTerminationStrategy: PID 1500 died... 11:44:21.351881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1500): Terminated: ok {rc=0} 11:44:21.396867 --- ParallelTerminationStrategy: PID 1503 died... 11:44:21.415683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1503): Terminated: ok {rc=0} 11:44:21.459822 --- ParallelTerminationStrategy: PID 1506 died... 11:44:21.478539 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1506): Terminated: ok {rc=0} 11:44:21.565367 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 11:44:22.873289 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:44:22.879928 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 11:44:22.913243 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 11:44:22.951180 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 11:44:23.037791 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 11:44:23.070898 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 11:44:23.109329 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 11:44:23.708590 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 11:44:23.758625 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:23.770125 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:44:23.822894 tst cs_paging_gprs_active.py: using LAC 21231 11:44:23.945735 tst cs_paging_gprs_active.py: using RAC 66 11:44:24.069395 tst cs_paging_gprs_active.py: using CellId 21231 11:44:24.192617 tst cs_paging_gprs_active.py: using BVCI 21232 11:44:24.308375 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:24.319824 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:24.330928 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:24.342077 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:24.353196 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:24.364267 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:24.375504 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:24.386572 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:24.397910 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:44:24.519934 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:44:24.645257 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:44:24.873127 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:44:25.211143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1512): Launched 11:44:25.505623 run iperf3-srv_10.42.42.10(pid=1513): Launched 11:44:25.634013 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:44:25.862192 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:44:26.202537 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1514): Launched 11:44:26.495888 run iperf3-srv_10.42.42.10(pid=1515): Launched 11:44:26.623106 tst cs_paging_gprs_active.py:38: start network... 11:44:26.849339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:44:27.369828 run create_hlr_db(pid=1516): Launched 11:44:27.499768 bus /gobi_6: Setting Powered False 11:44:28.565776 run create_hlr_db(pid=1516): Terminated: ok {rc=0} 11:44:29.030896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1518): Launched 11:44:29.367688 run osmo-hlr_10.42.42.2(pid=1519): Launched 11:44:29.497924 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:30.071950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1521): Launched 11:44:30.410024 run osmo-stp_10.42.42.5(pid=1522): Launched 11:44:30.538593 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:44:31.208939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1524): Launched 11:44:31.348778 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:44:31.641473 run patchelf(pid=1525): Launched 11:44:31.844674 run osmo-stp_10.42.42.5(pid=1522): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1522)] 11:44:31.990145 run osmo-stp_10.42.42.5(pid=1522): stdout: | (launched: 2022-12-09_11:44:30.348696) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:32.135894 run osmo-stp_10.42.42.5(pid=1522): stderr: | 20221209114430541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114430541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114430542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114430542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114430542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114430543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114430543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:32.270650 run osmo-stp_10.42.42.5(pid=1522): stdout: | (launched: 2022-12-09_11:44:30.348696) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:32.399730 run osmo-stp_10.42.42.5(pid=1522): stderr: | 20221209114430541 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114430541 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114430542 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114430542 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114430542 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114430543 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114430543 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:32.552315 run patchelf(pid=1525): Terminating (SIGINT) 11:44:32.731089 run patchelf(pid=1525): Terminated: ok {rc=0} 11:44:32.859173 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1522): Process ended prematurely: osmo-stp_10.42.42.5(pid=1522) [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1522)] [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 11:44:32.868806 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 11:44:32.896620 run osmo-hlr_10.42.42.2(pid=1519): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1519)] 11:44:32.945385 run osmo-hlr_10.42.42.2(pid=1519): stdout: | (launched: 2022-12-09_11:44:29.306154) 11:44:32.995721 run osmo-hlr_10.42.42.2(pid=1519): stderr: | 20221209114429506 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114429506 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114429506 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114429506 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114429506 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114429506 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114429519 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114429528 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114429528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114429528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:33.046524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1512): Terminating (SIGTERM) 11:44:33.088014 run iperf3-srv_10.42.42.10(pid=1513): Terminating (SIGTERM) 11:44:33.128829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1514): Terminating (SIGTERM) 11:44:33.170146 run iperf3-srv_10.42.42.10(pid=1515): Terminating (SIGTERM) 11:44:33.210677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1518): Terminating (SIGTERM) 11:44:33.251261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1521): Terminating (SIGTERM) 11:44:33.291785 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1524): Terminating (SIGTERM) 11:44:33.332643 --- ParallelTerminationStrategy: PID 1512 died... 11:44:33.352175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1512): Terminated: ok {rc=0} 11:44:33.397418 --- ParallelTerminationStrategy: PID 1513 died... 11:44:33.416086 run iperf3-srv_10.42.42.10(pid=1513): Terminated {rc=256} 11:44:33.460556 --- ParallelTerminationStrategy: PID 1514 died... 11:44:33.479519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1514): Terminated: ok {rc=0} 11:44:33.524053 --- ParallelTerminationStrategy: PID 1515 died... 11:44:33.542951 run iperf3-srv_10.42.42.10(pid=1515): Terminated {rc=256} 11:44:33.587524 --- ParallelTerminationStrategy: PID 1518 died... 11:44:33.606543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1518): Terminated: ok {rc=0} 11:44:33.651162 --- ParallelTerminationStrategy: PID 1521 died... 11:44:33.670114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1521): Terminated: ok {rc=0} 11:44:33.714845 --- ParallelTerminationStrategy: PID 1524 died... 11:44:33.733868 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1524): Terminated: ok {rc=0} 11:44:33.821837 bus /gobi_0: Setting Powered False 11:44:34.924157 bus /gobi_0: Setting Powered False 11:44:36.041716 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 11:44:37.197612 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:37.210437 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:44:37.267663 tst iperf3.py: using LAC 21232 11:44:37.400815 tst iperf3.py: using RAC 67 11:44:37.533683 tst iperf3.py: using CellId 21232 11:44:37.667136 tst iperf3.py: using BVCI 21233 11:44:37.791082 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:37.803001 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:37.814802 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:37.826722 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:37.838675 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:37.850567 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:37.862928 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:37.875508 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:37.887643 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:44:38.009616 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:44:38.221076 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:44:38.535321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1526): Launched 11:44:38.810911 run iperf3-srv_10.42.42.10(pid=1527): Launched 11:44:38.929761 tst iperf3.py:8: start network... 11:44:39.140214 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:44:39.626752 run create_hlr_db(pid=1528): Launched 11:44:39.755343 bus /gobi_6: Setting Powered False 11:44:40.817825 run create_hlr_db(pid=1528): Terminated: ok {rc=0} 11:44:41.276340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1530): Launched 11:44:41.612601 run osmo-hlr_10.42.42.2(pid=1531): Launched 11:44:41.734614 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:42.292312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1533): Launched 11:44:42.607865 run osmo-stp_10.42.42.5(pid=1534): Launched 11:44:42.728176 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:44:43.266127 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1536): Launched 11:44:43.386854 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:44:43.651135 run patchelf(pid=1537): Launched 11:44:43.826799 run osmo-stp_10.42.42.5(pid=1534): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1534)] 11:44:43.959404 run osmo-stp_10.42.42.5(pid=1534): stdout: | (launched: 2022-12-09_11:44:42.549170) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:44.093792 run osmo-stp_10.42.42.5(pid=1534): stderr: | 20221209114442723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114442723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114442724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114442724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114442724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114442725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114442725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:44.227768 run osmo-stp_10.42.42.5(pid=1534): stdout: | (launched: 2022-12-09_11:44:42.549170) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:44.356278 run osmo-stp_10.42.42.5(pid=1534): stderr: | 20221209114442723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114442723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114442724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114442724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114442724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114442725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114442725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:44.508788 run patchelf(pid=1537): Terminating (SIGINT) 11:44:44.686454 run patchelf(pid=1537): Terminated: ok {rc=0} 11:44:44.814155 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1534): Process ended prematurely: osmo-stp_10.42.42.5(pid=1534) [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1534)] [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 11:44:44.823707 tst iperf3.py:8: Test FAILED (7.7 sec) 11:44:44.851437 run osmo-hlr_10.42.42.2(pid=1531): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1531)] 11:44:44.899532 run osmo-hlr_10.42.42.2(pid=1531): stdout: | (launched: 2022-12-09_11:44:41.551156) 11:44:44.949390 run osmo-hlr_10.42.42.2(pid=1531): stderr: | 20221209114441732 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114441732 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114441732 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114441732 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114441732 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114441732 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114441744 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114441752 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114441752 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114441752 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:44.999637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1526): Terminating (SIGTERM) 11:44:45.039758 run iperf3-srv_10.42.42.10(pid=1527): Terminating (SIGTERM) 11:44:45.079669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1530): Terminating (SIGTERM) 11:44:45.119830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1533): Terminating (SIGTERM) 11:44:45.159892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1536): Terminating (SIGTERM) 11:44:45.200171 --- ParallelTerminationStrategy: PID 1526 died... 11:44:45.219606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1526): Terminated: ok {rc=0} 11:44:45.264207 --- ParallelTerminationStrategy: PID 1527 died... 11:44:45.283226 run iperf3-srv_10.42.42.10(pid=1527): Terminated {rc=256} 11:44:45.327718 --- ParallelTerminationStrategy: PID 1530 died... 11:44:45.346702 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1530): Terminated: ok {rc=0} 11:44:45.391164 --- ParallelTerminationStrategy: PID 1533 died... 11:44:45.410082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1533): Terminated: ok {rc=0} 11:44:45.454593 --- ParallelTerminationStrategy: PID 1536 died... 11:44:45.473494 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1536): Terminated: ok {rc=0} 11:44:45.560719 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 11:44:46.710741 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:46.723671 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:44:46.779868 tst iperf3m4.py: using LAC 21233 11:44:46.945308 tst iperf3m4.py: using RAC 68 11:44:47.131632 tst iperf3m4.py: using CellId 21233 11:44:47.257441 tst iperf3m4.py: using BVCI 21234 11:44:47.373204 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:47.384649 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:47.395900 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:47.407752 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:47.418942 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:47.430220 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:47.441549 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:47.452644 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:44:47.465187 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:44:47.588027 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:44:47.709338 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:44:47.831980 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:44:47.954346 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:44:48.164916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:44:48.482155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1538): Launched 11:44:48.758419 run iperf3-srv_10.42.42.10(pid=1539): Launched 11:44:48.876718 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:44:49.086328 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:44:49.401779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1540): Launched 11:44:49.675974 run iperf3-srv_10.42.42.10(pid=1541): Launched 11:44:49.794340 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:44:50.004080 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:44:50.319733 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1542): Launched 11:44:50.594529 run iperf3-srv_10.42.42.10(pid=1543): Launched 11:44:50.713314 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:44:50.922773 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:44:51.238226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1544): Launched 11:44:51.513318 run iperf3-srv_10.42.42.10(pid=1545): Launched 11:44:51.631034 tst iperf3m4.py:8: start network... 11:44:51.840284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:44:52.326477 run create_hlr_db(pid=1546): Launched 11:44:52.453956 bus /gobi_6: Setting Powered False 11:44:53.514893 run create_hlr_db(pid=1546): Terminated: ok {rc=0} 11:44:53.951183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1548): Launched 11:44:54.265372 run osmo-hlr_10.42.42.2(pid=1549): Launched 11:44:54.384410 run osmo-stp_10.42.42.5: Starting osmo-stp 11:44:54.941289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1551): Launched 11:44:55.254878 run osmo-stp_10.42.42.5(pid=1552): Launched 11:44:55.373972 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:44:55.911319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1554): Launched 11:44:56.030957 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:44:56.294576 run patchelf(pid=1555): Launched 11:44:56.468569 run osmo-stp_10.42.42.5(pid=1552): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1552)] 11:44:56.600063 run osmo-stp_10.42.42.5(pid=1552): stdout: | (launched: 2022-12-09_11:44:55.196779) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:56.732730 run osmo-stp_10.42.42.5(pid=1552): stderr: | 20221209114455365 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114455365 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114455365 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114455366 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114455366 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114455366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114455366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:56.866577 run osmo-stp_10.42.42.5(pid=1552): stdout: | (launched: 2022-12-09_11:44:55.196779) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:44:56.993722 run osmo-stp_10.42.42.5(pid=1552): stderr: | 20221209114455365 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114455365 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114455365 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114455366 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114455366 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114455366 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114455366 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:44:57.144782 run patchelf(pid=1555): Terminating (SIGINT) 11:44:57.320894 run patchelf(pid=1555): Terminated: ok {rc=0} 11:44:57.448650 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1552): Process ended prematurely: osmo-stp_10.42.42.5(pid=1552) [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1552)] [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 11:44:57.458412 tst iperf3m4.py:8: Test FAILED (10.8 sec) 11:44:57.486048 run osmo-hlr_10.42.42.2(pid=1549): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1549)] 11:44:57.534056 run osmo-hlr_10.42.42.2(pid=1549): stdout: | (launched: 2022-12-09_11:44:54.206541) 11:44:57.583655 run osmo-hlr_10.42.42.2(pid=1549): stderr: | 20221209114454383 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114454383 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114454383 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114454383 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114454383 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114454384 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114454396 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114454406 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114454406 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114454406 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:44:57.633643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1538): Terminating (SIGTERM) 11:44:57.673760 run iperf3-srv_10.42.42.10(pid=1539): Terminating (SIGTERM) 11:44:57.713726 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1540): Terminating (SIGTERM) 11:44:57.753743 run iperf3-srv_10.42.42.10(pid=1541): Terminating (SIGTERM) 11:44:57.793604 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1542): Terminating (SIGTERM) 11:44:57.833529 run iperf3-srv_10.42.42.10(pid=1543): Terminating (SIGTERM) 11:44:57.873474 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1544): Terminating (SIGTERM) 11:44:57.913537 run iperf3-srv_10.42.42.10(pid=1545): Terminating (SIGTERM) 11:44:57.953375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1548): Terminating (SIGTERM) 11:44:57.993388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1551): Terminating (SIGTERM) 11:44:58.033326 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1554): Terminating (SIGTERM) 11:44:58.073540 --- ParallelTerminationStrategy: PID 1538 died... 11:44:58.092812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1538): Terminated: ok {rc=0} 11:44:58.137254 --- ParallelTerminationStrategy: PID 1539 died... 11:44:58.156076 run iperf3-srv_10.42.42.10(pid=1539): Terminated {rc=256} 11:44:58.200248 --- ParallelTerminationStrategy: PID 1540 died... 11:44:58.219003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1540): Terminated: ok {rc=0} 11:44:58.263356 --- ParallelTerminationStrategy: PID 1541 died... 11:44:58.282188 run iperf3-srv_10.42.42.10(pid=1541): Terminated {rc=256} 11:44:58.326353 --- ParallelTerminationStrategy: PID 1542 died... 11:44:58.345050 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1542): Terminated: ok {rc=0} 11:44:58.389703 --- ParallelTerminationStrategy: PID 1543 died... 11:44:58.408437 run iperf3-srv_10.42.42.10(pid=1543): Terminated {rc=256} 11:44:58.452941 --- ParallelTerminationStrategy: PID 1544 died... 11:44:58.471824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1544): Terminated: ok {rc=0} 11:44:58.515947 --- ParallelTerminationStrategy: PID 1545 died... 11:44:58.534639 run iperf3-srv_10.42.42.10(pid=1545): Terminated {rc=256} 11:44:58.578510 --- ParallelTerminationStrategy: PID 1548 died... 11:44:58.597290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1548): Terminated: ok {rc=0} 11:44:58.641471 --- ParallelTerminationStrategy: PID 1551 died... 11:44:58.659984 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1551): Terminated: ok {rc=0} 11:44:58.704495 --- ParallelTerminationStrategy: PID 1554 died... 11:44:58.723316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1554): Terminated: ok {rc=0} 11:44:58.810995 bus /gobi_4: Setting Powered False 11:44:59.912035 bus /gobi_4: Setting Powered False 11:45:01.036690 bus /gobi_1: Setting Powered False 11:45:02.155643 bus /gobi_1: Setting Powered False 11:45:03.287753 bus /gobi_0: Setting Powered False 11:45:04.386954 bus /gobi_0: Setting Powered False 11:45:05.504738 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 11:45:06.609530 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:45:06.622369 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:45:06.681196 tst ping.py: using LAC 21234 11:45:06.808289 tst ping.py: using RAC 69 11:45:06.935695 tst ping.py: using CellId 21234 11:45:07.062761 tst ping.py: using BVCI 21235 11:45:07.182212 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:45:07.194500 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:45:07.206413 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:45:07.218474 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:45:07.230519 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:45:07.242403 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:45:07.254712 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:45:07.266552 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:45:07.388270 tst ping.py:19: start network... 11:45:07.611211 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:08.120456 run create_hlr_db(pid=1560): Launched 11:45:08.246141 bus /gobi_6: Setting Powered False 11:45:09.310123 run create_hlr_db(pid=1560): Terminated: ok {rc=0} 11:45:09.751433 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1562): Launched 11:45:10.060274 run osmo-hlr_10.42.42.2(pid=1563): Launched 11:45:10.177694 run osmo-stp_10.42.42.5: Starting osmo-stp 11:45:10.710028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1565): Launched 11:45:11.017390 run osmo-stp_10.42.42.5(pid=1566): Launched 11:45:11.135127 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:45:11.666714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1568): Launched 11:45:11.784704 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:45:12.046809 run patchelf(pid=1569): Launched 11:45:12.218508 run osmo-stp_10.42.42.5(pid=1566): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1566)] 11:45:12.349227 run osmo-stp_10.42.42.5(pid=1566): stdout: | (launched: 2022-12-09_11:45:10.960470) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:12.480732 run osmo-stp_10.42.42.5(pid=1566): stderr: | 20221209114511131 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114511132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114511132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114511132 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114511133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114511133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114511133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:12.612012 run osmo-stp_10.42.42.5(pid=1566): stdout: | (launched: 2022-12-09_11:45:10.960470) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:12.737629 run osmo-stp_10.42.42.5(pid=1566): stderr: | 20221209114511131 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114511132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114511132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114511132 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114511133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114511133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114511133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:12.886911 run patchelf(pid=1569): Terminating (SIGINT) 11:45:13.061384 run patchelf(pid=1569): Terminated: ok {rc=0} 11:45:13.186873 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1566): Process ended prematurely: osmo-stp_10.42.42.5(pid=1566) [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1566)] [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 11:45:13.195905 tst ping.py:22: Test FAILED (6.6 sec) 11:45:13.223166 run osmo-hlr_10.42.42.2(pid=1563): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1563)] 11:45:13.271124 run osmo-hlr_10.42.42.2(pid=1563): stdout: | (launched: 2022-12-09_11:45:10.002990) 11:45:13.321536 run osmo-hlr_10.42.42.2(pid=1563): stderr: | 20221209114510178 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114510178 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114510178 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114510179 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114510179 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114510179 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114510191 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114510199 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114510200 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114510200 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:45:13.371799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1562): Terminating (SIGTERM) 11:45:13.411979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1565): Terminating (SIGTERM) 11:45:13.452314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1568): Terminating (SIGTERM) 11:45:13.492815 --- ParallelTerminationStrategy: PID 1562 died... 11:45:13.512312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1562): Terminated: ok {rc=0} 11:45:13.556740 --- ParallelTerminationStrategy: PID 1565 died... 11:45:13.575715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1565): Terminated: ok {rc=0} 11:45:13.620508 --- ParallelTerminationStrategy: PID 1568 died... 11:45:13.639325 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1568): Terminated: ok {rc=0} 11:45:13.724399 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 11:45:14.812006 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:45:14.825508 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:45:14.882307 tst ping_idle_ping.py: using LAC 21235 11:45:15.013367 tst ping_idle_ping.py: using RAC 70 11:45:15.143845 tst ping_idle_ping.py: using CellId 21235 11:45:15.275614 tst ping_idle_ping.py: using BVCI 21236 11:45:15.398184 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:45:15.410317 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:45:15.422304 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:45:15.434584 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:45:15.446742 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:45:15.458994 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:45:15.471450 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 11:45:15.484216 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 11:45:15.607938 tst ping_idle_ping.py:24: start network... 11:45:15.833863 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:16.367604 run create_hlr_db(pid=1570): Launched 11:45:16.553262 bus /gobi_6: Setting Powered False 11:45:17.618792 run create_hlr_db(pid=1570): Terminated: ok {rc=0} 11:45:18.080075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1572): Launched 11:45:18.390933 run osmo-hlr_10.42.42.2(pid=1573): Launched 11:45:18.508104 run osmo-stp_10.42.42.5: Starting osmo-stp 11:45:19.057147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1575): Launched 11:45:19.367108 run osmo-stp_10.42.42.5(pid=1576): Launched 11:45:19.484902 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:45:20.016039 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1578): Launched 11:45:20.134185 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:45:20.394553 run patchelf(pid=1579): Launched 11:45:20.566062 run osmo-stp_10.42.42.5(pid=1576): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1576)] 11:45:20.696866 run osmo-stp_10.42.42.5(pid=1576): stdout: | (launched: 2022-12-09_11:45:19.310187) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:20.828622 run osmo-stp_10.42.42.5(pid=1576): stderr: | 20221209114519482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114519482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114519482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114519482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114519483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114519483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114519483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:20.960693 run osmo-stp_10.42.42.5(pid=1576): stdout: | (launched: 2022-12-09_11:45:19.310187) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:21.086699 run osmo-stp_10.42.42.5(pid=1576): stderr: | 20221209114519482 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114519482 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114519482 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114519482 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114519483 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114519483 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114519483 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:21.235527 run patchelf(pid=1579): Terminating (SIGINT) 11:45:21.409937 run patchelf(pid=1579): Terminated: ok {rc=0} 11:45:21.535142 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1576): Process ended prematurely: osmo-stp_10.42.42.5(pid=1576) [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1576)] [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 11:45:21.544208 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 11:45:21.571472 run osmo-hlr_10.42.42.2(pid=1573): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1573)] 11:45:21.620041 run osmo-hlr_10.42.42.2(pid=1573): stdout: | (launched: 2022-12-09_11:45:18.332467) 11:45:21.669800 run osmo-hlr_10.42.42.2(pid=1573): stderr: | 20221209114518510 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114518510 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114518510 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114518511 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114518511 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114518511 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114518523 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114518532 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114518532 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114518532 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:45:21.720009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1572): Terminating (SIGTERM) 11:45:21.760131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1575): Terminating (SIGTERM) 11:45:21.800380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1578): Terminating (SIGTERM) 11:45:21.841041 --- ParallelTerminationStrategy: PID 1572 died... 11:45:21.860346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1572): Terminated: ok {rc=0} 11:45:21.904819 --- ParallelTerminationStrategy: PID 1575 died... 11:45:21.924109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1575): Terminated: ok {rc=0} 11:45:21.968378 --- ParallelTerminationStrategy: PID 1578 died... 11:45:21.987296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1578): Terminated: ok {rc=0} 11:45:22.075278 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:45:23.389559 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:45:23.397666 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:45:23.433499 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 11:45:23.469436 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:45:23.524653 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:45:23.559709 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 11:45:23.595865 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:45:24.153878 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2359 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 11:45:24.159801 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:45:24.171345 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:45:24.244418 tst switch_tch_pdch.py: using LAC 21236 11:45:24.366814 tst switch_tch_pdch.py: using RAC 71 11:45:24.486961 tst switch_tch_pdch.py: using CellId 21236 11:45:24.606782 tst switch_tch_pdch.py: using BVCI 21237 11:45:24.719112 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:45:24.730505 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:45:24.741734 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:45:24.752754 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:45:24.763813 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:45:24.774856 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:45:24.786124 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:45:24.797281 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:45:24.919707 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:45:25.044461 tst switch_tch_pdch.py:51: start network... 11:45:25.266969 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:25.776045 run create_hlr_db(pid=1583): Launched 11:45:25.902020 bus /gobi_6: Setting Powered False 11:45:26.967019 run create_hlr_db(pid=1583): Terminated: ok {rc=0} 11:45:27.428266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1585): Launched 11:45:27.758746 run osmo-hlr_10.42.42.2(pid=1586): Launched 11:45:27.884134 run osmo-stp_10.42.42.5: Starting osmo-stp 11:45:28.452156 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1588): Launched 11:45:28.781640 run osmo-stp_10.42.42.5(pid=1589): Launched 11:45:28.907577 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:45:29.477493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1591): Launched 11:45:29.604254 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:45:29.883353 run patchelf(pid=1592): Launched 11:45:30.066952 run osmo-stp_10.42.42.5(pid=1589): ERR: Terminated: ERROR {rc=1} [trial-2359↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1589)] 11:45:30.207353 run osmo-stp_10.42.42.5(pid=1589): stdout: | (launched: 2022-12-09_11:45:28.721423) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:30.348435 run osmo-stp_10.42.42.5(pid=1589): stderr: | 20221209114528915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114528915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114528915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114528916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114528916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114528916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114528916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:30.489184 run osmo-stp_10.42.42.5(pid=1589): stdout: | (launched: 2022-12-09_11:45:28.721423) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:30.624070 run osmo-stp_10.42.42.5(pid=1589): stderr: | 20221209114528915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114528915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114528915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114528916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114528916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114528916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114528916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:30.783752 run patchelf(pid=1592): Terminating (SIGINT) 11:45:30.989140 run patchelf(pid=1592): Terminated: ok {rc=0} 11:45:31.126322 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1589): Process ended prematurely: osmo-stp_10.42.42.5(pid=1589) [trial-2359↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1589)] [trial-2359↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 11:45:31.137112 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 11:45:31.169353 run osmo-hlr_10.42.42.2(pid=1586): ERR: Terminated: ERROR {rc=237} [trial-2359↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1586)] 11:45:31.223285 run osmo-hlr_10.42.42.2(pid=1586): stdout: | (launched: 2022-12-09_11:45:27.698124) 11:45:31.278959 run osmo-hlr_10.42.42.2(pid=1586): stderr: | 20221209114527897 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114527897 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114527897 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114527897 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114527897 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114527897 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114527913 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114527923 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114527923 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114527923 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:45:31.335093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1585): Terminating (SIGTERM) 11:45:31.380507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1588): Terminating (SIGTERM) 11:45:31.425879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1591): Terminating (SIGTERM) 11:45:31.471292 --- ParallelTerminationStrategy: PID 1585 died... 11:45:31.492441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1585): Terminated: ok {rc=0} 11:45:31.542916 --- ParallelTerminationStrategy: PID 1588 died... 11:45:31.563663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1588): Terminated: ok {rc=0} 11:45:31.614241 --- ParallelTerminationStrategy: PID 1591 died... 11:45:31.635234 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1591): Terminated: ok {rc=0} 11:45:31.733847 bus /gobi_0: Setting Powered False 11:45:32.851204 bus /gobi_0: Setting Powered False 11:45:33.969321 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 11:45:35.225164 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:45:35.231535 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 11:45:35.266806 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 11:45:35.302668 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 11:45:35.357412 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 11:45:35.391855 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 11:45:35.427460 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 11:45:35.983965 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2359 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 11:45:35.989660 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:45:36.001122 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 11:45:36.075229 tst switch_tch_pdch.py: using LAC 21237 11:45:36.201788 tst switch_tch_pdch.py: using RAC 72 11:45:36.328884 tst switch_tch_pdch.py: using CellId 21237 11:45:36.455285 tst switch_tch_pdch.py: using BVCI 21238 11:45:36.576275 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:45:36.587841 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:45:36.599187 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:45:36.610777 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:45:36.622481 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:45:36.634081 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:45:36.645746 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:45:36.657252 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:45:36.780212 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:45:36.904253 tst switch_tch_pdch.py:51: start network... 11:45:37.127082 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:37.607309 run create_hlr_db(pid=1596): Launched 11:45:37.732205 bus /gobi_6: Setting Powered False 11:45:38.797231 run create_hlr_db(pid=1596): Terminated: ok {rc=0} 11:45:39.227662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1598): Launched 11:45:39.556770 run osmo-hlr_10.42.42.2(pid=1599): Launched 11:45:39.683294 run osmo-stp_10.42.42.5: Starting osmo-stp 11:45:40.225686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1601): Launched 11:45:40.556070 run osmo-stp_10.42.42.5(pid=1602): Launched 11:45:40.684040 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:45:41.220919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1604): Launched 11:45:41.346959 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:45:41.623019 run patchelf(pid=1605): Launched 11:45:41.805333 run osmo-stp_10.42.42.5(pid=1602): ERR: Terminated: ERROR {rc=1} [trial-2359↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1602)] 11:45:41.943735 run osmo-stp_10.42.42.5(pid=1602): stdout: | (launched: 2022-12-09_11:45:40.495476) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:42.083686 run osmo-stp_10.42.42.5(pid=1602): stderr: | 20221209114540689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114540689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114540689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114540689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114540690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114540690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114540690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:42.224078 run osmo-stp_10.42.42.5(pid=1602): stdout: | (launched: 2022-12-09_11:45:40.495476) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:45:42.358092 run osmo-stp_10.42.42.5(pid=1602): stderr: | 20221209114540689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114540689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114540689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114540689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114540690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114540690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114540690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:45:42.516523 run patchelf(pid=1605): Terminating (SIGINT) 11:45:42.701107 run patchelf(pid=1605): Terminated: ok {rc=0} 11:45:42.833862 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=1602): Process ended prematurely: osmo-stp_10.42.42.5(pid=1602) [trial-2359↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1602)] [trial-2359↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 11:45:42.843566 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 11:45:42.872482 run osmo-hlr_10.42.42.2(pid=1599): ERR: Terminated: ERROR {rc=237} [trial-2359↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1599)] 11:45:42.923175 run osmo-hlr_10.42.42.2(pid=1599): stdout: | (launched: 2022-12-09_11:45:39.496205) 11:45:42.975742 run osmo-hlr_10.42.42.2(pid=1599): stderr: | 20221209114539698 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114539698 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114539698 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114539698 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114539698 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114539698 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114539711 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114539721 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114539721 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114539721 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:45:43.028789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1598): Terminating (SIGTERM) 11:45:43.071266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1601): Terminating (SIGTERM) 11:45:43.114040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1604): Terminating (SIGTERM) 11:45:43.156817 --- ParallelTerminationStrategy: PID 1598 died... 11:45:43.177141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1598): Terminated: ok {rc=0} 11:45:43.224656 --- ParallelTerminationStrategy: PID 1601 died... 11:45:43.244443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1601): Terminated: ok {rc=0} 11:45:43.291597 --- ParallelTerminationStrategy: PID 1604 died... 11:45:43.311255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1604): Terminated: ok {rc=0} 11:45:43.400510 bus /gobi_0: Setting Powered False 11:45:44.498687 bus /gobi_0: Setting Powered False 11:45:45.617659 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 11:45:46.905487 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:45:46.912871 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 11:45:46.969891 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 11:45:46.981214 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:45:47.043657 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 11:45:47.088889 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 11:45:47.098246 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:45:47.625084 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 11:45:47.631181 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 11:45:47.643183 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:45:47.696775 tst mo_mt_sms.py: using LAC 21238 11:45:47.815775 tst mo_mt_sms.py: using RAC 73 11:45:47.941810 tst mo_mt_sms.py: using CellId 21238 11:45:48.061842 tst mo_mt_sms.py: using BVCI 21239 11:45:48.172342 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:45:48.290874 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:45:48.407425 tst mo_mt_sms.py:9: start nitb and bts... 11:45:48.614552 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:45:49.239365 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1609): Launched 11:45:49.546522 run osmo-nitb_10.42.42.2(pid=1610): Launched 11:45:49.717269 run osmo-nitb_10.42.42.2(pid=1610): ERR: Terminated: ERROR {rc=2} [trial-2359↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1610)] 11:45:49.854718 run osmo-nitb_10.42.42.2(pid=1610): stdout: | (launched: 2022-12-09_11:45:49.489983) 11:45:49.994838 run osmo-nitb_10.42.42.2(pid=1610): stderr: | (launched: 2022-12-09_11:45:49.535171) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:45:50.134172 run osmo-nitb_10.42.42.2(pid=1610): stdout: | (launched: 2022-12-09_11:45:49.489983) 11:45:50.267131 run osmo-nitb_10.42.42.2(pid=1610): stderr: | (launched: 2022-12-09_11:45:49.535171) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1610): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1610) [trial-2359↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1610)] 11:45:50.663179 tst osmo-nitb_10.42.42.2(pid=1610): stdout: | (launched: 2022-12-09_11:45:49.489983) 11:45:50.786879 tst osmo-nitb_10.42.42.2(pid=1610): stderr: | (launched: 2022-12-09_11:45:49.535171) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:45:50.932193 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=1610): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1610) [trial-2359↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1610)] [trial-2359↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 11:45:50.940627 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 11:45:50.947209 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1609): Terminating (SIGTERM) 11:45:51.155938 --- ParallelTerminationStrategy: PID 1609 died... 11:45:51.176570 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1609): Terminated: ok {rc=0} 11:45:51.262075 bus /sierra_3: Setting Powered False 11:45:52.359377 bus /sierra_3: Setting Powered False 11:45:53.477776 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 sms:trx-sysmocell5000 --------------------------------------------------------------------- 11:45:54.685553 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:45:54.690081 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 11:45:54.726122 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:45:54.754071 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 11:45:54.809525 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 11:45:54.845485 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:45:54.873065 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 11:45:55.420470 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 11:45:55.426083 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:45:55.437363 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:45:55.488032 tst mo_mt_sms.py: using LAC 21239 11:45:55.618014 tst mo_mt_sms.py: using RAC 74 11:45:55.747716 tst mo_mt_sms.py: using CellId 21239 11:45:55.876084 tst mo_mt_sms.py: using BVCI 21240 11:45:55.994801 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:45:56.006206 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:45:56.017606 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:45:56.028834 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:45:56.040370 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:45:56.051830 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:45:56.169435 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 11:45:56.290999 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:45:56.766235 run create_hlr_db(pid=1614): Launched 11:45:56.892368 bus /sierra_2: Setting Powered False 11:45:57.953656 run create_hlr_db(pid=1614): Terminated: ok {rc=0} 11:45:58.404873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1616): Launched 11:45:58.734276 run osmo-hlr_10.42.42.2(pid=1617): Launched 11:45:58.859355 run osmo-stp_10.42.42.5: Starting osmo-stp 11:45:59.429821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1619): Launched 11:45:59.758329 run osmo-stp_10.42.42.5(pid=1620): Launched 11:45:59.884037 run osmo-msc_10.42.42.6: Starting osmo-msc 11:46:00.478520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1622): Launched 11:46:00.807252 run osmo-msc_10.42.42.6(pid=1623): Launched 11:46:01.268750 run osmo-stp_10.42.42.5(pid=1620): ERR: Terminated: ERROR {rc=1} [trial-2359↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1620)] 11:46:01.533739 run osmo-stp_10.42.42.5(pid=1620): stdout: | (launched: 2022-12-09_11:45:59.697916) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:01.684673 run osmo-stp_10.42.42.5(pid=1620): stderr: | 20221209114559891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114559891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114559891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114559892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114559892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114559892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114559892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:01.815616 run osmo-stp_10.42.42.5(pid=1620): stdout: | (launched: 2022-12-09_11:45:59.697916) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:01.939835 run osmo-stp_10.42.42.5(pid=1620): stderr: | 20221209114559891 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114559891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114559891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114559892 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114559892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114559892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114559892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:02.089821 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=1620): Process ended prematurely: osmo-stp_10.42.42.5(pid=1620) [trial-2359↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1620)] [trial-2359↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 11:46:02.098640 tst mo_mt_sms.py:16: Test FAILED (6.7 sec) 11:46:02.126217 run osmo-hlr_10.42.42.2(pid=1617): ERR: Terminated: ERROR {rc=237} [trial-2359↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1617)] 11:46:02.176369 run osmo-hlr_10.42.42.2(pid=1617): stdout: | (launched: 2022-12-09_11:45:58.674004) 11:46:02.228762 run osmo-hlr_10.42.42.2(pid=1617): stderr: | 20221209114558872 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114558872 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114558872 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114558872 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114558872 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114558873 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114558885 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114558893 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114558894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114558894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:02.299643 run osmo-msc_10.42.42.6(pid=1623): ERR: Terminated: ERROR {rc=2} [trial-2359↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1623)] 11:46:02.349215 run osmo-msc_10.42.42.6(pid=1623): stdout: | (launched: 2022-12-09_11:46:00.746935) 11:46:02.400894 run osmo-msc_10.42.42.6(pid=1623): stderr: | 20221209114601148 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209114601150 DLGLOBAL DEBUG validating counter group 0x7fd7c7681c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209114601150 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209114601150 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209114601150 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209114601150 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209114601152 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209114601152 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209114601152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209114601152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:46:02.452829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1616): Terminating (SIGTERM) 11:46:02.493259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1619): Terminating (SIGTERM) 11:46:02.533525 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1622): Terminating (SIGTERM) 11:46:02.573888 --- ParallelTerminationStrategy: PID 1616 died... 11:46:02.593267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1616): Terminated: ok {rc=0} 11:46:02.637873 --- ParallelTerminationStrategy: PID 1619 died... 11:46:02.656651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1619): Terminated: ok {rc=0} 11:46:02.701545 --- ParallelTerminationStrategy: PID 1622 died... 11:46:02.720495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1622): Terminated: ok {rc=0} 11:46:02.808285 bus /sierra_3: Setting Powered False 11:46:03.910278 bus /sierra_3: Setting Powered False 11:46:05.025618 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 11:46:06.262774 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:46:06.267137 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 11:46:06.303333 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 11:46:06.310615 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 11:46:06.347845 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 11:46:06.383558 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 11:46:06.390891 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 11:46:06.908434 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2359 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 11:46:06.913378 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 11:46:06.924273 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:46:06.972864 tst assert_extension.py: using LAC 21240 11:46:07.092739 tst assert_extension.py: using RAC 75 11:46:07.212551 tst assert_extension.py: using CellId 21240 11:46:07.334106 tst assert_extension.py: using BVCI 21241 11:46:07.446439 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 11:46:07.564067 tst assert_extension.py:10: start nitb and bts... 11:46:07.768165 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:46:08.394375 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1628): Launched 11:46:08.700862 run osmo-nitb_10.42.42.2(pid=1629): Launched 11:46:08.871291 run osmo-nitb_10.42.42.2(pid=1629): ERR: Terminated: ERROR {rc=2} [trial-2359↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1629)] 11:46:09.008466 run osmo-nitb_10.42.42.2(pid=1629): stdout: | (launched: 2022-12-09_11:46:08.643868) 11:46:09.147813 run osmo-nitb_10.42.42.2(pid=1629): stderr: | (launched: 2022-12-09_11:46:08.689151) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:46:09.286489 run osmo-nitb_10.42.42.2(pid=1629): stdout: | (launched: 2022-12-09_11:46:08.643868) 11:46:09.419899 run osmo-nitb_10.42.42.2(pid=1629): stderr: | (launched: 2022-12-09_11:46:08.689151) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=1629): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1629) [trial-2359↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1629)] 11:46:09.817065 tst osmo-nitb_10.42.42.2(pid=1629): stdout: | (launched: 2022-12-09_11:46:08.643868) 11:46:09.941409 tst osmo-nitb_10.42.42.2(pid=1629): stderr: | (launched: 2022-12-09_11:46:08.689151) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:46:10.087686 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=1629): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1629) [trial-2359↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1629)] [trial-2359↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 11:46:10.096205 tst assert_extension.py:12: Test FAILED (3.2 sec) 11:46:10.102878 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1628): Terminating (SIGTERM) 11:46:10.312019 --- ParallelTerminationStrategy: PID 1628 died... 11:46:10.332778 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=1628): Terminated: ok {rc=0} 11:46:10.420177 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 11:46:11.609376 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:46:11.613902 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 11:46:11.650157 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:46:11.678251 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 11:46:11.714075 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 11:46:11.747603 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:46:11.774152 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 11:46:12.312028 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2359 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 11:46:12.317701 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:46:12.329233 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:46:12.379862 tst assert_extension.py: using LAC 21241 11:46:12.508434 tst assert_extension.py: using RAC 76 11:46:12.634894 tst assert_extension.py: using CellId 21241 11:46:12.762903 tst assert_extension.py: using BVCI 21242 11:46:12.883127 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:46:12.894522 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:46:12.905670 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:46:12.917779 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:46:12.929151 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:46:12.940519 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 11:46:13.057557 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:46:13.531371 run create_hlr_db(pid=1633): Launched 11:46:13.656607 bus /sierra_2: Setting Powered False 11:46:14.717649 run create_hlr_db(pid=1633): Terminated: ok {rc=0} 11:46:15.167652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1635): Launched 11:46:15.497708 run osmo-hlr_10.42.42.2(pid=1636): Launched 11:46:15.623462 run osmo-stp_10.42.42.5: Starting osmo-stp 11:46:16.327010 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1638): Launched 11:46:16.665761 run osmo-stp_10.42.42.5(pid=1639): Launched 11:46:16.928694 run osmo-msc_10.42.42.6: Starting osmo-msc 11:46:17.597799 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1641): Launched 11:46:17.899799 run osmo-msc_10.42.42.6(pid=1642): Launched 11:46:18.067416 run osmo-stp_10.42.42.5(pid=1639): ERR: Terminated: ERROR {rc=1} [trial-2359↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1639)] 11:46:18.194267 run osmo-stp_10.42.42.5(pid=1639): stdout: | (launched: 2022-12-09_11:46:16.603020) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:18.321975 run osmo-stp_10.42.42.5(pid=1639): stderr: | 20221209114616899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114616899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114616899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114616900 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114616900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114616900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114616900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:18.447327 run osmo-stp_10.42.42.5(pid=1639): stdout: | (launched: 2022-12-09_11:46:16.603020) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:18.566597 run osmo-stp_10.42.42.5(pid=1639): stderr: | 20221209114616899 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114616899 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114616899 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114616900 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114616900 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114616900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114616900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:18.709838 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=1639): Process ended prematurely: osmo-stp_10.42.42.5(pid=1639) [trial-2359↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1639)] [trial-2359↪ussd:trx-sysmocell5000↪assert_extension.py:17] 11:46:18.718308 tst assert_extension.py:17: Test FAILED (6.4 sec) 11:46:18.744554 run osmo-hlr_10.42.42.2(pid=1636): ERR: Terminated: ERROR {rc=237} [trial-2359↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1636)] 11:46:18.792901 run osmo-hlr_10.42.42.2(pid=1636): stdout: | (launched: 2022-12-09_11:46:15.437305) 11:46:18.842758 run osmo-hlr_10.42.42.2(pid=1636): stderr: | 20221209114615636 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114615636 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114615636 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114615636 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114615636 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114615636 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114615649 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114615657 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114615657 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114615657 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:18.911911 run osmo-msc_10.42.42.6(pid=1642): ERR: Terminated: ERROR {rc=2} [trial-2359↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1642)] 11:46:18.959634 run osmo-msc_10.42.42.6(pid=1642): stdout: | (launched: 2022-12-09_11:46:17.843920) 11:46:19.009108 run osmo-msc_10.42.42.6(pid=1642): stderr: | 20221209114618114 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209114618115 DLGLOBAL DEBUG validating counter group 0x7f6fc539ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209114618115 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209114618115 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209114618115 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209114618115 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209114618118 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209114618119 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209114618119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209114618119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:46:19.059113 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1635): Terminating (SIGTERM) 11:46:19.099103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1638): Terminating (SIGTERM) 11:46:19.139182 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1641): Terminating (SIGTERM) 11:46:19.179363 --- ParallelTerminationStrategy: PID 1635 died... 11:46:19.198672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1635): Terminated: ok {rc=0} 11:46:19.242801 --- ParallelTerminationStrategy: PID 1638 died... 11:46:19.261560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1638): Terminated: ok {rc=0} 11:46:19.305624 --- ParallelTerminationStrategy: PID 1641 died... 11:46:19.324304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1641): Terminated: ok {rc=0} 11:46:19.408571 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 11:46:20.625284 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:46:20.632569 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 11:46:20.668571 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 11:46:20.696485 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 11:46:20.750117 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 11:46:20.785143 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 11:46:20.812892 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 11:46:21.366023 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 11:46:21.420781 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:46:21.432816 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:46:21.505695 tst mo_mt_call.py: using LAC 21242 11:46:21.628827 tst mo_mt_call.py: using RAC 77 11:46:21.753822 tst mo_mt_call.py: using CellId 21242 11:46:21.874228 tst mo_mt_call.py: using BVCI 21243 11:46:21.986933 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:46:21.998361 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:46:22.009478 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:46:22.020639 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:46:22.031856 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:46:22.042948 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:46:22.163050 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:46:22.282133 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:46:22.760286 run create_hlr_db(pid=1647): Launched 11:46:22.887284 bus /sierra_2: Setting Powered False 11:46:23.948701 run create_hlr_db(pid=1647): Terminated: ok {rc=0} 11:46:24.378947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1649): Launched 11:46:24.689204 run osmo-hlr_10.42.42.2(pid=1650): Launched 11:46:24.807288 run osmo-stp_10.42.42.5: Starting osmo-stp 11:46:25.353461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1652): Launched 11:46:25.664366 run osmo-stp_10.42.42.5(pid=1653): Launched 11:46:25.783704 run osmo-msc_10.42.42.6: Starting osmo-msc 11:46:26.358303 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1655): Launched 11:46:26.667856 run osmo-msc_10.42.42.6(pid=1656): Launched 11:46:26.842271 run osmo-stp_10.42.42.5(pid=1653): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1653)] 11:46:26.972852 run osmo-stp_10.42.42.5(pid=1653): stdout: | (launched: 2022-12-09_11:46:25.607199) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:27.103597 run osmo-stp_10.42.42.5(pid=1653): stderr: | 20221209114625780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114625780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114625781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114625781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114625781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114625782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114625782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:27.232071 run osmo-stp_10.42.42.5(pid=1653): stdout: | (launched: 2022-12-09_11:46:25.607199) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:27.354272 run osmo-stp_10.42.42.5(pid=1653): stderr: | 20221209114625780 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114625780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114625781 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114625781 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114625781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114625782 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114625782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:27.501728 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1653): Process ended prematurely: osmo-stp_10.42.42.5(pid=1653) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1653)] [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 11:46:27.510643 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 11:46:27.537251 run osmo-hlr_10.42.42.2(pid=1650): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1650)] 11:46:27.585663 run osmo-hlr_10.42.42.2(pid=1650): stdout: | (launched: 2022-12-09_11:46:24.631922) 11:46:27.635888 run osmo-hlr_10.42.42.2(pid=1650): stderr: | 20221209114624810 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114624810 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114624810 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114624810 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114624810 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114624810 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114624822 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114624830 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114624831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114624831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:27.706189 run osmo-msc_10.42.42.6(pid=1656): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1656)] 11:46:27.754567 run osmo-msc_10.42.42.6(pid=1656): stdout: | (launched: 2022-12-09_11:46:26.610579) 11:46:27.804437 run osmo-msc_10.42.42.6(pid=1656): stderr: | 20221209114626884 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209114626884 DLGLOBAL DEBUG validating counter group 0x7f4f8f026c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209114626884 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209114626884 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209114626884 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209114626884 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209114626886 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209114626886 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209114626887 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209114626887 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:46:27.854674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1649): Terminating (SIGTERM) 11:46:27.894684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1652): Terminating (SIGTERM) 11:46:27.934532 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1655): Terminating (SIGTERM) 11:46:27.974732 --- ParallelTerminationStrategy: PID 1649 died... 11:46:27.993954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1649): Terminated: ok {rc=0} 11:46:28.038183 --- ParallelTerminationStrategy: PID 1652 died... 11:46:28.056825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1652): Terminated: ok {rc=0} 11:46:28.100904 --- ParallelTerminationStrategy: PID 1655 died... 11:46:28.120075 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1655): Terminated: ok {rc=0} 11:46:28.204362 bus /sierra_3: Setting Powered False 11:46:29.303390 bus /sierra_3: Setting Powered False 11:46:30.422085 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 11:46:31.574638 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:46:31.588300 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:46:31.665399 tst mo_mt_call_osmux.py: using LAC 21243 11:46:31.799568 tst mo_mt_call_osmux.py: using RAC 78 11:46:31.929735 tst mo_mt_call_osmux.py: using CellId 21243 11:46:32.052827 tst mo_mt_call_osmux.py: using BVCI 21244 11:46:32.166629 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:46:32.178125 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:46:32.190963 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:46:32.202620 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:46:32.214359 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:46:32.226189 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:46:32.345273 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:46:32.463392 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:46:32.943206 run create_hlr_db(pid=1658): Launched 11:46:33.071035 bus /sierra_2: Setting Powered False 11:46:34.132348 run create_hlr_db(pid=1658): Terminated: ok {rc=0} 11:46:34.584378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1660): Launched 11:46:34.915797 run osmo-hlr_10.42.42.2(pid=1661): Launched 11:46:35.042282 run osmo-stp_10.42.42.5: Starting osmo-stp 11:46:35.617545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1663): Launched 11:46:35.950976 run osmo-stp_10.42.42.5(pid=1664): Launched 11:46:36.077232 run osmo-msc_10.42.42.6: Starting osmo-msc 11:46:36.674355 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1666): Launched 11:46:37.005841 run osmo-msc_10.42.42.6(pid=1667): Launched 11:46:37.189253 run osmo-stp_10.42.42.5(pid=1664): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1664)] 11:46:37.328846 run osmo-stp_10.42.42.5(pid=1664): stdout: | (launched: 2022-12-09_11:46:35.889804) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:37.468261 run osmo-stp_10.42.42.5(pid=1664): stderr: | 20221209114636083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114636083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114636084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114636084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114636084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114636085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114636085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:37.607805 run osmo-stp_10.42.42.5(pid=1664): stdout: | (launched: 2022-12-09_11:46:35.889804) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:37.739312 run osmo-stp_10.42.42.5(pid=1664): stderr: | 20221209114636083 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114636083 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114636084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114636084 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114636084 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114636085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114636085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:37.896089 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1664): Process ended prematurely: osmo-stp_10.42.42.5(pid=1664) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1664)] [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 11:46:37.906032 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:46:37.934780 run osmo-hlr_10.42.42.2(pid=1661): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1661)] 11:46:37.985729 run osmo-hlr_10.42.42.2(pid=1661): stdout: | (launched: 2022-12-09_11:46:34.855131) 11:46:38.038385 run osmo-hlr_10.42.42.2(pid=1661): stderr: | 20221209114635053 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114635053 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114635053 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114635053 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114635054 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114635054 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114635067 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114635077 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114635077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114635077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:38.111852 run osmo-msc_10.42.42.6(pid=1667): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1667)] 11:46:38.162607 run osmo-msc_10.42.42.6(pid=1667): stdout: | (launched: 2022-12-09_11:46:36.944780) 11:46:38.215305 run osmo-msc_10.42.42.6(pid=1667): stderr: | 20221209114637268 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209114637268 DLGLOBAL DEBUG validating counter group 0x7f93330c7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209114637268 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209114637268 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209114637268 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209114637269 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209114637270 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209114637271 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209114637271 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209114637271 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:46:38.268677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1660): Terminating (SIGTERM) 11:46:38.311477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1663): Terminating (SIGTERM) 11:46:38.354396 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1666): Terminating (SIGTERM) 11:46:38.397465 --- ParallelTerminationStrategy: PID 1660 died... 11:46:38.417790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1660): Terminated: ok {rc=0} 11:46:38.465193 --- ParallelTerminationStrategy: PID 1663 died... 11:46:38.485121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1663): Terminated: ok {rc=0} 11:46:38.532023 --- ParallelTerminationStrategy: PID 1666 died... 11:46:38.551934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1666): Terminated: ok {rc=0} 11:46:38.641373 bus /sierra_3: Setting Powered False 11:46:39.742215 bus /sierra_3: Setting Powered False 11:46:40.860139 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 11:46:42.122904 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:46:42.130687 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 11:46:42.164515 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 11:46:42.192123 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 11:46:42.243881 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 11:46:42.277673 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 11:46:42.304130 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 11:46:42.857737 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 11:46:42.906724 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:46:42.918033 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:46:42.988026 tst mo_mt_call.py: using LAC 21244 11:46:43.119119 tst mo_mt_call.py: using RAC 79 11:46:43.250803 tst mo_mt_call.py: using CellId 21244 11:46:43.380521 tst mo_mt_call.py: using BVCI 21245 11:46:43.502606 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:46:43.514603 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:46:43.526473 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:46:43.538991 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:46:43.551217 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:46:43.563348 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:46:43.687436 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:46:43.805098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:46:44.285120 run create_hlr_db(pid=1672): Launched 11:46:44.413131 bus /sierra_2: Setting Powered False 11:46:45.474470 run create_hlr_db(pid=1672): Terminated: ok {rc=0} 11:46:45.956074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1674): Launched 11:46:46.288829 run osmo-hlr_10.42.42.2(pid=1675): Launched 11:46:46.520513 run osmo-stp_10.42.42.5: Starting osmo-stp 11:46:47.122405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1677): Launched 11:46:47.450124 run osmo-stp_10.42.42.5(pid=1678): Launched 11:46:47.568526 run osmo-msc_10.42.42.6: Starting osmo-msc 11:46:48.134512 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1680): Launched 11:46:48.446046 run osmo-msc_10.42.42.6(pid=1681): Launched 11:46:48.619291 run osmo-stp_10.42.42.5(pid=1678): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1678)] 11:46:48.749901 run osmo-stp_10.42.42.5(pid=1678): stdout: | (launched: 2022-12-09_11:46:47.392545) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:48.880511 run osmo-stp_10.42.42.5(pid=1678): stderr: | 20221209114647565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114647565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114647565 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114647565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114647566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114647566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114647566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:49.009513 run osmo-stp_10.42.42.5(pid=1678): stdout: | (launched: 2022-12-09_11:46:47.392545) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:49.132058 run osmo-stp_10.42.42.5(pid=1678): stderr: | 20221209114647565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114647565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114647565 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114647565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114647566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114647566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114647566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:49.279555 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1678): Process ended prematurely: osmo-stp_10.42.42.5(pid=1678) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1678)] [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 11:46:49.288580 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:46:49.315561 run osmo-hlr_10.42.42.2(pid=1675): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1675)] 11:46:49.363832 run osmo-hlr_10.42.42.2(pid=1675): stdout: | (launched: 2022-12-09_11:46:46.225396) 11:46:49.413872 run osmo-hlr_10.42.42.2(pid=1675): stderr: | 20221209114646426 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114646426 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114646426 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114646426 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114646426 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114646426 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114646441 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114646464 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114646465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114646465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:49.483385 run osmo-msc_10.42.42.6(pid=1681): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1681)] 11:46:49.532511 run osmo-msc_10.42.42.6(pid=1681): stdout: | (launched: 2022-12-09_11:46:48.388395) 11:46:49.582700 run osmo-msc_10.42.42.6(pid=1681): stderr: | 20221209114648663 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209114648663 DLGLOBAL DEBUG validating counter group 0x7fac7c87cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209114648663 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209114648663 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209114648663 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209114648664 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209114648666 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209114648666 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209114648666 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209114648666 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:46:49.633026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1674): Terminating (SIGTERM) 11:46:49.674377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1677): Terminating (SIGTERM) 11:46:49.714522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1680): Terminating (SIGTERM) 11:46:49.754917 --- ParallelTerminationStrategy: PID 1674 died... 11:46:49.774416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1674): Terminated: ok {rc=0} 11:46:49.818734 --- ParallelTerminationStrategy: PID 1677 died... 11:46:49.837648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1677): Terminated: ok {rc=0} 11:46:49.882566 --- ParallelTerminationStrategy: PID 1680 died... 11:46:49.901311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1680): Terminated: ok {rc=0} 11:46:49.987733 bus /sierra_3: Setting Powered False 11:46:51.089068 bus /sierra_3: Setting Powered False 11:46:52.205371 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 11:46:53.354168 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:46:53.366409 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:46:53.437252 tst mo_mt_call_osmux.py: using LAC 21245 11:46:53.560604 tst mo_mt_call_osmux.py: using RAC 80 11:46:53.696622 tst mo_mt_call_osmux.py: using CellId 21245 11:46:53.826206 tst mo_mt_call_osmux.py: using BVCI 21246 11:46:53.946947 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:46:53.959046 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:46:53.970822 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:46:53.983227 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:46:53.995479 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:46:54.007766 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:46:54.129615 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:46:54.250257 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:46:54.730999 run create_hlr_db(pid=1683): Launched 11:46:54.859406 bus /sierra_2: Setting Powered False 11:46:55.920728 run create_hlr_db(pid=1683): Terminated: ok {rc=0} 11:46:56.354242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1685): Launched 11:46:56.666772 run osmo-hlr_10.42.42.2(pid=1686): Launched 11:46:56.785255 run osmo-stp_10.42.42.5: Starting osmo-stp 11:46:57.336712 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1688): Launched 11:46:57.650736 run osmo-stp_10.42.42.5(pid=1689): Launched 11:46:57.769659 run osmo-msc_10.42.42.6: Starting osmo-msc 11:46:58.329701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1691): Launched 11:46:58.642566 run osmo-msc_10.42.42.6(pid=1692): Launched 11:46:58.816610 run osmo-stp_10.42.42.5(pid=1689): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1689)] 11:46:58.947897 run osmo-stp_10.42.42.5(pid=1689): stdout: | (launched: 2022-12-09_11:46:57.592764) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:59.078841 run osmo-stp_10.42.42.5(pid=1689): stderr: | 20221209114657766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114657766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114657767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114657767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114657767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114657767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114657768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:59.207600 run osmo-stp_10.42.42.5(pid=1689): stdout: | (launched: 2022-12-09_11:46:57.592764) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:46:59.330451 run osmo-stp_10.42.42.5(pid=1689): stderr: | 20221209114657766 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114657766 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114657767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114657767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114657767 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114657767 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114657768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:46:59.476802 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1689): Process ended prematurely: osmo-stp_10.42.42.5(pid=1689) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1689)] [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 11:46:59.486071 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:46:59.512592 run osmo-hlr_10.42.42.2(pid=1686): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1686)] 11:46:59.560677 run osmo-hlr_10.42.42.2(pid=1686): stdout: | (launched: 2022-12-09_11:46:56.608787) 11:46:59.610168 run osmo-hlr_10.42.42.2(pid=1686): stderr: | 20221209114656785 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114656785 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114656785 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114656785 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114656785 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114656786 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114656799 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114656807 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114656807 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114656807 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:46:59.679382 run osmo-msc_10.42.42.6(pid=1692): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1692)] 11:46:59.727318 run osmo-msc_10.42.42.6(pid=1692): stdout: | (launched: 2022-12-09_11:46:58.584666) 11:46:59.777067 run osmo-msc_10.42.42.6(pid=1692): stderr: | 20221209114658859 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209114658859 DLGLOBAL DEBUG validating counter group 0x7fcfb208cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209114658860 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209114658860 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209114658860 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209114658860 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209114658862 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209114658862 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209114658862 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209114658862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:46:59.826956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1685): Terminating (SIGTERM) 11:46:59.866987 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1688): Terminating (SIGTERM) 11:46:59.906789 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1691): Terminating (SIGTERM) 11:46:59.947148 --- ParallelTerminationStrategy: PID 1685 died... 11:46:59.966401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1685): Terminated: ok {rc=0} 11:47:00.010615 --- ParallelTerminationStrategy: PID 1688 died... 11:47:00.029412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1688): Terminated: ok {rc=0} 11:47:00.073507 --- ParallelTerminationStrategy: PID 1691 died... 11:47:00.092361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1691): Terminated: ok {rc=0} 11:47:00.179159 bus /sierra_3: Setting Powered False 11:47:01.280489 bus /sierra_3: Setting Powered False 11:47:02.395529 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 11:47:03.644385 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:47:03.650906 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 11:47:03.684564 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 11:47:03.711501 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 11:47:03.762506 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 11:47:03.796218 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 11:47:03.822723 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 11:47:04.374927 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 11:47:04.424407 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:47:04.435792 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:47:04.504932 tst mo_mt_call.py: using LAC 21246 11:47:04.624592 tst mo_mt_call.py: using RAC 81 11:47:04.746270 tst mo_mt_call.py: using CellId 21246 11:47:04.867894 tst mo_mt_call.py: using BVCI 21247 11:47:04.982222 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:47:04.993617 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:47:05.004631 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:47:05.015775 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:47:05.026935 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:47:05.037946 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:47:05.156911 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:47:05.279583 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:47:05.794973 run create_hlr_db(pid=1697): Launched 11:47:05.922185 bus /sierra_2: Setting Powered False 11:47:06.983584 run create_hlr_db(pid=1697): Terminated: ok {rc=0} 11:47:07.446529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1699): Launched 11:47:07.779379 run osmo-hlr_10.42.42.2(pid=1700): Launched 11:47:07.905979 run osmo-stp_10.42.42.5: Starting osmo-stp 11:47:08.480065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1702): Launched 11:47:08.811737 run osmo-stp_10.42.42.5(pid=1703): Launched 11:47:08.937888 run osmo-msc_10.42.42.6: Starting osmo-msc 11:47:09.537218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1705): Launched 11:47:09.870697 run osmo-msc_10.42.42.6(pid=1706): Launched 11:47:10.055973 run osmo-stp_10.42.42.5(pid=1703): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1703)] 11:47:10.196235 run osmo-stp_10.42.42.5(pid=1703): stdout: | (launched: 2022-12-09_11:47:08.751012) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:10.337534 run osmo-stp_10.42.42.5(pid=1703): stderr: | 20221209114708944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114708944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114708945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114708945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114708946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114708946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114708946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:10.476536 run osmo-stp_10.42.42.5(pid=1703): stdout: | (launched: 2022-12-09_11:47:08.751012) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:10.608799 run osmo-stp_10.42.42.5(pid=1703): stderr: | 20221209114708944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114708944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114708945 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114708945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114708946 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114708946 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114708946 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:10.767112 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1703): Process ended prematurely: osmo-stp_10.42.42.5(pid=1703) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1703)] [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 11:47:10.777090 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:47:10.806336 run osmo-hlr_10.42.42.2(pid=1700): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1700)] 11:47:10.857850 run osmo-hlr_10.42.42.2(pid=1700): stdout: | (launched: 2022-12-09_11:47:07.718326) 11:47:10.910884 run osmo-hlr_10.42.42.2(pid=1700): stderr: | 20221209114707918 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114707918 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114707918 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114707918 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114707918 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114707918 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114707933 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114707941 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114707941 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114707941 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:47:10.984724 run osmo-msc_10.42.42.6(pid=1706): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1706)] 11:47:11.036335 run osmo-msc_10.42.42.6(pid=1706): stdout: | (launched: 2022-12-09_11:47:09.809385) 11:47:11.089243 run osmo-msc_10.42.42.6(pid=1706): stderr: | 20221209114710131 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209114710131 DLGLOBAL DEBUG validating counter group 0x7f5fc42e4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209114710131 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209114710132 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209114710132 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209114710132 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209114710134 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209114710134 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209114710134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209114710134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:47:11.142388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1699): Terminating (SIGTERM) 11:47:11.185524 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1702): Terminating (SIGTERM) 11:47:11.228692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1705): Terminating (SIGTERM) 11:47:11.272800 --- ParallelTerminationStrategy: PID 1699 died... 11:47:11.293323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1699): Terminated: ok {rc=0} 11:47:11.341435 --- ParallelTerminationStrategy: PID 1702 died... 11:47:11.361523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1702): Terminated: ok {rc=0} 11:47:11.409295 --- ParallelTerminationStrategy: PID 1705 died... 11:47:11.429255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1705): Terminated: ok {rc=0} 11:47:11.519627 bus /sierra_3: Setting Powered False 11:47:12.619756 bus /sierra_3: Setting Powered False 11:47:13.740160 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 11:47:14.894428 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:47:14.907318 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:47:14.985238 tst mo_mt_call_osmux.py: using LAC 21247 11:47:15.114404 tst mo_mt_call_osmux.py: using RAC 82 11:47:15.245910 tst mo_mt_call_osmux.py: using CellId 21247 11:47:15.376087 tst mo_mt_call_osmux.py: using BVCI 21248 11:47:15.496678 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:47:15.508700 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:47:15.520564 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:47:15.533353 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:47:15.545653 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:47:15.557923 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:47:15.684247 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:47:15.809476 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:47:16.339652 run create_hlr_db(pid=1708): Launched 11:47:16.501167 bus /sierra_2: Setting Powered False 11:47:17.566733 run create_hlr_db(pid=1708): Terminated: ok {rc=0} 11:47:18.030559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1710): Launched 11:47:18.363915 run osmo-hlr_10.42.42.2(pid=1711): Launched 11:47:18.491345 run osmo-stp_10.42.42.5: Starting osmo-stp 11:47:19.060585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1713): Launched 11:47:19.393309 run osmo-stp_10.42.42.5(pid=1714): Launched 11:47:19.520329 run osmo-msc_10.42.42.6: Starting osmo-msc 11:47:20.120742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1716): Launched 11:47:20.454547 run osmo-msc_10.42.42.6(pid=1717): Launched 11:47:20.640097 run osmo-stp_10.42.42.5(pid=1714): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1714)] 11:47:20.779654 run osmo-stp_10.42.42.5(pid=1714): stdout: | (launched: 2022-12-09_11:47:19.331853) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:20.919978 run osmo-stp_10.42.42.5(pid=1714): stderr: | 20221209114719524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114719524 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114719525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114719525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114719525 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114719526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114719526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:21.058660 run osmo-stp_10.42.42.5(pid=1714): stdout: | (launched: 2022-12-09_11:47:19.331853) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:21.190292 run osmo-stp_10.42.42.5(pid=1714): stderr: | 20221209114719524 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114719524 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114719525 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114719525 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114719525 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114719526 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114719526 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:21.348111 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1714): Process ended prematurely: osmo-stp_10.42.42.5(pid=1714) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1714)] [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 11:47:21.358074 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 11:47:21.386977 run osmo-hlr_10.42.42.2(pid=1711): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1711)] 11:47:21.438036 run osmo-hlr_10.42.42.2(pid=1711): stdout: | (launched: 2022-12-09_11:47:18.302866) 11:47:21.490704 run osmo-hlr_10.42.42.2(pid=1711): stderr: | 20221209114718502 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114718502 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114718502 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114718502 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114718502 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114718502 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114718514 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114718524 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114718524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114718524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:47:21.564059 run osmo-msc_10.42.42.6(pid=1717): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1717)] 11:47:21.615037 run osmo-msc_10.42.42.6(pid=1717): stdout: | (launched: 2022-12-09_11:47:20.392841) 11:47:21.667434 run osmo-msc_10.42.42.6(pid=1717): stderr: | 20221209114720715 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209114720715 DLGLOBAL DEBUG validating counter group 0x7f7bbb0d1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209114720715 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209114720715 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209114720716 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209114720716 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209114720717 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209114720718 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209114720718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209114720718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:47:21.720392 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1710): Terminating (SIGTERM) 11:47:21.763183 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1713): Terminating (SIGTERM) 11:47:21.805956 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1716): Terminating (SIGTERM) 11:47:21.849054 --- ParallelTerminationStrategy: PID 1710 died... 11:47:21.869273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1710): Terminated: ok {rc=0} 11:47:21.917512 --- ParallelTerminationStrategy: PID 1713 died... 11:47:21.937542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1713): Terminated: ok {rc=0} 11:47:21.984850 --- ParallelTerminationStrategy: PID 1716 died... 11:47:22.005264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1716): Terminated: ok {rc=0} 11:47:22.095148 bus /sierra_3: Setting Powered False 11:47:23.196644 bus /sierra_3: Setting Powered False 11:47:24.314926 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 11:47:25.573984 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:47:25.581317 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 11:47:25.616649 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 11:47:25.645046 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 11:47:25.699478 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 11:47:25.734618 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 11:47:25.762307 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 11:47:26.319327 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 11:47:26.372632 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:47:26.384462 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:47:26.456502 tst mo_mt_call.py: using LAC 21248 11:47:26.587909 tst mo_mt_call.py: using RAC 83 11:47:26.712751 tst mo_mt_call.py: using CellId 21248 11:47:26.841245 tst mo_mt_call.py: using BVCI 21249 11:47:26.954401 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:47:26.966084 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:47:26.977518 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:47:26.989140 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:47:27.000848 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:47:27.012372 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:47:27.130147 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:47:27.248705 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:47:27.729215 run create_hlr_db(pid=1722): Launched 11:47:27.856362 bus /sierra_2: Setting Powered False 11:47:28.918058 run create_hlr_db(pid=1722): Terminated: ok {rc=0} 11:47:29.372191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1724): Launched 11:47:29.703930 run osmo-hlr_10.42.42.2(pid=1725): Launched 11:47:29.830606 run osmo-stp_10.42.42.5: Starting osmo-stp 11:47:30.407165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1727): Launched 11:47:30.740185 run osmo-stp_10.42.42.5(pid=1728): Launched 11:47:30.888479 run osmo-msc_10.42.42.6: Starting osmo-msc 11:47:31.613811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1730): Launched 11:47:31.952346 run osmo-msc_10.42.42.6(pid=1731): Launched 11:47:32.273473 run osmo-stp_10.42.42.5(pid=1728): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1728)] 11:47:32.407809 run osmo-stp_10.42.42.5(pid=1728): stdout: | (launched: 2022-12-09_11:47:30.678413) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:32.538952 run osmo-stp_10.42.42.5(pid=1728): stderr: | 20221209114730918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114730918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114730919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114730928 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114730929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114730929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114730929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:32.669419 run osmo-stp_10.42.42.5(pid=1728): stdout: | (launched: 2022-12-09_11:47:30.678413) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:32.792932 run osmo-stp_10.42.42.5(pid=1728): stderr: | 20221209114730918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114730918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114730919 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114730928 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114730929 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114730929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114730929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:32.941348 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1728): Process ended prematurely: osmo-stp_10.42.42.5(pid=1728) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1728)] [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 11:47:32.950512 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 11:47:32.977609 run osmo-hlr_10.42.42.2(pid=1725): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1725)] 11:47:33.026359 run osmo-hlr_10.42.42.2(pid=1725): stdout: | (launched: 2022-12-09_11:47:29.643282) 11:47:33.076847 run osmo-hlr_10.42.42.2(pid=1725): stderr: | 20221209114729845 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114729845 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114729845 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114729845 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114729845 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114729845 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114729858 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114729866 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114729866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114729866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:47:33.147247 run osmo-msc_10.42.42.6(pid=1731): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1731)] 11:47:33.195789 run osmo-msc_10.42.42.6(pid=1731): stdout: | (launched: 2022-12-09_11:47:31.889107) 11:47:33.246017 run osmo-msc_10.42.42.6(pid=1731): stderr: | 20221209114732309 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209114732309 DLGLOBAL DEBUG validating counter group 0x7f396ffb5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209114732309 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209114732309 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209114732309 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209114732310 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209114732311 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209114732312 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209114732312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209114732312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:47:33.296840 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1724): Terminating (SIGTERM) 11:47:33.337788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1727): Terminating (SIGTERM) 11:47:33.378620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1730): Terminating (SIGTERM) 11:47:33.419723 --- ParallelTerminationStrategy: PID 1724 died... 11:47:33.439318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1724): Terminated: ok {rc=0} 11:47:33.484297 --- ParallelTerminationStrategy: PID 1727 died... 11:47:33.503344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1727): Terminated: ok {rc=0} 11:47:33.548289 --- ParallelTerminationStrategy: PID 1730 died... 11:47:33.567322 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1730): Terminated: ok {rc=0} 11:47:33.655507 bus /sierra_3: Setting Powered False 11:47:34.757230 bus /sierra_3: Setting Powered False 11:47:35.878814 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 11:47:37.029574 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:47:37.041879 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:47:37.113889 tst mo_mt_call_osmux.py: using LAC 21249 11:47:37.237369 tst mo_mt_call_osmux.py: using RAC 84 11:47:37.359009 tst mo_mt_call_osmux.py: using CellId 21249 11:47:37.484670 tst mo_mt_call_osmux.py: using BVCI 21250 11:47:37.606757 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:47:37.618466 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:47:37.630311 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:47:37.642270 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:47:37.654539 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:47:37.666666 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:47:37.789301 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:47:37.911061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:47:38.395643 run create_hlr_db(pid=1734): Launched 11:47:38.523858 bus /sierra_2: Setting Powered False 11:47:39.586396 run create_hlr_db(pid=1734): Terminated: ok {rc=0} 11:47:40.041468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1736): Launched 11:47:40.377775 run osmo-hlr_10.42.42.2(pid=1737): Launched 11:47:40.505116 run osmo-stp_10.42.42.5: Starting osmo-stp 11:47:41.077412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1739): Launched 11:47:41.412384 run osmo-stp_10.42.42.5(pid=1740): Launched 11:47:41.538820 run osmo-msc_10.42.42.6: Starting osmo-msc 11:47:42.141058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1742): Launched 11:47:42.474958 run osmo-msc_10.42.42.6(pid=1743): Launched 11:47:42.661713 run osmo-stp_10.42.42.5(pid=1740): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1740)] 11:47:42.801252 run osmo-stp_10.42.42.5(pid=1740): stdout: | (launched: 2022-12-09_11:47:41.351182) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:42.941368 run osmo-stp_10.42.42.5(pid=1740): stderr: | 20221209114741544 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114741545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114741545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114741545 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114741546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114741546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114741546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:43.079679 run osmo-stp_10.42.42.5(pid=1740): stdout: | (launched: 2022-12-09_11:47:41.351182) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:43.211195 run osmo-stp_10.42.42.5(pid=1740): stderr: | 20221209114741544 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114741545 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114741545 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114741545 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114741546 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114741546 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114741546 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:43.369321 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1740): Process ended prematurely: osmo-stp_10.42.42.5(pid=1740) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1740)] [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 11:47:43.379029 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:47:43.407715 run osmo-hlr_10.42.42.2(pid=1737): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1737)] 11:47:43.458654 run osmo-hlr_10.42.42.2(pid=1737): stdout: | (launched: 2022-12-09_11:47:40.316277) 11:47:43.511758 run osmo-hlr_10.42.42.2(pid=1737): stderr: | 20221209114740517 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114740517 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114740517 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114740517 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114740517 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114740517 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114740528 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114740537 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114740537 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114740537 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:47:43.585313 run osmo-msc_10.42.42.6(pid=1743): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1743)] 11:47:43.635998 run osmo-msc_10.42.42.6(pid=1743): stdout: | (launched: 2022-12-09_11:47:42.413988) 11:47:43.688637 run osmo-msc_10.42.42.6(pid=1743): stderr: | 20221209114742737 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209114742737 DLGLOBAL DEBUG validating counter group 0x7fd323a87c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209114742737 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209114742737 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209114742737 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209114742737 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209114742739 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209114742741 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209114742741 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209114742741 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:47:43.741751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1736): Terminating (SIGTERM) 11:47:43.784176 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1739): Terminating (SIGTERM) 11:47:43.826731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1742): Terminating (SIGTERM) 11:47:43.869360 --- ParallelTerminationStrategy: PID 1736 died... 11:47:43.889423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1736): Terminated: ok {rc=0} 11:47:43.936277 --- ParallelTerminationStrategy: PID 1739 died... 11:47:43.955864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1739): Terminated: ok {rc=0} 11:47:44.002560 --- ParallelTerminationStrategy: PID 1742 died... 11:47:44.022262 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1742): Terminated: ok {rc=0} 11:47:44.111934 bus /sierra_3: Setting Powered False 11:47:45.211368 bus /sierra_3: Setting Powered False 11:47:46.328257 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 11:47:47.587671 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:47:47.594794 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 11:47:47.630272 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 11:47:47.658060 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 11:47:47.711631 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 11:47:47.746666 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 11:47:47.774419 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 11:47:48.328339 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 11:47:48.381661 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:47:48.393536 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:47:48.470075 tst mo_mt_call.py: using LAC 21250 11:47:48.599680 tst mo_mt_call.py: using RAC 85 11:47:48.729462 tst mo_mt_call.py: using CellId 21250 11:47:48.858793 tst mo_mt_call.py: using BVCI 21251 11:47:48.980453 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:47:48.992225 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:47:49.003764 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:47:49.015589 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:47:49.027547 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:47:49.039327 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:47:49.161543 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:47:49.284090 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:47:49.798568 run create_hlr_db(pid=1748): Launched 11:47:49.925652 bus /sierra_2: Setting Powered False 11:47:50.991258 run create_hlr_db(pid=1748): Terminated: ok {rc=0} 11:47:51.436079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1750): Launched 11:47:51.750719 run osmo-hlr_10.42.42.2(pid=1751): Launched 11:47:51.881823 run osmo-stp_10.42.42.5: Starting osmo-stp 11:47:52.457464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1753): Launched 11:47:52.791668 run osmo-stp_10.42.42.5(pid=1754): Launched 11:47:52.917829 run osmo-msc_10.42.42.6: Starting osmo-msc 11:47:53.517759 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1756): Launched 11:47:53.851291 run osmo-msc_10.42.42.6(pid=1757): Launched 11:47:54.036142 run osmo-stp_10.42.42.5(pid=1754): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1754)] 11:47:54.176050 run osmo-stp_10.42.42.5(pid=1754): stdout: | (launched: 2022-12-09_11:47:52.730570) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:54.316659 run osmo-stp_10.42.42.5(pid=1754): stderr: | 20221209114752925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114752926 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114752926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114752926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114752927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114752927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114752927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:54.455767 run osmo-stp_10.42.42.5(pid=1754): stdout: | (launched: 2022-12-09_11:47:52.730570) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:47:54.587716 run osmo-stp_10.42.42.5(pid=1754): stderr: | 20221209114752925 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114752926 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114752926 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114752926 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114752927 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114752927 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114752927 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:47:54.745567 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1754): Process ended prematurely: osmo-stp_10.42.42.5(pid=1754) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1754)] [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 11:47:54.755433 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:47:54.784568 run osmo-hlr_10.42.42.2(pid=1751): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1751)] 11:47:54.835989 run osmo-hlr_10.42.42.2(pid=1751): stdout: | (launched: 2022-12-09_11:47:51.692023) 11:47:54.888536 run osmo-hlr_10.42.42.2(pid=1751): stderr: | 20221209114751887 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114751887 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114751887 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114751887 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114751887 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114751887 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114751899 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114751907 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114751908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114751908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:47:54.961775 run osmo-msc_10.42.42.6(pid=1757): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1757)] 11:47:55.012901 run osmo-msc_10.42.42.6(pid=1757): stdout: | (launched: 2022-12-09_11:47:53.790182) 11:47:55.065348 run osmo-msc_10.42.42.6(pid=1757): stderr: | 20221209114754112 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209114754113 DLGLOBAL DEBUG validating counter group 0x7f500483cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209114754113 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209114754113 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209114754113 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209114754113 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209114754115 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209114754115 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209114754115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209114754115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:47:55.118390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1750): Terminating (SIGTERM) 11:47:55.161036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1753): Terminating (SIGTERM) 11:47:55.203969 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1756): Terminating (SIGTERM) 11:47:55.247139 --- ParallelTerminationStrategy: PID 1750 died... 11:47:55.267420 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1750): Terminated: ok {rc=0} 11:47:55.315687 --- ParallelTerminationStrategy: PID 1753 died... 11:47:55.335726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1753): Terminated: ok {rc=0} 11:47:55.383196 --- ParallelTerminationStrategy: PID 1756 died... 11:47:55.403090 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1756): Terminated: ok {rc=0} 11:47:55.491628 bus /sierra_3: Setting Powered False 11:47:56.591906 bus /sierra_3: Setting Powered False 11:47:57.709848 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 11:47:58.860396 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:47:58.873156 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:47:58.947551 tst mo_mt_call_osmux.py: using LAC 21251 11:47:59.078373 tst mo_mt_call_osmux.py: using RAC 86 11:47:59.201169 tst mo_mt_call_osmux.py: using CellId 21251 11:47:59.328905 tst mo_mt_call_osmux.py: using BVCI 21252 11:47:59.442808 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:47:59.454410 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:47:59.465876 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:47:59.477138 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:47:59.488380 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:47:59.499459 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:47:59.621284 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:47:59.741396 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:48:00.225750 run create_hlr_db(pid=1759): Launched 11:48:00.354608 bus /sierra_2: Setting Powered False 11:48:01.422284 run create_hlr_db(pid=1759): Terminated: ok {rc=0} 11:48:01.903710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1761): Launched 11:48:02.237769 run osmo-hlr_10.42.42.2(pid=1762): Launched 11:48:02.358449 run osmo-stp_10.42.42.5: Starting osmo-stp 11:48:02.910118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1764): Launched 11:48:03.223061 run osmo-stp_10.42.42.5(pid=1765): Launched 11:48:03.342191 run osmo-msc_10.42.42.6: Starting osmo-msc 11:48:03.905077 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1767): Launched 11:48:04.218319 run osmo-msc_10.42.42.6(pid=1768): Launched 11:48:04.394080 run osmo-stp_10.42.42.5(pid=1765): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1765)] 11:48:04.525839 run osmo-stp_10.42.42.5(pid=1765): stdout: | (launched: 2022-12-09_11:48:03.165396) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:04.657896 run osmo-stp_10.42.42.5(pid=1765): stderr: | 20221209114803337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114803338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114803338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114803338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114803339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114803339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114803339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:04.787656 run osmo-stp_10.42.42.5(pid=1765): stdout: | (launched: 2022-12-09_11:48:03.165396) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:04.911019 run osmo-stp_10.42.42.5(pid=1765): stderr: | 20221209114803337 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114803338 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114803338 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114803338 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114803339 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114803339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114803339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:05.059105 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1765): Process ended prematurely: osmo-stp_10.42.42.5(pid=1765) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1765)] [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 11:48:05.068357 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:48:05.095332 run osmo-hlr_10.42.42.2(pid=1762): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1762)] 11:48:05.143727 run osmo-hlr_10.42.42.2(pid=1762): stdout: | (launched: 2022-12-09_11:48:02.179095) 11:48:05.193841 run osmo-hlr_10.42.42.2(pid=1762): stderr: | 20221209114802357 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114802357 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114802357 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114802357 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114802357 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114802357 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114802369 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114802377 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114802377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114802377 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:48:05.263322 run osmo-msc_10.42.42.6(pid=1768): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1768)] 11:48:05.311366 run osmo-msc_10.42.42.6(pid=1768): stdout: | (launched: 2022-12-09_11:48:04.160246) 11:48:05.361252 run osmo-msc_10.42.42.6(pid=1768): stderr: | 20221209114804435 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209114804436 DLGLOBAL DEBUG validating counter group 0x7f4c32d1ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209114804436 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209114804436 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209114804436 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209114804436 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209114804438 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209114804438 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209114804439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209114804439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:48:05.411469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1761): Terminating (SIGTERM) 11:48:05.451784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1764): Terminating (SIGTERM) 11:48:05.492102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1767): Terminating (SIGTERM) 11:48:05.532581 --- ParallelTerminationStrategy: PID 1761 died... 11:48:05.551954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1761): Terminated: ok {rc=0} 11:48:05.596485 --- ParallelTerminationStrategy: PID 1764 died... 11:48:05.615431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1764): Terminated: ok {rc=0} 11:48:05.659923 --- ParallelTerminationStrategy: PID 1767 died... 11:48:05.679032 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1767): Terminated: ok {rc=0} 11:48:05.764436 bus /sierra_3: Setting Powered False 11:48:06.863362 bus /sierra_3: Setting Powered False 11:48:07.983920 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:48:09.250510 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:48:09.258394 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:48:09.292842 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 11:48:09.319795 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:48:09.370831 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:48:09.404328 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 11:48:09.430563 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:48:09.985052 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 11:48:10.035488 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:48:10.046968 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:48:10.116417 tst mo_mt_call.py: using LAC 21252 11:48:10.236842 tst mo_mt_call.py: using RAC 87 11:48:10.358081 tst mo_mt_call.py: using CellId 21252 11:48:10.479879 tst mo_mt_call.py: using BVCI 21253 11:48:10.592661 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:48:10.603994 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:48:10.615173 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:48:10.626537 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:48:10.637967 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:48:10.649260 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:48:10.770689 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:48:10.891635 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:48:11.374515 run create_hlr_db(pid=1773): Launched 11:48:11.501924 bus /sierra_2: Setting Powered False 11:48:12.564180 run create_hlr_db(pid=1773): Terminated: ok {rc=0} 11:48:13.017969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1775): Launched 11:48:13.335746 run osmo-hlr_10.42.42.2(pid=1776): Launched 11:48:13.453593 run osmo-stp_10.42.42.5: Starting osmo-stp 11:48:14.005745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1778): Launched 11:48:14.341154 run osmo-stp_10.42.42.5(pid=1780): Launched 11:48:14.468027 run osmo-msc_10.42.42.6: Starting osmo-msc 11:48:15.069761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1782): Launched 11:48:15.404529 run osmo-msc_10.42.42.6(pid=1783): Launched 11:48:15.590120 run osmo-stp_10.42.42.5(pid=1780): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1780)] 11:48:15.730454 run osmo-stp_10.42.42.5(pid=1780): stdout: | (launched: 2022-12-09_11:48:14.278924) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:15.927735 run osmo-stp_10.42.42.5(pid=1780): stderr: | 20221209114814473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114814473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114814473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114814474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114814474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114814474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114814474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:16.061449 run osmo-stp_10.42.42.5(pid=1780): stdout: | (launched: 2022-12-09_11:48:14.278924) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:16.221715 run osmo-stp_10.42.42.5(pid=1780): stderr: | 20221209114814473 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114814473 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114814473 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114814474 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114814474 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114814474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114814474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:16.377981 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1780): Process ended prematurely: osmo-stp_10.42.42.5(pid=1780) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1780)] [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 11:48:16.388201 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 11:48:16.417145 run osmo-hlr_10.42.42.2(pid=1776): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1776)] 11:48:16.466924 run osmo-hlr_10.42.42.2(pid=1776): stdout: | (launched: 2022-12-09_11:48:13.277898) 11:48:16.529212 run osmo-hlr_10.42.42.2(pid=1776): stderr: | 20221209114813457 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114813457 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114813457 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114813457 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114813457 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114813457 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114813469 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114813478 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114813478 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114813478 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:48:16.623095 run osmo-msc_10.42.42.6(pid=1783): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1783)] 11:48:16.687247 run osmo-msc_10.42.42.6(pid=1783): stdout: | (launched: 2022-12-09_11:48:15.343261) 11:48:16.739418 run osmo-msc_10.42.42.6(pid=1783): stderr: | 20221209114815669 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209114815669 DLGLOBAL DEBUG validating counter group 0x7fc5ff6c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209114815669 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209114815670 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209114815670 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209114815670 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209114815671 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209114815672 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209114815672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209114815672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:48:16.792692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1775): Terminating (SIGTERM) 11:48:16.835546 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1778): Terminating (SIGTERM) 11:48:16.880548 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1782): Terminating (SIGTERM) 11:48:16.924706 --- ParallelTerminationStrategy: PID 1775 died... 11:48:16.945193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1775): Terminated: ok {rc=0} 11:48:16.994654 --- ParallelTerminationStrategy: PID 1778 died... 11:48:17.014717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1778): Terminated: ok {rc=0} 11:48:17.061862 --- ParallelTerminationStrategy: PID 1782 died... 11:48:17.081934 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1782): Terminated: ok {rc=0} 11:48:17.171222 bus /sierra_3: Setting Powered False 11:48:18.270550 bus /sierra_3: Setting Powered False 11:48:19.387539 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 11:48:20.537279 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:48:20.549458 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:48:20.620544 tst mo_mt_call_osmux.py: using LAC 21253 11:48:20.744744 tst mo_mt_call_osmux.py: using RAC 88 11:48:20.867016 tst mo_mt_call_osmux.py: using CellId 21253 11:48:20.990343 tst mo_mt_call_osmux.py: using BVCI 21254 11:48:21.105416 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:48:21.116640 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:48:21.127718 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:48:21.138849 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:48:21.150085 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:48:21.161214 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:48:21.284304 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:48:21.408910 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:48:21.923998 run create_hlr_db(pid=1785): Launched 11:48:22.051721 bus /sierra_2: Setting Powered False 11:48:23.116548 run create_hlr_db(pid=1785): Terminated: ok {rc=0} 11:48:23.562196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1787): Launched 11:48:23.874751 run osmo-hlr_10.42.42.2(pid=1788): Launched 11:48:23.994025 run osmo-stp_10.42.42.5: Starting osmo-stp 11:48:24.530202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1790): Launched 11:48:24.842627 run osmo-stp_10.42.42.5(pid=1791): Launched 11:48:24.962043 run osmo-msc_10.42.42.6: Starting osmo-msc 11:48:25.525009 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1793): Launched 11:48:25.837619 run osmo-msc_10.42.42.6(pid=1794): Launched 11:48:26.013756 run osmo-stp_10.42.42.5(pid=1791): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1791)] 11:48:26.146209 run osmo-stp_10.42.42.5(pid=1791): stdout: | (launched: 2022-12-09_11:48:24.784714) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:26.278804 run osmo-stp_10.42.42.5(pid=1791): stderr: | 20221209114824956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114824956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114824956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114824957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114824959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114824959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114824959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:26.408828 run osmo-stp_10.42.42.5(pid=1791): stdout: | (launched: 2022-12-09_11:48:24.784714) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:26.533546 run osmo-stp_10.42.42.5(pid=1791): stderr: | 20221209114824956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114824956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114824956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114824957 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114824959 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114824959 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114824959 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:26.682668 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1791): Process ended prematurely: osmo-stp_10.42.42.5(pid=1791) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1791)] [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 11:48:26.691642 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 11:48:26.718589 run osmo-hlr_10.42.42.2(pid=1788): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1788)] 11:48:26.766790 run osmo-hlr_10.42.42.2(pid=1788): stdout: | (launched: 2022-12-09_11:48:23.817322) 11:48:26.816608 run osmo-hlr_10.42.42.2(pid=1788): stderr: | 20221209114823997 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114823997 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114823997 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114823997 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114823997 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114823997 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114824012 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114824022 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114824022 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114824022 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:48:26.886309 run osmo-msc_10.42.42.6(pid=1794): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1794)] 11:48:26.934423 run osmo-msc_10.42.42.6(pid=1794): stdout: | (launched: 2022-12-09_11:48:25.779668) 11:48:26.984052 run osmo-msc_10.42.42.6(pid=1794): stderr: | 20221209114826054 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209114826054 DLGLOBAL DEBUG validating counter group 0x7f42b2255c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209114826054 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209114826054 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209114826054 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209114826054 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209114826056 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209114826056 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209114826057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209114826057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:48:27.034502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1787): Terminating (SIGTERM) 11:48:27.075017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1790): Terminating (SIGTERM) 11:48:27.115109 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1793): Terminating (SIGTERM) 11:48:27.155615 --- ParallelTerminationStrategy: PID 1787 died... 11:48:27.174944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1787): Terminated: ok {rc=0} 11:48:27.219372 --- ParallelTerminationStrategy: PID 1790 died... 11:48:27.238269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1790): Terminated: ok {rc=0} 11:48:27.282478 --- ParallelTerminationStrategy: PID 1793 died... 11:48:27.301519 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1793): Terminated: ok {rc=0} 11:48:27.386731 bus /sierra_3: Setting Powered False 11:48:28.485442 bus /sierra_3: Setting Powered False 11:48:29.603586 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:48:30.863452 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:48:30.870535 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:48:30.925551 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 11:48:30.956171 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 11:48:31.009668 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:48:31.045765 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 11:48:31.074368 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 11:48:31.632641 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 11:48:31.693477 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:48:31.706232 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:48:31.782157 tst mo_mt_call.py: using LAC 21254 11:48:31.914014 tst mo_mt_call.py: using RAC 89 11:48:32.084440 tst mo_mt_call.py: using CellId 21254 11:48:32.229609 tst mo_mt_call.py: using BVCI 21255 11:48:32.346153 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:48:32.357735 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:48:32.368870 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:48:32.380169 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:48:32.391129 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:48:32.402424 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:48:32.522994 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:48:32.648780 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:48:33.162185 run create_hlr_db(pid=1799): Launched 11:48:33.288536 bus /sierra_2: Setting Powered False 11:48:34.354717 run create_hlr_db(pid=1799): Terminated: ok {rc=0} 11:48:34.798999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1801): Launched 11:48:35.110803 run osmo-hlr_10.42.42.2(pid=1802): Launched 11:48:35.229573 run osmo-stp_10.42.42.5: Starting osmo-stp 11:48:35.786947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1804): Launched 11:48:36.098954 run osmo-stp_10.42.42.5(pid=1805): Launched 11:48:36.216912 run osmo-msc_10.42.42.6: Starting osmo-msc 11:48:36.781834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1807): Launched 11:48:37.096396 run osmo-msc_10.42.42.6(pid=1808): Launched 11:48:37.271391 run osmo-stp_10.42.42.5(pid=1805): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1805)] 11:48:37.413406 run osmo-stp_10.42.42.5(pid=1805): stdout: | (launched: 2022-12-09_11:48:36.041289) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:37.556089 run osmo-stp_10.42.42.5(pid=1805): stderr: | 20221209114836214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114836214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114836215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114836215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114836216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114836216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114836216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:37.695785 run osmo-stp_10.42.42.5(pid=1805): stdout: | (launched: 2022-12-09_11:48:36.041289) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:37.828529 run osmo-stp_10.42.42.5(pid=1805): stderr: | 20221209114836214 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114836214 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114836215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114836215 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114836216 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114836216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114836216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:37.987545 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1805): Process ended prematurely: osmo-stp_10.42.42.5(pid=1805) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1805)] [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 11:48:37.997609 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:48:38.027112 run osmo-hlr_10.42.42.2(pid=1802): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1802)] 11:48:38.078844 run osmo-hlr_10.42.42.2(pid=1802): stdout: | (launched: 2022-12-09_11:48:35.053416) 11:48:38.131916 run osmo-hlr_10.42.42.2(pid=1802): stderr: | 20221209114835230 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114835230 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114835230 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114835230 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114835230 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114835230 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114835243 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114835251 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114835251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114835251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:48:38.205729 run osmo-msc_10.42.42.6(pid=1808): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1808)] 11:48:38.257363 run osmo-msc_10.42.42.6(pid=1808): stdout: | (launched: 2022-12-09_11:48:37.038414) 11:48:38.310686 run osmo-msc_10.42.42.6(pid=1808): stderr: | 20221209114837312 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209114837312 DLGLOBAL DEBUG validating counter group 0x7fdba4deac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209114837312 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209114837312 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209114837312 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209114837312 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209114837314 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209114837314 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209114837315 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209114837315 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:48:38.364741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1801): Terminating (SIGTERM) 11:48:38.407902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1804): Terminating (SIGTERM) 11:48:38.450991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1807): Terminating (SIGTERM) 11:48:38.494325 --- ParallelTerminationStrategy: PID 1801 died... 11:48:38.514954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1801): Terminated: ok {rc=0} 11:48:38.562983 --- ParallelTerminationStrategy: PID 1804 died... 11:48:38.582999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1804): Terminated: ok {rc=0} 11:48:38.630752 --- ParallelTerminationStrategy: PID 1807 died... 11:48:38.651210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1807): Terminated: ok {rc=0} 11:48:38.742503 bus /sierra_3: Setting Powered False 11:48:39.840363 bus /sierra_3: Setting Powered False 11:48:40.958835 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 11:48:42.110923 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:48:42.123645 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:48:42.199791 tst mo_mt_call_osmux.py: using LAC 21255 11:48:42.322979 tst mo_mt_call_osmux.py: using RAC 90 11:48:42.445148 tst mo_mt_call_osmux.py: using CellId 21255 11:48:42.570699 tst mo_mt_call_osmux.py: using BVCI 21256 11:48:42.685579 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:48:42.696874 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:48:42.708074 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:48:42.719105 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:48:42.730197 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:48:42.741226 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:48:42.861559 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:48:42.989151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:48:43.503528 run create_hlr_db(pid=1810): Launched 11:48:43.631175 bus /sierra_2: Setting Powered False 11:48:44.696143 run create_hlr_db(pid=1810): Terminated: ok {rc=0} 11:48:45.142364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1812): Launched 11:48:45.454544 run osmo-hlr_10.42.42.2(pid=1813): Launched 11:48:45.573736 run osmo-stp_10.42.42.5: Starting osmo-stp 11:48:46.133664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1816): Launched 11:48:46.469742 run osmo-stp_10.42.42.5(pid=1817): Launched 11:48:46.717274 run osmo-msc_10.42.42.6: Starting osmo-msc 11:48:47.438289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1820): Launched 11:48:47.772698 run osmo-msc_10.42.42.6(pid=1821): Launched 11:48:47.958142 run osmo-stp_10.42.42.5(pid=1817): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1817)] 11:48:48.098564 run osmo-stp_10.42.42.5(pid=1817): stdout: | (launched: 2022-12-09_11:48:46.397189) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:48.239259 run osmo-stp_10.42.42.5(pid=1817): stderr: | 20221209114846709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114846709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114846710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114846710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114846710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114846711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114846711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:48.379389 run osmo-stp_10.42.42.5(pid=1817): stdout: | (launched: 2022-12-09_11:48:46.397189) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:48.511766 run osmo-stp_10.42.42.5(pid=1817): stderr: | 20221209114846709 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114846709 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114846710 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114846710 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114846710 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114846711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114846711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:48.670470 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1817): Process ended prematurely: osmo-stp_10.42.42.5(pid=1817) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1817)] [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 11:48:48.680309 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 11:48:48.709516 run osmo-hlr_10.42.42.2(pid=1813): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1813)] 11:48:48.760787 run osmo-hlr_10.42.42.2(pid=1813): stdout: | (launched: 2022-12-09_11:48:45.396798) 11:48:48.814077 run osmo-hlr_10.42.42.2(pid=1813): stderr: | 20221209114845574 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114845574 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114845574 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114845575 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114845575 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114845575 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114845587 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114845596 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114845597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114845597 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:48:48.887823 run osmo-msc_10.42.42.6(pid=1821): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1821)] 11:48:48.938954 run osmo-msc_10.42.42.6(pid=1821): stdout: | (launched: 2022-12-09_11:48:47.711134) 11:48:48.991870 run osmo-msc_10.42.42.6(pid=1821): stderr: | 20221209114848037 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209114848037 DLGLOBAL DEBUG validating counter group 0x7f99597cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209114848037 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209114848037 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209114848037 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209114848038 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209114848039 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209114848040 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209114848040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209114848040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:48:49.045450 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1812): Terminating (SIGTERM) 11:48:49.088190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1816): Terminating (SIGTERM) 11:48:49.130958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1820): Terminating (SIGTERM) 11:48:49.173668 --- ParallelTerminationStrategy: PID 1812 died... 11:48:49.193751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1812): Terminated: ok {rc=0} 11:48:49.241332 --- ParallelTerminationStrategy: PID 1816 died... 11:48:49.261201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1816): Terminated: ok {rc=0} 11:48:49.309088 --- ParallelTerminationStrategy: PID 1820 died... 11:48:49.328869 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1820): Terminated: ok {rc=0} 11:48:49.418237 bus /sierra_3: Setting Powered False 11:48:50.517927 bus /sierra_3: Setting Powered False 11:48:51.634493 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 11:48:52.893496 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:48:52.898473 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 11:48:52.934779 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 11:48:52.962794 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 11:48:53.049770 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 11:48:53.085305 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 11:48:53.113544 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 11:48:53.699469 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2359 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 11:48:53.705211 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:48:53.716640 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:48:53.770490 tst emergency_mo_mt_call.py: using LAC 21256 11:48:53.899083 tst emergency_mo_mt_call.py: using RAC 91 11:48:54.030786 tst emergency_mo_mt_call.py: using CellId 21256 11:48:54.160348 tst emergency_mo_mt_call.py: using BVCI 21257 11:48:54.278611 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:48:54.290054 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:48:54.301308 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:48:54.313394 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:48:54.325517 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:48:54.337218 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:48:54.458354 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:48:54.581398 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:48:55.085582 run create_hlr_db(pid=1826): Launched 11:48:55.210902 bus /sierra_2: Setting Powered False 11:48:56.275926 run create_hlr_db(pid=1826): Terminated: ok {rc=0} 11:48:56.733441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1828): Launched 11:48:57.061871 run osmo-hlr_10.42.42.2(pid=1829): Launched 11:48:57.186636 run osmo-stp_10.42.42.5: Starting osmo-stp 11:48:57.752709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1831): Launched 11:48:58.079925 run osmo-stp_10.42.42.5(pid=1832): Launched 11:48:58.214903 tst emergency_mo_mt_call.py: using MSISDN 7193 11:48:58.388063 run osmo-msc_10.42.42.6: Starting osmo-msc 11:48:58.975482 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1834): Launched 11:48:59.301594 run osmo-msc_10.42.42.6(pid=1835): Launched 11:48:59.485260 run osmo-stp_10.42.42.5(pid=1832): ERR: Terminated: ERROR {rc=1} [trial-2359↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1832)] 11:48:59.623588 run osmo-stp_10.42.42.5(pid=1832): stdout: | (launched: 2022-12-09_11:48:58.019943) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:48:59.762303 run osmo-stp_10.42.42.5(pid=1832): stderr: | 20221209114858215 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114858215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114858215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114858216 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114858218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114858218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114858218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:48:59.899975 run osmo-stp_10.42.42.5(pid=1832): stdout: | (launched: 2022-12-09_11:48:58.019943) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:00.030224 run osmo-stp_10.42.42.5(pid=1832): stderr: | 20221209114858215 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114858215 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114858215 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114858216 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114858218 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114858218 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114858218 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:00.186184 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=1832): Process ended prematurely: osmo-stp_10.42.42.5(pid=1832) [trial-2359↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1832)] [trial-2359↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 11:49:00.195431 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 11:49:00.223892 run osmo-hlr_10.42.42.2(pid=1829): ERR: Terminated: ERROR {rc=237} [trial-2359↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1829)] 11:49:00.275225 run osmo-hlr_10.42.42.2(pid=1829): stdout: | (launched: 2022-12-09_11:48:57.001589) 11:49:00.328766 run osmo-hlr_10.42.42.2(pid=1829): stderr: | 20221209114857202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114857202 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114857202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114857202 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114857202 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114857202 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114857213 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114857222 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114857222 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114857222 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:49:00.402601 run osmo-msc_10.42.42.6(pid=1835): ERR: Terminated: ERROR {rc=2} [trial-2359↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1835)] 11:49:00.454242 run osmo-msc_10.42.42.6(pid=1835): stdout: | (launched: 2022-12-09_11:48:59.241481) 11:49:00.507401 run osmo-msc_10.42.42.6(pid=1835): stderr: | 20221209114859566 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209114859566 DLGLOBAL DEBUG validating counter group 0x7f60459f4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209114859567 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209114859567 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209114859567 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209114859567 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209114859569 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209114859569 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209114859569 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209114859569 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:49:00.561051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1828): Terminating (SIGTERM) 11:49:00.603940 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1831): Terminating (SIGTERM) 11:49:00.646870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1834): Terminating (SIGTERM) 11:49:00.689972 --- ParallelTerminationStrategy: PID 1828 died... 11:49:00.710378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1828): Terminated: ok {rc=0} 11:49:00.758059 --- ParallelTerminationStrategy: PID 1831 died... 11:49:00.778017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1831): Terminated: ok {rc=0} 11:49:00.825300 --- ParallelTerminationStrategy: PID 1834 died... 11:49:00.854120 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1834): Terminated: ok {rc=0} 11:49:00.969285 bus /sierra_3: Setting Powered False 11:49:02.078440 bus /sierra_3: Setting Powered False 11:49:03.214147 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 11:49:04.303213 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:49:04.314993 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:49:04.367549 tst emergency_preemptive_call.py: using LAC 21257 11:49:04.493419 tst emergency_preemptive_call.py: using RAC 92 11:49:04.613480 tst emergency_preemptive_call.py: using CellId 21257 11:49:04.734532 tst emergency_preemptive_call.py: using BVCI 21258 11:49:04.844407 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:49:04.855760 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:49:04.866786 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:49:04.877969 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:49:04.889094 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 11:49:04.900100 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:49:05.021502 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:49:05.141685 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:49:05.263833 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:49:05.382852 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:49:05.858518 run create_hlr_db(pid=1837): Launched 11:49:05.983828 bus /sierra_2: Setting Powered False 11:49:07.044467 run create_hlr_db(pid=1837): Terminated: ok {rc=0} 11:49:07.494367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1839): Launched 11:49:07.822253 run osmo-hlr_10.42.42.2(pid=1840): Launched 11:49:07.946916 run osmo-stp_10.42.42.5: Starting osmo-stp 11:49:08.515803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1842): Launched 11:49:08.843563 run osmo-stp_10.42.42.5(pid=1843): Launched 11:49:08.977842 tst emergency_preemptive_call.py: using MSISDN 7194 11:49:09.146830 run osmo-msc_10.42.42.6: Starting osmo-msc 11:49:09.737642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1845): Launched 11:49:10.066650 run osmo-msc_10.42.42.6(pid=1846): Launched 11:49:10.251362 run osmo-stp_10.42.42.5(pid=1843): ERR: Terminated: ERROR {rc=1} [trial-2359↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1843)] 11:49:10.390356 run osmo-stp_10.42.42.5(pid=1843): stdout: | (launched: 2022-12-09_11:49:08.783494) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:10.528713 run osmo-stp_10.42.42.5(pid=1843): stderr: | 20221209114908976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114908976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114908976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114908977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114908977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114908977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114908977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:10.666246 run osmo-stp_10.42.42.5(pid=1843): stdout: | (launched: 2022-12-09_11:49:08.783494) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:10.796554 run osmo-stp_10.42.42.5(pid=1843): stderr: | 20221209114908976 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114908976 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114908976 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114908977 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114908977 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114908977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114908977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:10.952529 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=1843): Process ended prematurely: osmo-stp_10.42.42.5(pid=1843) [trial-2359↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1843)] [trial-2359↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 11:49:10.961700 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 11:49:10.990413 run osmo-hlr_10.42.42.2(pid=1840): ERR: Terminated: ERROR {rc=237} [trial-2359↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1840)] 11:49:11.041819 run osmo-hlr_10.42.42.2(pid=1840): stdout: | (launched: 2022-12-09_11:49:07.762103) 11:49:11.095117 run osmo-hlr_10.42.42.2(pid=1840): stderr: | 20221209114907962 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114907962 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114907962 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114907962 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114907962 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114907962 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114907974 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114907982 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114907982 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114907983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:49:11.169040 run osmo-msc_10.42.42.6(pid=1846): ERR: Terminated: ERROR {rc=2} [trial-2359↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=1846)] 11:49:11.220193 run osmo-msc_10.42.42.6(pid=1846): stdout: | (launched: 2022-12-09_11:49:10.006346) 11:49:11.273324 run osmo-msc_10.42.42.6(pid=1846): stderr: | 20221209114910327 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209114910327 DLGLOBAL DEBUG validating counter group 0x7f0b4f8bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209114910327 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209114910327 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209114910327 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209114910328 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209114910329 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209114910330 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209114910330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209114910330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:49:11.327293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1839): Terminating (SIGTERM) 11:49:11.370261 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1842): Terminating (SIGTERM) 11:49:11.412857 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1845): Terminating (SIGTERM) 11:49:11.455919 --- ParallelTerminationStrategy: PID 1839 died... 11:49:11.476085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1839): Terminated: ok {rc=0} 11:49:11.523617 --- ParallelTerminationStrategy: PID 1842 died... 11:49:11.543547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1842): Terminated: ok {rc=0} 11:49:11.590732 --- ParallelTerminationStrategy: PID 1845 died... 11:49:11.610658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=1845): Terminated: ok {rc=0} 11:49:11.701557 bus /sierra_9: Setting Powered False 11:49:12.800050 bus /sierra_9: Setting Powered False 11:49:13.917783 bus /sierra_8: Setting Powered False 11:49:15.017638 bus /sierra_8: Setting Powered False 11:49:16.133229 bus /sierra_3: Setting Powered False 11:49:17.235534 bus /sierra_3: Setting Powered False 11:49:18.353489 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 11:49:19.638413 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:49:19.642703 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 11:49:19.676665 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 11:49:19.715043 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 11:49:19.801496 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 11:49:19.834971 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 11:49:19.873028 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 11:49:20.465944 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 11:49:20.516236 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:20.527047 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:49:20.577193 tst cs_paging_gprs_active.py: using LAC 21258 11:49:20.700085 tst cs_paging_gprs_active.py: using RAC 93 11:49:20.824273 tst cs_paging_gprs_active.py: using CellId 21258 11:49:20.948287 tst cs_paging_gprs_active.py: using BVCI 21259 11:49:21.062963 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:21.073901 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:21.084556 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:21.095352 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:21.106079 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:21.116635 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:21.127381 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:21.137955 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:21.148634 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:49:21.269465 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:49:21.393800 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:49:21.619840 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:21.955258 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1851): Launched 11:49:22.246756 run iperf3-srv_10.42.42.10(pid=1852): Launched 11:49:22.373258 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:49:22.598309 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:22.933924 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1853): Launched 11:49:23.225530 run iperf3-srv_10.42.42.10(pid=1854): Launched 11:49:23.353049 tst cs_paging_gprs_active.py:38: start network... 11:49:23.579314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:49:24.099827 run create_hlr_db(pid=1855): Launched 11:49:24.228899 bus /sierra_2: Setting Powered False 11:49:25.291061 run create_hlr_db(pid=1855): Terminated: ok {rc=0} 11:49:25.757440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1857): Launched 11:49:26.094732 run osmo-hlr_10.42.42.2(pid=1858): Launched 11:49:26.222896 run osmo-stp_10.42.42.5: Starting osmo-stp 11:49:26.800876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1860): Launched 11:49:27.135891 run osmo-stp_10.42.42.5(pid=1861): Launched 11:49:27.264066 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:49:27.840619 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1863): Launched 11:49:27.969124 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:49:28.252771 run patchelf(pid=1864): Launched 11:49:28.440670 run osmo-stp_10.42.42.5(pid=1861): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1861)] 11:49:28.582394 run osmo-stp_10.42.42.5(pid=1861): stdout: | (launched: 2022-12-09_11:49:27.074749) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:28.725044 run osmo-stp_10.42.42.5(pid=1861): stderr: | 20221209114927267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114927268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114927268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114927268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114927269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114927269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114927269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:28.867954 run osmo-stp_10.42.42.5(pid=1861): stdout: | (launched: 2022-12-09_11:49:27.074749) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:29.005941 run osmo-stp_10.42.42.5(pid=1861): stderr: | 20221209114927267 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114927268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114927268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114927268 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114927269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114927269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114927269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:29.168379 run patchelf(pid=1864): Terminating (SIGINT) 11:49:29.358573 run patchelf(pid=1864): Terminated: ok {rc=0} 11:49:29.494499 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1861): Process ended prematurely: osmo-stp_10.42.42.5(pid=1861) [trial-2359↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1861)] [trial-2359↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 11:49:29.504799 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 11:49:29.534673 run osmo-hlr_10.42.42.2(pid=1858): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1858)] 11:49:29.585963 run osmo-hlr_10.42.42.2(pid=1858): stdout: | (launched: 2022-12-09_11:49:26.032694) 11:49:29.638965 run osmo-hlr_10.42.42.2(pid=1858): stderr: | 20221209114926235 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114926235 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114926235 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114926235 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114926235 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114926235 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114926248 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114926258 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114926258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114926258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:49:29.692737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1851): Terminating (SIGTERM) 11:49:29.735883 run iperf3-srv_10.42.42.10(pid=1852): Terminating (SIGTERM) 11:49:29.778805 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1853): Terminating (SIGTERM) 11:49:29.821851 run iperf3-srv_10.42.42.10(pid=1854): Terminating (SIGTERM) 11:49:29.864575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1857): Terminating (SIGTERM) 11:49:29.907899 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1860): Terminating (SIGTERM) 11:49:29.950838 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1863): Terminating (SIGTERM) 11:49:29.993745 --- ParallelTerminationStrategy: PID 1851 died... 11:49:30.014086 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1851): Terminated: ok {rc=0} 11:49:30.062007 --- ParallelTerminationStrategy: PID 1852 died... 11:49:30.081919 run iperf3-srv_10.42.42.10(pid=1852): Terminated {rc=256} 11:49:30.129248 --- ParallelTerminationStrategy: PID 1853 died... 11:49:30.149193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1853): Terminated: ok {rc=0} 11:49:30.196746 --- ParallelTerminationStrategy: PID 1854 died... 11:49:30.216633 run iperf3-srv_10.42.42.10(pid=1854): Terminated {rc=256} 11:49:30.264011 --- ParallelTerminationStrategy: PID 1857 died... 11:49:30.284152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1857): Terminated: ok {rc=0} 11:49:30.332303 --- ParallelTerminationStrategy: PID 1860 died... 11:49:30.352408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1860): Terminated: ok {rc=0} 11:49:30.400147 --- ParallelTerminationStrategy: PID 1863 died... 11:49:30.420252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1863): Terminated: ok {rc=0} 11:49:30.510757 bus /gobi_0: Setting Powered False 11:49:31.616754 bus /gobi_0: Setting Powered False 11:49:32.740551 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 11:49:33.893354 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:33.905608 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:49:33.961227 tst iperf3.py: using LAC 21259 11:49:34.092432 tst iperf3.py: using RAC 94 11:49:34.229475 tst iperf3.py: using CellId 21259 11:49:34.358789 tst iperf3.py: using BVCI 21260 11:49:34.480377 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:34.492010 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:34.503279 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:34.514837 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:34.526586 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:34.538270 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:34.550261 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:34.561734 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:34.573484 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:49:34.692872 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:49:34.903053 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:35.218596 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1865): Launched 11:49:35.491276 run iperf3-srv_10.42.42.10(pid=1866): Launched 11:49:35.608712 tst iperf3.py:8: start network... 11:49:35.816696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:49:36.299852 run create_hlr_db(pid=1867): Launched 11:49:36.429198 bus /gobi_6: Setting Powered False 11:49:37.490783 run create_hlr_db(pid=1867): Terminated: ok {rc=0} 11:49:37.926325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1869): Launched 11:49:38.240304 run osmo-hlr_10.42.42.2(pid=1870): Launched 11:49:38.359081 run osmo-stp_10.42.42.5: Starting osmo-stp 11:49:38.897363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1872): Launched 11:49:39.213667 run osmo-stp_10.42.42.5(pid=1873): Launched 11:49:39.334580 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:49:39.876923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1875): Launched 11:49:39.997809 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:49:40.261451 run patchelf(pid=1876): Launched 11:49:40.436433 run osmo-stp_10.42.42.5(pid=1873): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1873)] 11:49:40.568493 run osmo-stp_10.42.42.5(pid=1873): stdout: | (launched: 2022-12-09_11:49:39.155453) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:40.702183 run osmo-stp_10.42.42.5(pid=1873): stderr: | 20221209114939329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114939329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114939329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114939329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114939330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114939330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114939330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:40.835479 run osmo-stp_10.42.42.5(pid=1873): stdout: | (launched: 2022-12-09_11:49:39.155453) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:40.963297 run osmo-stp_10.42.42.5(pid=1873): stderr: | 20221209114939329 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114939329 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114939329 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114939329 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114939330 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114939330 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114939330 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:41.115682 run patchelf(pid=1876): Terminating (SIGINT) 11:49:41.291918 run patchelf(pid=1876): Terminated: ok {rc=0} 11:49:41.419772 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1873): Process ended prematurely: osmo-stp_10.42.42.5(pid=1873) [trial-2359↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1873)] [trial-2359↪gprs:trx-sysmocell5000↪iperf3.py:8] 11:49:41.429698 tst iperf3.py:8: Test FAILED (7.6 sec) 11:49:41.457138 run osmo-hlr_10.42.42.2(pid=1870): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1870)] 11:49:41.505404 run osmo-hlr_10.42.42.2(pid=1870): stdout: | (launched: 2022-12-09_11:49:38.181814) 11:49:41.555554 run osmo-hlr_10.42.42.2(pid=1870): stderr: | 20221209114938359 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114938359 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114938359 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114938359 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114938359 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114938359 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114938385 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114938394 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114938395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114938395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:49:41.605832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1865): Terminating (SIGTERM) 11:49:41.646096 run iperf3-srv_10.42.42.10(pid=1866): Terminating (SIGTERM) 11:49:41.686216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1869): Terminating (SIGTERM) 11:49:41.726369 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1872): Terminating (SIGTERM) 11:49:41.766456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1875): Terminating (SIGTERM) 11:49:41.806968 --- ParallelTerminationStrategy: PID 1865 died... 11:49:41.825896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1865): Terminated: ok {rc=0} 11:49:41.869986 --- ParallelTerminationStrategy: PID 1866 died... 11:49:41.889064 run iperf3-srv_10.42.42.10(pid=1866): Terminated {rc=256} 11:49:41.933382 --- ParallelTerminationStrategy: PID 1869 died... 11:49:41.952083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1869): Terminated: ok {rc=0} 11:49:41.996340 --- ParallelTerminationStrategy: PID 1872 died... 11:49:42.015303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1872): Terminated: ok {rc=0} 11:49:42.059747 --- ParallelTerminationStrategy: PID 1875 died... 11:49:42.078813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1875): Terminated: ok {rc=0} 11:49:42.163300 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 11:49:43.315085 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:43.327215 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:49:43.379960 tst iperf3m4.py: using LAC 21260 11:49:43.512190 tst iperf3m4.py: using RAC 95 11:49:43.644301 tst iperf3m4.py: using CellId 21260 11:49:43.773739 tst iperf3m4.py: using BVCI 21261 11:49:43.894797 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:43.906174 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:43.917271 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:43.928584 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:43.939862 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:43.951097 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:43.962785 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:43.974179 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:49:43.985680 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:49:44.110287 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:49:44.235685 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:49:44.354911 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:49:44.475980 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:49:44.700627 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:45.035003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1877): Launched 11:49:45.325959 run iperf3-srv_10.42.42.10(pid=1878): Launched 11:49:45.452401 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:49:45.675954 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:46.038214 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1879): Launched 11:49:46.353730 run iperf3-srv_10.42.42.10(pid=1880): Launched 11:49:46.487548 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:49:46.716719 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:47.059796 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1881): Launched 11:49:47.363539 run iperf3-srv_10.42.42.10(pid=1882): Launched 11:49:47.488872 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:49:47.713052 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:49:48.046519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1883): Launched 11:49:48.336715 run iperf3-srv_10.42.42.10(pid=1884): Launched 11:49:48.463133 tst iperf3m4.py:8: start network... 11:49:48.687880 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:49:49.205712 run create_hlr_db(pid=1885): Launched 11:49:49.333778 bus /gobi_6: Setting Powered False 11:49:50.399517 run create_hlr_db(pid=1885): Terminated: ok {rc=0} 11:49:50.862380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1887): Launched 11:49:51.196701 run osmo-hlr_10.42.42.2(pid=1888): Launched 11:49:51.324656 run osmo-stp_10.42.42.5: Starting osmo-stp 11:49:51.898896 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1890): Launched 11:49:52.233456 run osmo-stp_10.42.42.5(pid=1891): Launched 11:49:52.362382 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:49:52.940077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1893): Launched 11:49:53.067801 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:49:53.350062 run patchelf(pid=1894): Launched 11:49:53.536086 run osmo-stp_10.42.42.5(pid=1891): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1891)] 11:49:53.676810 run osmo-stp_10.42.42.5(pid=1891): stdout: | (launched: 2022-12-09_11:49:52.171816) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:53.819090 run osmo-stp_10.42.42.5(pid=1891): stderr: | 20221209114952363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114952364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114952364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114952364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114952365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114952365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114952365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:53.961151 run osmo-stp_10.42.42.5(pid=1891): stdout: | (launched: 2022-12-09_11:49:52.171816) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:49:54.097502 run osmo-stp_10.42.42.5(pid=1891): stderr: | 20221209114952363 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209114952364 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209114952364 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209114952364 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209114952365 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209114952365 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209114952365 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:49:54.258860 run patchelf(pid=1894): Terminating (SIGINT) 11:49:54.446957 run patchelf(pid=1894): Terminated: ok {rc=0} 11:49:54.582352 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1891): Process ended prematurely: osmo-stp_10.42.42.5(pid=1891) [trial-2359↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1891)] [trial-2359↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 11:49:54.592666 tst iperf3m4.py:8: Test FAILED (11.3 sec) 11:49:54.622471 run osmo-hlr_10.42.42.2(pid=1888): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1888)] 11:49:54.673509 run osmo-hlr_10.42.42.2(pid=1888): stdout: | (launched: 2022-12-09_11:49:51.135186) 11:49:54.726255 run osmo-hlr_10.42.42.2(pid=1888): stderr: | 20221209114951333 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209114951333 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209114951333 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209114951333 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209114951333 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209114951333 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209114951346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209114951354 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209114951355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209114951355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:49:54.778972 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1877): Terminating (SIGTERM) 11:49:54.821535 run iperf3-srv_10.42.42.10(pid=1878): Terminating (SIGTERM) 11:49:54.864089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1879): Terminating (SIGTERM) 11:49:54.906920 run iperf3-srv_10.42.42.10(pid=1880): Terminating (SIGTERM) 11:49:54.950588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1881): Terminating (SIGTERM) 11:49:54.993657 run iperf3-srv_10.42.42.10(pid=1882): Terminating (SIGTERM) 11:49:55.035999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1883): Terminating (SIGTERM) 11:49:55.078704 run iperf3-srv_10.42.42.10(pid=1884): Terminating (SIGTERM) 11:49:55.121147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1887): Terminating (SIGTERM) 11:49:55.163875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1890): Terminating (SIGTERM) 11:49:55.206547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1893): Terminating (SIGTERM) 11:49:55.249489 --- ParallelTerminationStrategy: PID 1877 died... 11:49:55.269661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1877): Terminated: ok {rc=0} 11:49:55.317281 --- ParallelTerminationStrategy: PID 1878 died... 11:49:55.337113 run iperf3-srv_10.42.42.10(pid=1878): Terminated {rc=256} 11:49:55.384361 --- ParallelTerminationStrategy: PID 1879 died... 11:49:55.404361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1879): Terminated: ok {rc=0} 11:49:55.451732 --- ParallelTerminationStrategy: PID 1880 died... 11:49:55.471785 run iperf3-srv_10.42.42.10(pid=1880): Terminated {rc=256} 11:49:55.519268 --- ParallelTerminationStrategy: PID 1881 died... 11:49:55.539264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1881): Terminated: ok {rc=0} 11:49:55.586650 --- ParallelTerminationStrategy: PID 1882 died... 11:49:55.606601 run iperf3-srv_10.42.42.10(pid=1882): Terminated {rc=256} 11:49:55.654207 --- ParallelTerminationStrategy: PID 1883 died... 11:49:55.674250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1883): Terminated: ok {rc=0} 11:49:55.721683 --- ParallelTerminationStrategy: PID 1884 died... 11:49:55.741642 run iperf3-srv_10.42.42.10(pid=1884): Terminated {rc=256} 11:49:55.789206 --- ParallelTerminationStrategy: PID 1887 died... 11:49:55.809336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1887): Terminated: ok {rc=0} 11:49:55.857360 --- ParallelTerminationStrategy: PID 1890 died... 11:49:55.877447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1890): Terminated: ok {rc=0} 11:49:55.924858 --- ParallelTerminationStrategy: PID 1893 died... 11:49:55.945283 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1893): Terminated: ok {rc=0} 11:49:56.036471 bus /gobi_4: Setting Powered False 11:49:57.137991 bus /gobi_4: Setting Powered False 11:49:58.254483 bus /gobi_1: Setting Powered False 11:49:59.354730 bus /gobi_1: Setting Powered False 11:50:00.473622 bus /gobi_0: Setting Powered False 11:50:01.578543 bus /gobi_0: Setting Powered False 11:50:02.716220 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 11:50:03.824459 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:50:03.836662 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:50:03.892891 tst ping.py: using LAC 21261 11:50:04.020178 tst ping.py: using RAC 96 11:50:04.145900 tst ping.py: using CellId 21261 11:50:04.272196 tst ping.py: using BVCI 21262 11:50:04.386023 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:50:04.396871 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:50:04.407793 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:50:04.419205 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:50:04.430501 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:50:04.441925 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:50:04.453681 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:50:04.465140 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:50:04.583761 tst ping.py:19: start network... 11:50:04.805770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:50:05.310609 run create_hlr_db(pid=1899): Launched 11:50:05.435904 bus /gobi_6: Setting Powered False 11:50:06.501191 run create_hlr_db(pid=1899): Terminated: ok {rc=0} 11:50:06.955213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1901): Launched 11:50:07.281675 run osmo-hlr_10.42.42.2(pid=1902): Launched 11:50:07.408066 run osmo-stp_10.42.42.5: Starting osmo-stp 11:50:07.946599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1904): Launched 11:50:08.253427 run osmo-stp_10.42.42.5(pid=1905): Launched 11:50:08.370153 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:50:08.899395 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1907): Launched 11:50:09.017462 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:50:09.276721 run patchelf(pid=1908): Launched 11:50:09.447982 run osmo-stp_10.42.42.5(pid=1905): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1905)] 11:50:09.578404 run osmo-stp_10.42.42.5(pid=1905): stdout: | (launched: 2022-12-09_11:50:08.196439) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:09.709838 run osmo-stp_10.42.42.5(pid=1905): stderr: | 20221209115008366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115008366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115008367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115008367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115008369 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115008370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115008370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:09.841208 run osmo-stp_10.42.42.5(pid=1905): stdout: | (launched: 2022-12-09_11:50:08.196439) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:09.966692 run osmo-stp_10.42.42.5(pid=1905): stderr: | 20221209115008366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115008366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115008367 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115008367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115008369 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115008370 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115008370 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:10.115308 run patchelf(pid=1908): Terminating (SIGINT) 11:50:10.288020 run patchelf(pid=1908): Terminated: ok {rc=0} 11:50:10.413521 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1905): Process ended prematurely: osmo-stp_10.42.42.5(pid=1905) [trial-2359↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1905)] [trial-2359↪gprs:trx-sysmocell5000↪ping.py:22] 11:50:10.422763 tst ping.py:22: Test FAILED (6.6 sec) 11:50:10.450073 run osmo-hlr_10.42.42.2(pid=1902): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1902)] 11:50:10.499021 run osmo-hlr_10.42.42.2(pid=1902): stdout: | (launched: 2022-12-09_11:50:07.221425) 11:50:10.549425 run osmo-hlr_10.42.42.2(pid=1902): stderr: | 20221209115007421 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115007422 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115007422 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115007422 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115007422 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115007422 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115007435 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115007445 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115007445 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115007445 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:50:10.600139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1901): Terminating (SIGTERM) 11:50:10.640697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1904): Terminating (SIGTERM) 11:50:10.681203 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1907): Terminating (SIGTERM) 11:50:10.721894 --- ParallelTerminationStrategy: PID 1901 died... 11:50:10.741398 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1901): Terminated: ok {rc=0} 11:50:10.786551 --- ParallelTerminationStrategy: PID 1904 died... 11:50:10.805834 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1904): Terminated: ok {rc=0} 11:50:10.850852 --- ParallelTerminationStrategy: PID 1907 died... 11:50:10.869863 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1907): Terminated: ok {rc=0} 11:50:10.958145 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 11:50:12.047774 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:50:12.059692 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 11:50:12.111139 tst ping_idle_ping.py: using LAC 21262 11:50:12.234243 tst ping_idle_ping.py: using RAC 97 11:50:12.356901 tst ping_idle_ping.py: using CellId 21262 11:50:12.477385 tst ping_idle_ping.py: using BVCI 21263 11:50:12.588300 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:50:12.599401 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:50:12.610141 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:50:12.620855 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:50:12.631524 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:50:12.642262 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:50:12.653017 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 11:50:12.663807 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 11:50:12.783997 tst ping_idle_ping.py:24: start network... 11:50:13.005612 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:50:13.515021 run create_hlr_db(pid=1910): Launched 11:50:13.641085 bus /gobi_6: Setting Powered False 11:50:14.706334 run create_hlr_db(pid=1910): Terminated: ok {rc=0} 11:50:15.146955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1912): Launched 11:50:15.457286 run osmo-hlr_10.42.42.2(pid=1913): Launched 11:50:15.575573 run osmo-stp_10.42.42.5: Starting osmo-stp 11:50:16.150603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1915): Launched 11:50:16.477436 run osmo-stp_10.42.42.5(pid=1916): Launched 11:50:16.708880 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:50:17.373170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1918): Launched 11:50:17.495884 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:50:17.755190 run patchelf(pid=1919): Launched 11:50:17.926368 run osmo-stp_10.42.42.5(pid=1916): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1916)] 11:50:18.056265 run osmo-stp_10.42.42.5(pid=1916): stdout: | (launched: 2022-12-09_11:50:16.419869) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:18.187036 run osmo-stp_10.42.42.5(pid=1916): stderr: | 20221209115016600 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115016601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115016601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115016601 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115016604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115016604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115016604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:18.317648 run osmo-stp_10.42.42.5(pid=1916): stdout: | (launched: 2022-12-09_11:50:16.419869) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:18.442714 run osmo-stp_10.42.42.5(pid=1916): stderr: | 20221209115016600 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115016601 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115016601 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115016601 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115016604 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115016604 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115016604 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:18.590251 run patchelf(pid=1919): Terminating (SIGINT) 11:50:18.762821 run patchelf(pid=1919): Terminated: ok {rc=0} 11:50:18.887244 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1916): Process ended prematurely: osmo-stp_10.42.42.5(pid=1916) [trial-2359↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1916)] [trial-2359↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 11:50:18.896150 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 11:50:18.923133 run osmo-hlr_10.42.42.2(pid=1913): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1913)] 11:50:18.971071 run osmo-hlr_10.42.42.2(pid=1913): stdout: | (launched: 2022-12-09_11:50:15.400053) 11:50:19.020834 run osmo-hlr_10.42.42.2(pid=1913): stderr: | 20221209115015578 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115015578 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115015578 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115015578 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115015578 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115015578 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115015590 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115015602 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115015602 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115015602 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:50:19.071125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1912): Terminating (SIGTERM) 11:50:19.111250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1915): Terminating (SIGTERM) 11:50:19.151219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1918): Terminating (SIGTERM) 11:50:19.191358 --- ParallelTerminationStrategy: PID 1912 died... 11:50:19.210614 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1912): Terminated: ok {rc=0} 11:50:19.255182 --- ParallelTerminationStrategy: PID 1915 died... 11:50:19.274090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1915): Terminated: ok {rc=0} 11:50:19.318805 --- ParallelTerminationStrategy: PID 1918 died... 11:50:19.337929 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1918): Terminated: ok {rc=0} 11:50:19.424901 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 11:50:20.744471 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:50:20.750235 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:50:20.784408 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:50:20.822809 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:50:20.908710 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:50:20.942038 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:50:20.980045 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:50:21.577921 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:50:21.627980 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:21.639244 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:50:21.689377 tst cs_paging_gprs_active.py: using LAC 21263 11:50:21.810923 tst cs_paging_gprs_active.py: using RAC 98 11:50:21.934254 tst cs_paging_gprs_active.py: using CellId 21263 11:50:22.056936 tst cs_paging_gprs_active.py: using BVCI 21264 11:50:22.171403 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:22.182505 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:22.193306 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:22.204018 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:22.214778 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:22.225536 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:22.236343 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:22.247238 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:22.258395 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:50:22.381895 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:50:22.506244 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:50:22.733737 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:50:23.070594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1923): Launched 11:50:23.363590 run iperf3-srv_10.42.42.10(pid=1924): Launched 11:50:23.490628 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:50:23.717065 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:50:24.053877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1925): Launched 11:50:24.346178 run iperf3-srv_10.42.42.10(pid=1926): Launched 11:50:24.472903 tst cs_paging_gprs_active.py:38: start network... 11:50:24.698324 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:50:25.216754 run create_hlr_db(pid=1927): Launched 11:50:25.345426 bus /gobi_6: Setting Powered False 11:50:26.407369 run create_hlr_db(pid=1927): Terminated: ok {rc=0} 11:50:26.855022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1931): Launched 11:50:27.169508 run osmo-hlr_10.42.42.2(pid=1932): Launched 11:50:27.290476 run osmo-stp_10.42.42.5: Starting osmo-stp 11:50:27.846364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1934): Launched 11:50:28.160205 run osmo-stp_10.42.42.5(pid=1935): Launched 11:50:28.279595 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:50:28.819048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1937): Launched 11:50:28.939292 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:50:29.205311 run patchelf(pid=1938): Launched 11:50:29.380446 run osmo-stp_10.42.42.5(pid=1935): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1935)] 11:50:29.513485 run osmo-stp_10.42.42.5(pid=1935): stdout: | (launched: 2022-12-09_11:50:28.101751) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:29.646936 run osmo-stp_10.42.42.5(pid=1935): stderr: | 20221209115028274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115028274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115028274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115028275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115028275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115028275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115028275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:29.780370 run osmo-stp_10.42.42.5(pid=1935): stdout: | (launched: 2022-12-09_11:50:28.101751) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:29.908653 run osmo-stp_10.42.42.5(pid=1935): stderr: | 20221209115028274 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115028274 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115028274 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115028275 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115028275 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115028275 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115028275 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:30.060710 run patchelf(pid=1938): Terminating (SIGINT) 11:50:30.238184 run patchelf(pid=1938): Terminated: ok {rc=0} 11:50:30.365471 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=1935): Process ended prematurely: osmo-stp_10.42.42.5(pid=1935) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1935)] [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:50:30.375165 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 11:50:30.402911 run osmo-hlr_10.42.42.2(pid=1932): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1932)] 11:50:30.451161 run osmo-hlr_10.42.42.2(pid=1932): stdout: | (launched: 2022-12-09_11:50:27.111341) 11:50:30.501936 run osmo-hlr_10.42.42.2(pid=1932): stderr: | 20221209115027291 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115027291 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115027291 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115027291 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115027291 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115027292 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115027304 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115027312 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115027313 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115027313 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:50:30.552601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1923): Terminating (SIGTERM) 11:50:30.593378 run iperf3-srv_10.42.42.10(pid=1924): Terminating (SIGTERM) 11:50:30.634008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1925): Terminating (SIGTERM) 11:50:30.674810 run iperf3-srv_10.42.42.10(pid=1926): Terminating (SIGTERM) 11:50:30.715367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1931): Terminating (SIGTERM) 11:50:30.755979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1934): Terminating (SIGTERM) 11:50:30.796567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1937): Terminating (SIGTERM) 11:50:30.841551 --- ParallelTerminationStrategy: PID 1923 died... 11:50:30.861952 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1923): Terminated: ok {rc=0} 11:50:30.916525 --- ParallelTerminationStrategy: PID 1924 died... 11:50:30.946128 run iperf3-srv_10.42.42.10(pid=1924): Terminated {rc=256} 11:50:30.996522 --- ParallelTerminationStrategy: PID 1925 died... 11:50:31.017640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1925): Terminated: ok {rc=0} 11:50:31.068345 --- ParallelTerminationStrategy: PID 1926 died... 11:50:31.089376 run iperf3-srv_10.42.42.10(pid=1926): Terminated {rc=256} 11:50:31.140784 --- ParallelTerminationStrategy: PID 1931 died... 11:50:31.161652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1931): Terminated: ok {rc=0} 11:50:31.213296 --- ParallelTerminationStrategy: PID 1934 died... 11:50:31.234348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1934): Terminated: ok {rc=0} 11:50:31.288503 --- ParallelTerminationStrategy: PID 1937 died... 11:50:31.313066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1937): Terminated: ok {rc=0} 11:50:31.421846 bus /gobi_0: Setting Powered False 11:50:32.529365 bus /gobi_0: Setting Powered False 11:50:33.645964 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:50:34.798060 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:34.809981 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:50:34.864574 tst iperf3.py: using LAC 21264 11:50:34.989058 tst iperf3.py: using RAC 99 11:50:35.113095 tst iperf3.py: using CellId 21264 11:50:35.237382 tst iperf3.py: using BVCI 21265 11:50:35.351363 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:35.362696 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:35.373785 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:35.384704 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:35.395613 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:35.406562 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:35.417760 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:35.428541 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:35.440008 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:50:35.562456 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:50:35.788322 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:50:36.123250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1939): Launched 11:50:36.415518 run iperf3-srv_10.42.42.10(pid=1940): Launched 11:50:36.541379 tst iperf3.py:8: start network... 11:50:36.765865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:50:37.282803 run create_hlr_db(pid=1941): Launched 11:50:37.412176 bus /gobi_6: Setting Powered False 11:50:38.474229 run create_hlr_db(pid=1941): Terminated: ok {rc=0} 11:50:38.939175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1943): Launched 11:50:39.273687 run osmo-hlr_10.42.42.2(pid=1944): Launched 11:50:39.404824 run osmo-stp_10.42.42.5: Starting osmo-stp 11:50:39.986368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1946): Launched 11:50:40.321394 run osmo-stp_10.42.42.5(pid=1947): Launched 11:50:40.450625 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:50:41.031578 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1949): Launched 11:50:41.160022 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:50:41.443077 run patchelf(pid=1950): Launched 11:50:41.629418 run osmo-stp_10.42.42.5(pid=1947): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1947)] 11:50:41.770468 run osmo-stp_10.42.42.5(pid=1947): stdout: | (launched: 2022-12-09_11:50:40.259689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:41.912580 run osmo-stp_10.42.42.5(pid=1947): stderr: | 20221209115040453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115040453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115040454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115040454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115040454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115040454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115040454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:42.055016 run osmo-stp_10.42.42.5(pid=1947): stdout: | (launched: 2022-12-09_11:50:40.259689) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:42.191401 run osmo-stp_10.42.42.5(pid=1947): stderr: | 20221209115040453 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115040453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115040454 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115040454 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115040454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115040454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115040454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:42.353169 run patchelf(pid=1950): Terminating (SIGINT) 11:50:42.541358 run patchelf(pid=1950): Terminated: ok {rc=0} 11:50:42.677386 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1947): Process ended prematurely: osmo-stp_10.42.42.5(pid=1947) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1947)] [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 11:50:42.687649 tst iperf3.py:8: Test FAILED (7.9 sec) 11:50:42.717034 run osmo-hlr_10.42.42.2(pid=1944): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1944)] 11:50:42.768581 run osmo-hlr_10.42.42.2(pid=1944): stdout: | (launched: 2022-12-09_11:50:39.212484) 11:50:42.821662 run osmo-hlr_10.42.42.2(pid=1944): stderr: | 20221209115039413 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115039413 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115039413 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115039413 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115039413 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115039413 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115039429 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115039439 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115039439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115039439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:50:42.875311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1939): Terminating (SIGTERM) 11:50:42.918411 run iperf3-srv_10.42.42.10(pid=1940): Terminating (SIGTERM) 11:50:42.961283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1943): Terminating (SIGTERM) 11:50:43.004027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1946): Terminating (SIGTERM) 11:50:43.047015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1949): Terminating (SIGTERM) 11:50:43.090250 --- ParallelTerminationStrategy: PID 1939 died... 11:50:43.110571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1939): Terminated: ok {rc=0} 11:50:43.158287 --- ParallelTerminationStrategy: PID 1940 died... 11:50:43.178236 run iperf3-srv_10.42.42.10(pid=1940): Terminated {rc=256} 11:50:43.225862 --- ParallelTerminationStrategy: PID 1943 died... 11:50:43.245885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1943): Terminated: ok {rc=0} 11:50:43.293789 --- ParallelTerminationStrategy: PID 1946 died... 11:50:43.313852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1946): Terminated: ok {rc=0} 11:50:43.361599 --- ParallelTerminationStrategy: PID 1949 died... 11:50:43.381878 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1949): Terminated: ok {rc=0} 11:50:43.472852 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:50:44.628252 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:44.640462 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:50:44.693757 tst iperf3m4.py: using LAC 21265 11:50:44.825704 tst iperf3m4.py: using RAC 100 11:50:44.949347 tst iperf3m4.py: using CellId 21265 11:50:45.072393 tst iperf3m4.py: using BVCI 21266 11:50:45.188072 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:45.199427 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:45.211146 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:45.222626 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:45.234157 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:45.245604 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:45.257055 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:45.268214 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:50:45.279598 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:50:45.402714 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:50:45.526290 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:50:45.653325 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:50:45.772722 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:50:46.026161 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:50:46.399713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1951): Launched 11:50:46.769776 run iperf3-srv_10.42.42.10(pid=1952): Launched 11:50:46.910076 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:50:47.125101 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:50:47.444714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1953): Launched 11:50:47.719343 run iperf3-srv_10.42.42.10(pid=1954): Launched 11:50:47.837594 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:50:48.045325 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:50:48.357666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1955): Launched 11:50:48.631990 run iperf3-srv_10.42.42.10(pid=1956): Launched 11:50:48.749665 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:50:48.958566 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:50:49.271898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1957): Launched 11:50:49.544460 run iperf3-srv_10.42.42.10(pid=1958): Launched 11:50:49.663077 tst iperf3m4.py:8: start network... 11:50:49.871788 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:50:50.355115 run create_hlr_db(pid=1959): Launched 11:50:50.483062 bus /gobi_6: Setting Powered False 11:50:51.544543 run create_hlr_db(pid=1959): Terminated: ok {rc=0} 11:50:52.002485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1961): Launched 11:50:52.336718 run osmo-hlr_10.42.42.2(pid=1962): Launched 11:50:52.464290 run osmo-stp_10.42.42.5: Starting osmo-stp 11:50:53.039036 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1965): Launched 11:50:53.374358 run osmo-stp_10.42.42.5(pid=1966): Launched 11:50:53.501818 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:50:54.078795 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1968): Launched 11:50:54.207135 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:50:54.489842 run patchelf(pid=1969): Launched 11:50:54.675968 run osmo-stp_10.42.42.5(pid=1966): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1966)] 11:50:54.816938 run osmo-stp_10.42.42.5(pid=1966): stdout: | (launched: 2022-12-09_11:50:53.312502) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:54.959969 run osmo-stp_10.42.42.5(pid=1966): stderr: | 20221209115053506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115053506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115053506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115053507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115053507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115053507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115053507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:55.103112 run osmo-stp_10.42.42.5(pid=1966): stdout: | (launched: 2022-12-09_11:50:53.312502) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:50:55.239937 run osmo-stp_10.42.42.5(pid=1966): stderr: | 20221209115053506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115053506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115053506 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115053507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115053507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115053507 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115053507 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:50:55.402567 run patchelf(pid=1969): Terminating (SIGINT) 11:50:55.590615 run patchelf(pid=1969): Terminated: ok {rc=0} 11:50:55.726656 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=1966): Process ended prematurely: osmo-stp_10.42.42.5(pid=1966) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1966)] [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 11:50:55.737079 tst iperf3m4.py:8: Test FAILED (11.1 sec) 11:50:55.767240 run osmo-hlr_10.42.42.2(pid=1962): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1962)] 11:50:55.818525 run osmo-hlr_10.42.42.2(pid=1962): stdout: | (launched: 2022-12-09_11:50:52.275577) 11:50:55.871453 run osmo-hlr_10.42.42.2(pid=1962): stderr: | 20221209115052475 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115052475 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115052475 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115052475 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115052475 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115052475 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115052488 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115052497 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115052497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115052497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:50:55.924738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1951): Terminating (SIGTERM) 11:50:55.968031 run iperf3-srv_10.42.42.10(pid=1952): Terminating (SIGTERM) 11:50:56.011103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1953): Terminating (SIGTERM) 11:50:56.054160 run iperf3-srv_10.42.42.10(pid=1954): Terminating (SIGTERM) 11:50:56.098574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1955): Terminating (SIGTERM) 11:50:56.141952 run iperf3-srv_10.42.42.10(pid=1956): Terminating (SIGTERM) 11:50:56.184896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1957): Terminating (SIGTERM) 11:50:56.227887 run iperf3-srv_10.42.42.10(pid=1958): Terminating (SIGTERM) 11:50:56.270767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1961): Terminating (SIGTERM) 11:50:56.313671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1965): Terminating (SIGTERM) 11:50:56.356629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1968): Terminating (SIGTERM) 11:50:56.400207 --- ParallelTerminationStrategy: PID 1951 died... 11:50:56.420652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1951): Terminated: ok {rc=0} 11:50:56.468421 --- ParallelTerminationStrategy: PID 1952 died... 11:50:56.488218 run iperf3-srv_10.42.42.10(pid=1952): Terminated {rc=256} 11:50:56.535424 --- ParallelTerminationStrategy: PID 1953 died... 11:50:56.555077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1953): Terminated: ok {rc=0} 11:50:56.602592 --- ParallelTerminationStrategy: PID 1954 died... 11:50:56.622391 run iperf3-srv_10.42.42.10(pid=1954): Terminated {rc=256} 11:50:56.669714 --- ParallelTerminationStrategy: PID 1955 died... 11:50:56.689544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1955): Terminated: ok {rc=0} 11:50:56.736701 --- ParallelTerminationStrategy: PID 1956 died... 11:50:56.756512 run iperf3-srv_10.42.42.10(pid=1956): Terminated {rc=256} 11:50:56.803580 --- ParallelTerminationStrategy: PID 1957 died... 11:50:56.823265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1957): Terminated: ok {rc=0} 11:50:56.870561 --- ParallelTerminationStrategy: PID 1958 died... 11:50:56.890305 run iperf3-srv_10.42.42.10(pid=1958): Terminated {rc=256} 11:50:56.937456 --- ParallelTerminationStrategy: PID 1961 died... 11:50:56.957274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1961): Terminated: ok {rc=0} 11:50:57.004407 --- ParallelTerminationStrategy: PID 1965 died... 11:50:57.024244 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1965): Terminated: ok {rc=0} 11:50:57.071535 --- ParallelTerminationStrategy: PID 1968 died... 11:50:57.091566 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1968): Terminated: ok {rc=0} 11:50:57.182337 bus /gobi_4: Setting Powered False 11:50:58.284184 bus /gobi_4: Setting Powered False 11:50:59.401710 bus /gobi_1: Setting Powered False 11:51:00.501538 bus /gobi_1: Setting Powered False 11:51:01.620040 bus /gobi_0: Setting Powered False 11:51:02.724176 bus /gobi_0: Setting Powered False 11:51:03.843820 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 11:51:04.949470 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:51:04.961619 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:51:05.013451 tst ping.py: using LAC 21266 11:51:05.136069 tst ping.py: using RAC 101 11:51:05.257603 tst ping.py: using CellId 21266 11:51:05.377077 tst ping.py: using BVCI 21267 11:51:05.487308 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:51:05.498441 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:51:05.509310 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:51:05.520132 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:51:05.530908 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:51:05.541794 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:51:05.552828 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:51:05.563650 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:51:05.685513 tst ping.py:19: start network... 11:51:05.906970 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:51:06.413400 run create_hlr_db(pid=1970): Launched 11:51:06.539020 bus /gobi_6: Setting Powered False 11:51:07.603642 run create_hlr_db(pid=1970): Terminated: ok {rc=0} 11:51:08.044937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1972): Launched 11:51:08.351961 run osmo-hlr_10.42.42.2(pid=1973): Launched 11:51:08.468876 run osmo-stp_10.42.42.5: Starting osmo-stp 11:51:09.001181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1975): Launched 11:51:09.331205 run osmo-stp_10.42.42.5(pid=1976): Launched 11:51:09.456388 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:51:10.022552 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1978): Launched 11:51:10.149212 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:51:10.427522 run patchelf(pid=1979): Launched 11:51:10.610827 run osmo-stp_10.42.42.5(pid=1976): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1976)] 11:51:10.750095 run osmo-stp_10.42.42.5(pid=1976): stdout: | (launched: 2022-12-09_11:51:09.271118) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:10.890805 run osmo-stp_10.42.42.5(pid=1976): stderr: | 20221209115109464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115109464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115109464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115109464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115109467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115109467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115109467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:11.032032 run osmo-stp_10.42.42.5(pid=1976): stdout: | (launched: 2022-12-09_11:51:09.271118) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:11.166483 run osmo-stp_10.42.42.5(pid=1976): stderr: | 20221209115109464 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115109464 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115109464 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115109464 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115109467 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115109467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115109467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:11.325858 run patchelf(pid=1979): Terminating (SIGINT) 11:51:11.511495 run patchelf(pid=1979): Terminated: ok {rc=0} 11:51:11.645315 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=1976): Process ended prematurely: osmo-stp_10.42.42.5(pid=1976) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1976)] [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 11:51:11.655061 tst ping.py:22: Test FAILED (6.7 sec) 11:51:11.684347 run osmo-hlr_10.42.42.2(pid=1973): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1973)] 11:51:11.735828 run osmo-hlr_10.42.42.2(pid=1973): stdout: | (launched: 2022-12-09_11:51:08.295294) 11:51:11.789196 run osmo-hlr_10.42.42.2(pid=1973): stderr: | 20221209115108476 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115108476 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115108476 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115108476 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115108476 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115108476 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115108488 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115108497 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115108497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115108498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:51:11.842595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1972): Terminating (SIGTERM) 11:51:11.885749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1975): Terminating (SIGTERM) 11:51:11.928931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1978): Terminating (SIGTERM) 11:51:11.972415 --- ParallelTerminationStrategy: PID 1972 died... 11:51:11.992786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1972): Terminated: ok {rc=0} 11:51:12.040397 --- ParallelTerminationStrategy: PID 1975 died... 11:51:12.060614 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1975): Terminated: ok {rc=0} 11:51:12.107968 --- ParallelTerminationStrategy: PID 1978 died... 11:51:12.127832 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1978): Terminated: ok {rc=0} 11:51:12.217453 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:51:13.306400 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:51:13.318531 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:51:13.374037 tst ping_idle_ping.py: using LAC 21267 11:51:13.493776 tst ping_idle_ping.py: using RAC 102 11:51:13.614255 tst ping_idle_ping.py: using CellId 21267 11:51:13.733163 tst ping_idle_ping.py: using BVCI 21268 11:51:13.845061 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:51:13.856148 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:51:13.867090 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:51:13.878153 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:51:13.889224 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:51:13.900098 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:51:13.911189 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:51:13.922130 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:51:14.041145 tst ping_idle_ping.py:24: start network... 11:51:14.248304 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:51:14.727211 run create_hlr_db(pid=1980): Launched 11:51:14.852499 bus /gobi_6: Setting Powered False 11:51:15.921273 run create_hlr_db(pid=1980): Terminated: ok {rc=0} 11:51:16.368638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1982): Launched 11:51:16.701570 run osmo-hlr_10.42.42.2(pid=1983): Launched 11:51:16.940013 run osmo-stp_10.42.42.5: Starting osmo-stp 11:51:17.626083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1985): Launched 11:51:17.934141 run osmo-stp_10.42.42.5(pid=1986): Launched 11:51:18.050351 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:51:18.580136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1988): Launched 11:51:18.697978 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:51:18.958368 run patchelf(pid=1989): Launched 11:51:19.130724 run osmo-stp_10.42.42.5(pid=1986): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1986)] 11:51:19.261263 run osmo-stp_10.42.42.5(pid=1986): stdout: | (launched: 2022-12-09_11:51:17.877407) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:19.392942 run osmo-stp_10.42.42.5(pid=1986): stderr: | 20221209115118049 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115118049 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115118049 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115118050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115118050 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115118050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115118051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:19.524671 run osmo-stp_10.42.42.5(pid=1986): stdout: | (launched: 2022-12-09_11:51:17.877407) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:19.650766 run osmo-stp_10.42.42.5(pid=1986): stderr: | 20221209115118049 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115118049 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115118049 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115118050 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115118050 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115118050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115118051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:19.800173 run patchelf(pid=1989): Terminating (SIGINT) 11:51:19.974496 run patchelf(pid=1989): Terminated: ok {rc=0} 11:51:20.099851 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=1986): Process ended prematurely: osmo-stp_10.42.42.5(pid=1986) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1986)] [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 11:51:20.108929 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 11:51:20.135937 run osmo-hlr_10.42.42.2(pid=1983): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=1983)] 11:51:20.184054 run osmo-hlr_10.42.42.2(pid=1983): stdout: | (launched: 2022-12-09_11:51:16.641817) 11:51:20.234186 run osmo-hlr_10.42.42.2(pid=1983): stderr: | 20221209115116990 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115116990 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115116991 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115116991 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115116991 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115116991 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115117014 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115117040 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115117040 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115117040 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:51:20.284919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1982): Terminating (SIGTERM) 11:51:20.325516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1985): Terminating (SIGTERM) 11:51:20.366154 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1988): Terminating (SIGTERM) 11:51:20.406922 --- ParallelTerminationStrategy: PID 1982 died... 11:51:20.426369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=1982): Terminated: ok {rc=0} 11:51:20.471531 --- ParallelTerminationStrategy: PID 1985 died... 11:51:20.490670 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=1985): Terminated: ok {rc=0} 11:51:20.535406 --- ParallelTerminationStrategy: PID 1988 died... 11:51:20.554469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=1988): Terminated: ok {rc=0} 11:51:20.641920 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:51:21.958147 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:51:21.963941 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:51:21.997483 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:51:22.035808 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:51:22.122774 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:51:22.155997 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:51:22.193960 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:51:22.792066 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:51:22.841724 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:22.852788 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:51:22.923343 tst cs_paging_gprs_active.py: using LAC 21268 11:51:23.047793 tst cs_paging_gprs_active.py: using RAC 103 11:51:23.171822 tst cs_paging_gprs_active.py: using CellId 21268 11:51:23.295965 tst cs_paging_gprs_active.py: using BVCI 21269 11:51:23.409455 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:23.420358 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:23.431291 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:23.442175 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:23.452932 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:23.463807 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:23.474778 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:23.485555 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:23.496437 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:51:23.615510 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:51:23.737044 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:51:23.947518 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:51:24.260539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1996): Launched 11:51:24.533264 run iperf3-srv_10.42.42.10(pid=1997): Launched 11:51:24.651828 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:51:24.861408 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:51:25.175097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1998): Launched 11:51:25.447774 run iperf3-srv_10.42.42.10(pid=1999): Launched 11:51:25.565166 tst cs_paging_gprs_active.py:38: start network... 11:51:25.773440 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:51:26.256669 run create_hlr_db(pid=2000): Launched 11:51:26.384753 bus /gobi_6: Setting Powered False 11:51:27.446827 run create_hlr_db(pid=2000): Terminated: ok {rc=0} 11:51:27.902471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2002): Launched 11:51:28.236698 run osmo-hlr_10.42.42.2(pid=2003): Launched 11:51:28.365607 run osmo-stp_10.42.42.5: Starting osmo-stp 11:51:28.939576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2005): Launched 11:51:29.273949 run osmo-stp_10.42.42.5(pid=2006): Launched 11:51:29.402900 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:51:29.978991 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2008): Launched 11:51:30.107340 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:51:30.390388 run patchelf(pid=2009): Launched 11:51:30.577204 run osmo-stp_10.42.42.5(pid=2006): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2006)] 11:51:30.717915 run osmo-stp_10.42.42.5(pid=2006): stdout: | (launched: 2022-12-09_11:51:29.212221) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:30.874762 run osmo-stp_10.42.42.5(pid=2006): stderr: | 20221209115129406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115129406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115129406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115129407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115129409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115129409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115129409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:31.027676 run osmo-stp_10.42.42.5(pid=2006): stdout: | (launched: 2022-12-09_11:51:29.212221) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:31.167307 run osmo-stp_10.42.42.5(pid=2006): stderr: | 20221209115129406 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115129406 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115129406 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115129407 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115129409 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115129409 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115129409 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:31.332831 run patchelf(pid=2009): Terminating (SIGINT) 11:51:31.526370 run patchelf(pid=2009): Terminated: ok {rc=0} 11:51:31.665919 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2006): Process ended prematurely: osmo-stp_10.42.42.5(pid=2006) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2006)] [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:51:31.677398 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 11:51:31.710113 run osmo-hlr_10.42.42.2(pid=2003): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2003)] 11:51:31.763401 run osmo-hlr_10.42.42.2(pid=2003): stdout: | (launched: 2022-12-09_11:51:28.175420) 11:51:31.818539 run osmo-hlr_10.42.42.2(pid=2003): stderr: | 20221209115128377 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115128378 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115128378 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115128378 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115128378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115128378 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115128390 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115128399 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115128399 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115128399 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:51:31.874346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1996): Terminating (SIGTERM) 11:51:31.920318 run iperf3-srv_10.42.42.10(pid=1997): Terminating (SIGTERM) 11:51:31.967613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1998): Terminating (SIGTERM) 11:51:32.017620 run iperf3-srv_10.42.42.10(pid=1999): Terminating (SIGTERM) 11:51:32.068651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2002): Terminating (SIGTERM) 11:51:32.120492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2005): Terminating (SIGTERM) 11:51:32.172168 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2008): Terminating (SIGTERM) 11:51:32.217587 --- ParallelTerminationStrategy: PID 1996 died... 11:51:32.237856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1996): Terminated: ok {rc=0} 11:51:32.285124 --- ParallelTerminationStrategy: PID 1997 died... 11:51:32.304144 run iperf3-srv_10.42.42.10(pid=1997): Terminated {rc=256} 11:51:32.348494 --- ParallelTerminationStrategy: PID 1998 died... 11:51:32.367253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=1998): Terminated: ok {rc=0} 11:51:32.411489 --- ParallelTerminationStrategy: PID 1999 died... 11:51:32.430194 run iperf3-srv_10.42.42.10(pid=1999): Terminated {rc=256} 11:51:32.474903 --- ParallelTerminationStrategy: PID 2002 died... 11:51:32.493654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2002): Terminated: ok {rc=0} 11:51:32.537869 --- ParallelTerminationStrategy: PID 2005 died... 11:51:32.557059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2005): Terminated: ok {rc=0} 11:51:32.601405 --- ParallelTerminationStrategy: PID 2008 died... 11:51:32.620048 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2008): Terminated: ok {rc=0} 11:51:32.707181 bus /gobi_0: Setting Powered False 11:51:33.807865 bus /gobi_0: Setting Powered False 11:51:34.923924 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:51:36.072940 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:36.084857 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:51:36.158682 tst iperf3.py: using LAC 21269 11:51:36.280452 tst iperf3.py: using RAC 104 11:51:36.404181 tst iperf3.py: using CellId 21269 11:51:36.527753 tst iperf3.py: using BVCI 21270 11:51:36.642446 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:36.653627 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:36.664591 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:36.675629 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:36.686479 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:36.697434 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:36.708527 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:36.719434 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:36.730479 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:51:36.852310 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:51:37.077557 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:51:37.413178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2010): Launched 11:51:37.705635 run iperf3-srv_10.42.42.10(pid=2011): Launched 11:51:37.832017 tst iperf3.py:8: start network... 11:51:38.058263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:51:38.578587 run create_hlr_db(pid=2012): Launched 11:51:38.706566 bus /gobi_6: Setting Powered False 11:51:39.772718 run create_hlr_db(pid=2012): Terminated: ok {rc=0} 11:51:40.219455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2014): Launched 11:51:40.533831 run osmo-hlr_10.42.42.2(pid=2015): Launched 11:51:40.653164 run osmo-stp_10.42.42.5: Starting osmo-stp 11:51:41.190315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2017): Launched 11:51:41.502567 run osmo-stp_10.42.42.5(pid=2018): Launched 11:51:41.621971 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:51:42.161364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2020): Launched 11:51:42.281958 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:51:42.547509 run patchelf(pid=2021): Launched 11:51:42.722034 run osmo-stp_10.42.42.5(pid=2018): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2018)] 11:51:42.853858 run osmo-stp_10.42.42.5(pid=2018): stdout: | (launched: 2022-12-09_11:51:41.444759) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:42.987106 run osmo-stp_10.42.42.5(pid=2018): stderr: | 20221209115141619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115141619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115141620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115141620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115141620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115141620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115141621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:43.120381 run osmo-stp_10.42.42.5(pid=2018): stdout: | (launched: 2022-12-09_11:51:41.444759) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:43.249572 run osmo-stp_10.42.42.5(pid=2018): stderr: | 20221209115141619 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115141619 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115141620 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115141620 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115141620 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115141620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115141621 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:43.400496 run patchelf(pid=2021): Terminating (SIGINT) 11:51:43.577324 run patchelf(pid=2021): Terminated: ok {rc=0} 11:51:43.704912 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2018): Process ended prematurely: osmo-stp_10.42.42.5(pid=2018) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2018)] [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 11:51:43.714552 tst iperf3.py:8: Test FAILED (7.7 sec) 11:51:43.741929 run osmo-hlr_10.42.42.2(pid=2015): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2015)] 11:51:43.790118 run osmo-hlr_10.42.42.2(pid=2015): stdout: | (launched: 2022-12-09_11:51:40.475786) 11:51:43.840189 run osmo-hlr_10.42.42.2(pid=2015): stderr: | 20221209115140656 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115140656 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115140656 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115140656 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115140656 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115140657 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115140668 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115140679 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115140679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115140679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:51:43.890287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2010): Terminating (SIGTERM) 11:51:43.930250 run iperf3-srv_10.42.42.10(pid=2011): Terminating (SIGTERM) 11:51:43.970115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2014): Terminating (SIGTERM) 11:51:44.010693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2017): Terminating (SIGTERM) 11:51:44.050772 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2020): Terminating (SIGTERM) 11:51:44.090756 --- ParallelTerminationStrategy: PID 2010 died... 11:51:44.109951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2010): Terminated: ok {rc=0} 11:51:44.154273 --- ParallelTerminationStrategy: PID 2011 died... 11:51:44.172818 run iperf3-srv_10.42.42.10(pid=2011): Terminated {rc=256} 11:51:44.216918 --- ParallelTerminationStrategy: PID 2014 died... 11:51:44.236137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2014): Terminated: ok {rc=0} 11:51:44.280332 --- ParallelTerminationStrategy: PID 2017 died... 11:51:44.299212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2017): Terminated: ok {rc=0} 11:51:44.343917 --- ParallelTerminationStrategy: PID 2020 died... 11:51:44.362591 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2020): Terminated: ok {rc=0} 11:51:44.446909 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 11:51:45.592173 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:45.604083 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:51:45.676435 tst iperf3m4.py: using LAC 21270 11:51:45.798554 tst iperf3m4.py: using RAC 105 11:51:45.930765 tst iperf3m4.py: using CellId 21270 11:51:46.060344 tst iperf3m4.py: using BVCI 21271 11:51:46.188458 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:46.201697 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:46.215564 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:46.229903 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:46.242671 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:46.256365 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:46.270423 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:46.285057 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:51:46.299063 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:51:46.425638 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:51:46.572363 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:51:46.714005 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:51:46.846718 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:51:47.082243 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:51:47.427042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2022): Launched 11:51:47.722580 run iperf3-srv_10.42.42.10(pid=2023): Launched 11:51:47.850244 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:51:48.077414 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:51:48.415614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2024): Launched 11:51:48.709255 run iperf3-srv_10.42.42.10(pid=2025): Launched 11:51:48.835585 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:51:49.060806 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:51:49.398089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2026): Launched 11:51:49.692582 run iperf3-srv_10.42.42.10(pid=2027): Launched 11:51:49.818945 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:51:50.044917 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:51:50.381464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2028): Launched 11:51:50.675844 run iperf3-srv_10.42.42.10(pid=2029): Launched 11:51:50.802191 tst iperf3m4.py:8: start network... 11:51:51.027336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:51:51.546631 run create_hlr_db(pid=2030): Launched 11:51:51.674987 bus /gobi_6: Setting Powered False 11:51:52.740262 run create_hlr_db(pid=2030): Terminated: ok {rc=0} 11:51:53.187114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2032): Launched 11:51:53.526288 run osmo-hlr_10.42.42.2(pid=2033): Launched 11:51:53.655226 run osmo-stp_10.42.42.5: Starting osmo-stp 11:51:54.235990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2035): Launched 11:51:54.570453 run osmo-stp_10.42.42.5(pid=2036): Launched 11:51:54.698475 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:51:55.274751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2038): Launched 11:51:55.403817 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:51:55.686812 run patchelf(pid=2039): Launched 11:51:55.872856 run osmo-stp_10.42.42.5(pid=2036): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2036)] 11:51:56.014324 run osmo-stp_10.42.42.5(pid=2036): stdout: | (launched: 2022-12-09_11:51:54.508874) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:56.157235 run osmo-stp_10.42.42.5(pid=2036): stderr: | 20221209115154701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115154701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115154701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115154702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115154702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115154702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115154702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:56.299845 run osmo-stp_10.42.42.5(pid=2036): stdout: | (launched: 2022-12-09_11:51:54.508874) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:51:56.437213 run osmo-stp_10.42.42.5(pid=2036): stderr: | 20221209115154701 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115154701 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115154701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115154702 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115154702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115154702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115154702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:51:56.599748 run patchelf(pid=2039): Terminating (SIGINT) 11:51:56.787672 run patchelf(pid=2039): Terminated: ok {rc=0} 11:51:56.923851 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2036): Process ended prematurely: osmo-stp_10.42.42.5(pid=2036) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2036)] [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 11:51:56.934276 tst iperf3m4.py:8: Test FAILED (11.4 sec) 11:51:56.964186 run osmo-hlr_10.42.42.2(pid=2033): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2033)] 11:51:57.015472 run osmo-hlr_10.42.42.2(pid=2033): stdout: | (launched: 2022-12-09_11:51:53.464251) 11:51:57.069125 run osmo-hlr_10.42.42.2(pid=2033): stderr: | 20221209115153664 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115153664 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115153664 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115153664 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115153664 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115153664 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115153680 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115153690 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115153690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115153690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:51:57.122862 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2022): Terminating (SIGTERM) 11:51:57.166085 run iperf3-srv_10.42.42.10(pid=2023): Terminating (SIGTERM) 11:51:57.209194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2024): Terminating (SIGTERM) 11:51:57.252128 run iperf3-srv_10.42.42.10(pid=2025): Terminating (SIGTERM) 11:51:57.294859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2026): Terminating (SIGTERM) 11:51:57.338044 run iperf3-srv_10.42.42.10(pid=2027): Terminating (SIGTERM) 11:51:57.380846 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2028): Terminating (SIGTERM) 11:51:57.424240 run iperf3-srv_10.42.42.10(pid=2029): Terminating (SIGTERM) 11:51:57.467336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2032): Terminating (SIGTERM) 11:51:57.510059 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2035): Terminating (SIGTERM) 11:51:57.552866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2038): Terminating (SIGTERM) 11:51:57.596209 --- ParallelTerminationStrategy: PID 2022 died... 11:51:57.616512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2022): Terminated: ok {rc=0} 11:51:57.664137 --- ParallelTerminationStrategy: PID 2023 died... 11:51:57.684119 run iperf3-srv_10.42.42.10(pid=2023): Terminated {rc=256} 11:51:57.731393 --- ParallelTerminationStrategy: PID 2024 died... 11:51:57.751401 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2024): Terminated: ok {rc=0} 11:51:57.799025 --- ParallelTerminationStrategy: PID 2025 died... 11:51:57.818925 run iperf3-srv_10.42.42.10(pid=2025): Terminated {rc=256} 11:51:57.866252 --- ParallelTerminationStrategy: PID 2026 died... 11:51:57.886296 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2026): Terminated: ok {rc=0} 11:51:57.933783 --- ParallelTerminationStrategy: PID 2027 died... 11:51:57.953642 run iperf3-srv_10.42.42.10(pid=2027): Terminated {rc=256} 11:51:58.000882 --- ParallelTerminationStrategy: PID 2028 died... 11:51:58.020917 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2028): Terminated: ok {rc=0} 11:51:58.068382 --- ParallelTerminationStrategy: PID 2029 died... 11:51:58.088448 run iperf3-srv_10.42.42.10(pid=2029): Terminated {rc=256} 11:51:58.136012 --- ParallelTerminationStrategy: PID 2032 died... 11:51:58.155845 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2032): Terminated: ok {rc=0} 11:51:58.203483 --- ParallelTerminationStrategy: PID 2035 died... 11:51:58.223496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2035): Terminated: ok {rc=0} 11:51:58.271074 --- ParallelTerminationStrategy: PID 2038 died... 11:51:58.291102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2038): Terminated: ok {rc=0} 11:51:58.381856 bus /gobi_4: Setting Powered False 11:51:59.483414 bus /gobi_4: Setting Powered False 11:52:00.604497 bus /gobi_1: Setting Powered False 11:52:01.706309 bus /gobi_1: Setting Powered False 11:52:02.827268 bus /gobi_0: Setting Powered False 11:52:03.926987 bus /gobi_0: Setting Powered False 11:52:05.044828 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 11:52:06.146151 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:52:06.158529 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:52:06.229857 tst ping.py: using LAC 21271 11:52:06.351294 tst ping.py: using RAC 106 11:52:06.474177 tst ping.py: using CellId 21271 11:52:06.605579 tst ping.py: using BVCI 21272 11:52:06.717784 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:52:06.729319 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:52:06.740202 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:52:06.751162 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:52:06.762021 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:52:06.772869 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:52:06.784000 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:52:06.794863 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:52:06.911947 tst ping.py:19: start network... 11:52:07.116782 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:52:07.589761 run create_hlr_db(pid=2042): Launched 11:52:07.714110 bus /gobi_6: Setting Powered False 11:52:08.776089 run create_hlr_db(pid=2042): Terminated: ok {rc=0} 11:52:09.225162 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2044): Launched 11:52:09.554751 run osmo-hlr_10.42.42.2(pid=2045): Launched 11:52:09.679967 run osmo-stp_10.42.42.5: Starting osmo-stp 11:52:10.244737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2047): Launched 11:52:10.572901 run osmo-stp_10.42.42.5(pid=2048): Launched 11:52:10.697523 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:52:11.261814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2050): Launched 11:52:11.387664 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:52:11.664525 run patchelf(pid=2051): Launched 11:52:11.847157 run osmo-stp_10.42.42.5(pid=2048): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2048)] 11:52:11.986217 run osmo-stp_10.42.42.5(pid=2048): stdout: | (launched: 2022-12-09_11:52:10.512633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:12.126730 run osmo-stp_10.42.42.5(pid=2048): stderr: | 20221209115210707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115210707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115210707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115210707 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115210708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115210708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115210708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:12.267528 run osmo-stp_10.42.42.5(pid=2048): stdout: | (launched: 2022-12-09_11:52:10.512633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:12.401931 run osmo-stp_10.42.42.5(pid=2048): stderr: | 20221209115210707 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115210707 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115210707 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115210707 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115210708 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115210708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115210708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:12.561382 run patchelf(pid=2051): Terminating (SIGINT) 11:52:12.746203 run patchelf(pid=2051): Terminated: ok {rc=0} 11:52:12.879613 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2048): Process ended prematurely: osmo-stp_10.42.42.5(pid=2048) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2048)] [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 11:52:12.889204 tst ping.py:22: Test FAILED (6.7 sec) 11:52:12.918270 run osmo-hlr_10.42.42.2(pid=2045): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2045)] 11:52:12.969589 run osmo-hlr_10.42.42.2(pid=2045): stdout: | (launched: 2022-12-09_11:52:09.494284) 11:52:13.023045 run osmo-hlr_10.42.42.2(pid=2045): stderr: | 20221209115209696 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115209696 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115209696 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115209696 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115209696 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115209696 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115209708 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115209716 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115209717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115209717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:13.077102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2044): Terminating (SIGTERM) 11:52:13.120414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2047): Terminating (SIGTERM) 11:52:13.163919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2050): Terminating (SIGTERM) 11:52:13.207517 --- ParallelTerminationStrategy: PID 2044 died... 11:52:13.228063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2044): Terminated: ok {rc=0} 11:52:13.275985 --- ParallelTerminationStrategy: PID 2047 died... 11:52:13.296132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2047): Terminated: ok {rc=0} 11:52:13.344064 --- ParallelTerminationStrategy: PID 2050 died... 11:52:13.364170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2050): Terminated: ok {rc=0} 11:52:13.455827 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 11:52:14.546716 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:52:14.559711 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:52:14.637234 tst ping_idle_ping.py: using LAC 21272 11:52:14.766748 tst ping_idle_ping.py: using RAC 107 11:52:14.897271 tst ping_idle_ping.py: using CellId 21272 11:52:15.031136 tst ping_idle_ping.py: using BVCI 21273 11:52:15.151615 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:52:15.163267 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:52:15.174753 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:52:15.186920 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:52:15.198295 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:52:15.210529 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:52:15.222321 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:52:15.233863 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:52:15.356533 tst ping_idle_ping.py:24: start network... 11:52:15.578826 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:52:16.124911 run create_hlr_db(pid=2052): Launched 11:52:16.290592 bus /gobi_6: Setting Powered False 11:52:17.352000 run create_hlr_db(pid=2052): Terminated: ok {rc=0} 11:52:17.805399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2054): Launched 11:52:18.135443 run osmo-hlr_10.42.42.2(pid=2055): Launched 11:52:18.260587 run osmo-stp_10.42.42.5: Starting osmo-stp 11:52:18.830927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2057): Launched 11:52:19.160466 run osmo-stp_10.42.42.5(pid=2058): Launched 11:52:19.285931 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:52:19.853688 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2060): Launched 11:52:19.980395 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:52:20.259553 run patchelf(pid=2061): Launched 11:52:20.443558 run osmo-stp_10.42.42.5(pid=2058): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2058)] 11:52:20.583250 run osmo-stp_10.42.42.5(pid=2058): stdout: | (launched: 2022-12-09_11:52:19.100081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:20.724213 run osmo-stp_10.42.42.5(pid=2058): stderr: | 20221209115219294 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115219294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115219294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115219295 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115219295 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115219295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115219295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:20.865159 run osmo-stp_10.42.42.5(pid=2058): stdout: | (launched: 2022-12-09_11:52:19.100081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:20.999811 run osmo-stp_10.42.42.5(pid=2058): stderr: | 20221209115219294 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115219294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115219294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115219295 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115219295 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115219295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115219295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:21.159517 run patchelf(pid=2061): Terminating (SIGINT) 11:52:21.344739 run patchelf(pid=2061): Terminated: ok {rc=0} 11:52:21.479233 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2058): Process ended prematurely: osmo-stp_10.42.42.5(pid=2058) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2058)] [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 11:52:21.489035 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 11:52:21.517902 run osmo-hlr_10.42.42.2(pid=2055): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2055)] 11:52:21.568585 run osmo-hlr_10.42.42.2(pid=2055): stdout: | (launched: 2022-12-09_11:52:18.075122) 11:52:21.621257 run osmo-hlr_10.42.42.2(pid=2055): stderr: | 20221209115218274 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115218274 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115218274 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115218274 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115218274 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115218274 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115218288 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115218298 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115218298 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115218298 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:21.674176 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2054): Terminating (SIGTERM) 11:52:21.716535 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2057): Terminating (SIGTERM) 11:52:21.759091 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2060): Terminating (SIGTERM) 11:52:21.801716 --- ParallelTerminationStrategy: PID 2054 died... 11:52:21.821741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2054): Terminated: ok {rc=0} 11:52:21.868806 --- ParallelTerminationStrategy: PID 2057 died... 11:52:21.889026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2057): Terminated: ok {rc=0} 11:52:21.936101 --- ParallelTerminationStrategy: PID 2060 died... 11:52:21.955892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2060): Terminated: ok {rc=0} 11:52:22.045017 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:52:23.362879 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:52:23.369541 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:52:23.405621 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 11:52:23.446306 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 11:52:23.535157 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:52:23.568657 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 11:52:23.606716 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 11:52:24.206127 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 11:52:24.256048 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:24.267376 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:52:24.338082 tst cs_paging_gprs_active.py: using LAC 21273 11:52:24.461265 tst cs_paging_gprs_active.py: using RAC 108 11:52:24.585057 tst cs_paging_gprs_active.py: using CellId 21273 11:52:24.707670 tst cs_paging_gprs_active.py: using BVCI 21274 11:52:24.822563 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:24.833795 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:24.844624 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:24.855544 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:24.866524 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:24.877554 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:24.888553 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:24.899380 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:24.910516 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:52:25.035171 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:52:25.155489 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:52:25.367198 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:52:25.683193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2065): Launched 11:52:25.958465 run iperf3-srv_10.42.42.10(pid=2066): Launched 11:52:26.077234 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:52:26.287767 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:52:26.604639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2067): Launched 11:52:26.878059 run iperf3-srv_10.42.42.10(pid=2068): Launched 11:52:26.995732 tst cs_paging_gprs_active.py:38: start network... 11:52:27.204458 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:52:27.689117 run create_hlr_db(pid=2069): Launched 11:52:27.817593 bus /gobi_6: Setting Powered False 11:52:28.879587 run create_hlr_db(pid=2069): Terminated: ok {rc=0} 11:52:29.315516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2071): Launched 11:52:29.629346 run osmo-hlr_10.42.42.2(pid=2072): Launched 11:52:29.748924 run osmo-stp_10.42.42.5: Starting osmo-stp 11:52:30.290344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2074): Launched 11:52:30.604710 run osmo-stp_10.42.42.5(pid=2075): Launched 11:52:30.723671 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:52:31.310822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2077): Launched 11:52:31.441977 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:52:31.714653 run patchelf(pid=2078): Launched 11:52:31.893866 run osmo-stp_10.42.42.5(pid=2075): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2075)] 11:52:32.028304 run osmo-stp_10.42.42.5(pid=2075): stdout: | (launched: 2022-12-09_11:52:30.546002) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:32.164124 run osmo-stp_10.42.42.5(pid=2075): stderr: | 20221209115230722 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115230722 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115230722 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115230722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115230723 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115230723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115230723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:32.299009 run osmo-stp_10.42.42.5(pid=2075): stdout: | (launched: 2022-12-09_11:52:30.546002) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:32.427711 run osmo-stp_10.42.42.5(pid=2075): stderr: | 20221209115230722 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115230722 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115230722 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115230722 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115230723 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115230723 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115230723 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:32.579565 run patchelf(pid=2078): Terminating (SIGINT) 11:52:32.757565 run patchelf(pid=2078): Terminated: ok {rc=0} 11:52:32.885183 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2075): Process ended prematurely: osmo-stp_10.42.42.5(pid=2075) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2075)] [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 11:52:32.894841 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 11:52:32.922404 run osmo-hlr_10.42.42.2(pid=2072): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2072)] 11:52:32.970762 run osmo-hlr_10.42.42.2(pid=2072): stdout: | (launched: 2022-12-09_11:52:29.571162) 11:52:33.021290 run osmo-hlr_10.42.42.2(pid=2072): stderr: | 20221209115229748 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115229748 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115229748 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115229748 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115229748 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115229749 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115229761 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115229769 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115229769 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115229770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:33.071715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2065): Terminating (SIGTERM) 11:52:33.111915 run iperf3-srv_10.42.42.10(pid=2066): Terminating (SIGTERM) 11:52:33.151970 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2067): Terminating (SIGTERM) 11:52:33.192156 run iperf3-srv_10.42.42.10(pid=2068): Terminating (SIGTERM) 11:52:33.232234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2071): Terminating (SIGTERM) 11:52:33.272394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2074): Terminating (SIGTERM) 11:52:33.312650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2077): Terminating (SIGTERM) 11:52:33.352903 --- ParallelTerminationStrategy: PID 2065 died... 11:52:33.372246 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2065): Terminated: ok {rc=0} 11:52:33.417132 --- ParallelTerminationStrategy: PID 2066 died... 11:52:33.435872 run iperf3-srv_10.42.42.10(pid=2066): Terminated {rc=256} 11:52:33.480104 --- ParallelTerminationStrategy: PID 2067 died... 11:52:33.498729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2067): Terminated: ok {rc=0} 11:52:33.542850 --- ParallelTerminationStrategy: PID 2068 died... 11:52:33.561604 run iperf3-srv_10.42.42.10(pid=2068): Terminated {rc=256} 11:52:33.605667 --- ParallelTerminationStrategy: PID 2071 died... 11:52:33.624365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2071): Terminated: ok {rc=0} 11:52:33.668609 --- ParallelTerminationStrategy: PID 2074 died... 11:52:33.687585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2074): Terminated: ok {rc=0} 11:52:33.731745 --- ParallelTerminationStrategy: PID 2077 died... 11:52:33.750532 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2077): Terminated: ok {rc=0} 11:52:33.835083 bus /gobi_0: Setting Powered False 11:52:34.933843 bus /gobi_0: Setting Powered False 11:52:36.051613 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 11:52:37.204905 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:37.217372 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:52:37.293393 tst iperf3.py: using LAC 21274 11:52:37.425239 tst iperf3.py: using RAC 109 11:52:37.557445 tst iperf3.py: using CellId 21274 11:52:37.681397 tst iperf3.py: using BVCI 21275 11:52:37.796917 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:37.808574 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:37.819674 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:37.830797 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:37.841868 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:37.852830 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:37.864007 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:37.875013 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:37.886147 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:52:38.009241 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:52:38.236398 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:52:38.573207 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2079): Launched 11:52:38.866629 run iperf3-srv_10.42.42.10(pid=2080): Launched 11:52:38.993507 tst iperf3.py:8: start network... 11:52:39.218675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:52:39.737692 run create_hlr_db(pid=2081): Launched 11:52:39.866780 bus /gobi_6: Setting Powered False 11:52:40.932114 run create_hlr_db(pid=2081): Terminated: ok {rc=0} 11:52:41.396413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2083): Launched 11:52:41.731775 run osmo-hlr_10.42.42.2(pid=2084): Launched 11:52:41.859883 run osmo-stp_10.42.42.5: Starting osmo-stp 11:52:42.436343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2086): Launched 11:52:42.772349 run osmo-stp_10.42.42.5(pid=2087): Launched 11:52:42.900725 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:52:43.479580 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2089): Launched 11:52:43.608256 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:52:43.891324 run patchelf(pid=2090): Launched 11:52:44.077897 run osmo-stp_10.42.42.5(pid=2087): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2087)] 11:52:44.219205 run osmo-stp_10.42.42.5(pid=2087): stdout: | (launched: 2022-12-09_11:52:42.710900) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:44.361785 run osmo-stp_10.42.42.5(pid=2087): stderr: | 20221209115242905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115242905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115242906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115242906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115242907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115242907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115242907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:44.505413 run osmo-stp_10.42.42.5(pid=2087): stdout: | (launched: 2022-12-09_11:52:42.710900) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:44.642547 run osmo-stp_10.42.42.5(pid=2087): stderr: | 20221209115242905 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115242905 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115242906 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115242906 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115242907 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115242907 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115242907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:44.804550 run patchelf(pid=2090): Terminating (SIGINT) 11:52:44.992581 run patchelf(pid=2090): Terminated: ok {rc=0} 11:52:45.129232 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2087): Process ended prematurely: osmo-stp_10.42.42.5(pid=2087) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2087)] [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 11:52:45.139697 tst iperf3.py:8: Test FAILED (8.0 sec) 11:52:45.169524 run osmo-hlr_10.42.42.2(pid=2084): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2084)] 11:52:45.220618 run osmo-hlr_10.42.42.2(pid=2084): stdout: | (launched: 2022-12-09_11:52:41.670703) 11:52:45.273368 run osmo-hlr_10.42.42.2(pid=2084): stderr: | 20221209115241870 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115241870 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115241870 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115241870 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115241870 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115241870 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115241883 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115241893 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115241893 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115241893 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:45.326863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2079): Terminating (SIGTERM) 11:52:45.369909 run iperf3-srv_10.42.42.10(pid=2080): Terminating (SIGTERM) 11:52:45.412767 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2083): Terminating (SIGTERM) 11:52:45.455937 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2086): Terminating (SIGTERM) 11:52:45.499000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2089): Terminating (SIGTERM) 11:52:45.542038 --- ParallelTerminationStrategy: PID 2079 died... 11:52:45.562336 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2079): Terminated: ok {rc=0} 11:52:45.609920 --- ParallelTerminationStrategy: PID 2080 died... 11:52:45.629598 run iperf3-srv_10.42.42.10(pid=2080): Terminated {rc=256} 11:52:45.676787 --- ParallelTerminationStrategy: PID 2083 died... 11:52:45.697077 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2083): Terminated: ok {rc=0} 11:52:45.744247 --- ParallelTerminationStrategy: PID 2086 died... 11:52:45.764113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2086): Terminated: ok {rc=0} 11:52:45.811594 --- ParallelTerminationStrategy: PID 2089 died... 11:52:45.837321 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2089): Terminated: ok {rc=0} 11:52:45.952894 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 11:52:47.112802 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:47.130970 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:52:47.204472 tst iperf3m4.py: using LAC 21275 11:52:47.331657 tst iperf3m4.py: using RAC 110 11:52:47.453813 tst iperf3m4.py: using CellId 21275 11:52:47.583487 tst iperf3m4.py: using BVCI 21276 11:52:47.706164 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:47.717971 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:47.729618 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:47.742198 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:47.753820 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:47.767230 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:47.779310 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:47.791402 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:52:47.803905 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:52:47.929830 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:52:48.054047 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:52:48.176239 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:52:48.298674 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:52:48.509073 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:52:48.823603 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2091): Launched 11:52:49.097930 run iperf3-srv_10.42.42.10(pid=2092): Launched 11:52:49.216468 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:52:49.426538 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:52:49.742633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2093): Launched 11:52:50.016287 run iperf3-srv_10.42.42.10(pid=2094): Launched 11:52:50.133947 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:52:50.342904 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:52:50.657125 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2095): Launched 11:52:50.930891 run iperf3-srv_10.42.42.10(pid=2096): Launched 11:52:51.048515 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:52:51.256567 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:52:51.570155 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2097): Launched 11:52:51.842530 run iperf3-srv_10.42.42.10(pid=2098): Launched 11:52:51.959628 tst iperf3m4.py:8: start network... 11:52:52.167542 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:52:52.651409 run create_hlr_db(pid=2099): Launched 11:52:52.778988 bus /gobi_6: Setting Powered False 11:52:53.841242 run create_hlr_db(pid=2099): Terminated: ok {rc=0} 11:52:54.279067 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2101): Launched 11:52:54.593560 run osmo-hlr_10.42.42.2(pid=2102): Launched 11:52:54.712132 run osmo-stp_10.42.42.5: Starting osmo-stp 11:52:55.257582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2104): Launched 11:52:55.571706 run osmo-stp_10.42.42.5(pid=2105): Launched 11:52:55.690396 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:52:56.227219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2107): Launched 11:52:56.346845 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:52:56.610338 run patchelf(pid=2108): Launched 11:52:56.783412 run osmo-stp_10.42.42.5(pid=2105): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2105)] 11:52:56.915539 run osmo-stp_10.42.42.5(pid=2105): stdout: | (launched: 2022-12-09_11:52:55.513627) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:57.048513 run osmo-stp_10.42.42.5(pid=2105): stderr: | 20221209115255683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115255683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115255683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115255684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115255685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115255685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115255685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:57.182178 run osmo-stp_10.42.42.5(pid=2105): stdout: | (launched: 2022-12-09_11:52:55.513627) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:52:57.309617 run osmo-stp_10.42.42.5(pid=2105): stderr: | 20221209115255683 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115255683 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115255683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115255684 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115255685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115255685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115255685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:52:57.460586 run patchelf(pid=2108): Terminating (SIGINT) 11:52:57.636798 run patchelf(pid=2108): Terminated: ok {rc=0} 11:52:57.763835 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2105): Process ended prematurely: osmo-stp_10.42.42.5(pid=2105) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2105)] [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 11:52:57.773592 tst iperf3m4.py:8: Test FAILED (10.7 sec) 11:52:57.801523 run osmo-hlr_10.42.42.2(pid=2102): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2102)] 11:52:57.849872 run osmo-hlr_10.42.42.2(pid=2102): stdout: | (launched: 2022-12-09_11:52:54.534022) 11:52:57.900442 run osmo-hlr_10.42.42.2(pid=2102): stderr: | 20221209115254713 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115254713 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115254713 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115254713 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115254713 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115254713 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115254725 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115254733 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115254733 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115254733 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:52:57.951152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2091): Terminating (SIGTERM) 11:52:57.991485 run iperf3-srv_10.42.42.10(pid=2092): Terminating (SIGTERM) 11:52:58.031832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2093): Terminating (SIGTERM) 11:52:58.072141 run iperf3-srv_10.42.42.10(pid=2094): Terminating (SIGTERM) 11:52:58.112433 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2095): Terminating (SIGTERM) 11:52:58.152704 run iperf3-srv_10.42.42.10(pid=2096): Terminating (SIGTERM) 11:52:58.192896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2097): Terminating (SIGTERM) 11:52:58.233087 run iperf3-srv_10.42.42.10(pid=2098): Terminating (SIGTERM) 11:52:58.273270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2101): Terminating (SIGTERM) 11:52:58.314008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2104): Terminating (SIGTERM) 11:52:58.354441 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2107): Terminating (SIGTERM) 11:52:58.395115 --- ParallelTerminationStrategy: PID 2091 died... 11:52:58.414542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2091): Terminated: ok {rc=0} 11:52:58.459430 --- ParallelTerminationStrategy: PID 2092 died... 11:52:58.478257 run iperf3-srv_10.42.42.10(pid=2092): Terminated {rc=256} 11:52:58.522379 --- ParallelTerminationStrategy: PID 2093 died... 11:52:58.541283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2093): Terminated: ok {rc=0} 11:52:58.586323 --- ParallelTerminationStrategy: PID 2094 died... 11:52:58.605351 run iperf3-srv_10.42.42.10(pid=2094): Terminated {rc=256} 11:52:58.649503 --- ParallelTerminationStrategy: PID 2095 died... 11:52:58.668173 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2095): Terminated: ok {rc=0} 11:52:58.713480 --- ParallelTerminationStrategy: PID 2096 died... 11:52:58.732356 run iperf3-srv_10.42.42.10(pid=2096): Terminated {rc=256} 11:52:58.777179 --- ParallelTerminationStrategy: PID 2097 died... 11:52:58.796118 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2097): Terminated: ok {rc=0} 11:52:58.841050 --- ParallelTerminationStrategy: PID 2098 died... 11:52:58.859891 run iperf3-srv_10.42.42.10(pid=2098): Terminated {rc=256} 11:52:58.904491 --- ParallelTerminationStrategy: PID 2101 died... 11:52:58.923383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2101): Terminated: ok {rc=0} 11:52:58.967810 --- ParallelTerminationStrategy: PID 2104 died... 11:52:58.986598 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2104): Terminated: ok {rc=0} 11:52:59.030991 --- ParallelTerminationStrategy: PID 2107 died... 11:52:59.050052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2107): Terminated: ok {rc=0} 11:52:59.138365 bus /gobi_4: Setting Powered False 11:53:00.240729 bus /gobi_4: Setting Powered False 11:53:01.358030 bus /gobi_1: Setting Powered False 11:53:02.488900 bus /gobi_1: Setting Powered False 11:53:03.615033 bus /gobi_0: Setting Powered False 11:53:04.714254 bus /gobi_0: Setting Powered False 11:53:05.837448 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 11:53:06.948617 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:53:06.962239 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:53:07.046381 tst ping.py: using LAC 21276 11:53:07.176056 tst ping.py: using RAC 111 11:53:07.305475 tst ping.py: using CellId 21276 11:53:07.434476 tst ping.py: using BVCI 21277 11:53:07.558473 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:53:07.571132 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:53:07.583907 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:53:07.599569 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:53:07.612248 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:53:07.625447 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:53:07.640172 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:53:07.653926 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:53:07.783510 tst ping.py:19: start network... 11:53:08.012284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:53:08.531975 run create_hlr_db(pid=2380): Launched 11:53:08.699439 bus /gobi_6: Setting Powered False 11:53:09.765465 run create_hlr_db(pid=2380): Terminated: ok {rc=0} 11:53:10.243025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2382): Launched 11:53:10.595614 run osmo-hlr_10.42.42.2(pid=2383): Launched 11:53:10.849533 run osmo-stp_10.42.42.5: Starting osmo-stp 11:53:11.545175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2385): Launched 11:53:11.895301 run osmo-stp_10.42.42.5(pid=2386): Launched 11:53:12.155472 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:53:12.811708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2388): Launched 11:53:12.951895 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:53:13.241213 run patchelf(pid=2389): Launched 11:53:13.443559 run osmo-stp_10.42.42.5(pid=2386): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2386)] 11:53:13.588542 run osmo-stp_10.42.42.5(pid=2386): stdout: | (launched: 2022-12-09_11:53:11.834333) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:13.734915 run osmo-stp_10.42.42.5(pid=2386): stderr: | 20221209115312127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115312127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115312128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115312128 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115312128 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115312133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115312133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:13.881418 run osmo-stp_10.42.42.5(pid=2386): stdout: | (launched: 2022-12-09_11:53:11.834333) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:14.022002 run osmo-stp_10.42.42.5(pid=2386): stderr: | 20221209115312127 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115312127 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115312128 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115312128 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115312128 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115312133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115312133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:14.187020 run patchelf(pid=2389): Terminating (SIGINT) 11:53:14.379454 run patchelf(pid=2389): Terminated: ok {rc=0} 11:53:14.518881 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2386): Process ended prematurely: osmo-stp_10.42.42.5(pid=2386) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2386)] [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 11:53:14.529980 tst ping.py:22: Test FAILED (7.6 sec) 11:53:14.562555 run osmo-hlr_10.42.42.2(pid=2383): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2383)] 11:53:14.617710 run osmo-hlr_10.42.42.2(pid=2383): stdout: | (launched: 2022-12-09_11:53:10.532146) 11:53:14.673445 run osmo-hlr_10.42.42.2(pid=2383): stderr: | 20221209115310840 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115310840 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115310840 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115310840 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115310840 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115310840 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115310855 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115310872 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115310872 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115310872 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:53:14.729761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2382): Terminating (SIGTERM) 11:53:14.775339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2385): Terminating (SIGTERM) 11:53:14.823686 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2388): Terminating (SIGTERM) 11:53:14.871758 --- ParallelTerminationStrategy: PID 2382 died... 11:53:14.893081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2382): Terminated: ok {rc=0} 11:53:14.945226 --- ParallelTerminationStrategy: PID 2385 died... 11:53:14.966145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2385): Terminated: ok {rc=0} 11:53:15.019425 --- ParallelTerminationStrategy: PID 2388 died... 11:53:15.040933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2388): Terminated: ok {rc=0} 11:53:15.137176 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 11:53:16.244079 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:53:16.267071 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:53:16.345343 tst ping_idle_ping.py: using LAC 21277 11:53:16.496873 tst ping_idle_ping.py: using RAC 112 11:53:16.671192 tst ping_idle_ping.py: using CellId 21277 11:53:16.840170 tst ping_idle_ping.py: using BVCI 21278 11:53:16.985130 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:53:16.999683 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:53:17.017497 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:53:17.033627 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:53:17.050403 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:53:17.066373 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:53:17.083927 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 11:53:17.100655 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 11:53:17.254076 tst ping_idle_ping.py:24: start network... 11:53:17.532850 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:53:18.113671 run create_hlr_db(pid=2390): Launched 11:53:18.256677 bus /gobi_6: Setting Powered False 11:53:19.323696 run create_hlr_db(pid=2390): Terminated: ok {rc=0} 11:53:19.808349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2392): Launched 11:53:20.164432 run osmo-hlr_10.42.42.2(pid=2393): Launched 11:53:20.426997 run osmo-stp_10.42.42.5: Starting osmo-stp 11:53:21.114581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2395): Launched 11:53:21.487550 run osmo-stp_10.42.42.5(pid=2396): Launched 11:53:21.745375 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:53:22.410830 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2398): Launched 11:53:22.553981 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:53:22.847103 run patchelf(pid=2399): Launched 11:53:23.051236 run osmo-stp_10.42.42.5(pid=2396): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2396)] 11:53:23.197454 run osmo-stp_10.42.42.5(pid=2396): stdout: | (launched: 2022-12-09_11:53:21.426144) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:23.345055 run osmo-stp_10.42.42.5(pid=2396): stderr: | 20221209115321718 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115321718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115321718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115321719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115321719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115321719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115321719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:23.494835 run osmo-stp_10.42.42.5(pid=2396): stdout: | (launched: 2022-12-09_11:53:21.426144) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:23.637377 run osmo-stp_10.42.42.5(pid=2396): stderr: | 20221209115321718 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115321718 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115321718 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115321719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115321719 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115321719 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115321719 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:23.805959 run patchelf(pid=2399): Terminating (SIGINT) 11:53:24.001174 run patchelf(pid=2399): Terminated: ok {rc=0} 11:53:24.141302 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2396): Process ended prematurely: osmo-stp_10.42.42.5(pid=2396) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2396)] [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 11:53:24.151329 tst ping_idle_ping.py:27: Test FAILED (7.9 sec) 11:53:24.180892 run osmo-hlr_10.42.42.2(pid=2393): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2393)] 11:53:24.232619 run osmo-hlr_10.42.42.2(pid=2393): stdout: | (launched: 2022-12-09_11:53:20.100224) 11:53:24.285969 run osmo-hlr_10.42.42.2(pid=2393): stderr: | 20221209115320412 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115320412 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115320412 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115320412 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115320412 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115320412 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115320436 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115320453 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115320453 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115320454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:53:24.339981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2392): Terminating (SIGTERM) 11:53:24.383353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2395): Terminating (SIGTERM) 11:53:24.426541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2398): Terminating (SIGTERM) 11:53:24.470288 --- ParallelTerminationStrategy: PID 2392 died... 11:53:24.490640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2392): Terminated: ok {rc=0} 11:53:24.538597 --- ParallelTerminationStrategy: PID 2395 died... 11:53:24.558681 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2395): Terminated: ok {rc=0} 11:53:24.606438 --- ParallelTerminationStrategy: PID 2398 died... 11:53:24.626504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2398): Terminated: ok {rc=0} 11:53:24.716361 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:53:26.026849 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:53:26.033812 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:53:26.067584 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 11:53:26.101911 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:53:26.155861 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:53:26.189772 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 11:53:26.224503 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:53:26.782737 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2359 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 11:53:26.788087 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:53:26.800072 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:53:26.876449 tst switch_tch_pdch.py: using LAC 21278 11:53:26.997670 tst switch_tch_pdch.py: using RAC 113 11:53:27.117667 tst switch_tch_pdch.py: using CellId 21278 11:53:27.235847 tst switch_tch_pdch.py: using BVCI 21279 11:53:27.346189 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:53:27.357658 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:53:27.368838 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:53:27.380088 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:53:27.391275 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:53:27.402415 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:53:27.413755 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 11:53:27.424857 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:53:27.543992 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:53:27.665937 tst switch_tch_pdch.py:51: start network... 11:53:27.871292 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:53:28.345511 run create_hlr_db(pid=2404): Launched 11:53:28.471904 bus /gobi_6: Setting Powered False 11:53:29.533302 run create_hlr_db(pid=2404): Terminated: ok {rc=0} 11:53:29.985432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2406): Launched 11:53:30.316504 run osmo-hlr_10.42.42.2(pid=2407): Launched 11:53:30.442965 run osmo-stp_10.42.42.5: Starting osmo-stp 11:53:31.043968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2409): Launched 11:53:31.401690 run osmo-stp_10.42.42.5(pid=2410): Launched 11:53:31.753482 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:53:32.357180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2412): Launched 11:53:32.489938 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:53:32.767309 run patchelf(pid=2413): Launched 11:53:32.951790 run osmo-stp_10.42.42.5(pid=2410): ERR: Terminated: ERROR {rc=1} [trial-2359↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2410)] 11:53:33.090863 run osmo-stp_10.42.42.5(pid=2410): stdout: | (launched: 2022-12-09_11:53:31.339811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:33.231409 run osmo-stp_10.42.42.5(pid=2410): stderr: | 20221209115331543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115331543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115331543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115331544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115331544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115331544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115331545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:33.371814 run osmo-stp_10.42.42.5(pid=2410): stdout: | (launched: 2022-12-09_11:53:31.339811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:33.506280 run osmo-stp_10.42.42.5(pid=2410): stderr: | 20221209115331543 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115331543 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115331543 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115331544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115331544 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115331544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115331545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:33.664813 run patchelf(pid=2413): Terminating (SIGINT) 11:53:33.849698 run patchelf(pid=2413): Terminated: ok {rc=0} 11:53:33.982578 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=2410): Process ended prematurely: osmo-stp_10.42.42.5(pid=2410) [trial-2359↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2410)] [trial-2359↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 11:53:33.992387 tst switch_tch_pdch.py:54: Test FAILED (7.2 sec) 11:53:34.021191 run osmo-hlr_10.42.42.2(pid=2407): ERR: Terminated: ERROR {rc=237} [trial-2359↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2407)] 11:53:34.072773 run osmo-hlr_10.42.42.2(pid=2407): stdout: | (launched: 2022-12-09_11:53:30.255853) 11:53:34.126157 run osmo-hlr_10.42.42.2(pid=2407): stderr: | 20221209115330457 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115330457 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115330457 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115330457 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115330457 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115330457 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115330470 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115330480 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115330481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115330481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:53:34.179479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2406): Terminating (SIGTERM) 11:53:34.222298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2409): Terminating (SIGTERM) 11:53:34.265133 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2412): Terminating (SIGTERM) 11:53:34.308078 --- ParallelTerminationStrategy: PID 2406 died... 11:53:34.328266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2406): Terminated: ok {rc=0} 11:53:34.376062 --- ParallelTerminationStrategy: PID 2409 died... 11:53:34.396065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2409): Terminated: ok {rc=0} 11:53:34.443484 --- ParallelTerminationStrategy: PID 2412 died... 11:53:34.463751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2412): Terminated: ok {rc=0} 11:53:34.554386 bus /gobi_0: Setting Powered False 11:53:35.653064 bus /gobi_0: Setting Powered False 11:53:36.769333 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 11:53:38.025012 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:53:38.030650 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 11:53:38.064161 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 11:53:38.098608 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 11:53:38.151467 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 11:53:38.184765 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 11:53:38.218824 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 11:53:38.777275 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2359 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 11:53:38.782259 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:53:38.793475 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 11:53:38.863717 tst switch_tch_pdch.py: using LAC 21279 11:53:38.994425 tst switch_tch_pdch.py: using RAC 114 11:53:39.124134 tst switch_tch_pdch.py: using CellId 21279 11:53:39.252433 tst switch_tch_pdch.py: using BVCI 21280 11:53:39.373381 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:53:39.385199 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:53:39.397058 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:53:39.409627 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:53:39.421521 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:53:39.433583 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:53:39.445856 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 11:53:39.457792 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:53:39.576729 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 11:53:39.697037 tst switch_tch_pdch.py:51: start network... 11:53:39.902361 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:53:40.351787 run create_hlr_db(pid=2418): Launched 11:53:40.477713 bus /gobi_6: Setting Powered False 11:53:41.542844 run create_hlr_db(pid=2418): Terminated: ok {rc=0} 11:53:41.972212 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2420): Launched 11:53:42.302182 run osmo-hlr_10.42.42.2(pid=2421): Launched 11:53:42.427576 run osmo-stp_10.42.42.5: Starting osmo-stp 11:53:42.967981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2423): Launched 11:53:43.297198 run osmo-stp_10.42.42.5(pid=2424): Launched 11:53:43.423437 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:53:43.960469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2426): Launched 11:53:44.087806 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:53:44.357447 run patchelf(pid=2427): Launched 11:53:44.530389 run osmo-stp_10.42.42.5(pid=2424): ERR: Terminated: ERROR {rc=1} [trial-2359↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2424)] 11:53:44.660758 run osmo-stp_10.42.42.5(pid=2424): stdout: | (launched: 2022-12-09_11:53:43.237111) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:44.792372 run osmo-stp_10.42.42.5(pid=2424): stderr: | 20221209115343431 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115343431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115343431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115343431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115343432 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115343432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115343432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:44.923683 run osmo-stp_10.42.42.5(pid=2424): stdout: | (launched: 2022-12-09_11:53:43.237111) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:53:45.050267 run osmo-stp_10.42.42.5(pid=2424): stderr: | 20221209115343431 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115343431 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115343431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115343431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115343432 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115343432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115343432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:53:45.199360 run patchelf(pid=2427): Terminating (SIGINT) 11:53:45.373855 run patchelf(pid=2427): Terminated: ok {rc=0} 11:53:45.499737 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=2424): Process ended prematurely: osmo-stp_10.42.42.5(pid=2424) [trial-2359↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2424)] [trial-2359↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 11:53:45.508669 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 11:53:45.535522 run osmo-hlr_10.42.42.2(pid=2421): ERR: Terminated: ERROR {rc=237} [trial-2359↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2421)] 11:53:45.583445 run osmo-hlr_10.42.42.2(pid=2421): stdout: | (launched: 2022-12-09_11:53:42.241709) 11:53:45.633267 run osmo-hlr_10.42.42.2(pid=2421): stderr: | 20221209115342441 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115342441 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115342441 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115342441 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115342441 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115342441 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115342454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115342464 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115342465 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115342465 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:53:45.683332 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2420): Terminating (SIGTERM) 11:53:45.723480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2423): Terminating (SIGTERM) 11:53:45.763747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2426): Terminating (SIGTERM) 11:53:45.804177 --- ParallelTerminationStrategy: PID 2420 died... 11:53:45.823468 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2420): Terminated: ok {rc=0} 11:53:45.872398 --- ParallelTerminationStrategy: PID 2423 died... 11:53:45.898747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2423): Terminated: ok {rc=0} 11:53:45.949844 --- ParallelTerminationStrategy: PID 2426 died... 11:53:45.969460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2426): Terminated: ok {rc=0} 11:53:46.058763 bus /gobi_0: Setting Powered False 11:53:47.167980 bus /gobi_0: Setting Powered False 11:53:48.295721 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 nitb_sms:trx-umtrx --------------------------------------------------------------------- 11:53:49.557611 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:53:49.561593 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 11:53:49.597816 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 11:53:49.605761 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 11:53:49.658959 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 11:53:49.691874 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 11:53:49.698712 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 11:53:50.237658 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 11:53:50.242676 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 11:53:50.253792 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 11:53:50.302557 tst mo_mt_sms.py: using LAC 21280 11:53:50.422560 tst mo_mt_sms.py: using RAC 115 11:53:50.542327 tst mo_mt_sms.py: using CellId 21280 11:53:50.659971 tst mo_mt_sms.py: using BVCI 21281 11:53:50.770091 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 11:53:50.892295 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 11:53:51.011968 tst mo_mt_sms.py:9: start nitb and bts... 11:53:51.237653 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:53:51.908106 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2432): Launched 11:53:52.237427 run osmo-nitb_10.42.42.2(pid=2433): Launched 11:53:52.422140 run osmo-nitb_10.42.42.2(pid=2433): ERR: Terminated: ERROR {rc=2} [trial-2359↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2433)] 11:53:52.570698 run osmo-nitb_10.42.42.2(pid=2433): stdout: | (launched: 2022-12-09_11:53:52.177287) 11:53:52.720110 run osmo-nitb_10.42.42.2(pid=2433): stderr: | (launched: 2022-12-09_11:53:52.225960) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:53:52.869793 run osmo-nitb_10.42.42.2(pid=2433): stdout: | (launched: 2022-12-09_11:53:52.177287) 11:53:53.012893 run osmo-nitb_10.42.42.2(pid=2433): stderr: | (launched: 2022-12-09_11:53:52.225960) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2433): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2433) [trial-2359↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2433)] 11:53:53.363774 tst osmo-nitb_10.42.42.2(pid=2433): stdout: | (launched: 2022-12-09_11:53:52.177287) 11:53:53.497067 tst osmo-nitb_10.42.42.2(pid=2433): stderr: | (launched: 2022-12-09_11:53:52.225960) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:53:53.654158 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=2433): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2433) [trial-2359↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2433)] [trial-2359↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 11:53:53.663322 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 11:53:53.670589 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2432): Terminating (SIGTERM) 11:53:53.882162 --- ParallelTerminationStrategy: PID 2432 died... 11:53:53.904097 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2432): Terminated: ok {rc=0} 11:53:53.993878 bus /sierra_3: Setting Powered False 11:53:55.093217 bus /sierra_3: Setting Powered False 11:53:56.213553 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 sms:trx-umtrx --------------------------------------------------------------------- 11:53:57.414150 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:53:57.418728 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 11:53:57.452599 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:53:57.480319 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 11:53:57.535922 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 11:53:57.568903 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:53:57.595316 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 11:53:58.139549 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 11:53:58.144455 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:53:58.155088 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 11:53:58.205743 tst mo_mt_sms.py: using LAC 21281 11:53:58.325097 tst mo_mt_sms.py: using RAC 116 11:53:58.443488 tst mo_mt_sms.py: using CellId 21281 11:53:58.562229 tst mo_mt_sms.py: using BVCI 21282 11:53:58.675280 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:53:58.685999 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:53:58.696481 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:53:58.706861 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:53:58.717344 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:53:58.727772 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 11:53:58.848767 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 11:53:58.967605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:53:59.443130 run create_hlr_db(pid=2437): Launched 11:53:59.568917 bus /sierra_2: Setting Powered False 11:54:00.630412 run create_hlr_db(pid=2437): Terminated: ok {rc=0} 11:54:01.090967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2439): Launched 11:54:01.417230 run osmo-hlr_10.42.42.2(pid=2440): Launched 11:54:01.559601 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:02.331217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2442): Launched 11:54:02.663275 run osmo-stp_10.42.42.5(pid=2443): Launched 11:54:02.791985 run osmo-msc_10.42.42.6: Starting osmo-msc 11:54:03.390653 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2445): Launched 11:54:03.719883 run osmo-msc_10.42.42.6(pid=2446): Launched 11:54:03.903635 run osmo-stp_10.42.42.5(pid=2443): ERR: Terminated: ERROR {rc=1} [trial-2359↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2443)] 11:54:04.041469 run osmo-stp_10.42.42.5(pid=2443): stdout: | (launched: 2022-12-09_11:54:02.602814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:04.179965 run osmo-stp_10.42.42.5(pid=2443): stderr: | 20221209115402795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115402795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115402795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115402796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115402796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115402796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115402796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:04.316866 run osmo-stp_10.42.42.5(pid=2443): stdout: | (launched: 2022-12-09_11:54:02.602814) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:04.447646 run osmo-stp_10.42.42.5(pid=2443): stderr: | 20221209115402795 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115402795 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115402795 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115402796 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115402796 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115402796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115402796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:04.604641 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=2443): Process ended prematurely: osmo-stp_10.42.42.5(pid=2443) [trial-2359↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2443)] [trial-2359↪sms:trx-umtrx↪mo_mt_sms.py:16] 11:54:04.613780 tst mo_mt_sms.py:16: Test FAILED (6.5 sec) 11:54:04.642156 run osmo-hlr_10.42.42.2(pid=2440): ERR: Terminated: ERROR {rc=237} [trial-2359↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2440)] 11:54:04.693336 run osmo-hlr_10.42.42.2(pid=2440): stdout: | (launched: 2022-12-09_11:54:01.357666) 11:54:04.746493 run osmo-hlr_10.42.42.2(pid=2440): stderr: | 20221209115401758 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115401758 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115401758 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115401758 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115401758 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115401759 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115401782 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115401799 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115401799 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115401799 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:54:04.820322 run osmo-msc_10.42.42.6(pid=2446): ERR: Terminated: ERROR {rc=2} [trial-2359↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2446)] 11:54:04.871084 run osmo-msc_10.42.42.6(pid=2446): stdout: | (launched: 2022-12-09_11:54:03.659651) 11:54:04.924484 run osmo-msc_10.42.42.6(pid=2446): stderr: | 20221209115403980 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209115403980 DLGLOBAL DEBUG validating counter group 0x7f0085969c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209115403980 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209115403980 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209115403980 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209115403980 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209115403982 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209115403982 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209115403983 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209115403983 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:54:04.978056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2439): Terminating (SIGTERM) 11:54:05.020990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2442): Terminating (SIGTERM) 11:54:05.063720 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2445): Terminating (SIGTERM) 11:54:05.107125 --- ParallelTerminationStrategy: PID 2439 died... 11:54:05.127687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2439): Terminated: ok {rc=0} 11:54:05.175343 --- ParallelTerminationStrategy: PID 2442 died... 11:54:05.195163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2442): Terminated: ok {rc=0} 11:54:05.242464 --- ParallelTerminationStrategy: PID 2445 died... 11:54:05.262386 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2445): Terminated: ok {rc=0} 11:54:05.351602 bus /sierra_3: Setting Powered False 11:54:06.451551 bus /sierra_3: Setting Powered False 11:54:07.571806 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 11:54:08.802378 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:54:08.806069 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 11:54:08.838269 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 11:54:08.845081 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 11:54:08.879923 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 11:54:08.912881 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 11:54:08.919762 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 11:54:09.442113 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2359 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 11:54:09.447522 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 11:54:09.458879 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 11:54:09.511030 tst assert_extension.py: using LAC 21282 11:54:09.639856 tst assert_extension.py: using RAC 117 11:54:09.765478 tst assert_extension.py: using CellId 21282 11:54:09.886240 tst assert_extension.py: using BVCI 21283 11:54:09.996311 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 11:54:10.116834 tst assert_extension.py:10: start nitb and bts... 11:54:10.338821 run osmo-nitb_10.42.42.2: Starting osmo-nitb 11:54:11.008451 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2451): Launched 11:54:11.338105 run osmo-nitb_10.42.42.2(pid=2452): Launched 11:54:11.522255 run osmo-nitb_10.42.42.2(pid=2452): ERR: Terminated: ERROR {rc=2} [trial-2359↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2452)] 11:54:11.668714 run osmo-nitb_10.42.42.2(pid=2452): stdout: | (launched: 2022-12-09_11:54:11.277702) 11:54:11.817167 run osmo-nitb_10.42.42.2(pid=2452): stderr: | (launched: 2022-12-09_11:54:11.326448) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:54:11.965162 run osmo-nitb_10.42.42.2(pid=2452): stdout: | (launched: 2022-12-09_11:54:11.277702) 11:54:12.107130 run osmo-nitb_10.42.42.2(pid=2452): stderr: | (launched: 2022-12-09_11:54:11.326448) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=2452): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2452) [trial-2359↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2452)] 11:54:12.463506 tst osmo-nitb_10.42.42.2(pid=2452): stdout: | (launched: 2022-12-09_11:54:11.277702) 11:54:12.596892 tst osmo-nitb_10.42.42.2(pid=2452): stderr: | (launched: 2022-12-09_11:54:11.326448) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 11:54:12.754207 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=2452): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2452) [trial-2359↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2452)] [trial-2359↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 11:54:12.763520 tst assert_extension.py:12: Test FAILED (3.3 sec) 11:54:12.770691 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2451): Terminating (SIGTERM) 11:54:12.983418 --- ParallelTerminationStrategy: PID 2451 died... 11:54:13.005829 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=2451): Terminated: ok {rc=0} 11:54:13.095925 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 ussd:trx-umtrx --------------------------------------------------------------------- 11:54:14.273453 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:54:14.277941 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 11:54:14.312164 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:54:14.340140 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 11:54:14.376697 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 11:54:14.410632 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:54:14.438408 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 11:54:14.965609 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2359 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 11:54:14.970570 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:54:14.981323 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 11:54:15.029137 tst assert_extension.py: using LAC 21283 11:54:15.150115 tst assert_extension.py: using RAC 118 11:54:15.269992 tst assert_extension.py: using CellId 21283 11:54:15.390667 tst assert_extension.py: using BVCI 21284 11:54:15.502373 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:54:15.513063 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:54:15.523629 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:54:15.534165 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:54:15.544562 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:54:15.554979 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 11:54:15.675996 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:54:16.193770 run create_hlr_db(pid=2456): Launched 11:54:16.354261 bus /sierra_2: Setting Powered False 11:54:17.416125 run create_hlr_db(pid=2456): Terminated: ok {rc=0} 11:54:17.879693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2458): Launched 11:54:18.210357 run osmo-hlr_10.42.42.2(pid=2459): Launched 11:54:18.338415 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:18.913433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2461): Launched 11:54:19.242571 run osmo-stp_10.42.42.5(pid=2462): Launched 11:54:19.369031 run osmo-msc_10.42.42.6: Starting osmo-msc 11:54:19.962370 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2464): Launched 11:54:20.290855 run osmo-msc_10.42.42.6(pid=2465): Launched 11:54:20.476324 run osmo-stp_10.42.42.5(pid=2462): ERR: Terminated: ERROR {rc=1} [trial-2359↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2462)] 11:54:20.615138 run osmo-stp_10.42.42.5(pid=2462): stdout: | (launched: 2022-12-09_11:54:19.182054) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:20.753967 run osmo-stp_10.42.42.5(pid=2462): stderr: | 20221209115419376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115419377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115419377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115419377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115419378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115419378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115419378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:20.891096 run osmo-stp_10.42.42.5(pid=2462): stdout: | (launched: 2022-12-09_11:54:19.182054) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:21.021248 run osmo-stp_10.42.42.5(pid=2462): stderr: | 20221209115419376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115419377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115419377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115419377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115419378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115419378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115419378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:21.177075 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=2462): Process ended prematurely: osmo-stp_10.42.42.5(pid=2462) [trial-2359↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2462)] [trial-2359↪ussd:trx-umtrx↪assert_extension.py:17] 11:54:21.186175 tst assert_extension.py:17: Test FAILED (6.2 sec) 11:54:21.214338 run osmo-hlr_10.42.42.2(pid=2459): ERR: Terminated: ERROR {rc=237} [trial-2359↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2459)] 11:54:21.265646 run osmo-hlr_10.42.42.2(pid=2459): stdout: | (launched: 2022-12-09_11:54:18.149480) 11:54:21.318488 run osmo-hlr_10.42.42.2(pid=2459): stderr: | 20221209115418346 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115418346 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115418346 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115418346 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115418346 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115418346 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115418358 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115418367 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115418367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115418367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:54:21.391885 run osmo-msc_10.42.42.6(pid=2465): ERR: Terminated: ERROR {rc=2} [trial-2359↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2465)] 11:54:21.443018 run osmo-msc_10.42.42.6(pid=2465): stdout: | (launched: 2022-12-09_11:54:20.230706) 11:54:21.496220 run osmo-msc_10.42.42.6(pid=2465): stderr: | 20221209115420552 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209115420552 DLGLOBAL DEBUG validating counter group 0x7fbf0d7dac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209115420552 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209115420552 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209115420552 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209115420553 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209115420554 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209115420555 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209115420555 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209115420555 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:54:21.549564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2458): Terminating (SIGTERM) 11:54:21.592216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2461): Terminating (SIGTERM) 11:54:21.634853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2464): Terminating (SIGTERM) 11:54:21.677729 --- ParallelTerminationStrategy: PID 2458 died... 11:54:21.697956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2458): Terminated: ok {rc=0} 11:54:21.745193 --- ParallelTerminationStrategy: PID 2461 died... 11:54:21.764898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2461): Terminated: ok {rc=0} 11:54:21.812200 --- ParallelTerminationStrategy: PID 2464 died... 11:54:21.831994 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2464): Terminated: ok {rc=0} 11:54:21.921893 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 11:54:23.132228 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:54:23.138974 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 11:54:23.172768 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 11:54:23.199568 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 11:54:23.255173 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 11:54:23.290566 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 11:54:23.318283 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 11:54:23.863026 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 11:54:23.915188 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:23.926679 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:54:23.996898 tst mo_mt_call.py: using LAC 21284 11:54:24.120391 tst mo_mt_call.py: using RAC 119 11:54:24.243554 tst mo_mt_call.py: using CellId 21284 11:54:24.367523 tst mo_mt_call.py: using BVCI 21285 11:54:24.482281 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:24.493609 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:24.504586 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:24.515658 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:24.526797 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:24.537824 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:54:24.659946 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:54:24.783236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:54:25.303277 run create_hlr_db(pid=2470): Launched 11:54:25.433728 bus /sierra_2: Setting Powered False 11:54:26.499879 run create_hlr_db(pid=2470): Terminated: ok {rc=0} 11:54:26.967348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2472): Launched 11:54:27.303849 run osmo-hlr_10.42.42.2(pid=2473): Launched 11:54:27.430199 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:27.989915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2475): Launched 11:54:28.305509 run osmo-stp_10.42.42.5(pid=2476): Launched 11:54:28.426539 run osmo-msc_10.42.42.6: Starting osmo-msc 11:54:28.997176 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2478): Launched 11:54:29.312191 run osmo-msc_10.42.42.6(pid=2479): Launched 11:54:29.489101 run osmo-stp_10.42.42.5(pid=2476): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2476)] 11:54:29.622539 run osmo-stp_10.42.42.5(pid=2476): stdout: | (launched: 2022-12-09_11:54:28.247238) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:29.755207 run osmo-stp_10.42.42.5(pid=2476): stderr: | 20221209115428420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115428420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115428420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115428420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115428421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115428421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115428421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:29.885882 run osmo-stp_10.42.42.5(pid=2476): stdout: | (launched: 2022-12-09_11:54:28.247238) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:30.010400 run osmo-stp_10.42.42.5(pid=2476): stderr: | 20221209115428420 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115428420 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115428420 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115428420 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115428421 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115428421 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115428421 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:30.159580 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2476): Process ended prematurely: osmo-stp_10.42.42.5(pid=2476) [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2476)] [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 11:54:30.168440 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:54:30.195208 run osmo-hlr_10.42.42.2(pid=2473): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2473)] 11:54:30.243571 run osmo-hlr_10.42.42.2(pid=2473): stdout: | (launched: 2022-12-09_11:54:27.241990) 11:54:30.293610 run osmo-hlr_10.42.42.2(pid=2473): stderr: | 20221209115427422 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115427422 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115427422 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115427422 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115427422 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115427422 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115427433 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115427441 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115427441 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115427441 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:54:30.363120 run osmo-msc_10.42.42.6(pid=2479): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2479)] 11:54:30.411182 run osmo-msc_10.42.42.6(pid=2479): stdout: | (launched: 2022-12-09_11:54:29.253409) 11:54:30.461362 run osmo-msc_10.42.42.6(pid=2479): stderr: | 20221209115429530 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209115429530 DLGLOBAL DEBUG validating counter group 0x7f14bb66ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209115429530 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209115429530 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209115429530 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209115429530 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209115429534 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209115429534 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209115429534 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209115429534 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:54:30.511414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2472): Terminating (SIGTERM) 11:54:30.551727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2475): Terminating (SIGTERM) 11:54:30.591874 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2478): Terminating (SIGTERM) 11:54:30.632082 --- ParallelTerminationStrategy: PID 2472 died... 11:54:30.651337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2472): Terminated: ok {rc=0} 11:54:30.695723 --- ParallelTerminationStrategy: PID 2475 died... 11:54:30.714609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2475): Terminated: ok {rc=0} 11:54:30.759512 --- ParallelTerminationStrategy: PID 2478 died... 11:54:30.778430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2478): Terminated: ok {rc=0} 11:54:30.884217 bus /sierra_3: Setting Powered False 11:54:32.014245 bus /sierra_3: Setting Powered False 11:54:33.132150 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 11:54:34.277832 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:34.289392 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 11:54:34.358159 tst mo_mt_call_osmux.py: using LAC 21285 11:54:34.476730 tst mo_mt_call_osmux.py: using RAC 120 11:54:34.596662 tst mo_mt_call_osmux.py: using CellId 21285 11:54:34.716797 tst mo_mt_call_osmux.py: using BVCI 21286 11:54:34.827699 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:34.838702 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:34.849939 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:34.860629 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:34.871473 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 11:54:34.882166 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:54:34.997975 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 11:54:35.121084 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:54:35.622146 run create_hlr_db(pid=2481): Launched 11:54:35.745636 bus /sierra_2: Setting Powered False 11:54:36.805500 run create_hlr_db(pid=2481): Terminated: ok {rc=0} 11:54:37.239568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2483): Launched 11:54:37.542108 run osmo-hlr_10.42.42.2(pid=2484): Launched 11:54:37.656546 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:38.177399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2486): Launched 11:54:38.480757 run osmo-stp_10.42.42.5(pid=2487): Launched 11:54:38.596122 run osmo-msc_10.42.42.6: Starting osmo-msc 11:54:39.139985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2489): Launched 11:54:39.442533 run osmo-msc_10.42.42.6(pid=2490): Launched 11:54:39.611259 run osmo-stp_10.42.42.5(pid=2487): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2487)] 11:54:39.738142 run osmo-stp_10.42.42.5(pid=2487): stdout: | (launched: 2022-12-09_11:54:38.424659) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:39.864623 run osmo-stp_10.42.42.5(pid=2487): stderr: | 20221209115438592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115438593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115438593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115438593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115438594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115438594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115438594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:39.989990 run osmo-stp_10.42.42.5(pid=2487): stdout: | (launched: 2022-12-09_11:54:38.424659) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:40.109225 run osmo-stp_10.42.42.5(pid=2487): stderr: | 20221209115438592 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115438593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115438593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115438593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115438594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115438594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115438594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:40.251716 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2487): Process ended prematurely: osmo-stp_10.42.42.5(pid=2487) [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2487)] [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 11:54:40.260462 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 11:54:40.286874 run osmo-hlr_10.42.42.2(pid=2484): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2484)] 11:54:40.334223 run osmo-hlr_10.42.42.2(pid=2484): stdout: | (launched: 2022-12-09_11:54:37.486319) 11:54:40.383215 run osmo-hlr_10.42.42.2(pid=2484): stderr: | 20221209115437660 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115437660 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115437660 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115437660 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115437660 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115437660 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115437672 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115437681 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115437681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115437681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:54:40.452540 run osmo-msc_10.42.42.6(pid=2490): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2490)] 11:54:40.500000 run osmo-msc_10.42.42.6(pid=2490): stdout: | (launched: 2022-12-09_11:54:39.386698) 11:54:40.549169 run osmo-msc_10.42.42.6(pid=2490): stderr: | 20221209115439654 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209115439655 DLGLOBAL DEBUG validating counter group 0x7fb613991c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209115439655 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209115439655 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209115439655 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209115439655 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209115439657 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209115439657 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209115439658 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209115439658 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:54:40.598866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2483): Terminating (SIGTERM) 11:54:40.638157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2486): Terminating (SIGTERM) 11:54:40.677545 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2489): Terminating (SIGTERM) 11:54:40.717166 --- ParallelTerminationStrategy: PID 2483 died... 11:54:40.736293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2483): Terminated: ok {rc=0} 11:54:40.780047 --- ParallelTerminationStrategy: PID 2486 died... 11:54:40.798650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2486): Terminated: ok {rc=0} 11:54:40.842356 --- ParallelTerminationStrategy: PID 2489 died... 11:54:40.860907 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2489): Terminated: ok {rc=0} 11:54:40.946418 bus /sierra_3: Setting Powered False 11:54:42.046916 bus /sierra_3: Setting Powered False 11:54:43.161317 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 11:54:44.405560 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:54:44.412046 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 11:54:44.443999 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 11:54:44.470377 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 11:54:44.522110 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 11:54:44.554029 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 11:54:44.580155 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 11:54:45.130791 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 11:54:45.178861 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:45.189988 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:54:45.257963 tst mo_mt_call.py: using LAC 21286 11:54:45.378268 tst mo_mt_call.py: using RAC 121 11:54:45.498606 tst mo_mt_call.py: using CellId 21286 11:54:45.619024 tst mo_mt_call.py: using BVCI 21287 11:54:45.729473 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:45.740637 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:45.751562 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:45.762429 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:45.773451 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:45.784212 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:54:45.919191 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:54:46.051161 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:54:46.530876 run create_hlr_db(pid=2496): Launched 11:54:46.690124 bus /sierra_2: Setting Powered False 11:54:47.753915 run create_hlr_db(pid=2496): Terminated: ok {rc=0} 11:54:48.186843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2498): Launched 11:54:48.488741 run osmo-hlr_10.42.42.2(pid=2499): Launched 11:54:48.602718 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:49.119769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2501): Launched 11:54:49.421001 run osmo-stp_10.42.42.5(pid=2502): Launched 11:54:49.536145 run osmo-msc_10.42.42.6: Starting osmo-msc 11:54:50.078778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2504): Launched 11:54:50.378756 run osmo-msc_10.42.42.6(pid=2505): Launched 11:54:50.545944 run osmo-stp_10.42.42.5(pid=2502): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2502)] 11:54:50.672431 run osmo-stp_10.42.42.5(pid=2502): stdout: | (launched: 2022-12-09_11:54:49.365878) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:50.798860 run osmo-stp_10.42.42.5(pid=2502): stderr: | 20221209115449532 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115449532 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115449532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115449533 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115449533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115449533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115449533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:50.923714 run osmo-stp_10.42.42.5(pid=2502): stdout: | (launched: 2022-12-09_11:54:49.365878) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:54:51.042931 run osmo-stp_10.42.42.5(pid=2502): stderr: | 20221209115449532 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115449532 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115449532 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115449533 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115449533 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115449533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115449533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:54:51.185712 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2502): Process ended prematurely: osmo-stp_10.42.42.5(pid=2502) [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2502)] [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 11:54:51.194526 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 11:54:51.220646 run osmo-hlr_10.42.42.2(pid=2499): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2499)] 11:54:51.268417 run osmo-hlr_10.42.42.2(pid=2499): stdout: | (launched: 2022-12-09_11:54:48.433424) 11:54:51.317736 run osmo-hlr_10.42.42.2(pid=2499): stderr: | 20221209115448607 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115448607 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115448607 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115448607 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115448607 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115448607 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115448625 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115448636 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115448636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115448636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:54:51.386412 run osmo-msc_10.42.42.6(pid=2505): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2505)] 11:54:51.434052 run osmo-msc_10.42.42.6(pid=2505): stdout: | (launched: 2022-12-09_11:54:50.323556) 11:54:51.483845 run osmo-msc_10.42.42.6(pid=2505): stderr: | 20221209115450592 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209115450592 DLGLOBAL DEBUG validating counter group 0x7f8447afbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209115450592 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209115450592 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209115450592 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209115450592 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209115450594 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209115450595 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209115450595 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209115450595 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:54:51.533639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2498): Terminating (SIGTERM) 11:54:51.572844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2501): Terminating (SIGTERM) 11:54:51.612006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2504): Terminating (SIGTERM) 11:54:51.651407 --- ParallelTerminationStrategy: PID 2498 died... 11:54:51.670436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2498): Terminated: ok {rc=0} 11:54:51.714174 --- ParallelTerminationStrategy: PID 2501 died... 11:54:51.732929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2501): Terminated: ok {rc=0} 11:54:51.777412 --- ParallelTerminationStrategy: PID 2504 died... 11:54:51.796138 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2504): Terminated: ok {rc=0} 11:54:51.880386 bus /sierra_3: Setting Powered False 11:54:52.978777 bus /sierra_3: Setting Powered False 11:54:54.095975 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 11:54:55.245301 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:55.257558 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 11:54:55.328609 tst mo_mt_call_osmux.py: using LAC 21287 11:54:55.456672 tst mo_mt_call_osmux.py: using RAC 122 11:54:55.587668 tst mo_mt_call_osmux.py: using CellId 21287 11:54:55.714535 tst mo_mt_call_osmux.py: using BVCI 21288 11:54:55.831784 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:55.843282 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:55.854627 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:55.866155 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:55.877901 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 11:54:55.889400 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:54:56.009426 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 11:54:56.130336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:54:56.597889 run create_hlr_db(pid=2507): Launched 11:54:56.722130 bus /sierra_2: Setting Powered False 11:54:57.782362 run create_hlr_db(pid=2507): Terminated: ok {rc=0} 11:54:58.224160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2509): Launched 11:54:58.548260 run osmo-hlr_10.42.42.2(pid=2510): Launched 11:54:58.672418 run osmo-stp_10.42.42.5: Starting osmo-stp 11:54:59.231792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2512): Launched 11:54:59.556128 run osmo-stp_10.42.42.5(pid=2513): Launched 11:54:59.679808 run osmo-msc_10.42.42.6: Starting osmo-msc 11:55:00.262828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2515): Launched 11:55:00.587024 run osmo-msc_10.42.42.6(pid=2516): Launched 11:55:00.766569 run osmo-stp_10.42.42.5(pid=2513): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2513)] 11:55:00.927871 run osmo-stp_10.42.42.5(pid=2513): stdout: | (launched: 2022-12-09_11:54:59.496824) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:01.177219 run osmo-stp_10.42.42.5(pid=2513): stderr: | 20221209115459686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115459686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115459686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115459687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115459687 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115459687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115459687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:01.322393 run osmo-stp_10.42.42.5(pid=2513): stdout: | (launched: 2022-12-09_11:54:59.496824) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:01.445876 run osmo-stp_10.42.42.5(pid=2513): stderr: | 20221209115459686 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115459686 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115459686 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115459687 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115459687 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115459687 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115459687 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:01.594908 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2513): Process ended prematurely: osmo-stp_10.42.42.5(pid=2513) [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2513)] [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 11:55:01.604322 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 11:55:01.631717 run osmo-hlr_10.42.42.2(pid=2510): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2510)] 11:55:01.684433 run osmo-hlr_10.42.42.2(pid=2510): stdout: | (launched: 2022-12-09_11:54:58.488916) 11:55:01.735903 run osmo-hlr_10.42.42.2(pid=2510): stderr: | 20221209115458685 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115458685 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115458685 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115458685 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115458685 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115458685 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115458695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115458704 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115458704 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115458704 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:55:01.807093 run osmo-msc_10.42.42.6(pid=2516): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2516)] 11:55:01.856069 run osmo-msc_10.42.42.6(pid=2516): stdout: | (launched: 2022-12-09_11:55:00.527820) 11:55:01.906892 run osmo-msc_10.42.42.6(pid=2516): stderr: | 20221209115500894 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209115500894 DLGLOBAL DEBUG validating counter group 0x7f362bc9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209115500894 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209115500894 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209115500894 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209115500895 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209115500896 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209115500897 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209115500897 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209115500897 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:55:01.958744 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2509): Terminating (SIGTERM) 11:55:02.000280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2512): Terminating (SIGTERM) 11:55:02.043212 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2515): Terminating (SIGTERM) 11:55:02.086626 --- ParallelTerminationStrategy: PID 2509 died... 11:55:02.107718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2509): Terminated: ok {rc=0} 11:55:02.154431 --- ParallelTerminationStrategy: PID 2512 died... 11:55:02.173752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2512): Terminated: ok {rc=0} 11:55:02.219182 --- ParallelTerminationStrategy: PID 2515 died... 11:55:02.238554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2515): Terminated: ok {rc=0} 11:55:02.327651 bus /sierra_3: Setting Powered False 11:55:03.427986 bus /sierra_3: Setting Powered False 11:55:04.545263 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 11:55:05.795389 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:55:05.802375 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 11:55:05.836484 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 11:55:05.863877 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 11:55:05.916688 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 11:55:05.949751 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 11:55:05.976927 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 11:55:06.529765 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 11:55:06.582069 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:55:06.593574 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:55:06.663070 tst mo_mt_call.py: using LAC 21288 11:55:06.791607 tst mo_mt_call.py: using RAC 123 11:55:06.912393 tst mo_mt_call.py: using CellId 21288 11:55:07.033608 tst mo_mt_call.py: using BVCI 21289 11:55:07.146526 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:55:07.157671 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:55:07.168670 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:55:07.179531 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:55:07.190365 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:55:07.201123 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:55:07.320093 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:55:07.439328 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:55:07.940517 run create_hlr_db(pid=2524): Launched 11:55:08.065987 bus /sierra_2: Setting Powered False 11:55:09.130079 run create_hlr_db(pid=2524): Terminated: ok {rc=0} 11:55:09.580053 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2526): Launched 11:55:09.903199 run osmo-hlr_10.42.42.2(pid=2527): Launched 11:55:10.025887 run osmo-stp_10.42.42.5: Starting osmo-stp 11:55:10.582287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2529): Launched 11:55:10.905121 run osmo-stp_10.42.42.5(pid=2530): Launched 11:55:11.030481 run osmo-msc_10.42.42.6: Starting osmo-msc 11:55:11.613345 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2532): Launched 11:55:11.915848 run osmo-msc_10.42.42.6(pid=2533): Launched 11:55:12.084031 run osmo-stp_10.42.42.5(pid=2530): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2530)] 11:55:12.211437 run osmo-stp_10.42.42.5(pid=2530): stdout: | (launched: 2022-12-09_11:55:10.846575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:12.338521 run osmo-stp_10.42.42.5(pid=2530): stderr: | 20221209115511033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115511034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115511034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115511034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115511035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115511035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115511035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:12.463825 run osmo-stp_10.42.42.5(pid=2530): stdout: | (launched: 2022-12-09_11:55:10.846575) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:12.583394 run osmo-stp_10.42.42.5(pid=2530): stderr: | 20221209115511033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115511034 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115511034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115511034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115511035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115511035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115511035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:12.726615 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2530): Process ended prematurely: osmo-stp_10.42.42.5(pid=2530) [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2530)] [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 11:55:12.735555 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 11:55:12.762252 run osmo-hlr_10.42.42.2(pid=2527): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2527)] 11:55:12.810359 run osmo-hlr_10.42.42.2(pid=2527): stdout: | (launched: 2022-12-09_11:55:09.844780) 11:55:12.859904 run osmo-hlr_10.42.42.2(pid=2527): stderr: | 20221209115510037 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115510037 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115510037 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115510037 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115510037 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115510037 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115510050 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115510058 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115510059 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115510059 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:55:12.928672 run osmo-msc_10.42.42.6(pid=2533): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2533)] 11:55:12.976040 run osmo-msc_10.42.42.6(pid=2533): stdout: | (launched: 2022-12-09_11:55:11.860520) 11:55:13.025206 run osmo-msc_10.42.42.6(pid=2533): stderr: | 20221209115512130 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209115512131 DLGLOBAL DEBUG validating counter group 0x7fb99b797c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209115512131 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209115512131 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209115512131 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209115512131 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209115512133 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209115512133 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209115512134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209115512135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:55:13.074855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2526): Terminating (SIGTERM) 11:55:13.114696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2529): Terminating (SIGTERM) 11:55:13.154507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2532): Terminating (SIGTERM) 11:55:13.194501 --- ParallelTerminationStrategy: PID 2526 died... 11:55:13.213526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2526): Terminated: ok {rc=0} 11:55:13.257547 --- ParallelTerminationStrategy: PID 2529 died... 11:55:13.276126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2529): Terminated: ok {rc=0} 11:55:13.320184 --- ParallelTerminationStrategy: PID 2532 died... 11:55:13.339369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2532): Terminated: ok {rc=0} 11:55:13.423438 bus /sierra_3: Setting Powered False 11:55:14.518842 bus /sierra_3: Setting Powered False 11:55:15.631457 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 11:55:16.781543 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:55:16.794731 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 11:55:16.869760 tst mo_mt_call_osmux.py: using LAC 21289 11:55:16.999480 tst mo_mt_call_osmux.py: using RAC 124 11:55:17.170489 tst mo_mt_call_osmux.py: using CellId 21289 11:55:17.299924 tst mo_mt_call_osmux.py: using BVCI 21290 11:55:17.410393 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:55:17.421604 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:55:17.432508 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:55:17.443364 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:55:17.454458 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 11:55:17.465449 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:55:17.583942 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 11:55:17.702520 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:55:18.170097 run create_hlr_db(pid=2535): Launched 11:55:18.294708 bus /sierra_2: Setting Powered False 11:55:19.354577 run create_hlr_db(pid=2535): Terminated: ok {rc=0} 11:55:19.797648 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2537): Launched 11:55:20.123720 run osmo-hlr_10.42.42.2(pid=2538): Launched 11:55:20.247053 run osmo-stp_10.42.42.5: Starting osmo-stp 11:55:20.803087 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2540): Launched 11:55:21.126343 run osmo-stp_10.42.42.5(pid=2541): Launched 11:55:21.249291 run osmo-msc_10.42.42.6: Starting osmo-msc 11:55:21.831511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2543): Launched 11:55:22.153585 run osmo-msc_10.42.42.6(pid=2544): Launched 11:55:22.334038 run osmo-stp_10.42.42.5(pid=2541): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2541)] 11:55:22.470826 run osmo-stp_10.42.42.5(pid=2541): stdout: | (launched: 2022-12-09_11:55:21.067056) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:22.608803 run osmo-stp_10.42.42.5(pid=2541): stderr: | 20221209115521254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115521254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115521254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115521255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115521255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115521255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115521255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:22.744034 run osmo-stp_10.42.42.5(pid=2541): stdout: | (launched: 2022-12-09_11:55:21.067056) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:22.872655 run osmo-stp_10.42.42.5(pid=2541): stderr: | 20221209115521254 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115521254 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115521254 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115521255 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115521255 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115521255 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115521255 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:23.026903 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2541): Process ended prematurely: osmo-stp_10.42.42.5(pid=2541) [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2541)] [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 11:55:23.036237 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:55:23.064594 run osmo-hlr_10.42.42.2(pid=2538): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2538)] 11:55:23.115084 run osmo-hlr_10.42.42.2(pid=2538): stdout: | (launched: 2022-12-09_11:55:20.064184) 11:55:23.167313 run osmo-hlr_10.42.42.2(pid=2538): stderr: | 20221209115520257 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115520257 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115520257 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115520257 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115520257 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115520258 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115520269 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115520278 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115520278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115520279 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:55:23.240111 run osmo-msc_10.42.42.6(pid=2544): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2544)] 11:55:23.290564 run osmo-msc_10.42.42.6(pid=2544): stdout: | (launched: 2022-12-09_11:55:22.095010) 11:55:23.342658 run osmo-msc_10.42.42.6(pid=2544): stderr: | 20221209115522412 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209115522412 DLGLOBAL DEBUG validating counter group 0x7faea61d0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209115522412 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209115522412 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209115522413 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209115522413 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209115522414 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209115522415 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209115522415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209115522415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:55:23.395026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2537): Terminating (SIGTERM) 11:55:23.437049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2540): Terminating (SIGTERM) 11:55:23.479067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2543): Terminating (SIGTERM) 11:55:23.522059 --- ParallelTerminationStrategy: PID 2537 died... 11:55:23.542285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2537): Terminated: ok {rc=0} 11:55:23.589166 --- ParallelTerminationStrategy: PID 2540 died... 11:55:23.608839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2540): Terminated: ok {rc=0} 11:55:23.655622 --- ParallelTerminationStrategy: PID 2543 died... 11:55:23.675158 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2543): Terminated: ok {rc=0} 11:55:23.763040 bus /sierra_3: Setting Powered False 11:55:24.861068 bus /sierra_3: Setting Powered False 11:55:25.980134 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 11:55:27.227009 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:55:27.233580 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 11:55:27.265701 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 11:55:27.292035 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 11:55:27.347888 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 11:55:27.379846 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 11:55:27.405799 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 11:55:27.952414 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 11:55:28.000193 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:28.011400 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:55:28.077760 tst mo_mt_call.py: using LAC 21290 11:55:28.194019 tst mo_mt_call.py: using RAC 125 11:55:28.310451 tst mo_mt_call.py: using CellId 21290 11:55:28.431615 tst mo_mt_call.py: using BVCI 21291 11:55:28.551742 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:28.563573 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:28.575084 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:28.586973 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:28.598956 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:28.610857 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:55:28.729358 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:55:28.847282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:55:29.313160 run create_hlr_db(pid=2550): Launched 11:55:29.437676 bus /sierra_2: Setting Powered False 11:55:30.498281 run create_hlr_db(pid=2550): Terminated: ok {rc=0} 11:55:30.953739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2552): Launched 11:55:31.297735 run osmo-hlr_10.42.42.2(pid=2553): Launched 11:55:31.534361 run osmo-stp_10.42.42.5: Starting osmo-stp 11:55:32.218641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2555): Launched 11:55:32.560193 run osmo-stp_10.42.42.5(pid=2556): Launched 11:55:32.686173 run osmo-msc_10.42.42.6: Starting osmo-msc 11:55:33.275652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2558): Launched 11:55:33.603886 run osmo-msc_10.42.42.6(pid=2559): Launched 11:55:33.786265 run osmo-stp_10.42.42.5(pid=2556): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2556)] 11:55:33.924019 run osmo-stp_10.42.42.5(pid=2556): stdout: | (launched: 2022-12-09_11:55:32.500009) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:34.062899 run osmo-stp_10.42.42.5(pid=2556): stderr: | 20221209115532688 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115532688 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115532689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115532689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115532690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115532690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115532690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:34.200315 run osmo-stp_10.42.42.5(pid=2556): stdout: | (launched: 2022-12-09_11:55:32.500009) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:34.331091 run osmo-stp_10.42.42.5(pid=2556): stderr: | 20221209115532688 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115532688 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115532689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115532689 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115532690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115532690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115532690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:34.487645 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2556): Process ended prematurely: osmo-stp_10.42.42.5(pid=2556) [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2556)] [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 11:55:34.497459 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 11:55:34.527615 run osmo-hlr_10.42.42.2(pid=2553): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2553)] 11:55:34.579187 run osmo-hlr_10.42.42.2(pid=2553): stdout: | (launched: 2022-12-09_11:55:31.232835) 11:55:34.632207 run osmo-hlr_10.42.42.2(pid=2553): stderr: | 20221209115531471 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115531471 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115531471 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115531471 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115531471 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115531471 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115531486 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115531502 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115531503 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115531503 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:55:34.705543 run osmo-msc_10.42.42.6(pid=2559): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2559)] 11:55:34.756786 run osmo-msc_10.42.42.6(pid=2559): stdout: | (launched: 2022-12-09_11:55:33.544079) 11:55:34.809996 run osmo-msc_10.42.42.6(pid=2559): stderr: | 20221209115533862 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209115533863 DLGLOBAL DEBUG validating counter group 0x7fc300149c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209115533863 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209115533863 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209115533863 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209115533863 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209115533865 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209115533865 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209115533865 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209115533866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:55:34.863389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2552): Terminating (SIGTERM) 11:55:34.906851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2555): Terminating (SIGTERM) 11:55:34.950082 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2558): Terminating (SIGTERM) 11:55:34.993397 --- ParallelTerminationStrategy: PID 2552 died... 11:55:35.013588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2552): Terminated: ok {rc=0} 11:55:35.061828 --- ParallelTerminationStrategy: PID 2555 died... 11:55:35.081622 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2555): Terminated: ok {rc=0} 11:55:35.129446 --- ParallelTerminationStrategy: PID 2558 died... 11:55:35.149429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2558): Terminated: ok {rc=0} 11:55:35.239462 bus /sierra_3: Setting Powered False 11:55:36.338635 bus /sierra_3: Setting Powered False 11:55:37.458078 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 11:55:38.604891 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:38.616840 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 11:55:38.689833 tst mo_mt_call_osmux.py: using LAC 21291 11:55:38.819254 tst mo_mt_call_osmux.py: using RAC 126 11:55:38.946760 tst mo_mt_call_osmux.py: using CellId 21291 11:55:39.074562 tst mo_mt_call_osmux.py: using BVCI 21292 11:55:39.194974 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:39.206778 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:39.218342 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:39.230726 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:39.243052 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 11:55:39.255214 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:55:39.371991 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 11:55:39.493927 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:55:40.004028 run create_hlr_db(pid=2561): Launched 11:55:40.129265 bus /sierra_2: Setting Powered False 11:55:41.194696 run create_hlr_db(pid=2561): Terminated: ok {rc=0} 11:55:41.632254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2563): Launched 11:55:41.944019 run osmo-hlr_10.42.42.2(pid=2564): Launched 11:55:42.059241 run osmo-stp_10.42.42.5: Starting osmo-stp 11:55:42.597691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2566): Launched 11:55:42.904916 run osmo-stp_10.42.42.5(pid=2567): Launched 11:55:43.020426 run osmo-msc_10.42.42.6: Starting osmo-msc 11:55:43.570803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2569): Launched 11:55:43.876316 run osmo-msc_10.42.42.6(pid=2570): Launched 11:55:44.047451 run osmo-stp_10.42.42.5(pid=2567): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2567)] 11:55:44.176576 run osmo-stp_10.42.42.5(pid=2567): stdout: | (launched: 2022-12-09_11:55:42.848263) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:44.305588 run osmo-stp_10.42.42.5(pid=2567): stderr: | 20221209115543017 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115543017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115543017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115543017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115543018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115543018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115543018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:44.432250 run osmo-stp_10.42.42.5(pid=2567): stdout: | (launched: 2022-12-09_11:55:42.848263) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:44.553550 run osmo-stp_10.42.42.5(pid=2567): stderr: | 20221209115543017 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115543017 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115543017 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115543017 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115543018 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115543018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115543018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:44.698276 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2567): Process ended prematurely: osmo-stp_10.42.42.5(pid=2567) [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2567)] [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 11:55:44.707065 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 11:55:44.733641 run osmo-hlr_10.42.42.2(pid=2564): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2564)] 11:55:44.781993 run osmo-hlr_10.42.42.2(pid=2564): stdout: | (launched: 2022-12-09_11:55:41.882354) 11:55:44.832525 run osmo-hlr_10.42.42.2(pid=2564): stderr: | 20221209115542061 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115542061 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115542061 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115542062 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115542062 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115542062 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115542074 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115542082 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115542083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115542083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:55:44.902005 run osmo-msc_10.42.42.6(pid=2570): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2570)] 11:55:44.950008 run osmo-msc_10.42.42.6(pid=2570): stdout: | (launched: 2022-12-09_11:55:43.820170) 11:55:44.999748 run osmo-msc_10.42.42.6(pid=2570): stderr: | 20221209115544089 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209115544089 DLGLOBAL DEBUG validating counter group 0x7ff9d5e9cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209115544089 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209115544089 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209115544089 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209115544090 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209115544091 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209115544092 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209115544092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209115544092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:55:45.049838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2563): Terminating (SIGTERM) 11:55:45.089575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2566): Terminating (SIGTERM) 11:55:45.129581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2569): Terminating (SIGTERM) 11:55:45.169951 --- ParallelTerminationStrategy: PID 2563 died... 11:55:45.189310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2563): Terminated: ok {rc=0} 11:55:45.234014 --- ParallelTerminationStrategy: PID 2566 died... 11:55:45.252920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2566): Terminated: ok {rc=0} 11:55:45.297559 --- ParallelTerminationStrategy: PID 2569 died... 11:55:45.316358 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2569): Terminated: ok {rc=0} 11:55:45.400711 bus /sierra_3: Setting Powered False 11:55:46.494024 bus /sierra_3: Setting Powered False 11:55:47.607320 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 11:55:48.860353 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:55:48.867288 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 11:55:48.901374 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 11:55:48.929087 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 11:55:48.983273 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 11:55:49.017256 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 11:55:49.044856 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 11:55:49.595890 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 11:55:49.648667 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:55:49.660202 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:55:49.730675 tst mo_mt_call.py: using LAC 21292 11:55:49.860876 tst mo_mt_call.py: using RAC 127 11:55:49.981607 tst mo_mt_call.py: using CellId 21292 11:55:50.101831 tst mo_mt_call.py: using BVCI 21293 11:55:50.212847 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:55:50.224322 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:55:50.235349 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:55:50.246466 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:55:50.257589 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:55:50.268503 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:55:50.388060 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:55:50.510715 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:55:51.016483 run create_hlr_db(pid=2576): Launched 11:55:51.142285 bus /sierra_2: Setting Powered False 11:55:52.206939 run create_hlr_db(pid=2576): Terminated: ok {rc=0} 11:55:52.661618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2578): Launched 11:55:52.989469 run osmo-hlr_10.42.42.2(pid=2579): Launched 11:55:53.115246 run osmo-stp_10.42.42.5: Starting osmo-stp 11:55:53.678506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2581): Launched 11:55:54.004782 run osmo-stp_10.42.42.5(pid=2582): Launched 11:55:54.132244 run osmo-msc_10.42.42.6: Starting osmo-msc 11:55:54.721486 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2584): Launched 11:55:55.051063 run osmo-msc_10.42.42.6(pid=2585): Launched 11:55:55.233493 run osmo-stp_10.42.42.5(pid=2582): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2582)] 11:55:55.371384 run osmo-stp_10.42.42.5(pid=2582): stdout: | (launched: 2022-12-09_11:55:53.945461) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:55.509933 run osmo-stp_10.42.42.5(pid=2582): stderr: | 20221209115554133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115554133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115554134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115554134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115554134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115554134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115554135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:55.646374 run osmo-stp_10.42.42.5(pid=2582): stdout: | (launched: 2022-12-09_11:55:53.945461) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:55:55.776182 run osmo-stp_10.42.42.5(pid=2582): stderr: | 20221209115554133 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115554133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115554134 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115554134 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115554134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115554134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115554135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:55:55.931246 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2582): Process ended prematurely: osmo-stp_10.42.42.5(pid=2582) [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2582)] [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 11:55:55.940610 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:55:55.969186 run osmo-hlr_10.42.42.2(pid=2579): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2579)] 11:55:56.019977 run osmo-hlr_10.42.42.2(pid=2579): stdout: | (launched: 2022-12-09_11:55:52.929786) 11:55:56.072497 run osmo-hlr_10.42.42.2(pid=2579): stderr: | 20221209115553124 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115553124 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115553124 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115553124 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115553124 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115553124 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115553137 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115553146 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115553147 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115553147 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:55:56.145371 run osmo-msc_10.42.42.6(pid=2585): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2585)] 11:55:56.195879 run osmo-msc_10.42.42.6(pid=2585): stdout: | (launched: 2022-12-09_11:55:54.991244) 11:55:56.248132 run osmo-msc_10.42.42.6(pid=2585): stderr: | 20221209115555309 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209115555309 DLGLOBAL DEBUG validating counter group 0x7f6654d34c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209115555309 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209115555309 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209115555309 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209115555310 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209115555311 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209115555312 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209115555312 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209115555312 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:55:56.300621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2578): Terminating (SIGTERM) 11:55:56.342853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2581): Terminating (SIGTERM) 11:55:56.385169 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2584): Terminating (SIGTERM) 11:55:56.427611 --- ParallelTerminationStrategy: PID 2578 died... 11:55:56.447788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2578): Terminated: ok {rc=0} 11:55:56.494701 --- ParallelTerminationStrategy: PID 2581 died... 11:55:56.514422 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2581): Terminated: ok {rc=0} 11:55:56.562025 --- ParallelTerminationStrategy: PID 2584 died... 11:55:56.581951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2584): Terminated: ok {rc=0} 11:55:56.671181 bus /sierra_3: Setting Powered False 11:55:57.771289 bus /sierra_3: Setting Powered False 11:55:58.888886 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 11:56:00.038377 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:56:00.050779 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 11:56:00.122663 tst mo_mt_call_osmux.py: using LAC 21293 11:56:00.251795 tst mo_mt_call_osmux.py: using RAC 128 11:56:00.379923 tst mo_mt_call_osmux.py: using CellId 21293 11:56:00.508337 tst mo_mt_call_osmux.py: using BVCI 21294 11:56:00.622354 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:56:00.633788 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:56:00.644754 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:56:00.656423 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:56:00.668601 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 11:56:00.679950 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:56:00.801840 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 11:56:00.937060 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:01.434543 run create_hlr_db(pid=2587): Launched 11:56:01.594192 bus /sierra_2: Setting Powered False 11:56:02.654930 run create_hlr_db(pid=2587): Terminated: ok {rc=0} 11:56:03.080314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2589): Launched 11:56:03.386912 run osmo-hlr_10.42.42.2(pid=2590): Launched 11:56:03.502153 run osmo-stp_10.42.42.5: Starting osmo-stp 11:56:04.038692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2592): Launched 11:56:04.343989 run osmo-stp_10.42.42.5(pid=2593): Launched 11:56:04.460299 run osmo-msc_10.42.42.6: Starting osmo-msc 11:56:05.010723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2595): Launched 11:56:05.316046 run osmo-msc_10.42.42.6(pid=2596): Launched 11:56:05.486460 run osmo-stp_10.42.42.5(pid=2593): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2593)] 11:56:05.616199 run osmo-stp_10.42.42.5(pid=2593): stdout: | (launched: 2022-12-09_11:56:04.288260) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:05.745154 run osmo-stp_10.42.42.5(pid=2593): stderr: | 20221209115604455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115604455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115604456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115604456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115604457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115604457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115604457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:05.872067 run osmo-stp_10.42.42.5(pid=2593): stdout: | (launched: 2022-12-09_11:56:04.288260) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:05.992469 run osmo-stp_10.42.42.5(pid=2593): stderr: | 20221209115604455 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115604455 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115604456 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115604456 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115604457 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115604457 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115604457 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:06.137975 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2593): Process ended prematurely: osmo-stp_10.42.42.5(pid=2593) [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2593)] [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 11:56:06.146658 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 11:56:06.173216 run osmo-hlr_10.42.42.2(pid=2590): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2590)] 11:56:06.220644 run osmo-hlr_10.42.42.2(pid=2590): stdout: | (launched: 2022-12-09_11:56:03.330441) 11:56:06.270213 run osmo-hlr_10.42.42.2(pid=2590): stderr: | 20221209115603503 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115603503 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115603503 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115603503 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115603503 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115603503 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115603515 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115603524 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115603524 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115603524 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:56:06.339313 run osmo-msc_10.42.42.6(pid=2596): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2596)] 11:56:06.387006 run osmo-msc_10.42.42.6(pid=2596): stdout: | (launched: 2022-12-09_11:56:05.259126) 11:56:06.436309 run osmo-msc_10.42.42.6(pid=2596): stderr: | 20221209115605530 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209115605530 DLGLOBAL DEBUG validating counter group 0x7ffb9bea8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209115605530 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209115605531 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209115605531 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209115605531 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209115605533 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209115605533 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209115605533 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209115605533 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:56:06.485944 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2589): Terminating (SIGTERM) 11:56:06.525553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2592): Terminating (SIGTERM) 11:56:06.565267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2595): Terminating (SIGTERM) 11:56:06.605119 --- ParallelTerminationStrategy: PID 2589 died... 11:56:06.624234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2589): Terminated: ok {rc=0} 11:56:06.668766 --- ParallelTerminationStrategy: PID 2592 died... 11:56:06.687460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2592): Terminated: ok {rc=0} 11:56:06.731728 --- ParallelTerminationStrategy: PID 2595 died... 11:56:06.750344 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2595): Terminated: ok {rc=0} 11:56:06.833781 bus /sierra_3: Setting Powered False 11:56:07.931868 bus /sierra_3: Setting Powered False 11:56:09.049316 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 11:56:10.302305 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:56:10.308577 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 11:56:10.340625 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 11:56:10.366931 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 11:56:10.418850 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 11:56:10.451354 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 11:56:10.477686 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 11:56:11.027775 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 11:56:11.076383 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:11.087626 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:56:11.156455 tst mo_mt_call.py: using LAC 21294 11:56:11.277772 tst mo_mt_call.py: using RAC 129 11:56:11.397624 tst mo_mt_call.py: using CellId 21294 11:56:11.517337 tst mo_mt_call.py: using BVCI 21295 11:56:11.628467 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:11.639631 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:11.650577 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:11.661508 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:11.672446 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:11.683399 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:56:11.804346 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:56:11.923273 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:12.398141 run create_hlr_db(pid=2601): Launched 11:56:12.523906 bus /sierra_2: Setting Powered False 11:56:13.584379 run create_hlr_db(pid=2601): Terminated: ok {rc=0} 11:56:14.031572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2603): Launched 11:56:14.360473 run osmo-hlr_10.42.42.2(pid=2604): Launched 11:56:14.480858 run osmo-stp_10.42.42.5: Starting osmo-stp 11:56:15.022779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2606): Launched 11:56:15.328464 run osmo-stp_10.42.42.5(pid=2607): Launched 11:56:15.444539 run osmo-msc_10.42.42.6: Starting osmo-msc 11:56:16.027726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2609): Launched 11:56:16.361754 run osmo-msc_10.42.42.6(pid=2610): Launched 11:56:16.768226 run osmo-stp_10.42.42.5(pid=2607): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2607)] 11:56:17.147977 run osmo-stp_10.42.42.5(pid=2607): stdout: | (launched: 2022-12-09_11:56:15.272362) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:17.296851 run osmo-stp_10.42.42.5(pid=2607): stderr: | 20221209115615440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115615441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115615441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115615441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115615442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115615442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115615442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:17.436876 run osmo-stp_10.42.42.5(pid=2607): stdout: | (launched: 2022-12-09_11:56:15.272362) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:17.568423 run osmo-stp_10.42.42.5(pid=2607): stderr: | 20221209115615440 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115615441 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115615441 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115615441 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115615442 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115615442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115615442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:17.725115 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2607): Process ended prematurely: osmo-stp_10.42.42.5(pid=2607) [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2607)] [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 11:56:17.734781 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 11:56:17.763702 run osmo-hlr_10.42.42.2(pid=2604): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2604)] 11:56:17.814630 run osmo-hlr_10.42.42.2(pid=2604): stdout: | (launched: 2022-12-09_11:56:14.300788) 11:56:17.867157 run osmo-hlr_10.42.42.2(pid=2604): stderr: | 20221209115614476 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115614476 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115614476 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115614476 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115614476 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115614477 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115614489 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115614497 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115614497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115614497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:56:17.940405 run osmo-msc_10.42.42.6(pid=2610): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2610)] 11:56:17.991032 run osmo-msc_10.42.42.6(pid=2610): stdout: | (launched: 2022-12-09_11:56:16.295524) 11:56:18.043559 run osmo-msc_10.42.42.6(pid=2610): stderr: | 20221209115616783 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209115616784 DLGLOBAL DEBUG validating counter group 0x7f1f570e3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209115616784 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209115616784 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209115616784 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209115616784 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209115616786 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209115616786 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209115616786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209115616786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:56:18.096607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2603): Terminating (SIGTERM) 11:56:18.139163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2606): Terminating (SIGTERM) 11:56:18.181933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2609): Terminating (SIGTERM) 11:56:18.224547 --- ParallelTerminationStrategy: PID 2603 died... 11:56:18.244419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2603): Terminated: ok {rc=0} 11:56:18.291642 --- ParallelTerminationStrategy: PID 2606 died... 11:56:18.311416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2606): Terminated: ok {rc=0} 11:56:18.358225 --- ParallelTerminationStrategy: PID 2609 died... 11:56:18.378066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2609): Terminated: ok {rc=0} 11:56:18.467098 bus /sierra_3: Setting Powered False 11:56:19.565598 bus /sierra_3: Setting Powered False 11:56:20.681998 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 11:56:21.830717 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:21.843318 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 11:56:21.916518 tst mo_mt_call_osmux.py: using LAC 21295 11:56:22.048792 tst mo_mt_call_osmux.py: using RAC 130 11:56:22.177382 tst mo_mt_call_osmux.py: using CellId 21295 11:56:22.311156 tst mo_mt_call_osmux.py: using BVCI 21296 11:56:22.432100 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:22.444533 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:22.456361 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:22.468071 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:22.479962 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 11:56:22.491498 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:56:22.613321 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 11:56:22.731901 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:23.205608 run create_hlr_db(pid=2612): Launched 11:56:23.332032 bus /sierra_2: Setting Powered False 11:56:24.393137 run create_hlr_db(pid=2612): Terminated: ok {rc=0} 11:56:24.839147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2614): Launched 11:56:25.166039 run osmo-hlr_10.42.42.2(pid=2615): Launched 11:56:25.291214 run osmo-stp_10.42.42.5: Starting osmo-stp 11:56:25.860070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2617): Launched 11:56:26.188624 run osmo-stp_10.42.42.5(pid=2618): Launched 11:56:26.313168 run osmo-msc_10.42.42.6: Starting osmo-msc 11:56:26.901755 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2620): Launched 11:56:27.230352 run osmo-msc_10.42.42.6(pid=2621): Launched 11:56:27.412823 run osmo-stp_10.42.42.5(pid=2618): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2618)] 11:56:27.551532 run osmo-stp_10.42.42.5(pid=2618): stdout: | (launched: 2022-12-09_11:56:26.128216) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:27.690401 run osmo-stp_10.42.42.5(pid=2618): stderr: | 20221209115626319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115626319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115626319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115626319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115626320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115626320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115626320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:27.826933 run osmo-stp_10.42.42.5(pid=2618): stdout: | (launched: 2022-12-09_11:56:26.128216) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:27.956636 run osmo-stp_10.42.42.5(pid=2618): stderr: | 20221209115626319 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115626319 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115626319 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115626319 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115626320 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115626320 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115626320 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:28.112317 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2618): Process ended prematurely: osmo-stp_10.42.42.5(pid=2618) [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2618)] [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 11:56:28.121871 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:56:28.150208 run osmo-hlr_10.42.42.2(pid=2615): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2615)] 11:56:28.201133 run osmo-hlr_10.42.42.2(pid=2615): stdout: | (launched: 2022-12-09_11:56:25.106562) 11:56:28.253622 run osmo-hlr_10.42.42.2(pid=2615): stderr: | 20221209115625302 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115625302 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115625302 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115625303 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115625303 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115625303 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115625315 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115625324 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115625324 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115625324 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:56:28.326626 run osmo-msc_10.42.42.6(pid=2621): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2621)] 11:56:28.376922 run osmo-msc_10.42.42.6(pid=2621): stdout: | (launched: 2022-12-09_11:56:27.170740) 11:56:28.429233 run osmo-msc_10.42.42.6(pid=2621): stderr: | 20221209115627487 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209115627488 DLGLOBAL DEBUG validating counter group 0x7f1a290ddc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209115627488 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209115627488 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209115627488 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209115627488 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209115627490 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209115627490 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209115627490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209115627490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:56:28.481792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2614): Terminating (SIGTERM) 11:56:28.524462 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2617): Terminating (SIGTERM) 11:56:28.567313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2620): Terminating (SIGTERM) 11:56:28.610019 --- ParallelTerminationStrategy: PID 2614 died... 11:56:28.629751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2614): Terminated: ok {rc=0} 11:56:28.676572 --- ParallelTerminationStrategy: PID 2617 died... 11:56:28.696092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2617): Terminated: ok {rc=0} 11:56:28.743038 --- ParallelTerminationStrategy: PID 2620 died... 11:56:28.762692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2620): Terminated: ok {rc=0} 11:56:28.851465 bus /sierra_3: Setting Powered False 11:56:29.949415 bus /sierra_3: Setting Powered False 11:56:31.071995 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 11:56:32.329659 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:56:32.335222 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 11:56:32.367380 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 11:56:32.393901 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 11:56:32.446227 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 11:56:32.479203 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 11:56:32.505720 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 11:56:33.052856 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 11:56:33.101965 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:33.112792 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:56:33.182207 tst mo_mt_call.py: using LAC 21296 11:56:33.301188 tst mo_mt_call.py: using RAC 131 11:56:33.420891 tst mo_mt_call.py: using CellId 21296 11:56:33.542191 tst mo_mt_call.py: using BVCI 21297 11:56:33.655057 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:33.665899 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:33.676456 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:33.687158 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:33.697828 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:33.708480 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:56:33.829322 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:56:33.948054 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:34.422620 run create_hlr_db(pid=2626): Launched 11:56:34.550494 bus /sierra_2: Setting Powered False 11:56:35.615039 run create_hlr_db(pid=2626): Terminated: ok {rc=0} 11:56:36.051795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2628): Launched 11:56:36.358619 run osmo-hlr_10.42.42.2(pid=2629): Launched 11:56:36.475139 run osmo-stp_10.42.42.5: Starting osmo-stp 11:56:36.998819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2631): Launched 11:56:37.304524 run osmo-stp_10.42.42.5(pid=2632): Launched 11:56:37.421142 run osmo-msc_10.42.42.6: Starting osmo-msc 11:56:37.973475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2634): Launched 11:56:38.281145 run osmo-msc_10.42.42.6(pid=2635): Launched 11:56:38.452688 run osmo-stp_10.42.42.5(pid=2632): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2632)] 11:56:38.581819 run osmo-stp_10.42.42.5(pid=2632): stdout: | (launched: 2022-12-09_11:56:37.248429) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:38.710373 run osmo-stp_10.42.42.5(pid=2632): stderr: | 20221209115637414 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115637414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115637414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115637415 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115637415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115637415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115637415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:38.836887 run osmo-stp_10.42.42.5(pid=2632): stdout: | (launched: 2022-12-09_11:56:37.248429) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:38.957560 run osmo-stp_10.42.42.5(pid=2632): stderr: | 20221209115637414 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115637414 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115637414 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115637415 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115637415 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115637415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115637415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:39.102468 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2632): Process ended prematurely: osmo-stp_10.42.42.5(pid=2632) [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2632)] [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 11:56:39.111254 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 11:56:39.137828 run osmo-hlr_10.42.42.2(pid=2629): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2629)] 11:56:39.185745 run osmo-hlr_10.42.42.2(pid=2629): stdout: | (launched: 2022-12-09_11:56:36.302557) 11:56:39.235287 run osmo-hlr_10.42.42.2(pid=2629): stderr: | 20221209115636475 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115636476 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115636476 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115636476 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115636476 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115636476 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115636488 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115636496 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115636497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115636497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:56:39.304232 run osmo-msc_10.42.42.6(pid=2635): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2635)] 11:56:39.352011 run osmo-msc_10.42.42.6(pid=2635): stdout: | (launched: 2022-12-09_11:56:38.224730) 11:56:39.401214 run osmo-msc_10.42.42.6(pid=2635): stderr: | 20221209115638494 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209115638494 DLGLOBAL DEBUG validating counter group 0x7fcc82150c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209115638494 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209115638494 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209115638494 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209115638494 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209115638496 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209115638497 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209115638497 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209115638497 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:56:39.451002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2628): Terminating (SIGTERM) 11:56:39.490685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2631): Terminating (SIGTERM) 11:56:39.530361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2634): Terminating (SIGTERM) 11:56:39.570262 --- ParallelTerminationStrategy: PID 2628 died... 11:56:39.589515 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2628): Terminated: ok {rc=0} 11:56:39.633714 --- ParallelTerminationStrategy: PID 2631 died... 11:56:39.652473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2631): Terminated: ok {rc=0} 11:56:39.696545 --- ParallelTerminationStrategy: PID 2634 died... 11:56:39.715366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2634): Terminated: ok {rc=0} 11:56:39.799844 bus /sierra_3: Setting Powered False 11:56:40.897051 bus /sierra_3: Setting Powered False 11:56:42.012875 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 11:56:43.162631 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:43.174804 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 11:56:43.247219 tst mo_mt_call_osmux.py: using LAC 21297 11:56:43.377807 tst mo_mt_call_osmux.py: using RAC 132 11:56:43.506244 tst mo_mt_call_osmux.py: using CellId 21297 11:56:43.635266 tst mo_mt_call_osmux.py: using BVCI 21298 11:56:43.756272 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:43.767798 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:43.779077 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:43.790331 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:43.802214 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 11:56:43.813616 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:56:43.931828 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 11:56:44.050009 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:44.525652 run create_hlr_db(pid=2638): Launched 11:56:44.652379 bus /sierra_2: Setting Powered False 11:56:45.713994 run create_hlr_db(pid=2638): Terminated: ok {rc=0} 11:56:46.190625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2640): Launched 11:56:46.538712 run osmo-hlr_10.42.42.2(pid=2641): Launched 11:56:46.791838 run osmo-stp_10.42.42.5: Starting osmo-stp 11:56:47.490400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2643): Launched 11:56:47.796563 run osmo-stp_10.42.42.5(pid=2644): Launched 11:56:47.913881 run osmo-msc_10.42.42.6: Starting osmo-msc 11:56:48.471456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2646): Launched 11:56:48.777318 run osmo-msc_10.42.42.6(pid=2647): Launched 11:56:48.947531 run osmo-stp_10.42.42.5(pid=2644): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2644)] 11:56:49.076059 run osmo-stp_10.42.42.5(pid=2644): stdout: | (launched: 2022-12-09_11:56:47.740270) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:49.205227 run osmo-stp_10.42.42.5(pid=2644): stderr: | 20221209115647906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115647906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115647907 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115647907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115647908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115647908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115647908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:49.331768 run osmo-stp_10.42.42.5(pid=2644): stdout: | (launched: 2022-12-09_11:56:47.740270) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:56:49.452664 run osmo-stp_10.42.42.5(pid=2644): stderr: | 20221209115647906 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115647906 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115647907 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115647907 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115647908 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115647908 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115647908 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:56:49.597992 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2644): Process ended prematurely: osmo-stp_10.42.42.5(pid=2644) [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2644)] [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 11:56:49.606619 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 11:56:49.633212 run osmo-hlr_10.42.42.2(pid=2641): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2641)] 11:56:49.680738 run osmo-hlr_10.42.42.2(pid=2641): stdout: | (launched: 2022-12-09_11:56:46.475550) 11:56:49.730270 run osmo-hlr_10.42.42.2(pid=2641): stderr: | 20221209115646776 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115646776 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115646776 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115646776 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115646776 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115646776 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115646799 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115646810 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115646810 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115646810 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:56:49.799121 run osmo-msc_10.42.42.6(pid=2647): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2647)] 11:56:49.846425 run osmo-msc_10.42.42.6(pid=2647): stdout: | (launched: 2022-12-09_11:56:48.721104) 11:56:49.895403 run osmo-msc_10.42.42.6(pid=2647): stderr: | 20221209115648989 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209115648989 DLGLOBAL DEBUG validating counter group 0x7f36b376bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209115648989 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209115648989 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209115648989 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209115648990 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209115648991 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209115648992 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209115648992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209115648992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:56:49.944742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2640): Terminating (SIGTERM) 11:56:49.984299 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2643): Terminating (SIGTERM) 11:56:50.023877 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2646): Terminating (SIGTERM) 11:56:50.063579 --- ParallelTerminationStrategy: PID 2640 died... 11:56:50.082610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2640): Terminated: ok {rc=0} 11:56:50.126574 --- ParallelTerminationStrategy: PID 2643 died... 11:56:50.145254 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2643): Terminated: ok {rc=0} 11:56:50.189183 --- ParallelTerminationStrategy: PID 2646 died... 11:56:50.207823 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2646): Terminated: ok {rc=0} 11:56:50.291980 bus /sierra_3: Setting Powered False 11:56:51.387875 bus /sierra_3: Setting Powered False 11:56:52.503695 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 11:56:53.752621 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:56:53.758535 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 11:56:53.790634 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 11:56:53.817039 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 11:56:53.870264 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 11:56:53.902624 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 11:56:53.928744 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 11:56:54.481360 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 11:56:54.537365 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:56:54.549384 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:56:54.609200 tst mo_mt_call.py: using LAC 21298 11:56:54.728754 tst mo_mt_call.py: using RAC 133 11:56:54.846717 tst mo_mt_call.py: using CellId 21298 11:56:54.966269 tst mo_mt_call.py: using BVCI 21299 11:56:55.078216 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:56:55.089630 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:56:55.100705 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:56:55.111926 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:56:55.123105 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:56:55.134235 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:56:55.249102 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:56:55.364601 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:56:55.838058 run create_hlr_db(pid=2652): Launched 11:56:55.963061 bus /sierra_2: Setting Powered False 11:56:57.023562 run create_hlr_db(pid=2652): Terminated: ok {rc=0} 11:56:57.470716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2654): Launched 11:56:57.798089 run osmo-hlr_10.42.42.2(pid=2655): Launched 11:56:57.922288 run osmo-stp_10.42.42.5: Starting osmo-stp 11:56:58.488809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2657): Launched 11:56:58.815966 run osmo-stp_10.42.42.5(pid=2658): Launched 11:56:58.940223 run osmo-msc_10.42.42.6: Starting osmo-msc 11:56:59.529721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2660): Launched 11:56:59.858380 run osmo-msc_10.42.42.6(pid=2661): Launched 11:57:00.041252 run osmo-stp_10.42.42.5(pid=2658): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2658)] 11:57:00.179421 run osmo-stp_10.42.42.5(pid=2658): stdout: | (launched: 2022-12-09_11:56:58.757061) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:00.317886 run osmo-stp_10.42.42.5(pid=2658): stderr: | 20221209115658944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115658944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115658944 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115658945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115658945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115658945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115658945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:00.455702 run osmo-stp_10.42.42.5(pid=2658): stdout: | (launched: 2022-12-09_11:56:58.757061) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:00.586145 run osmo-stp_10.42.42.5(pid=2658): stderr: | 20221209115658944 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115658944 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115658944 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115658945 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115658945 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115658945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115658945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:00.741895 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2658): Process ended prematurely: osmo-stp_10.42.42.5(pid=2658) [trial-2359↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2658)] [trial-2359↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 11:57:00.751424 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 11:57:00.779477 run osmo-hlr_10.42.42.2(pid=2655): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2655)] 11:57:00.837313 run osmo-hlr_10.42.42.2(pid=2655): stdout: | (launched: 2022-12-09_11:56:57.738734) 11:57:00.908179 run osmo-hlr_10.42.42.2(pid=2655): stderr: | 20221209115657933 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115657933 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115657933 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115657933 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115657933 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115657934 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115657946 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115657955 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115657955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115657955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:57:00.982655 run osmo-msc_10.42.42.6(pid=2661): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2661)] 11:57:01.034219 run osmo-msc_10.42.42.6(pid=2661): stdout: | (launched: 2022-12-09_11:56:59.798730) 11:57:01.087436 run osmo-msc_10.42.42.6(pid=2661): stderr: | 20221209115700116 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209115700116 DLGLOBAL DEBUG validating counter group 0x7efd36473c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209115700116 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209115700116 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209115700116 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209115700116 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209115700118 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209115700118 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209115700119 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209115700119 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:57:01.140898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2654): Terminating (SIGTERM) 11:57:01.184638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2657): Terminating (SIGTERM) 11:57:01.232216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2660): Terminating (SIGTERM) 11:57:01.277790 --- ParallelTerminationStrategy: PID 2654 died... 11:57:01.298125 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2654): Terminated: ok {rc=0} 11:57:01.347774 --- ParallelTerminationStrategy: PID 2657 died... 11:57:01.368090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2657): Terminated: ok {rc=0} 11:57:01.416337 --- ParallelTerminationStrategy: PID 2660 died... 11:57:01.437809 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2660): Terminated: ok {rc=0} 11:57:01.528331 bus /sierra_3: Setting Powered False 11:57:02.626127 bus /sierra_3: Setting Powered False 11:57:03.741207 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 11:57:04.887545 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:57:04.899602 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 11:57:04.951521 tst mo_mt_call_osmux.py: using LAC 21299 11:57:05.071412 tst mo_mt_call_osmux.py: using RAC 134 11:57:05.190820 tst mo_mt_call_osmux.py: using CellId 21299 11:57:05.313429 tst mo_mt_call_osmux.py: using BVCI 21300 11:57:05.423954 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:57:05.435406 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:57:05.446653 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:57:05.457835 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:57:05.469175 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 11:57:05.480254 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:57:05.600622 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 11:57:05.720067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:57:06.193199 run create_hlr_db(pid=2663): Launched 11:57:06.317917 bus /sierra_2: Setting Powered False 11:57:07.378607 run create_hlr_db(pid=2663): Terminated: ok {rc=0} 11:57:07.826447 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2665): Launched 11:57:08.154470 run osmo-hlr_10.42.42.2(pid=2666): Launched 11:57:08.279793 run osmo-stp_10.42.42.5: Starting osmo-stp 11:57:08.846314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2668): Launched 11:57:09.174094 run osmo-stp_10.42.42.5(pid=2669): Launched 11:57:09.298895 run osmo-msc_10.42.42.6: Starting osmo-msc 11:57:09.894036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2671): Launched 11:57:10.222454 run osmo-msc_10.42.42.6(pid=2672): Launched 11:57:10.405766 run osmo-stp_10.42.42.5(pid=2669): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2669)] 11:57:10.545152 run osmo-stp_10.42.42.5(pid=2669): stdout: | (launched: 2022-12-09_11:57:09.114202) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:10.685323 run osmo-stp_10.42.42.5(pid=2669): stderr: | 20221209115709303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115709304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115709304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115709304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115709305 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115709305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115709305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:10.821907 run osmo-stp_10.42.42.5(pid=2669): stdout: | (launched: 2022-12-09_11:57:09.114202) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:10.952255 run osmo-stp_10.42.42.5(pid=2669): stderr: | 20221209115709303 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115709304 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115709304 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115709304 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115709305 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115709305 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115709305 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:11.108109 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2669): Process ended prematurely: osmo-stp_10.42.42.5(pid=2669) [trial-2359↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2669)] [trial-2359↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 11:57:11.117550 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 11:57:11.145932 run osmo-hlr_10.42.42.2(pid=2666): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2666)] 11:57:11.196249 run osmo-hlr_10.42.42.2(pid=2666): stdout: | (launched: 2022-12-09_11:57:08.094933) 11:57:11.248674 run osmo-hlr_10.42.42.2(pid=2666): stderr: | 20221209115708290 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115708290 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115708290 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115708290 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115708290 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115708290 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115708309 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115708318 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115708318 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115708318 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:57:11.321223 run osmo-msc_10.42.42.6(pid=2672): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2672)] 11:57:11.371380 run osmo-msc_10.42.42.6(pid=2672): stdout: | (launched: 2022-12-09_11:57:10.162523) 11:57:11.423285 run osmo-msc_10.42.42.6(pid=2672): stderr: | 20221209115710481 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209115710481 DLGLOBAL DEBUG validating counter group 0x7effae8afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209115710481 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209115710481 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209115710481 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209115710482 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209115710483 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209115710484 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209115710484 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209115710484 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:57:11.475854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2665): Terminating (SIGTERM) 11:57:11.517924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2668): Terminating (SIGTERM) 11:57:11.560658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2671): Terminating (SIGTERM) 11:57:11.603781 --- ParallelTerminationStrategy: PID 2665 died... 11:57:11.623939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2665): Terminated: ok {rc=0} 11:57:11.670852 --- ParallelTerminationStrategy: PID 2668 died... 11:57:11.690529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2668): Terminated: ok {rc=0} 11:57:11.737146 --- ParallelTerminationStrategy: PID 2671 died... 11:57:11.756670 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2671): Terminated: ok {rc=0} 11:57:11.844850 bus /sierra_3: Setting Powered False 11:57:12.942574 bus /sierra_3: Setting Powered False 11:57:14.058948 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 emergency:trx-umtrx --------------------------------------------------------------------- 11:57:15.312940 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:57:15.317729 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 11:57:15.352102 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 11:57:15.379761 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 11:57:15.466106 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 11:57:15.499638 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 11:57:15.526867 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 11:57:16.110102 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2359 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 11:57:16.116895 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:57:16.128796 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 11:57:16.179954 tst emergency_mo_mt_call.py: using LAC 21300 11:57:16.302585 tst emergency_mo_mt_call.py: using RAC 135 11:57:16.468503 tst emergency_mo_mt_call.py: using CellId 21300 11:57:16.592112 tst emergency_mo_mt_call.py: using BVCI 21301 11:57:16.706085 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:57:16.717456 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:57:16.728442 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:57:16.740108 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:57:16.751069 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:57:16.762631 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 11:57:16.881385 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 11:57:17.004241 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:57:17.535539 run create_hlr_db(pid=2678): Launched 11:57:17.659139 bus /sierra_2: Setting Powered False 11:57:18.723053 run create_hlr_db(pid=2678): Terminated: ok {rc=0} 11:57:19.156615 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2680): Launched 11:57:19.458683 run osmo-hlr_10.42.42.2(pid=2681): Launched 11:57:19.574352 run osmo-stp_10.42.42.5: Starting osmo-stp 11:57:20.093328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2683): Launched 11:57:20.394376 run osmo-stp_10.42.42.5(pid=2684): Launched 11:57:20.518890 tst emergency_mo_mt_call.py: using MSISDN 7195 11:57:20.673680 run osmo-msc_10.42.42.6: Starting osmo-msc 11:57:21.218195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2686): Launched 11:57:21.519959 run osmo-msc_10.42.42.6(pid=2687): Launched 11:57:21.690103 run osmo-stp_10.42.42.5(pid=2684): ERR: Terminated: ERROR {rc=1} [trial-2359↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2684)] 11:57:21.824460 run osmo-stp_10.42.42.5(pid=2684): stdout: | (launched: 2022-12-09_11:57:20.339261) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:21.962854 run osmo-stp_10.42.42.5(pid=2684): stderr: | 20221209115720506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115720506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115720507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115720507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115720507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115720508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115720508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:22.098596 run osmo-stp_10.42.42.5(pid=2684): stdout: | (launched: 2022-12-09_11:57:20.339261) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:22.227820 run osmo-stp_10.42.42.5(pid=2684): stderr: | 20221209115720506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115720506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115720507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115720507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115720507 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115720508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115720508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:22.381747 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=2684): Process ended prematurely: osmo-stp_10.42.42.5(pid=2684) [trial-2359↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2684)] [trial-2359↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 11:57:22.390840 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 11:57:22.419129 run osmo-hlr_10.42.42.2(pid=2681): ERR: Terminated: ERROR {rc=237} [trial-2359↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2681)] 11:57:22.469728 run osmo-hlr_10.42.42.2(pid=2681): stdout: | (launched: 2022-12-09_11:57:19.403014) 11:57:22.522431 run osmo-hlr_10.42.42.2(pid=2681): stderr: | 20221209115719576 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115719576 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115719576 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115719576 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115719576 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115719576 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115719589 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115719600 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115719600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115719600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:57:22.596155 run osmo-msc_10.42.42.6(pid=2687): ERR: Terminated: ERROR {rc=2} [trial-2359↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2687)] 11:57:22.647504 run osmo-msc_10.42.42.6(pid=2687): stdout: | (launched: 2022-12-09_11:57:21.464243) 11:57:22.700317 run osmo-msc_10.42.42.6(pid=2687): stderr: | 20221209115721753 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209115721754 DLGLOBAL DEBUG validating counter group 0x7fbe05b90c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209115721754 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209115721754 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209115721754 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209115721754 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209115721756 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209115721756 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209115721757 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209115721757 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:57:22.753485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2680): Terminating (SIGTERM) 11:57:22.796141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2683): Terminating (SIGTERM) 11:57:22.839047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2686): Terminating (SIGTERM) 11:57:22.881820 --- ParallelTerminationStrategy: PID 2680 died... 11:57:22.902708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2680): Terminated: ok {rc=0} 11:57:22.950711 --- ParallelTerminationStrategy: PID 2683 died... 11:57:22.970809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2683): Terminated: ok {rc=0} 11:57:23.018295 --- ParallelTerminationStrategy: PID 2686 died... 11:57:23.038571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2686): Terminated: ok {rc=0} 11:57:23.129295 bus /sierra_3: Setting Powered False 11:57:24.229326 bus /sierra_3: Setting Powered False 11:57:25.349964 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 11:57:26.440129 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:57:26.452103 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 11:57:26.503602 tst emergency_preemptive_call.py: using LAC 21301 11:57:26.630447 tst emergency_preemptive_call.py: using RAC 136 11:57:26.757293 tst emergency_preemptive_call.py: using CellId 21301 11:57:26.885118 tst emergency_preemptive_call.py: using BVCI 21302 11:57:26.995757 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:57:27.006860 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:57:27.017634 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:57:27.029701 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:57:27.040708 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 11:57:27.051793 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 11:57:27.169978 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 11:57:27.287140 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 11:57:27.407225 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 11:57:27.523308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:57:27.991942 run create_hlr_db(pid=2689): Launched 11:57:28.115225 bus /sierra_2: Setting Powered False 11:57:29.175499 run create_hlr_db(pid=2689): Terminated: ok {rc=0} 11:57:29.598368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2691): Launched 11:57:29.900143 run osmo-hlr_10.42.42.2(pid=2692): Launched 11:57:30.014050 run osmo-stp_10.42.42.5: Starting osmo-stp 11:57:30.531358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2694): Launched 11:57:30.840395 run osmo-stp_10.42.42.5(pid=2695): Launched 11:57:31.074269 tst emergency_preemptive_call.py: using MSISDN 7196 11:57:31.306340 run osmo-msc_10.42.42.6: Starting osmo-msc 11:57:31.865569 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2697): Launched 11:57:32.221760 run osmo-msc_10.42.42.6(pid=2698): Launched 11:57:32.431797 run osmo-stp_10.42.42.5(pid=2695): ERR: Terminated: ERROR {rc=1} [trial-2359↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2695)] 11:57:32.571603 run osmo-stp_10.42.42.5(pid=2695): stdout: | (launched: 2022-12-09_11:57:30.778543) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:32.712191 run osmo-stp_10.42.42.5(pid=2695): stderr: | 20221209115731039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115731039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115731040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115731040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115731041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115731041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115731041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:32.848619 run osmo-stp_10.42.42.5(pid=2695): stdout: | (launched: 2022-12-09_11:57:30.778543) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:32.977482 run osmo-stp_10.42.42.5(pid=2695): stderr: | 20221209115731039 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115731039 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115731040 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115731040 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115731041 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115731041 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115731041 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:33.131825 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=2695): Process ended prematurely: osmo-stp_10.42.42.5(pid=2695) [trial-2359↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2695)] [trial-2359↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 11:57:33.141022 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 11:57:33.169372 run osmo-hlr_10.42.42.2(pid=2692): ERR: Terminated: ERROR {rc=237} [trial-2359↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2692)] 11:57:33.220920 run osmo-hlr_10.42.42.2(pid=2692): stdout: | (launched: 2022-12-09_11:57:29.844384) 11:57:33.273783 run osmo-hlr_10.42.42.2(pid=2692): stderr: | 20221209115730016 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115730016 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115730017 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115730017 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115730017 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115730017 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115730032 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115730043 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115730043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115730043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:57:33.347516 run osmo-msc_10.42.42.6(pid=2698): ERR: Terminated: ERROR {rc=2} [trial-2359↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=2698)] 11:57:33.398511 run osmo-msc_10.42.42.6(pid=2698): stdout: | (launched: 2022-12-09_11:57:32.155405) 11:57:33.451114 run osmo-msc_10.42.42.6(pid=2698): stderr: | 20221209115732512 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209115732513 DLGLOBAL DEBUG validating counter group 0x7f968498ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209115732513 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209115732513 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209115732513 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209115732513 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209115732515 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209115732515 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209115732516 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209115732516 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 11:57:33.504422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2691): Terminating (SIGTERM) 11:57:33.547417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2694): Terminating (SIGTERM) 11:57:33.591159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2697): Terminating (SIGTERM) 11:57:33.634356 --- ParallelTerminationStrategy: PID 2691 died... 11:57:33.654764 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2691): Terminated: ok {rc=0} 11:57:33.702641 --- ParallelTerminationStrategy: PID 2694 died... 11:57:33.722798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2694): Terminated: ok {rc=0} 11:57:33.770098 --- ParallelTerminationStrategy: PID 2697 died... 11:57:33.789991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=2697): Terminated: ok {rc=0} 11:57:33.879384 bus /sierra_9: Setting Powered False 11:57:34.978635 bus /sierra_9: Setting Powered False 11:57:36.095036 bus /sierra_8: Setting Powered False 11:57:37.193908 bus /sierra_8: Setting Powered False 11:57:38.311216 bus /sierra_3: Setting Powered False 11:57:39.408686 bus /sierra_3: Setting Powered False 11:57:40.526327 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-umtrx --------------------------------------------------------------------- 11:57:41.800887 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:57:41.805517 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 11:57:41.839334 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 11:57:41.878819 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 11:57:41.968174 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 11:57:42.000793 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 11:57:42.039507 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 11:57:42.633053 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 11:57:42.687295 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:57:42.698568 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 11:57:42.747875 tst cs_paging_gprs_active.py: using LAC 21302 11:57:42.878468 tst cs_paging_gprs_active.py: using RAC 137 11:57:43.008481 tst cs_paging_gprs_active.py: using CellId 21302 11:57:43.138374 tst cs_paging_gprs_active.py: using BVCI 21303 11:57:43.260016 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:57:43.271241 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:57:43.282278 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:57:43.293702 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:57:43.305185 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:57:43.316322 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:57:43.327359 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:57:43.338406 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:57:43.349817 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 11:57:43.468828 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 11:57:43.589723 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:57:43.797319 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:44.105435 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2703): Launched 11:57:44.372939 run iperf3-srv_10.42.42.10(pid=2704): Launched 11:57:44.489079 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:57:44.694636 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:45.002867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2705): Launched 11:57:45.270854 run iperf3-srv_10.42.42.10(pid=2706): Launched 11:57:45.386248 tst cs_paging_gprs_active.py:38: start network... 11:57:45.591025 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:57:46.070331 run create_hlr_db(pid=2707): Launched 11:57:46.234894 bus /sierra_2: Setting Powered False 11:57:47.299376 run create_hlr_db(pid=2707): Terminated: ok {rc=0} 11:57:47.742474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2709): Launched 11:57:48.049688 run osmo-hlr_10.42.42.2(pid=2710): Launched 11:57:48.167073 run osmo-stp_10.42.42.5: Starting osmo-stp 11:57:48.696486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2712): Launched 11:57:49.004297 run osmo-stp_10.42.42.5(pid=2713): Launched 11:57:49.121517 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:57:49.647722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2715): Launched 11:57:49.765666 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:57:50.024332 run patchelf(pid=2716): Launched 11:57:50.209273 run osmo-stp_10.42.42.5(pid=2713): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2713)] 11:57:50.348448 run osmo-stp_10.42.42.5(pid=2713): stdout: | (launched: 2022-12-09_11:57:48.947287) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:50.488647 run osmo-stp_10.42.42.5(pid=2713): stderr: | 20221209115749115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115749115 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115749116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115749116 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115749116 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115749117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115749117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:50.630158 run osmo-stp_10.42.42.5(pid=2713): stdout: | (launched: 2022-12-09_11:57:48.947287) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:57:50.765453 run osmo-stp_10.42.42.5(pid=2713): stderr: | 20221209115749115 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115749115 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115749116 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115749116 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115749116 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115749117 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115749117 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:57:50.925371 run patchelf(pid=2716): Terminating (SIGINT) 11:57:51.111536 run patchelf(pid=2716): Terminated: ok {rc=0} 11:57:51.245303 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2713): Process ended prematurely: osmo-stp_10.42.42.5(pid=2713) [trial-2359↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2713)] [trial-2359↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 11:57:51.255399 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 11:57:51.284682 run osmo-hlr_10.42.42.2(pid=2710): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2710)] 11:57:51.335366 run osmo-hlr_10.42.42.2(pid=2710): stdout: | (launched: 2022-12-09_11:57:47.992596) 11:57:51.387717 run osmo-hlr_10.42.42.2(pid=2710): stderr: | 20221209115748166 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115748166 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115748166 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115748166 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115748166 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115748166 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115748178 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115748186 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115748186 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115748186 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:57:51.440350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2703): Terminating (SIGTERM) 11:57:51.482639 run iperf3-srv_10.42.42.10(pid=2704): Terminating (SIGTERM) 11:57:51.524874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2705): Terminating (SIGTERM) 11:57:51.567356 run iperf3-srv_10.42.42.10(pid=2706): Terminating (SIGTERM) 11:57:51.609733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2709): Terminating (SIGTERM) 11:57:51.652282 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2712): Terminating (SIGTERM) 11:57:51.694577 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2715): Terminating (SIGTERM) 11:57:51.737277 --- ParallelTerminationStrategy: PID 2703 died... 11:57:51.757426 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2703): Terminated: ok {rc=0} 11:57:51.804538 --- ParallelTerminationStrategy: PID 2704 died... 11:57:51.824340 run iperf3-srv_10.42.42.10(pid=2704): Terminated {rc=256} 11:57:51.871101 --- ParallelTerminationStrategy: PID 2705 died... 11:57:51.890879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2705): Terminated: ok {rc=0} 11:57:51.939414 --- ParallelTerminationStrategy: PID 2706 died... 11:57:51.959964 run iperf3-srv_10.42.42.10(pid=2706): Terminated {rc=256} 11:57:52.007184 --- ParallelTerminationStrategy: PID 2709 died... 11:57:52.027058 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2709): Terminated: ok {rc=0} 11:57:52.074029 --- ParallelTerminationStrategy: PID 2712 died... 11:57:52.093999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2712): Terminated: ok {rc=0} 11:57:52.140852 --- ParallelTerminationStrategy: PID 2715 died... 11:57:52.161007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2715): Terminated: ok {rc=0} 11:57:52.249095 bus /gobi_0: Setting Powered False 11:57:53.348445 bus /gobi_0: Setting Powered False 11:57:54.464567 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-umtrx iperf3.py ---------------------------------------------- 11:57:55.617194 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:57:55.629290 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 11:57:55.682290 tst iperf3.py: using LAC 21303 11:57:55.818038 tst iperf3.py: using RAC 138 11:57:55.961581 tst iperf3.py: using CellId 21303 11:57:56.093117 tst iperf3.py: using BVCI 21304 11:57:56.214984 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:57:56.226170 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:57:56.237139 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:57:56.248230 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:57:56.259340 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:57:56.270614 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:57:56.282111 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:57:56.293486 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:57:56.304713 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 11:57:56.422218 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:57:56.629923 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:57:56.938885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2717): Launched 11:57:57.208240 run iperf3-srv_10.42.42.10(pid=2718): Launched 11:57:57.324444 tst iperf3.py:8: start network... 11:57:57.530890 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:57:58.006732 run create_hlr_db(pid=2719): Launched 11:57:58.135966 bus /gobi_6: Setting Powered False 11:57:59.198190 run create_hlr_db(pid=2719): Terminated: ok {rc=0} 11:57:59.648637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2721): Launched 11:57:59.979523 run osmo-hlr_10.42.42.2(pid=2722): Launched 11:58:00.105768 run osmo-stp_10.42.42.5: Starting osmo-stp 11:58:00.675710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2724): Launched 11:58:01.017676 run osmo-stp_10.42.42.5(pid=2725): Launched 11:58:01.206682 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:58:01.832247 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2727): Launched 11:58:01.964422 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:58:02.230463 run patchelf(pid=2728): Launched 11:58:02.419363 run osmo-stp_10.42.42.5(pid=2725): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2725)] 11:58:02.550894 run osmo-stp_10.42.42.5(pid=2725): stdout: | (launched: 2022-12-09_11:58:00.956733) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:02.682692 run osmo-stp_10.42.42.5(pid=2725): stderr: | 20221209115801293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115801294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115801294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115801294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115801295 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115801295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115801295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:02.814562 run osmo-stp_10.42.42.5(pid=2725): stdout: | (launched: 2022-12-09_11:58:00.956733) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:02.940795 run osmo-stp_10.42.42.5(pid=2725): stderr: | 20221209115801293 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115801294 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115801294 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115801294 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115801295 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115801295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115801295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:03.091556 run patchelf(pid=2728): Terminating (SIGINT) 11:58:03.265732 run patchelf(pid=2728): Terminated: ok {rc=0} 11:58:03.391778 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2725): Process ended prematurely: osmo-stp_10.42.42.5(pid=2725) [trial-2359↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2725)] [trial-2359↪gprs:trx-umtrx↪iperf3.py:8] 11:58:03.401836 tst iperf3.py:8: Test FAILED (7.8 sec) 11:58:03.429444 run osmo-hlr_10.42.42.2(pid=2722): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2722)] 11:58:03.477948 run osmo-hlr_10.42.42.2(pid=2722): stdout: | (launched: 2022-12-09_11:57:59.919583) 11:58:03.527744 run osmo-hlr_10.42.42.2(pid=2722): stderr: | 20221209115800115 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115800115 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115800115 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115800115 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115800115 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115800115 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115800128 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115800139 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115800139 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115800139 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:58:03.577909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2717): Terminating (SIGTERM) 11:58:03.618205 run iperf3-srv_10.42.42.10(pid=2718): Terminating (SIGTERM) 11:58:03.658326 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2721): Terminating (SIGTERM) 11:58:03.698466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2724): Terminating (SIGTERM) 11:58:03.738883 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2727): Terminating (SIGTERM) 11:58:03.779482 --- ParallelTerminationStrategy: PID 2717 died... 11:58:03.798942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2717): Terminated: ok {rc=0} 11:58:03.843525 --- ParallelTerminationStrategy: PID 2718 died... 11:58:03.862334 run iperf3-srv_10.42.42.10(pid=2718): Terminated {rc=256} 11:58:03.906453 --- ParallelTerminationStrategy: PID 2721 died... 11:58:03.925380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2721): Terminated: ok {rc=0} 11:58:03.969837 --- ParallelTerminationStrategy: PID 2724 died... 11:58:03.988607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2724): Terminated: ok {rc=0} 11:58:04.033004 --- ParallelTerminationStrategy: PID 2727 died... 11:58:04.052259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2727): Terminated: ok {rc=0} 11:58:04.139040 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 11:58:05.288849 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:05.300269 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 11:58:05.347177 tst iperf3m4.py: using LAC 21304 11:58:05.468335 tst iperf3m4.py: using RAC 139 11:58:05.587837 tst iperf3m4.py: using CellId 21304 11:58:05.709187 tst iperf3m4.py: using BVCI 21305 11:58:05.820442 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:05.831561 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:05.842304 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:05.852894 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:05.863497 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:05.874150 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:05.884579 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:05.894998 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:05.905861 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 11:58:06.021679 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 11:58:06.149665 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 11:58:06.270457 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 11:58:06.394372 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:58:06.618406 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:06.950234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2729): Launched 11:58:07.239399 run iperf3-srv_10.42.42.10(pid=2730): Launched 11:58:07.365943 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:58:07.589341 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:07.920931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2731): Launched 11:58:08.209107 run iperf3-srv_10.42.42.10(pid=2732): Launched 11:58:08.334010 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:58:08.557313 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:08.889281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2733): Launched 11:58:09.177493 run iperf3-srv_10.42.42.10(pid=2734): Launched 11:58:09.302779 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:58:09.526159 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:09.859894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2735): Launched 11:58:10.147510 run iperf3-srv_10.42.42.10(pid=2736): Launched 11:58:10.273676 tst iperf3m4.py:8: start network... 11:58:10.495617 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:58:11.006642 run create_hlr_db(pid=2737): Launched 11:58:11.135903 bus /gobi_6: Setting Powered False 11:58:12.200339 run create_hlr_db(pid=2737): Terminated: ok {rc=0} 11:58:12.658231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2739): Launched 11:58:12.987686 run osmo-hlr_10.42.42.2(pid=2740): Launched 11:58:13.114099 run osmo-stp_10.42.42.5: Starting osmo-stp 11:58:13.681426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2742): Launched 11:58:14.012896 run osmo-stp_10.42.42.5(pid=2743): Launched 11:58:14.140043 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:58:14.709110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2745): Launched 11:58:14.836066 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:58:15.115068 run patchelf(pid=2746): Launched 11:58:15.300684 run osmo-stp_10.42.42.5(pid=2743): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2743)] 11:58:15.440304 run osmo-stp_10.42.42.5(pid=2743): stdout: | (launched: 2022-12-09_11:58:13.952393) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:15.581208 run osmo-stp_10.42.42.5(pid=2743): stderr: | 20221209115814139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115814139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115814140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115814140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115814140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115814141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115814141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:15.722762 run osmo-stp_10.42.42.5(pid=2743): stdout: | (launched: 2022-12-09_11:58:13.952393) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:15.863307 run osmo-stp_10.42.42.5(pid=2743): stderr: | 20221209115814139 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115814139 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115814140 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115814140 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115814140 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115814141 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115814141 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:16.027289 run patchelf(pid=2746): Terminating (SIGINT) 11:58:16.217260 run patchelf(pid=2746): Terminated: ok {rc=0} 11:58:16.355060 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2743): Process ended prematurely: osmo-stp_10.42.42.5(pid=2743) [trial-2359↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2743)] [trial-2359↪gprs:trx-umtrx↪iperf3m4.py:8] 11:58:16.366430 tst iperf3m4.py:8: Test FAILED (11.1 sec) 11:58:16.398035 run osmo-hlr_10.42.42.2(pid=2740): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2740)] 11:58:16.450189 run osmo-hlr_10.42.42.2(pid=2740): stdout: | (launched: 2022-12-09_11:58:12.927613) 11:58:16.503838 run osmo-hlr_10.42.42.2(pid=2740): stderr: | 20221209115813123 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115813123 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115813123 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115813123 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115813123 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115813124 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115813136 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115813144 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115813144 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115813144 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:58:16.558149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2729): Terminating (SIGTERM) 11:58:16.602285 run iperf3-srv_10.42.42.10(pid=2730): Terminating (SIGTERM) 11:58:16.647598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2731): Terminating (SIGTERM) 11:58:16.692083 run iperf3-srv_10.42.42.10(pid=2732): Terminating (SIGTERM) 11:58:16.737148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2733): Terminating (SIGTERM) 11:58:16.781424 run iperf3-srv_10.42.42.10(pid=2734): Terminating (SIGTERM) 11:58:16.826875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2735): Terminating (SIGTERM) 11:58:16.871360 run iperf3-srv_10.42.42.10(pid=2736): Terminating (SIGTERM) 11:58:16.915261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2739): Terminating (SIGTERM) 11:58:16.959538 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2742): Terminating (SIGTERM) 11:58:17.003565 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2745): Terminating (SIGTERM) 11:58:17.047689 --- ParallelTerminationStrategy: PID 2729 died... 11:58:17.068191 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2729): Terminated: ok {rc=0} 11:58:17.117944 --- ParallelTerminationStrategy: PID 2730 died... 11:58:17.138126 run iperf3-srv_10.42.42.10(pid=2730): Terminated {rc=256} 11:58:17.187608 --- ParallelTerminationStrategy: PID 2731 died... 11:58:17.208221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2731): Terminated: ok {rc=0} 11:58:17.257180 --- ParallelTerminationStrategy: PID 2732 died... 11:58:17.276609 run iperf3-srv_10.42.42.10(pid=2732): Terminated {rc=256} 11:58:17.324187 --- ParallelTerminationStrategy: PID 2733 died... 11:58:17.343810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2733): Terminated: ok {rc=0} 11:58:17.391529 --- ParallelTerminationStrategy: PID 2734 died... 11:58:17.411051 run iperf3-srv_10.42.42.10(pid=2734): Terminated {rc=256} 11:58:17.459350 --- ParallelTerminationStrategy: PID 2735 died... 11:58:17.479000 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2735): Terminated: ok {rc=0} 11:58:17.526803 --- ParallelTerminationStrategy: PID 2736 died... 11:58:17.546359 run iperf3-srv_10.42.42.10(pid=2736): Terminated {rc=256} 11:58:17.594300 --- ParallelTerminationStrategy: PID 2739 died... 11:58:17.613939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2739): Terminated: ok {rc=0} 11:58:17.661688 --- ParallelTerminationStrategy: PID 2742 died... 11:58:17.681475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2742): Terminated: ok {rc=0} 11:58:17.729098 --- ParallelTerminationStrategy: PID 2745 died... 11:58:17.748804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2745): Terminated: ok {rc=0} 11:58:17.838374 bus /gobi_4: Setting Powered False 11:58:18.936899 bus /gobi_4: Setting Powered False 11:58:20.054430 bus /gobi_1: Setting Powered False 11:58:21.152911 bus /gobi_1: Setting Powered False 11:58:22.267839 bus /gobi_0: Setting Powered False 11:58:23.367158 bus /gobi_0: Setting Powered False 11:58:24.481513 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-umtrx ping.py ---------------------------------------------- 11:58:25.584307 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:25.596387 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 11:58:25.652055 tst ping.py: using LAC 21305 11:58:25.778455 tst ping.py: using RAC 140 11:58:25.903484 tst ping.py: using CellId 21305 11:58:26.022919 tst ping.py: using BVCI 21306 11:58:26.132372 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:26.143222 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:26.154001 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:26.164755 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:26.175516 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:26.186275 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:26.197257 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:26.207805 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 11:58:26.325883 tst ping.py:19: start network... 11:58:26.546303 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:58:27.048581 run create_hlr_db(pid=2748): Launched 11:58:27.173812 bus /gobi_6: Setting Powered False 11:58:28.237959 run create_hlr_db(pid=2748): Terminated: ok {rc=0} 11:58:28.690846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2750): Launched 11:58:29.017449 run osmo-hlr_10.42.42.2(pid=2751): Launched 11:58:29.142796 run osmo-stp_10.42.42.5: Starting osmo-stp 11:58:29.706109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2753): Launched 11:58:30.032571 run osmo-stp_10.42.42.5(pid=2754): Launched 11:58:30.157287 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:58:30.718717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2756): Launched 11:58:30.846357 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:58:31.129917 run patchelf(pid=2757): Launched 11:58:31.325349 run osmo-stp_10.42.42.5(pid=2754): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2754)] 11:58:31.467698 run osmo-stp_10.42.42.5(pid=2754): stdout: | (launched: 2022-12-09_11:58:29.973513) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:31.631971 run osmo-stp_10.42.42.5(pid=2754): stderr: | 20221209115830161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115830161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115830162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115830162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115830162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115830163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115830163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:31.795908 run osmo-stp_10.42.42.5(pid=2754): stdout: | (launched: 2022-12-09_11:58:29.973513) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:31.936510 run osmo-stp_10.42.42.5(pid=2754): stderr: | 20221209115830161 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115830161 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115830162 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115830162 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115830162 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115830163 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115830163 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:32.098838 run patchelf(pid=2757): Terminating (SIGINT) 11:58:32.287207 run patchelf(pid=2757): Terminated: ok {rc=0} 11:58:32.422602 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2754): Process ended prematurely: osmo-stp_10.42.42.5(pid=2754) [trial-2359↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2754)] [trial-2359↪gprs:trx-umtrx↪ping.py:22] 11:58:32.432280 tst ping.py:22: Test FAILED (6.8 sec) 11:58:32.462862 run osmo-hlr_10.42.42.2(pid=2751): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2751)] 11:58:32.515253 run osmo-hlr_10.42.42.2(pid=2751): stdout: | (launched: 2022-12-09_11:58:28.957727) 11:58:32.569548 run osmo-hlr_10.42.42.2(pid=2751): stderr: | 20221209115829154 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115829154 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115829154 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115829154 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115829154 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115829154 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115829167 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115829176 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115829176 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115829176 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:58:32.624722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2750): Terminating (SIGTERM) 11:58:32.668992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2753): Terminating (SIGTERM) 11:58:32.713183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2756): Terminating (SIGTERM) 11:58:32.757729 --- ParallelTerminationStrategy: PID 2750 died... 11:58:32.778497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2750): Terminated: ok {rc=0} 11:58:32.828028 --- ParallelTerminationStrategy: PID 2753 died... 11:58:32.848346 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2753): Terminated: ok {rc=0} 11:58:32.897523 --- ParallelTerminationStrategy: PID 2756 died... 11:58:32.917670 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2756): Terminated: ok {rc=0} 11:58:33.009967 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 11:58:34.099729 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:34.111955 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 11:58:34.169446 tst ping_idle_ping.py: using LAC 21306 11:58:34.289590 tst ping_idle_ping.py: using RAC 141 11:58:34.413331 tst ping_idle_ping.py: using CellId 21306 11:58:34.531711 tst ping_idle_ping.py: using BVCI 21307 11:58:34.642595 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:34.653506 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:34.664231 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:34.674968 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:34.685538 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:34.696140 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:34.706819 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 11:58:34.717449 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 11:58:34.836630 tst ping_idle_ping.py:24: start network... 11:58:35.042137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:58:35.515399 run create_hlr_db(pid=2758): Launched 11:58:35.639914 bus /gobi_6: Setting Powered False 11:58:36.701515 run create_hlr_db(pid=2758): Terminated: ok {rc=0} 11:58:37.148578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2760): Launched 11:58:37.477388 run osmo-hlr_10.42.42.2(pid=2761): Launched 11:58:37.603107 run osmo-stp_10.42.42.5: Starting osmo-stp 11:58:38.164120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2763): Launched 11:58:38.492109 run osmo-stp_10.42.42.5(pid=2764): Launched 11:58:38.617704 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:58:39.178798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2766): Launched 11:58:39.304801 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:58:39.579095 run patchelf(pid=2767): Launched 11:58:39.762888 run osmo-stp_10.42.42.5(pid=2764): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2764)] 11:58:39.900492 run osmo-stp_10.42.42.5(pid=2764): stdout: | (launched: 2022-12-09_11:58:38.432567) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:40.039584 run osmo-stp_10.42.42.5(pid=2764): stderr: | 20221209115838623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115838623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115838623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115838624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115838624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115838624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115838624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:40.178981 run osmo-stp_10.42.42.5(pid=2764): stdout: | (launched: 2022-12-09_11:58:38.432567) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:40.311887 run osmo-stp_10.42.42.5(pid=2764): stderr: | 20221209115838623 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115838623 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115838623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115838624 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115838624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115838624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115838624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:40.469435 run patchelf(pid=2767): Terminating (SIGINT) 11:58:40.653220 run patchelf(pid=2767): Terminated: ok {rc=0} 11:58:40.785811 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2764): Process ended prematurely: osmo-stp_10.42.42.5(pid=2764) [trial-2359↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2764)] [trial-2359↪gprs:trx-umtrx↪ping_idle_ping.py:27] 11:58:40.795465 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 11:58:40.824831 run osmo-hlr_10.42.42.2(pid=2761): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2761)] 11:58:40.875514 run osmo-hlr_10.42.42.2(pid=2761): stdout: | (launched: 2022-12-09_11:58:37.417705) 11:58:40.928073 run osmo-hlr_10.42.42.2(pid=2761): stderr: | 20221209115837613 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115837614 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115837614 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115837614 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115837614 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115837614 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115837626 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115837635 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115837635 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115837635 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:58:40.980873 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2760): Terminating (SIGTERM) 11:58:41.023351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2763): Terminating (SIGTERM) 11:58:41.065714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2766): Terminating (SIGTERM) 11:58:41.108423 --- ParallelTerminationStrategy: PID 2760 died... 11:58:41.128336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2760): Terminated: ok {rc=0} 11:58:41.175355 --- ParallelTerminationStrategy: PID 2763 died... 11:58:41.195077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2763): Terminated: ok {rc=0} 11:58:41.241836 --- ParallelTerminationStrategy: PID 2766 died... 11:58:41.261453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2766): Terminated: ok {rc=0} 11:58:41.350901 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 11:58:42.655023 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:58:42.660801 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 11:58:42.695209 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 11:58:42.735181 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 11:58:42.825727 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 11:58:42.859448 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 11:58:42.899247 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 11:58:43.495442 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 11:58:43.549558 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:43.561096 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:58:43.612748 tst cs_paging_gprs_active.py: using LAC 21307 11:58:43.745374 tst cs_paging_gprs_active.py: using RAC 142 11:58:43.874758 tst cs_paging_gprs_active.py: using CellId 21307 11:58:44.006415 tst cs_paging_gprs_active.py: using BVCI 21308 11:58:44.127266 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:44.138843 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:44.150194 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:44.162181 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:44.173796 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:44.186239 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:44.198341 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:44.209495 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:44.220894 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:58:44.340720 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:58:44.457585 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:58:44.666059 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:44.976765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2772): Launched 11:58:45.249123 run iperf3-srv_10.42.42.10(pid=2773): Launched 11:58:45.366134 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:58:45.573804 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:45.901681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2774): Launched 11:58:46.220107 run iperf3-srv_10.42.42.10(pid=2775): Launched 11:58:46.362807 tst cs_paging_gprs_active.py:38: start network... 11:58:46.593093 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:58:47.121341 run create_hlr_db(pid=2776): Launched 11:58:47.266276 bus /gobi_6: Setting Powered False 11:58:48.326908 run create_hlr_db(pid=2776): Terminated: ok {rc=0} 11:58:48.790826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2778): Launched 11:58:49.124263 run osmo-hlr_10.42.42.2(pid=2779): Launched 11:58:49.252592 run osmo-stp_10.42.42.5: Starting osmo-stp 11:58:49.821963 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2781): Launched 11:58:50.153463 run osmo-stp_10.42.42.5(pid=2782): Launched 11:58:50.282204 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:58:50.856315 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2784): Launched 11:58:50.985677 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:58:51.266080 run patchelf(pid=2785): Launched 11:58:51.451707 run osmo-stp_10.42.42.5(pid=2782): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2782)] 11:58:51.591686 run osmo-stp_10.42.42.5(pid=2782): stdout: | (launched: 2022-12-09_11:58:50.092655) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:51.733542 run osmo-stp_10.42.42.5(pid=2782): stderr: | 20221209115850284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115850284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115850284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115850285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115850285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115850285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115850285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:51.874984 run osmo-stp_10.42.42.5(pid=2782): stdout: | (launched: 2022-12-09_11:58:50.092655) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:58:52.010767 run osmo-stp_10.42.42.5(pid=2782): stderr: | 20221209115850284 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115850284 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115850284 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115850285 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115850285 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115850285 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115850285 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:58:52.171772 run patchelf(pid=2785): Terminating (SIGINT) 11:58:52.359326 run patchelf(pid=2785): Terminated: ok {rc=0} 11:58:52.494109 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2782): Process ended prematurely: osmo-stp_10.42.42.5(pid=2782) [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2782)] [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 11:58:52.504314 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 11:58:52.533792 run osmo-hlr_10.42.42.2(pid=2779): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2779)] 11:58:52.584401 run osmo-hlr_10.42.42.2(pid=2779): stdout: | (launched: 2022-12-09_11:58:49.063348) 11:58:52.637291 run osmo-hlr_10.42.42.2(pid=2779): stderr: | 20221209115849260 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115849260 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115849260 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115849260 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115849260 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115849260 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115849272 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115849281 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115849281 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115849281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:58:52.690299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2772): Terminating (SIGTERM) 11:58:52.732642 run iperf3-srv_10.42.42.10(pid=2773): Terminating (SIGTERM) 11:58:52.775029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2774): Terminating (SIGTERM) 11:58:52.817402 run iperf3-srv_10.42.42.10(pid=2775): Terminating (SIGTERM) 11:58:52.859630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2778): Terminating (SIGTERM) 11:58:52.902153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2781): Terminating (SIGTERM) 11:58:52.944412 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2784): Terminating (SIGTERM) 11:58:52.986993 --- ParallelTerminationStrategy: PID 2772 died... 11:58:53.007210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2772): Terminated: ok {rc=0} 11:58:53.054320 --- ParallelTerminationStrategy: PID 2773 died... 11:58:53.073796 run iperf3-srv_10.42.42.10(pid=2773): Terminated {rc=256} 11:58:53.120870 --- ParallelTerminationStrategy: PID 2774 died... 11:58:53.141193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2774): Terminated: ok {rc=0} 11:58:53.188135 --- ParallelTerminationStrategy: PID 2775 died... 11:58:53.207771 run iperf3-srv_10.42.42.10(pid=2775): Terminated {rc=256} 11:58:53.254887 --- ParallelTerminationStrategy: PID 2778 died... 11:58:53.274706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2778): Terminated: ok {rc=0} 11:58:53.321525 --- ParallelTerminationStrategy: PID 2781 died... 11:58:53.341161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2781): Terminated: ok {rc=0} 11:58:53.387737 --- ParallelTerminationStrategy: PID 2784 died... 11:58:53.407545 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2784): Terminated: ok {rc=0} 11:58:53.496572 bus /gobi_0: Setting Powered False 11:58:54.595472 bus /gobi_0: Setting Powered False 11:58:55.713821 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 11:58:56.860916 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:56.872606 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:58:56.925434 tst iperf3.py: using LAC 21308 11:58:57.049773 tst iperf3.py: using RAC 143 11:58:57.173434 tst iperf3.py: using CellId 21308 11:58:57.304226 tst iperf3.py: using BVCI 21309 11:58:57.425427 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:57.436904 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:57.448162 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:57.459714 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:57.471058 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:57.482399 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:57.493954 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:57.505267 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:58:57.516836 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:58:57.635375 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:58:57.843028 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:58:58.153274 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2786): Launched 11:58:58.422909 run iperf3-srv_10.42.42.10(pid=2787): Launched 11:58:58.540727 tst iperf3.py:8: start network... 11:58:58.746814 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:58:59.223057 run create_hlr_db(pid=2788): Launched 11:58:59.349915 bus /gobi_6: Setting Powered False 11:59:00.411347 run create_hlr_db(pid=2788): Terminated: ok {rc=0} 11:59:00.876087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2790): Launched 11:59:01.214586 run osmo-hlr_10.42.42.2(pid=2791): Launched 11:59:01.490223 run osmo-stp_10.42.42.5: Starting osmo-stp 11:59:02.110288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2793): Launched 11:59:02.437053 run osmo-stp_10.42.42.5(pid=2794): Launched 11:59:02.554446 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:59:03.085137 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2796): Launched 11:59:03.203600 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:59:03.463854 run patchelf(pid=2797): Launched 11:59:03.636413 run osmo-stp_10.42.42.5(pid=2794): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2794)] 11:59:03.766525 run osmo-stp_10.42.42.5(pid=2794): stdout: | (launched: 2022-12-09_11:59:02.379613) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:03.897621 run osmo-stp_10.42.42.5(pid=2794): stderr: | 20221209115902550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115902550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115902550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115902550 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115902551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115902551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115902551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:04.028883 run osmo-stp_10.42.42.5(pid=2794): stdout: | (launched: 2022-12-09_11:59:02.379613) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:04.155043 run osmo-stp_10.42.42.5(pid=2794): stderr: | 20221209115902550 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115902550 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115902550 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115902550 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115902551 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115902551 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115902551 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:04.304085 run patchelf(pid=2797): Terminating (SIGINT) 11:59:04.478054 run patchelf(pid=2797): Terminated: ok {rc=0} 11:59:04.603850 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2794): Process ended prematurely: osmo-stp_10.42.42.5(pid=2794) [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2794)] [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 11:59:04.613662 tst iperf3.py:8: Test FAILED (7.8 sec) 11:59:04.641465 run osmo-hlr_10.42.42.2(pid=2791): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2791)] 11:59:04.689357 run osmo-hlr_10.42.42.2(pid=2791): stdout: | (launched: 2022-12-09_11:59:01.156067) 11:59:04.739046 run osmo-hlr_10.42.42.2(pid=2791): stderr: | 20221209115901444 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115901445 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115901445 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115901445 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115901445 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115901445 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115901463 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115901479 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115901480 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115901480 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:59:04.789308 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2786): Terminating (SIGTERM) 11:59:04.829429 run iperf3-srv_10.42.42.10(pid=2787): Terminating (SIGTERM) 11:59:04.869325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2790): Terminating (SIGTERM) 11:59:04.909489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2793): Terminating (SIGTERM) 11:59:04.949490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2796): Terminating (SIGTERM) 11:59:04.989718 --- ParallelTerminationStrategy: PID 2786 died... 11:59:05.009044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2786): Terminated: ok {rc=0} 11:59:05.053643 --- ParallelTerminationStrategy: PID 2787 died... 11:59:05.072437 run iperf3-srv_10.42.42.10(pid=2787): Terminated {rc=256} 11:59:05.117211 --- ParallelTerminationStrategy: PID 2790 died... 11:59:05.135952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2790): Terminated: ok {rc=0} 11:59:05.180335 --- ParallelTerminationStrategy: PID 2793 died... 11:59:05.199291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2793): Terminated: ok {rc=0} 11:59:05.243729 --- ParallelTerminationStrategy: PID 2796 died... 11:59:05.262708 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2796): Terminated: ok {rc=0} 11:59:05.347421 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 11:59:06.491722 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:06.503639 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:59:06.553266 tst iperf3m4.py: using LAC 21309 11:59:06.674652 tst iperf3m4.py: using RAC 144 11:59:06.797800 tst iperf3m4.py: using CellId 21309 11:59:06.918719 tst iperf3m4.py: using BVCI 21310 11:59:07.032208 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:07.043281 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:07.054171 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:07.065122 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:07.075993 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:07.086981 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:07.098097 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:07.109436 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:07.120443 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:59:07.243879 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:59:07.366072 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:59:07.486239 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:59:07.610436 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 11:59:07.834720 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:59:08.166175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2798): Launched 11:59:08.455106 run iperf3-srv_10.42.42.10(pid=2799): Launched 11:59:08.579816 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 11:59:08.803690 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:59:09.135717 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2800): Launched 11:59:09.424210 run iperf3-srv_10.42.42.10(pid=2801): Launched 11:59:09.549445 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 11:59:09.773001 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:59:10.105178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2802): Launched 11:59:10.393564 run iperf3-srv_10.42.42.10(pid=2803): Launched 11:59:10.519293 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 11:59:10.744165 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:59:11.077804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2804): Launched 11:59:11.367451 run iperf3-srv_10.42.42.10(pid=2805): Launched 11:59:11.493459 tst iperf3m4.py:8: start network... 11:59:11.716918 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:59:12.228863 run create_hlr_db(pid=2806): Launched 11:59:12.355651 bus /gobi_6: Setting Powered False 11:59:13.420234 run create_hlr_db(pid=2806): Terminated: ok {rc=0} 11:59:13.882178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2808): Launched 11:59:14.214127 run osmo-hlr_10.42.42.2(pid=2809): Launched 11:59:14.343387 run osmo-stp_10.42.42.5: Starting osmo-stp 11:59:14.918854 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2811): Launched 11:59:15.252543 run osmo-stp_10.42.42.5(pid=2812): Launched 11:59:15.379435 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:59:15.961029 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2814): Launched 11:59:16.092313 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:59:16.364245 run patchelf(pid=2815): Launched 11:59:16.558059 run osmo-stp_10.42.42.5(pid=2812): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2812)] 11:59:16.695727 run osmo-stp_10.42.42.5(pid=2812): stdout: | (launched: 2022-12-09_11:59:15.191692) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:16.832749 run osmo-stp_10.42.42.5(pid=2812): stderr: | 20221209115915380 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115915380 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115915380 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115915381 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115915381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115915381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115915381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:16.968546 run osmo-stp_10.42.42.5(pid=2812): stdout: | (launched: 2022-12-09_11:59:15.191692) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:17.100126 run osmo-stp_10.42.42.5(pid=2812): stderr: | 20221209115915380 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115915380 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115915380 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115915381 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115915381 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115915381 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115915381 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:17.253621 run patchelf(pid=2815): Terminating (SIGINT) 11:59:17.429684 run patchelf(pid=2815): Terminated: ok {rc=0} 11:59:17.557195 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2812): Process ended prematurely: osmo-stp_10.42.42.5(pid=2812) [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2812)] [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 11:59:17.566953 tst iperf3m4.py:8: Test FAILED (11.1 sec) 11:59:17.596393 run osmo-hlr_10.42.42.2(pid=2809): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2809)] 11:59:17.645551 run osmo-hlr_10.42.42.2(pid=2809): stdout: | (launched: 2022-12-09_11:59:14.153239) 11:59:17.695999 run osmo-hlr_10.42.42.2(pid=2809): stderr: | 20221209115914349 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115914349 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115914349 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115914349 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115914349 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115914350 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115914362 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115914371 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115914371 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115914371 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:59:17.746810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2798): Terminating (SIGTERM) 11:59:17.787650 run iperf3-srv_10.42.42.10(pid=2799): Terminating (SIGTERM) 11:59:17.828568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2800): Terminating (SIGTERM) 11:59:17.869112 run iperf3-srv_10.42.42.10(pid=2801): Terminating (SIGTERM) 11:59:17.909986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2802): Terminating (SIGTERM) 11:59:17.951049 run iperf3-srv_10.42.42.10(pid=2803): Terminating (SIGTERM) 11:59:17.991746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2804): Terminating (SIGTERM) 11:59:18.032545 run iperf3-srv_10.42.42.10(pid=2805): Terminating (SIGTERM) 11:59:18.073341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2808): Terminating (SIGTERM) 11:59:18.114000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2811): Terminating (SIGTERM) 11:59:18.154598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2814): Terminating (SIGTERM) 11:59:18.195058 --- ParallelTerminationStrategy: PID 2798 died... 11:59:18.214154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2798): Terminated: ok {rc=0} 11:59:18.258856 --- ParallelTerminationStrategy: PID 2799 died... 11:59:18.277811 run iperf3-srv_10.42.42.10(pid=2799): Terminated {rc=256} 11:59:18.322582 --- ParallelTerminationStrategy: PID 2800 died... 11:59:18.341439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2800): Terminated: ok {rc=0} 11:59:18.385820 --- ParallelTerminationStrategy: PID 2801 died... 11:59:18.404583 run iperf3-srv_10.42.42.10(pid=2801): Terminated {rc=256} 11:59:18.448846 --- ParallelTerminationStrategy: PID 2802 died... 11:59:18.468085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2802): Terminated: ok {rc=0} 11:59:18.512184 --- ParallelTerminationStrategy: PID 2803 died... 11:59:18.530937 run iperf3-srv_10.42.42.10(pid=2803): Terminated {rc=256} 11:59:18.575075 --- ParallelTerminationStrategy: PID 2804 died... 11:59:18.593866 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2804): Terminated: ok {rc=0} 11:59:18.638129 --- ParallelTerminationStrategy: PID 2805 died... 11:59:18.656918 run iperf3-srv_10.42.42.10(pid=2805): Terminated {rc=256} 11:59:18.700915 --- ParallelTerminationStrategy: PID 2808 died... 11:59:18.719810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2808): Terminated: ok {rc=0} 11:59:18.764187 --- ParallelTerminationStrategy: PID 2811 died... 11:59:18.783039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2811): Terminated: ok {rc=0} 11:59:18.829279 --- ParallelTerminationStrategy: PID 2814 died... 11:59:18.848016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2814): Terminated: ok {rc=0} 11:59:18.932643 bus /gobi_4: Setting Powered False 11:59:20.030847 bus /gobi_4: Setting Powered False 11:59:21.148631 bus /gobi_1: Setting Powered False 11:59:22.243252 bus /gobi_1: Setting Powered False 11:59:23.355774 bus /gobi_0: Setting Powered False 11:59:24.453734 bus /gobi_0: Setting Powered False 11:59:25.571305 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 11:59:26.674090 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:26.686394 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:59:26.740180 tst ping.py: using LAC 21310 11:59:26.869389 tst ping.py: using RAC 145 11:59:26.995542 tst ping.py: using CellId 21310 11:59:27.122623 tst ping.py: using BVCI 21311 11:59:27.241313 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:27.252928 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:27.264289 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:27.276255 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:27.289073 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:27.300220 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:27.312529 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:27.325655 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:59:27.444869 tst ping.py:19: start network... 11:59:27.664489 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:59:28.166434 run create_hlr_db(pid=2816): Launched 11:59:28.291542 bus /gobi_6: Setting Powered False 11:59:29.355906 run create_hlr_db(pid=2816): Terminated: ok {rc=0} 11:59:29.791266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2818): Launched 11:59:30.095032 run osmo-hlr_10.42.42.2(pid=2819): Launched 11:59:30.210614 run osmo-stp_10.42.42.5: Starting osmo-stp 11:59:30.735585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2821): Launched 11:59:31.053536 run osmo-stp_10.42.42.5(pid=2822): Launched 11:59:31.334334 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:59:32.041789 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2824): Launched 11:59:32.170662 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:59:32.428468 run patchelf(pid=2825): Launched 11:59:32.597914 run osmo-stp_10.42.42.5(pid=2822): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2822)] 11:59:32.726047 run osmo-stp_10.42.42.5(pid=2822): stdout: | (launched: 2022-12-09_11:59:30.991850) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:32.854934 run osmo-stp_10.42.42.5(pid=2822): stderr: | 20221209115931364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115931365 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115931365 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115931367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115931373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115931373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115931373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:32.983796 run osmo-stp_10.42.42.5(pid=2822): stdout: | (launched: 2022-12-09_11:59:30.991850) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:33.107680 run osmo-stp_10.42.42.5(pid=2822): stderr: | 20221209115931364 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115931365 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115931365 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115931367 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115931373 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115931373 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115931373 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:33.253909 run patchelf(pid=2825): Terminating (SIGINT) 11:59:33.424760 run patchelf(pid=2825): Terminated: ok {rc=0} 11:59:33.548176 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2822): Process ended prematurely: osmo-stp_10.42.42.5(pid=2822) [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2822)] [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 11:59:33.557088 tst ping.py:22: Test FAILED (6.9 sec) 11:59:33.584042 run osmo-hlr_10.42.42.2(pid=2819): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2819)] 11:59:33.631975 run osmo-hlr_10.42.42.2(pid=2819): stdout: | (launched: 2022-12-09_11:59:30.039121) 11:59:33.681692 run osmo-hlr_10.42.42.2(pid=2819): stderr: | 20221209115930214 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115930214 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115930214 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115930214 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115930214 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115930214 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115930227 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115930235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115930236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115930236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:59:33.732270 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2818): Terminating (SIGTERM) 11:59:33.772347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2821): Terminating (SIGTERM) 11:59:33.812437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2824): Terminating (SIGTERM) 11:59:33.852765 --- ParallelTerminationStrategy: PID 2818 died... 11:59:33.872276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2818): Terminated: ok {rc=0} 11:59:33.917092 --- ParallelTerminationStrategy: PID 2821 died... 11:59:33.936029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2821): Terminated: ok {rc=0} 11:59:33.981057 --- ParallelTerminationStrategy: PID 2824 died... 11:59:33.999975 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2824): Terminated: ok {rc=0} 11:59:34.085723 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 11:59:35.175369 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:35.187508 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 11:59:35.244786 tst ping_idle_ping.py: using LAC 21311 11:59:35.363027 tst ping_idle_ping.py: using RAC 146 11:59:35.481356 tst ping_idle_ping.py: using CellId 21311 11:59:35.598986 tst ping_idle_ping.py: using BVCI 21312 11:59:35.710270 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:35.721433 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:35.732284 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:35.743271 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:35.753992 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:35.764696 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:35.775545 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 11:59:35.786218 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 11:59:35.907666 tst ping_idle_ping.py:24: start network... 11:59:36.129534 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:59:36.635828 run create_hlr_db(pid=2826): Launched 11:59:36.762753 bus /gobi_6: Setting Powered False 11:59:37.826862 run create_hlr_db(pid=2826): Terminated: ok {rc=0} 11:59:38.264322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2828): Launched 11:59:38.571573 run osmo-hlr_10.42.42.2(pid=2829): Launched 11:59:38.689309 run osmo-stp_10.42.42.5: Starting osmo-stp 11:59:39.221618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2831): Launched 11:59:39.528246 run osmo-stp_10.42.42.5(pid=2832): Launched 11:59:39.644286 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:59:40.168774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2834): Launched 11:59:40.285602 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:59:40.542142 run patchelf(pid=2835): Launched 11:59:40.714082 run osmo-stp_10.42.42.5(pid=2832): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2832)] 11:59:40.843304 run osmo-stp_10.42.42.5(pid=2832): stdout: | (launched: 2022-12-09_11:59:39.471498) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:40.973436 run osmo-stp_10.42.42.5(pid=2832): stderr: | 20221209115939642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115939642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115939643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115939643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115939643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115939644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115939644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:41.103692 run osmo-stp_10.42.42.5(pid=2832): stdout: | (launched: 2022-12-09_11:59:39.471498) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:41.228042 run osmo-stp_10.42.42.5(pid=2832): stderr: | 20221209115939642 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115939642 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115939643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115939643 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115939643 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115939644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115939644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:41.375398 run patchelf(pid=2835): Terminating (SIGINT) 11:59:41.547714 run patchelf(pid=2835): Terminated: ok {rc=0} 11:59:41.671670 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2832): Process ended prematurely: osmo-stp_10.42.42.5(pid=2832) [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2832)] [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 11:59:41.680690 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 11:59:41.707763 run osmo-hlr_10.42.42.2(pid=2829): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2829)] 11:59:41.755390 run osmo-hlr_10.42.42.2(pid=2829): stdout: | (launched: 2022-12-09_11:59:38.514656) 11:59:41.805448 run osmo-hlr_10.42.42.2(pid=2829): stderr: | 20221209115938690 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115938690 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115938690 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115938690 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115938690 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115938690 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115938702 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115938711 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115938711 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115938711 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:59:41.855501 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2828): Terminating (SIGTERM) 11:59:41.895821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2831): Terminating (SIGTERM) 11:59:41.936060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2834): Terminating (SIGTERM) 11:59:41.977312 --- ParallelTerminationStrategy: PID 2828 died... 11:59:41.996761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2828): Terminated: ok {rc=0} 11:59:42.042126 --- ParallelTerminationStrategy: PID 2831 died... 11:59:42.061347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2831): Terminated: ok {rc=0} 11:59:42.106031 --- ParallelTerminationStrategy: PID 2834 died... 11:59:42.125092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2834): Terminated: ok {rc=0} 11:59:42.209705 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 11:59:43.517046 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 11:59:43.523670 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 11:59:43.558746 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 11:59:43.598826 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 11:59:43.689984 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 11:59:43.724081 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 11:59:43.764029 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 11:59:44.358959 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 11:59:44.413068 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:44.424394 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:59:44.495419 tst cs_paging_gprs_active.py: using LAC 21312 11:59:44.625380 tst cs_paging_gprs_active.py: using RAC 147 11:59:44.757294 tst cs_paging_gprs_active.py: using CellId 21312 11:59:44.888366 tst cs_paging_gprs_active.py: using BVCI 21313 11:59:45.010677 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:45.022175 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:45.033556 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:45.044920 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:45.056555 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:45.068340 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:45.080185 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:45.091717 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:45.103560 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:59:45.223983 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:59:45.344772 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 11:59:45.551945 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:59:45.862704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2840): Launched 11:59:46.206352 run iperf3-srv_10.42.42.10(pid=2841): Launched 11:59:46.339924 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 11:59:46.551939 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:59:46.868349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2842): Launched 11:59:47.154009 run iperf3-srv_10.42.42.10(pid=2843): Launched 11:59:47.289708 tst cs_paging_gprs_active.py:38: start network... 11:59:47.496170 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:59:47.975604 run create_hlr_db(pid=2844): Launched 11:59:48.102711 bus /gobi_6: Setting Powered False 11:59:49.164022 run create_hlr_db(pid=2844): Terminated: ok {rc=0} 11:59:49.596120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2846): Launched 11:59:49.907490 run osmo-hlr_10.42.42.2(pid=2847): Launched 11:59:50.026436 run osmo-stp_10.42.42.5: Starting osmo-stp 11:59:50.554928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2849): Launched 11:59:50.864138 run osmo-stp_10.42.42.5(pid=2850): Launched 11:59:50.982265 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 11:59:51.514468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2852): Launched 11:59:51.634872 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 11:59:51.904544 run patchelf(pid=2853): Launched 11:59:52.077878 run osmo-stp_10.42.42.5(pid=2850): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2850)] 11:59:52.208398 run osmo-stp_10.42.42.5(pid=2850): stdout: | (launched: 2022-12-09_11:59:50.807019) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:52.340226 run osmo-stp_10.42.42.5(pid=2850): stderr: | 20221209115950978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115950979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115950979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115950979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115950980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115950980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115950980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:52.472221 run osmo-stp_10.42.42.5(pid=2850): stdout: | (launched: 2022-12-09_11:59:50.807019) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 11:59:52.599285 run osmo-stp_10.42.42.5(pid=2850): stderr: | 20221209115950978 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209115950979 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209115950979 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209115950979 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209115950980 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209115950980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209115950980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 11:59:52.750167 run patchelf(pid=2853): Terminating (SIGINT) 11:59:52.925457 run patchelf(pid=2853): Terminated: ok {rc=0} 11:59:53.051479 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2850): Process ended prematurely: osmo-stp_10.42.42.5(pid=2850) [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2850)] [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 11:59:53.061087 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 11:59:53.088492 run osmo-hlr_10.42.42.2(pid=2847): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2847)] 11:59:53.136310 run osmo-hlr_10.42.42.2(pid=2847): stdout: | (launched: 2022-12-09_11:59:49.849909) 11:59:53.185701 run osmo-hlr_10.42.42.2(pid=2847): stderr: | 20221209115950028 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209115950028 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209115950028 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209115950028 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209115950028 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209115950028 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209115950042 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209115950051 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209115950051 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209115950051 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 11:59:53.235510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2840): Terminating (SIGTERM) 11:59:53.274957 run iperf3-srv_10.42.42.10(pid=2841): Terminating (SIGTERM) 11:59:53.314326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2842): Terminating (SIGTERM) 11:59:53.353705 run iperf3-srv_10.42.42.10(pid=2843): Terminating (SIGTERM) 11:59:53.393737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2846): Terminating (SIGTERM) 11:59:53.440049 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2849): Terminating (SIGTERM) 11:59:53.483032 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2852): Terminating (SIGTERM) 11:59:53.526761 --- ParallelTerminationStrategy: PID 2840 died... 11:59:53.546762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2840): Terminated: ok {rc=0} 11:59:53.595189 --- ParallelTerminationStrategy: PID 2841 died... 11:59:53.614975 run iperf3-srv_10.42.42.10(pid=2841): Terminated {rc=256} 11:59:53.663473 --- ParallelTerminationStrategy: PID 2842 died... 11:59:53.683343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2842): Terminated: ok {rc=0} 11:59:53.731473 --- ParallelTerminationStrategy: PID 2843 died... 11:59:53.751209 run iperf3-srv_10.42.42.10(pid=2843): Terminated {rc=256} 11:59:53.799154 --- ParallelTerminationStrategy: PID 2846 died... 11:59:53.819021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2846): Terminated: ok {rc=0} 11:59:53.867736 --- ParallelTerminationStrategy: PID 2849 died... 11:59:53.887588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2849): Terminated: ok {rc=0} 11:59:53.935669 --- ParallelTerminationStrategy: PID 2852 died... 11:59:53.955490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2852): Terminated: ok {rc=0} 11:59:54.045234 bus /gobi_0: Setting Powered False 11:59:55.145718 bus /gobi_0: Setting Powered False 11:59:56.260847 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 11:59:57.411508 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:57.423716 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 11:59:57.495297 tst iperf3.py: using LAC 21313 11:59:57.623841 tst iperf3.py: using RAC 148 11:59:57.754421 tst iperf3.py: using CellId 21313 11:59:57.884177 tst iperf3.py: using BVCI 21314 11:59:58.005403 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:58.016829 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:58.028033 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:58.039427 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:58.050782 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:58.062278 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:58.073864 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:58.085454 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 11:59:58.097153 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 11:59:58.217416 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 11:59:58.441294 run iperf3-srv_10.42.42.10: Starting iperf3-srv 11:59:58.774230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2854): Launched 11:59:59.063193 run iperf3-srv_10.42.42.10(pid=2855): Launched 11:59:59.189716 tst iperf3.py:8: start network... 11:59:59.413035 run osmo-hlr_10.42.42.2: Starting osmo-hlr 11:59:59.926344 run create_hlr_db(pid=2856): Launched 12:00:00.053934 bus /gobi_6: Setting Powered False 12:00:01.121449 run create_hlr_db(pid=2856): Terminated: ok {rc=0} 12:00:01.616547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2868): Launched 12:00:01.976055 run osmo-hlr_10.42.42.2(pid=2872): Launched 12:00:02.192640 run osmo-stp_10.42.42.5: Starting osmo-stp 12:00:03.077737 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2887): Launched 12:00:03.407185 run osmo-stp_10.42.42.5(pid=2889): Launched 12:00:03.558798 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:00:04.162165 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2906): Launched 12:00:04.278851 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:00:04.535353 run patchelf(pid=2907): Launched 12:00:04.704280 run osmo-stp_10.42.42.5(pid=2889): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2889)] 12:00:04.832482 run osmo-stp_10.42.42.5(pid=2889): stdout: | (launched: 2022-12-09_12:00:03.345592) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:04.962718 run osmo-stp_10.42.42.5(pid=2889): stderr: | 20221209120003706 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120003706 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120003706 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120003707 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120003707 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120003707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120003707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:05.092083 run osmo-stp_10.42.42.5(pid=2889): stdout: | (launched: 2022-12-09_12:00:03.345592) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:05.216239 run osmo-stp_10.42.42.5(pid=2889): stderr: | 20221209120003706 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120003706 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120003706 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120003707 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120003707 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120003707 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120003707 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:05.363252 run patchelf(pid=2907): Terminating (SIGINT) 12:00:05.534163 run patchelf(pid=2907): Terminated: ok {rc=0} 12:00:05.658040 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2889): Process ended prematurely: osmo-stp_10.42.42.5(pid=2889) [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2889)] [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 12:00:05.667444 tst iperf3.py:8: Test FAILED (8.3 sec) 12:00:05.694599 run osmo-hlr_10.42.42.2(pid=2872): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2872)] 12:00:05.742039 run osmo-hlr_10.42.42.2(pid=2872): stdout: | (launched: 2022-12-09_12:00:01.913942) 12:00:05.791143 run osmo-hlr_10.42.42.2(pid=2872): stderr: | 20221209120002296 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120002296 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120002296 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120002296 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120002296 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120002296 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120002321 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120002336 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120002336 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120002336 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:00:05.840709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2854): Terminating (SIGTERM) 12:00:05.880673 run iperf3-srv_10.42.42.10(pid=2855): Terminating (SIGTERM) 12:00:05.920441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2868): Terminating (SIGTERM) 12:00:05.960224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2887): Terminating (SIGTERM) 12:00:06.000595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2906): Terminating (SIGTERM) 12:00:06.040745 --- ParallelTerminationStrategy: PID 2854 died... 12:00:06.060077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2854): Terminated: ok {rc=0} 12:00:06.104425 --- ParallelTerminationStrategy: PID 2855 died... 12:00:06.123048 run iperf3-srv_10.42.42.10(pid=2855): Terminated {rc=256} 12:00:06.167152 --- ParallelTerminationStrategy: PID 2868 died... 12:00:06.186009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2868): Terminated: ok {rc=0} 12:00:06.229744 --- ParallelTerminationStrategy: PID 2887 died... 12:00:06.248418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2887): Terminated: ok {rc=0} 12:00:06.292211 --- ParallelTerminationStrategy: PID 2906 died... 12:00:06.310869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2906): Terminated: ok {rc=0} 12:00:06.396415 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:00:07.544406 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:07.556078 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:00:07.625292 tst iperf3m4.py: using LAC 21314 12:00:07.744556 tst iperf3m4.py: using RAC 149 12:00:07.865302 tst iperf3m4.py: using CellId 21314 12:00:07.983328 tst iperf3m4.py: using BVCI 21315 12:00:08.095327 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:08.106283 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:08.116918 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:08.127564 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:08.138182 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:08.148917 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:08.159645 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:08.170148 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:08.180747 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:00:08.300795 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:00:08.419399 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:00:08.538980 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:00:08.660607 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:00:08.878972 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:00:09.205249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2909): Launched 12:00:09.488000 run iperf3-srv_10.42.42.10(pid=2910): Launched 12:00:09.610185 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:00:09.828695 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:00:10.153660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2911): Launched 12:00:10.438498 run iperf3-srv_10.42.42.10(pid=2912): Launched 12:00:10.560512 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:00:10.778202 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:00:11.102804 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2913): Launched 12:00:11.383676 run iperf3-srv_10.42.42.10(pid=2914): Launched 12:00:11.504839 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:00:11.722218 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:00:12.045950 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2915): Launched 12:00:12.327492 run iperf3-srv_10.42.42.10(pid=2916): Launched 12:00:12.448812 tst iperf3m4.py:8: start network... 12:00:12.665915 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:00:13.168559 run create_hlr_db(pid=2917): Launched 12:00:13.291910 bus /gobi_6: Setting Powered False 12:00:14.356359 run create_hlr_db(pid=2917): Terminated: ok {rc=0} 12:00:14.791188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2920): Launched 12:00:15.096086 run osmo-hlr_10.42.42.2(pid=2921): Launched 12:00:15.214882 run osmo-stp_10.42.42.5: Starting osmo-stp 12:00:15.738104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2923): Launched 12:00:16.073009 run osmo-stp_10.42.42.5(pid=2924): Launched 12:00:16.372188 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:00:16.946462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2926): Launched 12:00:17.076824 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:00:17.337916 run patchelf(pid=2927): Launched 12:00:17.530624 run osmo-stp_10.42.42.5(pid=2924): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2924)] 12:00:17.669832 run osmo-stp_10.42.42.5(pid=2924): stdout: | (launched: 2022-12-09_12:00:16.010841) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:17.809639 run osmo-stp_10.42.42.5(pid=2924): stderr: | 20221209120016262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120016262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120016263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120016263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120016264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120016264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120016264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:17.949488 run osmo-stp_10.42.42.5(pid=2924): stdout: | (launched: 2022-12-09_12:00:16.010841) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:18.083452 run osmo-stp_10.42.42.5(pid=2924): stderr: | 20221209120016262 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120016262 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120016263 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120016263 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120016264 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120016264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120016264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:18.242305 run patchelf(pid=2927): Terminating (SIGINT) 12:00:18.426248 run patchelf(pid=2927): Terminated: ok {rc=0} 12:00:18.559482 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2924): Process ended prematurely: osmo-stp_10.42.42.5(pid=2924) [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2924)] [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:00:18.569860 tst iperf3m4.py:8: Test FAILED (11.1 sec) 12:00:18.599743 run osmo-hlr_10.42.42.2(pid=2921): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2921)] 12:00:18.651141 run osmo-hlr_10.42.42.2(pid=2921): stdout: | (launched: 2022-12-09_12:00:15.039389) 12:00:18.704370 run osmo-hlr_10.42.42.2(pid=2921): stderr: | 20221209120015213 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120015213 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120015213 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120015213 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120015213 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120015213 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120015226 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120015235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120015235 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120015235 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:00:18.757689 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2909): Terminating (SIGTERM) 12:00:18.800630 run iperf3-srv_10.42.42.10(pid=2910): Terminating (SIGTERM) 12:00:18.843469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2911): Terminating (SIGTERM) 12:00:18.886269 run iperf3-srv_10.42.42.10(pid=2912): Terminating (SIGTERM) 12:00:18.928775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2913): Terminating (SIGTERM) 12:00:18.971484 run iperf3-srv_10.42.42.10(pid=2914): Terminating (SIGTERM) 12:00:19.014077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2915): Terminating (SIGTERM) 12:00:19.056656 run iperf3-srv_10.42.42.10(pid=2916): Terminating (SIGTERM) 12:00:19.099269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2920): Terminating (SIGTERM) 12:00:19.142011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2923): Terminating (SIGTERM) 12:00:19.184650 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2926): Terminating (SIGTERM) 12:00:19.227643 --- ParallelTerminationStrategy: PID 2909 died... 12:00:19.247757 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2909): Terminated: ok {rc=0} 12:00:19.295019 --- ParallelTerminationStrategy: PID 2910 died... 12:00:19.314870 run iperf3-srv_10.42.42.10(pid=2910): Terminated {rc=256} 12:00:19.361792 --- ParallelTerminationStrategy: PID 2911 died... 12:00:19.381547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2911): Terminated: ok {rc=0} 12:00:19.428532 --- ParallelTerminationStrategy: PID 2912 died... 12:00:19.448138 run iperf3-srv_10.42.42.10(pid=2912): Terminated {rc=256} 12:00:19.495105 --- ParallelTerminationStrategy: PID 2913 died... 12:00:19.514680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2913): Terminated: ok {rc=0} 12:00:19.561760 --- ParallelTerminationStrategy: PID 2914 died... 12:00:19.581525 run iperf3-srv_10.42.42.10(pid=2914): Terminated {rc=256} 12:00:19.628453 --- ParallelTerminationStrategy: PID 2915 died... 12:00:19.648184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2915): Terminated: ok {rc=0} 12:00:19.695688 --- ParallelTerminationStrategy: PID 2916 died... 12:00:19.715639 run iperf3-srv_10.42.42.10(pid=2916): Terminated {rc=256} 12:00:19.762569 --- ParallelTerminationStrategy: PID 2920 died... 12:00:19.782184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2920): Terminated: ok {rc=0} 12:00:19.829267 --- ParallelTerminationStrategy: PID 2923 died... 12:00:19.849418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2923): Terminated: ok {rc=0} 12:00:19.896500 --- ParallelTerminationStrategy: PID 2926 died... 12:00:19.916328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2926): Terminated: ok {rc=0} 12:00:20.005674 bus /gobi_4: Setting Powered False 12:00:21.105330 bus /gobi_4: Setting Powered False 12:00:22.222108 bus /gobi_1: Setting Powered False 12:00:23.321774 bus /gobi_1: Setting Powered False 12:00:24.438751 bus /gobi_0: Setting Powered False 12:00:25.537266 bus /gobi_0: Setting Powered False 12:00:26.654722 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:00:27.754915 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:27.766621 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:00:27.836051 tst ping.py: using LAC 21315 12:00:27.958724 tst ping.py: using RAC 150 12:00:28.076259 tst ping.py: using CellId 21315 12:00:28.192574 tst ping.py: using BVCI 21316 12:00:28.301688 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:28.312558 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:28.323262 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:28.333942 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:28.344534 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:28.355147 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:28.365922 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:28.376518 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:00:28.494107 tst ping.py:19: start network... 12:00:28.695297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:00:29.161707 run create_hlr_db(pid=2928): Launched 12:00:29.284694 bus /gobi_6: Setting Powered False 12:00:30.345342 run create_hlr_db(pid=2928): Terminated: ok {rc=0} 12:00:30.787704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2930): Launched 12:00:31.132602 run osmo-hlr_10.42.42.2(pid=2931): Launched 12:00:31.329806 run osmo-stp_10.42.42.5: Starting osmo-stp 12:00:32.105808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2933): Launched 12:00:32.446220 run osmo-stp_10.42.42.5(pid=2934): Launched 12:00:32.569176 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:00:33.104107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2936): Launched 12:00:33.220150 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:00:33.474968 run patchelf(pid=2937): Launched 12:00:33.643469 run osmo-stp_10.42.42.5(pid=2934): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2934)] 12:00:33.770925 run osmo-stp_10.42.42.5(pid=2934): stdout: | (launched: 2022-12-09_12:00:32.382081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:33.899743 run osmo-stp_10.42.42.5(pid=2934): stderr: | 20221209120032575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120032575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120032576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120032576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120032577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120032577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120032577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:34.029326 run osmo-stp_10.42.42.5(pid=2934): stdout: | (launched: 2022-12-09_12:00:32.382081) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:34.152547 run osmo-stp_10.42.42.5(pid=2934): stderr: | 20221209120032575 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120032575 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120032576 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120032576 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120032577 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120032577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120032577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:34.299390 run patchelf(pid=2937): Terminating (SIGINT) 12:00:34.469663 run patchelf(pid=2937): Terminated: ok {rc=0} 12:00:34.592374 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=2934): Process ended prematurely: osmo-stp_10.42.42.5(pid=2934) [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2934)] [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 12:00:34.601551 tst ping.py:22: Test FAILED (6.8 sec) 12:00:34.628802 run osmo-hlr_10.42.42.2(pid=2931): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2931)] 12:00:34.676572 run osmo-hlr_10.42.42.2(pid=2931): stdout: | (launched: 2022-12-09_12:00:31.071128) 12:00:34.725656 run osmo-hlr_10.42.42.2(pid=2931): stderr: | 20221209120031410 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120031410 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120031410 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120031410 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120031410 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120031410 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120031432 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120031448 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120031448 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120031448 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:00:34.775633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2930): Terminating (SIGTERM) 12:00:34.815844 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2933): Terminating (SIGTERM) 12:00:34.855959 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2936): Terminating (SIGTERM) 12:00:34.896401 --- ParallelTerminationStrategy: PID 2930 died... 12:00:34.915628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2930): Terminated: ok {rc=0} 12:00:34.959968 --- ParallelTerminationStrategy: PID 2933 died... 12:00:34.978746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2933): Terminated: ok {rc=0} 12:00:35.023169 --- ParallelTerminationStrategy: PID 2936 died... 12:00:35.041940 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2936): Terminated: ok {rc=0} 12:00:35.128247 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:00:36.218139 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:36.230533 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:00:36.303638 tst ping_idle_ping.py: using LAC 21316 12:00:36.422026 tst ping_idle_ping.py: using RAC 151 12:00:36.550432 tst ping_idle_ping.py: using CellId 21316 12:00:36.676820 tst ping_idle_ping.py: using BVCI 21317 12:00:36.795549 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:36.807158 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:36.818601 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:36.830193 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:36.841781 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:36.853265 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:36.864756 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:00:36.876239 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:00:36.996689 tst ping_idle_ping.py:24: start network... 12:00:37.214156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:00:37.710760 run create_hlr_db(pid=2938): Launched 12:00:37.835090 bus /gobi_6: Setting Powered False 12:00:38.895264 run create_hlr_db(pid=2938): Terminated: ok {rc=0} 12:00:39.343170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2941): Launched 12:00:39.665899 run osmo-hlr_10.42.42.2(pid=2942): Launched 12:00:39.792471 run osmo-stp_10.42.42.5: Starting osmo-stp 12:00:40.348803 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2944): Launched 12:00:40.661735 run osmo-stp_10.42.42.5(pid=2945): Launched 12:00:40.781130 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:00:41.304483 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2947): Launched 12:00:41.420856 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:00:41.676251 run patchelf(pid=2948): Launched 12:00:41.845401 run osmo-stp_10.42.42.5(pid=2945): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2945)] 12:00:41.974025 run osmo-stp_10.42.42.5(pid=2945): stdout: | (launched: 2022-12-09_12:00:40.605328) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:42.103738 run osmo-stp_10.42.42.5(pid=2945): stderr: | 20221209120040775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120040775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120040775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120040775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120040776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120040776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120040776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:42.234468 run osmo-stp_10.42.42.5(pid=2945): stdout: | (launched: 2022-12-09_12:00:40.605328) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:42.359296 run osmo-stp_10.42.42.5(pid=2945): stderr: | 20221209120040775 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120040775 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120040775 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120040775 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120040776 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120040776 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120040776 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:42.506332 run patchelf(pid=2948): Terminating (SIGINT) 12:00:42.678383 run patchelf(pid=2948): Terminated: ok {rc=0} 12:00:42.802368 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=2945): Process ended prematurely: osmo-stp_10.42.42.5(pid=2945) [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2945)] [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:00:42.811204 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 12:00:42.838131 run osmo-hlr_10.42.42.2(pid=2942): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2942)] 12:00:42.885576 run osmo-hlr_10.42.42.2(pid=2942): stdout: | (launched: 2022-12-09_12:00:39.606784) 12:00:42.934738 run osmo-hlr_10.42.42.2(pid=2942): stderr: | 20221209120039799 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120039799 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120039799 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120039799 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120039799 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120039799 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120039811 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120039820 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120039820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120039820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:00:42.984278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2941): Terminating (SIGTERM) 12:00:43.024095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2944): Terminating (SIGTERM) 12:00:43.063977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2947): Terminating (SIGTERM) 12:00:43.104035 --- ParallelTerminationStrategy: PID 2941 died... 12:00:43.123208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2941): Terminated: ok {rc=0} 12:00:43.167456 --- ParallelTerminationStrategy: PID 2944 died... 12:00:43.185998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2944): Terminated: ok {rc=0} 12:00:43.229770 --- ParallelTerminationStrategy: PID 2947 died... 12:00:43.248313 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2947): Terminated: ok {rc=0} 12:00:43.333754 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:00:44.636839 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:00:44.643286 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:00:44.675950 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 12:00:44.714052 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 12:00:44.801484 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:00:44.835052 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 12:00:44.872898 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 12:00:45.470512 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 12:00:45.523776 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:45.535120 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:00:45.606375 tst cs_paging_gprs_active.py: using LAC 21317 12:00:45.736688 tst cs_paging_gprs_active.py: using RAC 152 12:00:45.896161 tst cs_paging_gprs_active.py: using CellId 21317 12:00:46.029999 tst cs_paging_gprs_active.py: using BVCI 21318 12:00:46.152614 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:46.165106 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:46.178337 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:46.190685 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:46.204706 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:46.218122 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:46.230533 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:46.244557 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:46.258402 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:00:46.387619 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:00:46.552234 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:00:46.765346 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:00:47.084314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2953): Launched 12:00:47.371528 run iperf3-srv_10.42.42.10(pid=2954): Launched 12:00:47.488880 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:00:47.695582 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:00:48.005840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2955): Launched 12:00:48.274443 run iperf3-srv_10.42.42.10(pid=2956): Launched 12:00:48.393404 tst cs_paging_gprs_active.py:38: start network... 12:00:48.599222 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:00:49.075186 run create_hlr_db(pid=2957): Launched 12:00:49.202157 bus /gobi_6: Setting Powered False 12:00:50.263465 run create_hlr_db(pid=2957): Terminated: ok {rc=0} 12:00:50.712650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2959): Launched 12:00:51.041185 run osmo-hlr_10.42.42.2(pid=2960): Launched 12:00:51.163273 run osmo-stp_10.42.42.5: Starting osmo-stp 12:00:51.697132 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2962): Launched 12:00:52.004862 run osmo-stp_10.42.42.5(pid=2963): Launched 12:00:52.121870 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:00:52.650567 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2965): Launched 12:00:52.767489 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:00:53.028487 run patchelf(pid=2966): Launched 12:00:53.200267 run osmo-stp_10.42.42.5(pid=2963): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2963)] 12:00:53.329957 run osmo-stp_10.42.42.5(pid=2963): stdout: | (launched: 2022-12-09_12:00:51.947695) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:53.460696 run osmo-stp_10.42.42.5(pid=2963): stderr: | 20221209120052118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120052118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120052119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120052119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120052120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120052120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120052120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:53.591333 run osmo-stp_10.42.42.5(pid=2963): stdout: | (launched: 2022-12-09_12:00:51.947695) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:00:53.717246 run osmo-stp_10.42.42.5(pid=2963): stderr: | 20221209120052118 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120052118 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120052119 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120052119 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120052120 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120052120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120052120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:00:53.866194 run patchelf(pid=2966): Terminating (SIGINT) 12:00:54.039915 run patchelf(pid=2966): Terminated: ok {rc=0} 12:00:54.164763 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=2963): Process ended prematurely: osmo-stp_10.42.42.5(pid=2963) [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2963)] [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 12:00:54.174302 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 12:00:54.201424 run osmo-hlr_10.42.42.2(pid=2960): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2960)] 12:00:54.249129 run osmo-hlr_10.42.42.2(pid=2960): stdout: | (launched: 2022-12-09_12:00:50.980733) 12:00:54.298397 run osmo-hlr_10.42.42.2(pid=2960): stderr: | 20221209120051157 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120051157 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120051157 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120051157 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120051157 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120051157 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120051170 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120051178 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120051178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120051178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:00:54.348623 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2953): Terminating (SIGTERM) 12:00:54.388663 run iperf3-srv_10.42.42.10(pid=2954): Terminating (SIGTERM) 12:00:54.428333 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2955): Terminating (SIGTERM) 12:00:54.468117 run iperf3-srv_10.42.42.10(pid=2956): Terminating (SIGTERM) 12:00:54.507793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2959): Terminating (SIGTERM) 12:00:54.547594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2962): Terminating (SIGTERM) 12:00:54.587254 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2965): Terminating (SIGTERM) 12:00:54.627146 --- ParallelTerminationStrategy: PID 2953 died... 12:00:54.646184 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2953): Terminated: ok {rc=0} 12:00:54.690165 --- ParallelTerminationStrategy: PID 2954 died... 12:00:54.708742 run iperf3-srv_10.42.42.10(pid=2954): Terminated {rc=256} 12:00:54.752518 --- ParallelTerminationStrategy: PID 2955 died... 12:00:54.771003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2955): Terminated: ok {rc=0} 12:00:54.814859 --- ParallelTerminationStrategy: PID 2956 died... 12:00:54.833543 run iperf3-srv_10.42.42.10(pid=2956): Terminated {rc=256} 12:00:54.877211 --- ParallelTerminationStrategy: PID 2959 died... 12:00:54.895817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2959): Terminated: ok {rc=0} 12:00:54.939635 --- ParallelTerminationStrategy: PID 2962 died... 12:00:54.958387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2962): Terminated: ok {rc=0} 12:00:55.003490 --- ParallelTerminationStrategy: PID 2965 died... 12:00:55.022161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2965): Terminated: ok {rc=0} 12:00:55.108017 bus /gobi_0: Setting Powered False 12:00:56.208880 bus /gobi_0: Setting Powered False 12:00:57.324539 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 12:00:58.472203 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:58.483910 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:00:58.556773 tst iperf3.py: using LAC 21318 12:00:58.676150 tst iperf3.py: using RAC 153 12:00:58.794858 tst iperf3.py: using CellId 21318 12:00:58.915025 tst iperf3.py: using BVCI 21319 12:00:59.027242 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:59.038300 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:59.049139 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:59.059855 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:59.070567 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:59.081269 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:59.092092 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:59.103163 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:00:59.114108 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:00:59.235354 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:00:59.440108 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:00:59.746756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2968): Launched 12:01:00.014108 run iperf3-srv_10.42.42.10(pid=2969): Launched 12:01:00.129199 tst iperf3.py:8: start network... 12:01:00.332794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:01:00.806784 run create_hlr_db(pid=2970): Launched 12:01:00.943160 bus /gobi_6: Setting Powered False 12:01:02.019193 run create_hlr_db(pid=2970): Terminated: ok {rc=0} 12:01:02.521296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2972): Launched 12:01:02.849602 run osmo-hlr_10.42.42.2(pid=2973): Launched 12:01:02.976860 run osmo-stp_10.42.42.5: Starting osmo-stp 12:01:03.543627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2975): Launched 12:01:03.872609 run osmo-stp_10.42.42.5(pid=2976): Launched 12:01:03.997323 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:01:04.560751 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2978): Launched 12:01:04.686724 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:01:04.962594 run patchelf(pid=2979): Launched 12:01:05.146594 run osmo-stp_10.42.42.5(pid=2976): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2976)] 12:01:05.285587 run osmo-stp_10.42.42.5(pid=2976): stdout: | (launched: 2022-12-09_12:01:03.812076) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:05.425543 run osmo-stp_10.42.42.5(pid=2976): stderr: | 20221209120103999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120103999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120104000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120104000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120104001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120104001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120104001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:05.565597 run osmo-stp_10.42.42.5(pid=2976): stdout: | (launched: 2022-12-09_12:01:03.812076) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:05.700162 run osmo-stp_10.42.42.5(pid=2976): stderr: | 20221209120103999 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120103999 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120104000 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120104000 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120104001 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120104001 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120104001 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:05.858860 run patchelf(pid=2979): Terminating (SIGINT) 12:01:06.043207 run patchelf(pid=2979): Terminated: ok {rc=0} 12:01:06.176851 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2976): Process ended prematurely: osmo-stp_10.42.42.5(pid=2976) [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2976)] [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 12:01:06.187162 tst iperf3.py:8: Test FAILED (7.8 sec) 12:01:06.216170 run osmo-hlr_10.42.42.2(pid=2973): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2973)] 12:01:06.267454 run osmo-hlr_10.42.42.2(pid=2973): stdout: | (launched: 2022-12-09_12:01:02.789667) 12:01:06.319879 run osmo-hlr_10.42.42.2(pid=2973): stderr: | 20221209120102983 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120102983 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120102983 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120102983 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120102984 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120102984 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120103023 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120103032 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120103033 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120103033 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:01:06.372872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2968): Terminating (SIGTERM) 12:01:06.415067 run iperf3-srv_10.42.42.10(pid=2969): Terminating (SIGTERM) 12:01:06.457690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2972): Terminating (SIGTERM) 12:01:06.500225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2975): Terminating (SIGTERM) 12:01:06.542824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2978): Terminating (SIGTERM) 12:01:06.584873 --- ParallelTerminationStrategy: PID 2968 died... 12:01:06.605409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2968): Terminated: ok {rc=0} 12:01:06.652504 --- ParallelTerminationStrategy: PID 2969 died... 12:01:06.672129 run iperf3-srv_10.42.42.10(pid=2969): Terminated {rc=256} 12:01:06.719117 --- ParallelTerminationStrategy: PID 2972 died... 12:01:06.738854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2972): Terminated: ok {rc=0} 12:01:06.785608 --- ParallelTerminationStrategy: PID 2975 died... 12:01:06.805286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2975): Terminated: ok {rc=0} 12:01:06.852122 --- ParallelTerminationStrategy: PID 2978 died... 12:01:06.871791 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2978): Terminated: ok {rc=0} 12:01:06.960260 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 12:01:08.111187 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:08.123643 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:01:08.196645 tst iperf3m4.py: using LAC 21319 12:01:08.326440 tst iperf3m4.py: using RAC 154 12:01:08.456281 tst iperf3m4.py: using CellId 21319 12:01:08.585345 tst iperf3m4.py: using BVCI 21320 12:01:08.704548 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:08.716237 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:08.727688 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:08.739468 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:08.751044 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:08.762770 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:08.774662 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:08.786261 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:08.798157 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:01:08.919814 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:01:09.041244 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:01:09.162490 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:01:09.282947 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:01:09.488222 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:01:09.794932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2980): Launched 12:01:10.063892 run iperf3-srv_10.42.42.10(pid=2981): Launched 12:01:10.179243 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:01:10.383887 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:01:10.692046 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2982): Launched 12:01:10.959448 run iperf3-srv_10.42.42.10(pid=2983): Launched 12:01:11.074499 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:01:11.278203 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:01:11.585748 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2984): Launched 12:01:11.854715 run iperf3-srv_10.42.42.10(pid=2985): Launched 12:01:11.971470 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:01:12.175432 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:01:12.481770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2986): Launched 12:01:12.750803 run iperf3-srv_10.42.42.10(pid=2987): Launched 12:01:12.867328 tst iperf3m4.py:8: start network... 12:01:13.070838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:01:13.543799 run create_hlr_db(pid=2988): Launched 12:01:13.669752 bus /gobi_6: Setting Powered False 12:01:14.730563 run create_hlr_db(pid=2988): Terminated: ok {rc=0} 12:01:15.179469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2990): Launched 12:01:15.509129 run osmo-hlr_10.42.42.2(pid=2991): Launched 12:01:15.636118 run osmo-stp_10.42.42.5: Starting osmo-stp 12:01:16.230015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2993): Launched 12:01:16.557486 run osmo-stp_10.42.42.5(pid=2994): Launched 12:01:16.755417 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:01:17.487259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2996): Launched 12:01:17.604841 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:01:17.864103 run patchelf(pid=2997): Launched 12:01:18.034723 run osmo-stp_10.42.42.5(pid=2994): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2994)] 12:01:18.164174 run osmo-stp_10.42.42.5(pid=2994): stdout: | (launched: 2022-12-09_12:01:16.494733) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:18.294676 run osmo-stp_10.42.42.5(pid=2994): stderr: | 20221209120116815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120116815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120116816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120116821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120116821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120116821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120116821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:18.425482 run osmo-stp_10.42.42.5(pid=2994): stdout: | (launched: 2022-12-09_12:01:16.494733) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:18.551027 run osmo-stp_10.42.42.5(pid=2994): stderr: | 20221209120116815 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120116815 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120116816 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120116821 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120116821 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120116821 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120116821 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:18.699911 run patchelf(pid=2997): Terminating (SIGINT) 12:01:18.873415 run patchelf(pid=2997): Terminated: ok {rc=0} 12:01:18.998942 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=2994): Process ended prematurely: osmo-stp_10.42.42.5(pid=2994) [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2994)] [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 12:01:19.008340 tst iperf3m4.py:8: Test FAILED (10.9 sec) 12:01:19.035927 run osmo-hlr_10.42.42.2(pid=2991): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=2991)] 12:01:19.083604 run osmo-hlr_10.42.42.2(pid=2991): stdout: | (launched: 2022-12-09_12:01:15.448736) 12:01:19.133364 run osmo-hlr_10.42.42.2(pid=2991): stderr: | 20221209120115643 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120115643 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120115643 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120115643 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120115643 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120115643 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120115656 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120115667 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120115667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120115667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:01:19.183643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2980): Terminating (SIGTERM) 12:01:19.223424 run iperf3-srv_10.42.42.10(pid=2981): Terminating (SIGTERM) 12:01:19.263322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2982): Terminating (SIGTERM) 12:01:19.303303 run iperf3-srv_10.42.42.10(pid=2983): Terminating (SIGTERM) 12:01:19.342690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2984): Terminating (SIGTERM) 12:01:19.382283 run iperf3-srv_10.42.42.10(pid=2985): Terminating (SIGTERM) 12:01:19.422106 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2986): Terminating (SIGTERM) 12:01:19.461833 run iperf3-srv_10.42.42.10(pid=2987): Terminating (SIGTERM) 12:01:19.501386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2990): Terminating (SIGTERM) 12:01:19.541085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2993): Terminating (SIGTERM) 12:01:19.580405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2996): Terminating (SIGTERM) 12:01:19.620204 --- ParallelTerminationStrategy: PID 2980 died... 12:01:19.639276 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2980): Terminated: ok {rc=0} 12:01:19.683948 --- ParallelTerminationStrategy: PID 2981 died... 12:01:19.702674 run iperf3-srv_10.42.42.10(pid=2981): Terminated {rc=256} 12:01:19.746585 --- ParallelTerminationStrategy: PID 2982 died... 12:01:19.765264 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2982): Terminated: ok {rc=0} 12:01:19.809182 --- ParallelTerminationStrategy: PID 2983 died... 12:01:19.827642 run iperf3-srv_10.42.42.10(pid=2983): Terminated {rc=256} 12:01:19.871444 --- ParallelTerminationStrategy: PID 2984 died... 12:01:19.890011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2984): Terminated: ok {rc=0} 12:01:19.934022 --- ParallelTerminationStrategy: PID 2985 died... 12:01:19.952598 run iperf3-srv_10.42.42.10(pid=2985): Terminated {rc=256} 12:01:19.996585 --- ParallelTerminationStrategy: PID 2986 died... 12:01:20.015292 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=2986): Terminated: ok {rc=0} 12:01:20.059435 --- ParallelTerminationStrategy: PID 2987 died... 12:01:20.078053 run iperf3-srv_10.42.42.10(pid=2987): Terminated {rc=256} 12:01:20.121832 --- ParallelTerminationStrategy: PID 2990 died... 12:01:20.140456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=2990): Terminated: ok {rc=0} 12:01:20.184580 --- ParallelTerminationStrategy: PID 2993 died... 12:01:20.203288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=2993): Terminated: ok {rc=0} 12:01:20.247079 --- ParallelTerminationStrategy: PID 2996 died... 12:01:20.265656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=2996): Terminated: ok {rc=0} 12:01:20.349912 bus /gobi_4: Setting Powered False 12:01:21.445624 bus /gobi_4: Setting Powered False 12:01:22.558521 bus /gobi_1: Setting Powered False 12:01:23.658734 bus /gobi_1: Setting Powered False 12:01:24.774542 bus /gobi_0: Setting Powered False 12:01:25.874005 bus /gobi_0: Setting Powered False 12:01:26.989225 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 12:01:28.089764 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:28.101320 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:01:28.170961 tst ping.py: using LAC 21320 12:01:28.290433 tst ping.py: using RAC 155 12:01:28.410002 tst ping.py: using CellId 21320 12:01:28.529394 tst ping.py: using BVCI 21321 12:01:28.637926 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:28.649044 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:28.659927 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:28.670788 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:28.681586 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:28.692407 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:28.703352 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:28.714150 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:01:28.833304 tst ping.py:19: start network... 12:01:29.049380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:01:29.547258 run create_hlr_db(pid=2998): Launched 12:01:29.671942 bus /gobi_6: Setting Powered False 12:01:30.735632 run create_hlr_db(pid=2998): Terminated: ok {rc=0} 12:01:31.202106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3000): Launched 12:01:31.529720 run osmo-hlr_10.42.42.2(pid=3001): Launched 12:01:31.817760 run osmo-stp_10.42.42.5: Starting osmo-stp 12:01:32.407191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3003): Launched 12:01:32.730249 run osmo-stp_10.42.42.5(pid=3004): Launched 12:01:32.852176 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:01:33.405471 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3006): Launched 12:01:33.529902 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:01:33.803690 run patchelf(pid=3007): Launched 12:01:33.984862 run osmo-stp_10.42.42.5(pid=3004): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3004)] 12:01:34.122504 run osmo-stp_10.42.42.5(pid=3004): stdout: | (launched: 2022-12-09_12:01:32.670054) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:34.260408 run osmo-stp_10.42.42.5(pid=3004): stderr: | 20221209120132860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120132860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120132860 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120132861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120132861 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120132861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120132862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:34.398981 run osmo-stp_10.42.42.5(pid=3004): stdout: | (launched: 2022-12-09_12:01:32.670054) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:34.531044 run osmo-stp_10.42.42.5(pid=3004): stderr: | 20221209120132860 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120132860 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120132860 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120132861 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120132861 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120132861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120132862 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:34.687671 run patchelf(pid=3007): Terminating (SIGINT) 12:01:34.870506 run patchelf(pid=3007): Terminated: ok {rc=0} 12:01:35.002490 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3004): Process ended prematurely: osmo-stp_10.42.42.5(pid=3004) [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3004)] [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 12:01:35.012024 tst ping.py:22: Test FAILED (6.9 sec) 12:01:35.041593 run osmo-hlr_10.42.42.2(pid=3001): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3001)] 12:01:35.093228 run osmo-hlr_10.42.42.2(pid=3001): stdout: | (launched: 2022-12-09_12:01:31.468581) 12:01:35.146198 run osmo-hlr_10.42.42.2(pid=3001): stderr: | 20221209120131666 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120131666 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120131666 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120131666 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120131666 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120131666 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120131680 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120131692 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120131693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120131693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:01:35.199921 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3000): Terminating (SIGTERM) 12:01:35.242821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3003): Terminating (SIGTERM) 12:01:35.285818 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3006): Terminating (SIGTERM) 12:01:35.329135 --- ParallelTerminationStrategy: PID 3000 died... 12:01:35.349451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3000): Terminated: ok {rc=0} 12:01:35.397383 --- ParallelTerminationStrategy: PID 3003 died... 12:01:35.417333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3003): Terminated: ok {rc=0} 12:01:35.465243 --- ParallelTerminationStrategy: PID 3006 died... 12:01:35.485310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3006): Terminated: ok {rc=0} 12:01:35.575650 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 12:01:36.664444 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:36.679815 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:01:36.755397 tst ping_idle_ping.py: using LAC 21321 12:01:36.883542 tst ping_idle_ping.py: using RAC 156 12:01:37.009578 tst ping_idle_ping.py: using CellId 21321 12:01:37.130197 tst ping_idle_ping.py: using BVCI 21322 12:01:37.239949 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:37.251153 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:37.262176 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:37.273629 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:37.285126 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:37.296465 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:37.308006 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:01:37.319437 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:01:37.440694 tst ping_idle_ping.py:24: start network... 12:01:37.658483 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:01:38.157273 run create_hlr_db(pid=3008): Launched 12:01:38.281018 bus /gobi_6: Setting Powered False 12:01:39.344851 run create_hlr_db(pid=3008): Terminated: ok {rc=0} 12:01:39.777611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3010): Launched 12:01:40.083025 run osmo-hlr_10.42.42.2(pid=3011): Launched 12:01:40.198326 run osmo-stp_10.42.42.5: Starting osmo-stp 12:01:40.716827 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3013): Launched 12:01:41.021747 run osmo-stp_10.42.42.5(pid=3014): Launched 12:01:41.137876 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:01:41.661576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3016): Launched 12:01:41.778378 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:01:42.034419 run patchelf(pid=3017): Launched 12:01:42.203438 run osmo-stp_10.42.42.5(pid=3014): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3014)] 12:01:42.331421 run osmo-stp_10.42.42.5(pid=3014): stdout: | (launched: 2022-12-09_12:01:40.964823) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:42.460209 run osmo-stp_10.42.42.5(pid=3014): stderr: | 20221209120141132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120141133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120141133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120141133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120141134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120141134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120141134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:42.589348 run osmo-stp_10.42.42.5(pid=3014): stdout: | (launched: 2022-12-09_12:01:40.964823) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:42.712737 run osmo-stp_10.42.42.5(pid=3014): stderr: | 20221209120141132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120141133 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120141133 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120141133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120141134 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120141134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120141134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:42.859427 run patchelf(pid=3017): Terminating (SIGINT) 12:01:43.030247 run patchelf(pid=3017): Terminated: ok {rc=0} 12:01:43.153443 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3014): Process ended prematurely: osmo-stp_10.42.42.5(pid=3014) [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3014)] [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 12:01:43.162361 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 12:01:43.189428 run osmo-hlr_10.42.42.2(pid=3011): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3011)] 12:01:43.238300 run osmo-hlr_10.42.42.2(pid=3011): stdout: | (launched: 2022-12-09_12:01:40.026939) 12:01:43.288441 run osmo-hlr_10.42.42.2(pid=3011): stderr: | 20221209120140199 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120140199 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120140199 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120140199 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120140199 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120140199 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120140211 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120140220 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120140220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120140220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:01:43.338928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3010): Terminating (SIGTERM) 12:01:43.378971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3013): Terminating (SIGTERM) 12:01:43.419208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3016): Terminating (SIGTERM) 12:01:43.459528 --- ParallelTerminationStrategy: PID 3010 died... 12:01:43.478934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3010): Terminated: ok {rc=0} 12:01:43.523286 --- ParallelTerminationStrategy: PID 3013 died... 12:01:43.542058 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3013): Terminated: ok {rc=0} 12:01:43.586098 --- ParallelTerminationStrategy: PID 3016 died... 12:01:43.604829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3016): Terminated: ok {rc=0} 12:01:43.691226 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 12:01:45.002717 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:01:45.008901 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 12:01:45.041292 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 12:01:45.079483 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 12:01:45.164379 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 12:01:45.196460 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 12:01:45.234720 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 12:01:45.855458 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 12:01:45.913560 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:01:45.926571 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:01:45.985228 tst cs_paging_gprs_active.py: using LAC 21322 12:01:46.118937 tst cs_paging_gprs_active.py: using RAC 157 12:01:46.276741 tst cs_paging_gprs_active.py: using CellId 21322 12:01:46.433984 tst cs_paging_gprs_active.py: using BVCI 21323 12:01:46.585980 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:01:46.600350 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:01:46.614690 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:01:46.629051 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:01:46.643469 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:01:46.660090 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:01:46.675661 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:01:46.690141 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:01:46.704306 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:01:46.830123 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:01:46.956274 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:01:47.248101 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:01:47.581554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3022): Launched 12:01:47.852365 run iperf3-srv_10.42.42.10(pid=3023): Launched 12:01:47.970999 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:01:48.176912 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:01:48.485783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3024): Launched 12:01:48.755464 run iperf3-srv_10.42.42.10(pid=3025): Launched 12:01:48.872275 tst cs_paging_gprs_active.py:38: start network... 12:01:49.077754 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:01:49.553591 run create_hlr_db(pid=3026): Launched 12:01:49.681569 bus /gobi_6: Setting Powered False 12:01:50.742921 run create_hlr_db(pid=3026): Terminated: ok {rc=0} 12:01:51.193559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3028): Launched 12:01:51.527083 run osmo-hlr_10.42.42.2(pid=3029): Launched 12:01:51.653519 run osmo-stp_10.42.42.5: Starting osmo-stp 12:01:52.218597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3031): Launched 12:01:52.549233 run osmo-stp_10.42.42.5(pid=3032): Launched 12:01:52.675061 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:01:53.239867 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3034): Launched 12:01:53.365683 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:01:53.643607 run patchelf(pid=3035): Launched 12:01:53.827495 run osmo-stp_10.42.42.5(pid=3032): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3032)] 12:01:53.967148 run osmo-stp_10.42.42.5(pid=3032): stdout: | (launched: 2022-12-09_12:01:52.488321) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:54.107797 run osmo-stp_10.42.42.5(pid=3032): stderr: | 20221209120152680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120152680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120152680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120152681 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120152681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120152681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120152681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:54.248080 run osmo-stp_10.42.42.5(pid=3032): stdout: | (launched: 2022-12-09_12:01:52.488321) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:01:54.383327 run osmo-stp_10.42.42.5(pid=3032): stderr: | 20221209120152680 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120152680 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120152680 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120152681 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120152681 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120152681 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120152681 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:01:54.543261 run patchelf(pid=3035): Terminating (SIGINT) 12:01:54.729617 run patchelf(pid=3035): Terminated: ok {rc=0} 12:01:54.863618 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3032): Process ended prematurely: osmo-stp_10.42.42.5(pid=3032) [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3032)] [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 12:01:54.874025 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 12:01:54.903631 run osmo-hlr_10.42.42.2(pid=3029): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3029)] 12:01:54.954739 run osmo-hlr_10.42.42.2(pid=3029): stdout: | (launched: 2022-12-09_12:01:51.466101) 12:01:55.007911 run osmo-hlr_10.42.42.2(pid=3029): stderr: | 20221209120151663 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120151663 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120151663 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120151663 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120151663 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120151663 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120151675 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120151685 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120151685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120151685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:01:55.061281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3022): Terminating (SIGTERM) 12:01:55.103935 run iperf3-srv_10.42.42.10(pid=3023): Terminating (SIGTERM) 12:01:55.146766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3024): Terminating (SIGTERM) 12:01:55.189460 run iperf3-srv_10.42.42.10(pid=3025): Terminating (SIGTERM) 12:01:55.232068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3028): Terminating (SIGTERM) 12:01:55.274788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3031): Terminating (SIGTERM) 12:01:55.317499 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3034): Terminating (SIGTERM) 12:01:55.360251 --- ParallelTerminationStrategy: PID 3022 died... 12:01:55.380456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3022): Terminated: ok {rc=0} 12:01:55.428158 --- ParallelTerminationStrategy: PID 3023 died... 12:01:55.447936 run iperf3-srv_10.42.42.10(pid=3023): Terminated {rc=256} 12:01:55.494844 --- ParallelTerminationStrategy: PID 3024 died... 12:01:55.514573 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3024): Terminated: ok {rc=0} 12:01:55.561481 --- ParallelTerminationStrategy: PID 3025 died... 12:01:55.581125 run iperf3-srv_10.42.42.10(pid=3025): Terminated {rc=256} 12:01:55.627926 --- ParallelTerminationStrategy: PID 3028 died... 12:01:55.647590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3028): Terminated: ok {rc=0} 12:01:55.694589 --- ParallelTerminationStrategy: PID 3031 died... 12:01:55.714647 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3031): Terminated: ok {rc=0} 12:01:55.762002 --- ParallelTerminationStrategy: PID 3034 died... 12:01:55.781713 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3034): Terminated: ok {rc=0} 12:01:55.871249 bus /gobi_0: Setting Powered False 12:01:56.970961 bus /gobi_0: Setting Powered False 12:01:58.087880 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 12:01:59.238345 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:01:59.250990 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:01:59.308030 tst iperf3.py: using LAC 21323 12:01:59.438267 tst iperf3.py: using RAC 158 12:01:59.573067 tst iperf3.py: using CellId 21323 12:01:59.701033 tst iperf3.py: using BVCI 21324 12:01:59.821319 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:01:59.833302 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:01:59.845192 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:01:59.858274 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:01:59.870319 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:01:59.882445 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:01:59.894607 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:01:59.906461 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:01:59.918450 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:02:00.037458 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:02:00.243084 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:02:00.552571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3036): Launched 12:02:00.822839 run iperf3-srv_10.42.42.10(pid=3037): Launched 12:02:00.987693 tst iperf3.py:8: start network... 12:02:01.229662 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:01.757610 run create_hlr_db(pid=3038): Launched 12:02:01.921234 bus /gobi_6: Setting Powered False 12:02:02.985974 run create_hlr_db(pid=3038): Terminated: ok {rc=0} 12:02:03.425699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3040): Launched 12:02:03.736264 run osmo-hlr_10.42.42.2(pid=3041): Launched 12:02:03.932592 run osmo-stp_10.42.42.5: Starting osmo-stp 12:02:04.461690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3043): Launched 12:02:04.772479 run osmo-stp_10.42.42.5(pid=3044): Launched 12:02:04.909319 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:02:05.453829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3046): Launched 12:02:05.573861 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:02:05.836149 run patchelf(pid=3047): Launched 12:02:06.008195 run osmo-stp_10.42.42.5(pid=3044): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3044)] 12:02:06.138334 run osmo-stp_10.42.42.5(pid=3044): stdout: | (launched: 2022-12-09_12:02:04.714183) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:06.269373 run osmo-stp_10.42.42.5(pid=3044): stderr: | 20221209120204883 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120204883 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120204883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120204884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120204884 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120204885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120204885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:06.400714 run osmo-stp_10.42.42.5(pid=3044): stdout: | (launched: 2022-12-09_12:02:04.714183) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:06.526677 run osmo-stp_10.42.42.5(pid=3044): stderr: | 20221209120204883 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120204883 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120204883 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120204884 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120204884 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120204885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120204885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:06.675598 run patchelf(pid=3047): Terminating (SIGINT) 12:02:06.849995 run patchelf(pid=3047): Terminated: ok {rc=0} 12:02:06.976489 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3044): Process ended prematurely: osmo-stp_10.42.42.5(pid=3044) [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3044)] [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 12:02:06.986495 tst iperf3.py:8: Test FAILED (7.8 sec) 12:02:07.013879 run osmo-hlr_10.42.42.2(pid=3041): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3041)] 12:02:07.061924 run osmo-hlr_10.42.42.2(pid=3041): stdout: | (launched: 2022-12-09_12:02:03.679010) 12:02:07.111678 run osmo-hlr_10.42.42.2(pid=3041): stderr: | 20221209120203856 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120203856 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120203856 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120203856 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120203856 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120203856 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120203871 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120203880 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120203880 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120203880 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:02:07.161712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3036): Terminating (SIGTERM) 12:02:07.201760 run iperf3-srv_10.42.42.10(pid=3037): Terminating (SIGTERM) 12:02:07.241556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3040): Terminating (SIGTERM) 12:02:07.281545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3043): Terminating (SIGTERM) 12:02:07.321596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3046): Terminating (SIGTERM) 12:02:07.361612 --- ParallelTerminationStrategy: PID 3036 died... 12:02:07.380731 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3036): Terminated: ok {rc=0} 12:02:07.424897 --- ParallelTerminationStrategy: PID 3037 died... 12:02:07.443990 run iperf3-srv_10.42.42.10(pid=3037): Terminated {rc=256} 12:02:07.487957 --- ParallelTerminationStrategy: PID 3040 died... 12:02:07.506546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3040): Terminated: ok {rc=0} 12:02:07.550577 --- ParallelTerminationStrategy: PID 3043 died... 12:02:07.569212 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3043): Terminated: ok {rc=0} 12:02:07.613188 --- ParallelTerminationStrategy: PID 3046 died... 12:02:07.631804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3046): Terminated: ok {rc=0} 12:02:07.719099 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 12:02:08.871299 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:08.883498 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:02:08.933959 tst iperf3m4.py: using LAC 21324 12:02:09.056387 tst iperf3m4.py: using RAC 159 12:02:09.178819 tst iperf3m4.py: using CellId 21324 12:02:09.301830 tst iperf3m4.py: using BVCI 21325 12:02:09.415915 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:09.427222 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:09.438364 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:09.449481 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:09.460569 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:09.471660 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:09.482888 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:09.493847 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:09.505070 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:02:09.626613 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:02:09.749872 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:02:09.869173 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:02:09.989262 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:02:10.211124 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:02:10.541345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3050): Launched 12:02:10.830308 run iperf3-srv_10.42.42.10(pid=3051): Launched 12:02:10.955706 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:02:11.176761 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:02:11.506536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3052): Launched 12:02:11.795527 run iperf3-srv_10.42.42.10(pid=3053): Launched 12:02:11.919611 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:02:12.139735 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:02:12.469553 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3054): Launched 12:02:12.758224 run iperf3-srv_10.42.42.10(pid=3055): Launched 12:02:12.882186 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:02:13.102050 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:02:13.430543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3056): Launched 12:02:13.718202 run iperf3-srv_10.42.42.10(pid=3057): Launched 12:02:13.843526 tst iperf3m4.py:8: start network... 12:02:14.063516 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:14.570710 run create_hlr_db(pid=3058): Launched 12:02:14.697579 bus /gobi_6: Setting Powered False 12:02:15.762401 run create_hlr_db(pid=3058): Terminated: ok {rc=0} 12:02:16.252064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3060): Launched 12:02:16.669928 run osmo-hlr_10.42.42.2(pid=3061): Launched 12:02:16.940816 run osmo-stp_10.42.42.5: Starting osmo-stp 12:02:17.533738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3063): Launched 12:02:17.841418 run osmo-stp_10.42.42.5(pid=3064): Launched 12:02:17.958304 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:02:18.489183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3066): Launched 12:02:18.606753 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:02:18.865584 run patchelf(pid=3067): Launched 12:02:19.037807 run osmo-stp_10.42.42.5(pid=3064): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3064)] 12:02:19.168303 run osmo-stp_10.42.42.5(pid=3064): stdout: | (launched: 2022-12-09_12:02:17.784334) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:19.299529 run osmo-stp_10.42.42.5(pid=3064): stderr: | 20221209120217954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120217954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120217954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120217954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120217955 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120217955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120217955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:19.431003 run osmo-stp_10.42.42.5(pid=3064): stdout: | (launched: 2022-12-09_12:02:17.784334) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:19.556821 run osmo-stp_10.42.42.5(pid=3064): stderr: | 20221209120217954 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120217954 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120217954 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120217954 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120217955 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120217955 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120217955 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:19.706281 run patchelf(pid=3067): Terminating (SIGINT) 12:02:19.879813 run patchelf(pid=3067): Terminated: ok {rc=0} 12:02:20.005487 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3064): Process ended prematurely: osmo-stp_10.42.42.5(pid=3064) [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3064)] [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 12:02:20.014989 tst iperf3m4.py:8: Test FAILED (11.2 sec) 12:02:20.042699 run osmo-hlr_10.42.42.2(pid=3061): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3061)] 12:02:20.090261 run osmo-hlr_10.42.42.2(pid=3061): stdout: | (launched: 2022-12-09_12:02:16.607279) 12:02:20.139603 run osmo-hlr_10.42.42.2(pid=3061): stderr: | 20221209120216852 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120216852 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120216852 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120216852 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120216852 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120216852 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120216867 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120216877 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120216878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120216878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:02:20.189393 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3050): Terminating (SIGTERM) 12:02:20.229603 run iperf3-srv_10.42.42.10(pid=3051): Terminating (SIGTERM) 12:02:20.269343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3052): Terminating (SIGTERM) 12:02:20.308879 run iperf3-srv_10.42.42.10(pid=3053): Terminating (SIGTERM) 12:02:20.348300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3054): Terminating (SIGTERM) 12:02:20.387913 run iperf3-srv_10.42.42.10(pid=3055): Terminating (SIGTERM) 12:02:20.427200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3056): Terminating (SIGTERM) 12:02:20.466703 run iperf3-srv_10.42.42.10(pid=3057): Terminating (SIGTERM) 12:02:20.507395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3060): Terminating (SIGTERM) 12:02:20.547459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3063): Terminating (SIGTERM) 12:02:20.586983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3066): Terminating (SIGTERM) 12:02:20.626571 --- ParallelTerminationStrategy: PID 3050 died... 12:02:20.645561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3050): Terminated: ok {rc=0} 12:02:20.689779 --- ParallelTerminationStrategy: PID 3051 died... 12:02:20.708228 run iperf3-srv_10.42.42.10(pid=3051): Terminated {rc=256} 12:02:20.751759 --- ParallelTerminationStrategy: PID 3052 died... 12:02:20.770294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3052): Terminated: ok {rc=0} 12:02:20.814070 --- ParallelTerminationStrategy: PID 3053 died... 12:02:20.832464 run iperf3-srv_10.42.42.10(pid=3053): Terminated {rc=256} 12:02:20.875873 --- ParallelTerminationStrategy: PID 3054 died... 12:02:20.894321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3054): Terminated: ok {rc=0} 12:02:20.937965 --- ParallelTerminationStrategy: PID 3055 died... 12:02:20.956357 run iperf3-srv_10.42.42.10(pid=3055): Terminated {rc=256} 12:02:20.999888 --- ParallelTerminationStrategy: PID 3056 died... 12:02:21.018415 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3056): Terminated: ok {rc=0} 12:02:21.062494 --- ParallelTerminationStrategy: PID 3057 died... 12:02:21.080927 run iperf3-srv_10.42.42.10(pid=3057): Terminated {rc=256} 12:02:21.124328 --- ParallelTerminationStrategy: PID 3060 died... 12:02:21.143011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3060): Terminated: ok {rc=0} 12:02:21.187172 --- ParallelTerminationStrategy: PID 3063 died... 12:02:21.205691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3063): Terminated: ok {rc=0} 12:02:21.249348 --- ParallelTerminationStrategy: PID 3066 died... 12:02:21.267926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3066): Terminated: ok {rc=0} 12:02:21.351939 bus /gobi_4: Setting Powered False 12:02:22.450989 bus /gobi_4: Setting Powered False 12:02:23.571015 bus /gobi_1: Setting Powered False 12:02:24.671970 bus /gobi_1: Setting Powered False 12:02:25.792128 bus /gobi_0: Setting Powered False 12:02:26.891704 bus /gobi_0: Setting Powered False 12:02:28.009377 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 12:02:29.113305 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:29.125654 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:02:29.178839 tst ping.py: using LAC 21325 12:02:29.298441 tst ping.py: using RAC 160 12:02:29.416487 tst ping.py: using CellId 21325 12:02:29.535704 tst ping.py: using BVCI 21326 12:02:29.646197 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:29.657708 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:29.669017 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:29.680140 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:29.691189 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:29.702403 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:29.713728 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:29.724825 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:02:29.840689 tst ping.py:19: start network... 12:02:30.041228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:30.504704 run create_hlr_db(pid=3068): Launched 12:02:30.627306 bus /gobi_6: Setting Powered False 12:02:31.687142 run create_hlr_db(pid=3068): Terminated: ok {rc=0} 12:02:32.115948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3070): Launched 12:02:32.430808 run osmo-hlr_10.42.42.2(pid=3071): Launched 12:02:32.547618 run osmo-stp_10.42.42.5: Starting osmo-stp 12:02:33.083527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3073): Launched 12:02:33.386899 run osmo-stp_10.42.42.5(pid=3074): Launched 12:02:33.503956 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:02:34.027497 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3076): Launched 12:02:34.143943 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:02:34.399673 run patchelf(pid=3077): Launched 12:02:34.568893 run osmo-stp_10.42.42.5(pid=3074): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3074)] 12:02:34.697223 run osmo-stp_10.42.42.5(pid=3074): stdout: | (launched: 2022-12-09_12:02:33.330129) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:34.826437 run osmo-stp_10.42.42.5(pid=3074): stderr: | 20221209120233496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120233497 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120233497 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120233497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120233498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120233498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120233498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:34.955750 run osmo-stp_10.42.42.5(pid=3074): stdout: | (launched: 2022-12-09_12:02:33.330129) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:35.079235 run osmo-stp_10.42.42.5(pid=3074): stderr: | 20221209120233496 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120233497 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120233497 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120233497 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120233498 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120233498 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120233498 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:35.226529 run patchelf(pid=3077): Terminating (SIGINT) 12:02:35.396907 run patchelf(pid=3077): Terminated: ok {rc=0} 12:02:35.519803 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3074): Process ended prematurely: osmo-stp_10.42.42.5(pid=3074) [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3074)] [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 12:02:35.528746 tst ping.py:22: Test FAILED (6.4 sec) 12:02:35.555573 run osmo-hlr_10.42.42.2(pid=3071): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3071)] 12:02:35.603983 run osmo-hlr_10.42.42.2(pid=3071): stdout: | (launched: 2022-12-09_12:02:32.374956) 12:02:35.653483 run osmo-hlr_10.42.42.2(pid=3071): stderr: | 20221209120232547 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120232547 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120232547 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120232547 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120232547 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120232547 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120232559 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120232567 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120232568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120232568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:02:35.703386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3070): Terminating (SIGTERM) 12:02:35.743283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3073): Terminating (SIGTERM) 12:02:35.783569 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3076): Terminating (SIGTERM) 12:02:35.823900 --- ParallelTerminationStrategy: PID 3070 died... 12:02:35.843861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3070): Terminated: ok {rc=0} 12:02:35.887546 --- ParallelTerminationStrategy: PID 3073 died... 12:02:35.906123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3073): Terminated: ok {rc=0} 12:02:35.950664 --- ParallelTerminationStrategy: PID 3076 died... 12:02:35.969380 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3076): Terminated: ok {rc=0} 12:02:36.056058 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 12:02:37.146388 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:37.158851 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:02:37.213155 tst ping_idle_ping.py: using LAC 21326 12:02:37.332905 tst ping_idle_ping.py: using RAC 161 12:02:37.450495 tst ping_idle_ping.py: using CellId 21326 12:02:37.568514 tst ping_idle_ping.py: using BVCI 21327 12:02:37.679766 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:37.691183 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:37.702310 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:37.713463 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:37.724492 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:37.735706 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:37.746891 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:02:37.757993 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:02:37.877242 tst ping_idle_ping.py:24: start network... 12:02:38.095282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:38.597961 run create_hlr_db(pid=3080): Launched 12:02:38.722145 bus /gobi_6: Setting Powered False 12:02:39.782822 run create_hlr_db(pid=3080): Terminated: ok {rc=0} 12:02:40.234743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3082): Launched 12:02:40.561805 run osmo-hlr_10.42.42.2(pid=3083): Launched 12:02:40.679617 run osmo-stp_10.42.42.5: Starting osmo-stp 12:02:41.203164 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3085): Launched 12:02:41.506468 run osmo-stp_10.42.42.5(pid=3086): Launched 12:02:41.622921 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:02:42.142916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3088): Launched 12:02:42.258561 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:02:42.511980 run patchelf(pid=3089): Launched 12:02:42.680145 run osmo-stp_10.42.42.5(pid=3086): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3086)] 12:02:42.807824 run osmo-stp_10.42.42.5(pid=3086): stdout: | (launched: 2022-12-09_12:02:41.450045) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:42.936433 run osmo-stp_10.42.42.5(pid=3086): stderr: | 20221209120241617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120241617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120241617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120241618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120241618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120241618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120241618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:43.065315 run osmo-stp_10.42.42.5(pid=3086): stdout: | (launched: 2022-12-09_12:02:41.450045) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:43.188258 run osmo-stp_10.42.42.5(pid=3086): stderr: | 20221209120241617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120241617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120241617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120241618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120241618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120241618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120241618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:43.334867 run patchelf(pid=3089): Terminating (SIGINT) 12:02:43.505147 run patchelf(pid=3089): Terminated: ok {rc=0} 12:02:43.627759 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3086): Process ended prematurely: osmo-stp_10.42.42.5(pid=3086) [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3086)] [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 12:02:43.637098 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 12:02:43.663908 run osmo-hlr_10.42.42.2(pid=3083): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3083)] 12:02:43.711691 run osmo-hlr_10.42.42.2(pid=3083): stdout: | (launched: 2022-12-09_12:02:40.499247) 12:02:43.761726 run osmo-hlr_10.42.42.2(pid=3083): stderr: | 20221209120240681 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120240681 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120240681 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120240681 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120240681 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120240681 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120240695 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120240703 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120240703 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120240703 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:02:43.811581 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3082): Terminating (SIGTERM) 12:02:43.851720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3085): Terminating (SIGTERM) 12:02:43.891859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3088): Terminating (SIGTERM) 12:02:43.932177 --- ParallelTerminationStrategy: PID 3082 died... 12:02:43.951348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3082): Terminated: ok {rc=0} 12:02:43.995492 --- ParallelTerminationStrategy: PID 3085 died... 12:02:44.014370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3085): Terminated: ok {rc=0} 12:02:44.058576 --- ParallelTerminationStrategy: PID 3088 died... 12:02:44.077397 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3088): Terminated: ok {rc=0} 12:02:44.161354 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:02:45.473420 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:02:45.480892 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:02:45.515607 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:02:45.551268 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:02:45.607027 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:02:45.640594 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:02:45.676334 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:02:46.265867 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2359 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:02:46.274764 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:02:46.290173 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:02:46.367045 tst switch_tch_pdch.py: using LAC 21327 12:02:46.495362 tst switch_tch_pdch.py: using RAC 162 12:02:46.656114 tst switch_tch_pdch.py: using CellId 21327 12:02:46.785471 tst switch_tch_pdch.py: using BVCI 21328 12:02:46.897999 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:02:46.910258 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:02:46.922571 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:02:46.934688 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:02:46.946331 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:02:46.958431 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:02:46.970558 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:02:46.982599 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:02:47.101790 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:02:47.222710 tst switch_tch_pdch.py:51: start network... 12:02:47.425138 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:47.890811 run create_hlr_db(pid=3093): Launched 12:02:48.016007 bus /gobi_6: Setting Powered False 12:02:49.076517 run create_hlr_db(pid=3093): Terminated: ok {rc=0} 12:02:49.517088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3095): Launched 12:02:49.822158 run osmo-hlr_10.42.42.2(pid=3096): Launched 12:02:49.935421 run osmo-stp_10.42.42.5: Starting osmo-stp 12:02:50.465534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3098): Launched 12:02:50.767719 run osmo-stp_10.42.42.5(pid=3099): Launched 12:02:50.881495 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:02:51.401392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3101): Launched 12:02:51.517211 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:02:51.773882 run patchelf(pid=3102): Launched 12:02:51.941416 run osmo-stp_10.42.42.5(pid=3099): ERR: Terminated: ERROR {rc=1} [trial-2359↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3099)] 12:02:52.068878 run osmo-stp_10.42.42.5(pid=3099): stdout: | (launched: 2022-12-09_12:02:50.711854) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:52.197731 run osmo-stp_10.42.42.5(pid=3099): stderr: | 20221209120250881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120250881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120250881 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120250882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120250882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120250882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120250882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:52.326428 run osmo-stp_10.42.42.5(pid=3099): stdout: | (launched: 2022-12-09_12:02:50.711854) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:02:52.449306 run osmo-stp_10.42.42.5(pid=3099): stderr: | 20221209120250881 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120250881 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120250881 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120250882 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120250882 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120250882 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120250882 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:02:52.595398 run patchelf(pid=3102): Terminating (SIGINT) 12:02:52.764644 run patchelf(pid=3102): Terminated: ok {rc=0} 12:02:52.887561 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3099): Process ended prematurely: osmo-stp_10.42.42.5(pid=3099) [trial-2359↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3099)] [trial-2359↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:02:52.896396 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 12:02:52.922821 run osmo-hlr_10.42.42.2(pid=3096): ERR: Terminated: ERROR {rc=237} [trial-2359↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3096)] 12:02:52.970256 run osmo-hlr_10.42.42.2(pid=3096): stdout: | (launched: 2022-12-09_12:02:49.766412) 12:02:53.019429 run osmo-hlr_10.42.42.2(pid=3096): stderr: | 20221209120249942 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120249942 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120249942 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120249942 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120249942 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120249942 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120249955 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120249966 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120249966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120249966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:02:53.068849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3095): Terminating (SIGTERM) 12:02:53.108866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3098): Terminating (SIGTERM) 12:02:53.148486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3101): Terminating (SIGTERM) 12:02:53.188361 --- ParallelTerminationStrategy: PID 3095 died... 12:02:53.207408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3095): Terminated: ok {rc=0} 12:02:53.251283 --- ParallelTerminationStrategy: PID 3098 died... 12:02:53.269723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3098): Terminated: ok {rc=0} 12:02:53.313991 --- ParallelTerminationStrategy: PID 3101 died... 12:02:53.332411 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3101): Terminated: ok {rc=0} 12:02:53.419235 bus /gobi_0: Setting Powered False 12:02:54.519799 bus /gobi_0: Setting Powered False 12:02:55.632886 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 12:02:56.889835 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:02:56.896646 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 12:02:56.929173 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 12:02:56.963572 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 12:02:57.016876 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 12:02:57.048878 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 12:02:57.082870 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 12:02:57.643049 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2359 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 12:02:57.649584 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:02:57.661105 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 12:02:57.737435 tst switch_tch_pdch.py: using LAC 21328 12:02:57.862123 tst switch_tch_pdch.py: using RAC 163 12:02:57.985972 tst switch_tch_pdch.py: using CellId 21328 12:02:58.110737 tst switch_tch_pdch.py: using BVCI 21329 12:02:58.229182 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:02:58.240728 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:02:58.252150 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:02:58.263781 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:02:58.275663 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:02:58.287524 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:02:58.299259 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:02:58.310802 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:02:58.433195 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:02:58.553741 tst switch_tch_pdch.py:51: start network... 12:02:58.771574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:02:59.241041 run create_hlr_db(pid=3106): Launched 12:02:59.363741 bus /gobi_6: Setting Powered False 12:03:00.427021 run create_hlr_db(pid=3106): Terminated: ok {rc=0} 12:03:00.857745 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3108): Launched 12:03:01.188813 run osmo-hlr_10.42.42.2(pid=3110): Launched 12:03:01.501722 run osmo-stp_10.42.42.5: Starting osmo-stp 12:03:02.112385 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3112): Launched 12:03:02.442852 run osmo-stp_10.42.42.5(pid=3113): Launched 12:03:02.566513 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:03:03.092904 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3115): Launched 12:03:03.217429 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:03:03.489675 run patchelf(pid=3116): Launched 12:03:03.670263 run osmo-stp_10.42.42.5(pid=3113): ERR: Terminated: ERROR {rc=1} [trial-2359↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3113)] 12:03:03.807815 run osmo-stp_10.42.42.5(pid=3113): stdout: | (launched: 2022-12-09_12:03:02.383300) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:03.945888 run osmo-stp_10.42.42.5(pid=3113): stderr: | 20221209120302571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120302571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120302571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120302572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120302572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120302572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120302573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:04.083888 run osmo-stp_10.42.42.5(pid=3113): stdout: | (launched: 2022-12-09_12:03:02.383300) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:04.216607 run osmo-stp_10.42.42.5(pid=3113): stderr: | 20221209120302571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120302571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120302571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120302572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120302572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120302572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120302573 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:04.373534 run patchelf(pid=3116): Terminating (SIGINT) 12:03:04.555226 run patchelf(pid=3116): Terminated: ok {rc=0} 12:03:04.686777 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3113): Process ended prematurely: osmo-stp_10.42.42.5(pid=3113) [trial-2359↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3113)] [trial-2359↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 12:03:04.696451 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 12:03:04.724881 run osmo-hlr_10.42.42.2(pid=3110): ERR: Terminated: ERROR {rc=237} [trial-2359↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3110)] 12:03:04.776444 run osmo-hlr_10.42.42.2(pid=3110): stdout: | (launched: 2022-12-09_12:03:01.129567) 12:03:04.828872 run osmo-hlr_10.42.42.2(pid=3110): stderr: | 20221209120301438 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120301438 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120301438 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120301438 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120301438 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120301438 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120301454 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120301471 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120301471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120301472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:04.881621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3108): Terminating (SIGTERM) 12:03:04.923968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3112): Terminating (SIGTERM) 12:03:04.966331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3115): Terminating (SIGTERM) 12:03:05.008672 --- ParallelTerminationStrategy: PID 3108 died... 12:03:05.028627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3108): Terminated: ok {rc=0} 12:03:05.075442 --- ParallelTerminationStrategy: PID 3112 died... 12:03:05.094973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3112): Terminated: ok {rc=0} 12:03:05.141521 --- ParallelTerminationStrategy: PID 3115 died... 12:03:05.161106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3115): Terminated: ok {rc=0} 12:03:05.250075 bus /gobi_0: Setting Powered False 12:03:06.349792 bus /gobi_0: Setting Powered False 12:03:07.466078 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 nitb_sms:trx-lms --------------------------------------------------------------------- 12:03:08.721805 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:03:08.726293 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 12:03:08.759365 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 12:03:08.766067 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 12:03:08.819108 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 12:03:08.852095 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 12:03:08.858750 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 12:03:09.395269 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 12:03:09.400125 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 12:03:09.410832 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 12:03:09.459180 tst mo_mt_sms.py: using LAC 21329 12:03:09.586055 tst mo_mt_sms.py: using RAC 164 12:03:09.714221 tst mo_mt_sms.py: using CellId 21329 12:03:09.840500 tst mo_mt_sms.py: using BVCI 21330 12:03:09.958616 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 12:03:10.077950 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 12:03:10.197234 tst mo_mt_sms.py:9: start nitb and bts... 12:03:10.415345 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:03:11.067441 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3120): Launched 12:03:11.389599 run osmo-nitb_10.42.42.2(pid=3121): Launched 12:03:11.570458 run osmo-nitb_10.42.42.2(pid=3121): ERR: Terminated: ERROR {rc=2} [trial-2359↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3121)] 12:03:11.714919 run osmo-nitb_10.42.42.2(pid=3121): stdout: | (launched: 2022-12-09_12:03:11.330918) 12:03:11.861497 run osmo-nitb_10.42.42.2(pid=3121): stderr: | (launched: 2022-12-09_12:03:11.378305) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:03:12.007787 run osmo-nitb_10.42.42.2(pid=3121): stdout: | (launched: 2022-12-09_12:03:11.330918) 12:03:12.147951 run osmo-nitb_10.42.42.2(pid=3121): stderr: | (launched: 2022-12-09_12:03:11.378305) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3121): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3121) [trial-2359↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3121)] 12:03:12.512796 tst osmo-nitb_10.42.42.2(pid=3121): stdout: | (launched: 2022-12-09_12:03:11.330918) 12:03:12.642543 tst osmo-nitb_10.42.42.2(pid=3121): stderr: | (launched: 2022-12-09_12:03:11.378305) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:03:12.795883 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=3121): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3121) [trial-2359↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3121)] [trial-2359↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 12:03:12.805162 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 12:03:12.812420 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3120): Terminating (SIGTERM) 12:03:13.024044 --- ParallelTerminationStrategy: PID 3120 died... 12:03:13.045685 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3120): Terminated: ok {rc=0} 12:03:13.134715 bus /sierra_3: Setting Powered False 12:03:14.233485 bus /sierra_3: Setting Powered False 12:03:15.350772 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 sms:trx-lms --------------------------------------------------------------------- 12:03:16.581242 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:03:16.586440 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 12:03:16.623516 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 12:03:16.652804 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 12:03:16.704675 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 12:03:16.739835 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 12:03:16.768591 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 12:03:17.322443 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 12:03:17.328528 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:03:17.339591 tst sms:trx-lms: Using 1 x bts (candidates: 1) 12:03:17.388615 tst mo_mt_sms.py: using LAC 21330 12:03:17.509228 tst mo_mt_sms.py: using RAC 165 12:03:17.626881 tst mo_mt_sms.py: using CellId 21330 12:03:17.744490 tst mo_mt_sms.py: using BVCI 21331 12:03:17.852776 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:03:17.863450 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:03:17.873999 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:03:17.884432 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:03:17.894749 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 12:03:17.905052 tst sms:trx-lms: Using 1 x modem (candidates: 2) 12:03:18.024580 tst sms:trx-lms: Using 1 x modem (candidates: 2) 12:03:18.147522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:03:18.643069 run create_hlr_db(pid=3125): Launched 12:03:18.765773 bus /sierra_2: Setting Powered False 12:03:19.828546 run create_hlr_db(pid=3125): Terminated: ok {rc=0} 12:03:20.275958 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3127): Launched 12:03:20.597457 run osmo-hlr_10.42.42.2(pid=3128): Launched 12:03:20.720470 run osmo-stp_10.42.42.5: Starting osmo-stp 12:03:21.277873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3130): Launched 12:03:21.600168 run osmo-stp_10.42.42.5(pid=3131): Launched 12:03:21.722595 run osmo-msc_10.42.42.6: Starting osmo-msc 12:03:22.303629 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3133): Launched 12:03:22.626222 run osmo-msc_10.42.42.6(pid=3134): Launched 12:03:22.806912 run osmo-stp_10.42.42.5(pid=3131): ERR: Terminated: ERROR {rc=1} [trial-2359↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3131)] 12:03:22.942096 run osmo-stp_10.42.42.5(pid=3131): stdout: | (launched: 2022-12-09_12:03:21.541151) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:23.077607 run osmo-stp_10.42.42.5(pid=3131): stderr: | 20221209120321732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120321733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120321733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120321733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120321734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120321734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120321734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:23.211452 run osmo-stp_10.42.42.5(pid=3131): stdout: | (launched: 2022-12-09_12:03:21.541151) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:23.338724 run osmo-stp_10.42.42.5(pid=3131): stderr: | 20221209120321732 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120321733 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120321733 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120321733 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120321734 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120321734 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120321734 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:23.491209 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=3131): Process ended prematurely: osmo-stp_10.42.42.5(pid=3131) [trial-2359↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3131)] [trial-2359↪sms:trx-lms↪mo_mt_sms.py:16] 12:03:23.500000 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 12:03:23.527830 run osmo-hlr_10.42.42.2(pid=3128): ERR: Terminated: ERROR {rc=237} [trial-2359↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3128)] 12:03:23.578425 run osmo-hlr_10.42.42.2(pid=3128): stdout: | (launched: 2022-12-09_12:03:20.538257) 12:03:23.630746 run osmo-hlr_10.42.42.2(pid=3128): stderr: | 20221209120320736 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120320736 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120320736 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120320736 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120320736 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120320736 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120320749 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120320757 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120320758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120320758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:23.703352 run osmo-msc_10.42.42.6(pid=3134): ERR: Terminated: ERROR {rc=2} [trial-2359↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3134)] 12:03:23.753934 run osmo-msc_10.42.42.6(pid=3134): stdout: | (launched: 2022-12-09_12:03:22.566168) 12:03:23.806493 run osmo-msc_10.42.42.6(pid=3134): stderr: | 20221209120322886 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209120322886 DLGLOBAL DEBUG validating counter group 0x7f38d0564c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209120322886 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209120322886 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209120322887 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209120322887 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209120322889 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209120322889 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209120322889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209120322889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:03:23.859081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3127): Terminating (SIGTERM) 12:03:23.901154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3130): Terminating (SIGTERM) 12:03:23.943247 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3133): Terminating (SIGTERM) 12:03:23.985722 --- ParallelTerminationStrategy: PID 3127 died... 12:03:24.005885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3127): Terminated: ok {rc=0} 12:03:24.052938 --- ParallelTerminationStrategy: PID 3130 died... 12:03:24.072587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3130): Terminated: ok {rc=0} 12:03:24.119401 --- ParallelTerminationStrategy: PID 3133 died... 12:03:24.138834 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3133): Terminated: ok {rc=0} 12:03:24.228283 bus /sierra_3: Setting Powered False 12:03:25.328793 bus /sierra_3: Setting Powered False 12:03:26.446358 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 nitb_ussd:trx-lms --------------------------------------------------------------------- 12:03:27.678200 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:03:27.682847 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 12:03:27.717816 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 12:03:27.724849 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 12:03:27.761578 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 12:03:27.795483 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 12:03:27.802588 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 12:03:28.322232 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2359 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 12:03:28.327586 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 12:03:28.338889 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 12:03:28.388356 tst assert_extension.py: using LAC 21331 12:03:28.514869 tst assert_extension.py: using RAC 166 12:03:28.641265 tst assert_extension.py: using CellId 21331 12:03:28.765788 tst assert_extension.py: using BVCI 21332 12:03:28.876752 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 12:03:28.992843 tst assert_extension.py:10: start nitb and bts... 12:03:29.193454 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:03:29.807281 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3139): Launched 12:03:30.109792 run osmo-nitb_10.42.42.2(pid=3140): Launched 12:03:30.277574 run osmo-nitb_10.42.42.2(pid=3140): ERR: Terminated: ERROR {rc=2} [trial-2359↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3140)] 12:03:30.413286 run osmo-nitb_10.42.42.2(pid=3140): stdout: | (launched: 2022-12-09_12:03:30.054063) 12:03:30.550258 run osmo-nitb_10.42.42.2(pid=3140): stderr: | (launched: 2022-12-09_12:03:30.098912) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:03:30.687674 run osmo-nitb_10.42.42.2(pid=3140): stdout: | (launched: 2022-12-09_12:03:30.054063) 12:03:30.818764 run osmo-nitb_10.42.42.2(pid=3140): stderr: | (launched: 2022-12-09_12:03:30.098912) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3140): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3140) [trial-2359↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3140)] 12:03:31.224159 tst osmo-nitb_10.42.42.2(pid=3140): stdout: | (launched: 2022-12-09_12:03:30.054063) 12:03:31.359074 tst osmo-nitb_10.42.42.2(pid=3140): stderr: | (launched: 2022-12-09_12:03:30.098912) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:03:31.517233 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=3140): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3140) [trial-2359↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3140)] [trial-2359↪nitb_ussd:trx-lms↪assert_extension.py:12] 12:03:31.526685 tst assert_extension.py:12: Test FAILED (3.2 sec) 12:03:31.533957 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3139): Terminating (SIGTERM) 12:03:31.748726 --- ParallelTerminationStrategy: PID 3139 died... 12:03:31.769277 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3139): Terminated: ok {rc=0} 12:03:31.861881 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 ussd:trx-lms --------------------------------------------------------------------- 12:03:33.044143 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:03:33.048428 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 12:03:33.083236 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 12:03:33.111108 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 12:03:33.146592 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 12:03:33.181111 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 12:03:33.208493 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 12:03:33.738488 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2359 ussd:trx-lms assert_extension.py ---------------------------------------------- 12:03:33.744109 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:03:33.755651 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 12:03:33.807778 tst assert_extension.py: using LAC 21332 12:03:33.932434 tst assert_extension.py: using RAC 167 12:03:34.057455 tst assert_extension.py: using CellId 21332 12:03:34.182467 tst assert_extension.py: using BVCI 21333 12:03:34.299985 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:03:34.311175 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:03:34.322476 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:03:34.334064 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:03:34.345746 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 12:03:34.357162 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 12:03:34.474103 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:03:34.937476 run create_hlr_db(pid=3144): Launched 12:03:35.060606 bus /sierra_2: Setting Powered False 12:03:36.121206 run create_hlr_db(pid=3144): Terminated: ok {rc=0} 12:03:36.542000 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3146): Launched 12:03:36.843053 run osmo-hlr_10.42.42.2(pid=3147): Launched 12:03:36.959608 run osmo-stp_10.42.42.5: Starting osmo-stp 12:03:37.476507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3149): Launched 12:03:37.777828 run osmo-stp_10.42.42.5(pid=3150): Launched 12:03:37.891364 run osmo-msc_10.42.42.6: Starting osmo-msc 12:03:38.430049 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3152): Launched 12:03:38.729602 run osmo-msc_10.42.42.6(pid=3153): Launched 12:03:38.899112 run osmo-stp_10.42.42.5(pid=3150): ERR: Terminated: ERROR {rc=1} [trial-2359↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3150)] 12:03:39.026735 run osmo-stp_10.42.42.5(pid=3150): stdout: | (launched: 2022-12-09_12:03:37.721730) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:39.154742 run osmo-stp_10.42.42.5(pid=3150): stderr: | 20221209120337890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120337891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120337891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120337891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120337892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120337892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120337892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:39.279844 run osmo-stp_10.42.42.5(pid=3150): stdout: | (launched: 2022-12-09_12:03:37.721730) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:39.399487 run osmo-stp_10.42.42.5(pid=3150): stderr: | 20221209120337890 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120337891 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120337891 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120337891 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120337892 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120337892 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120337892 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:39.542503 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=3150): Process ended prematurely: osmo-stp_10.42.42.5(pid=3150) [trial-2359↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3150)] [trial-2359↪ussd:trx-lms↪assert_extension.py:17] 12:03:39.550747 tst assert_extension.py:17: Test FAILED (5.8 sec) 12:03:39.576903 run osmo-hlr_10.42.42.2(pid=3147): ERR: Terminated: ERROR {rc=237} [trial-2359↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3147)] 12:03:39.624588 run osmo-hlr_10.42.42.2(pid=3147): stdout: | (launched: 2022-12-09_12:03:36.787405) 12:03:39.674834 run osmo-hlr_10.42.42.2(pid=3147): stderr: | 20221209120336960 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120336960 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120336960 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120336960 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120336960 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120336960 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120336972 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120336980 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120336980 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120336980 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:39.744259 run osmo-msc_10.42.42.6(pid=3153): ERR: Terminated: ERROR {rc=2} [trial-2359↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3153)] 12:03:39.792619 run osmo-msc_10.42.42.6(pid=3153): stdout: | (launched: 2022-12-09_12:03:38.673725) 12:03:39.842224 run osmo-msc_10.42.42.6(pid=3153): stderr: | 20221209120338942 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209120338942 DLGLOBAL DEBUG validating counter group 0x7fe048dfbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209120338942 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209120338942 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209120338942 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209120338943 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209120338944 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209120338945 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209120338945 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209120338945 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:03:39.891988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3146): Terminating (SIGTERM) 12:03:39.932115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3149): Terminating (SIGTERM) 12:03:39.973752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3152): Terminating (SIGTERM) 12:03:40.013921 --- ParallelTerminationStrategy: PID 3146 died... 12:03:40.033248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3146): Terminated: ok {rc=0} 12:03:40.077475 --- ParallelTerminationStrategy: PID 3149 died... 12:03:40.096337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3149): Terminated: ok {rc=0} 12:03:40.140175 --- ParallelTerminationStrategy: PID 3152 died... 12:03:40.158703 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3152): Terminated: ok {rc=0} 12:03:40.243677 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:03:41.454029 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:03:41.460542 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:03:41.493712 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:03:41.520778 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:03:41.571264 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:03:41.604083 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:03:41.630539 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:03:42.183067 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:03:42.232672 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:03:42.244008 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:03:42.311863 tst mo_mt_call.py: using LAC 21333 12:03:42.430392 tst mo_mt_call.py: using RAC 168 12:03:42.550332 tst mo_mt_call.py: using CellId 21333 12:03:42.669322 tst mo_mt_call.py: using BVCI 21334 12:03:42.779351 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:03:42.790560 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:03:42.801559 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:03:42.812442 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:03:42.823438 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:03:42.834521 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:03:42.952219 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:03:43.069148 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:03:43.542624 run create_hlr_db(pid=3158): Launched 12:03:43.669841 bus /sierra_2: Setting Powered False 12:03:44.730924 run create_hlr_db(pid=3158): Terminated: ok {rc=0} 12:03:45.178178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3160): Launched 12:03:45.505876 run osmo-hlr_10.42.42.2(pid=3161): Launched 12:03:45.630910 run osmo-stp_10.42.42.5: Starting osmo-stp 12:03:46.180753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3163): Launched 12:03:46.517104 run osmo-stp_10.42.42.5(pid=3164): Launched 12:03:46.857788 run osmo-msc_10.42.42.6: Starting osmo-msc 12:03:47.457576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3166): Launched 12:03:47.766306 run osmo-msc_10.42.42.6(pid=3167): Launched 12:03:47.938644 run osmo-stp_10.42.42.5(pid=3164): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3164)] 12:03:48.068140 run osmo-stp_10.42.42.5(pid=3164): stdout: | (launched: 2022-12-09_12:03:46.449313) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:48.197443 run osmo-stp_10.42.42.5(pid=3164): stderr: | 20221209120346735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120346735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120346736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120346736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120346737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120346738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120346738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:48.324340 run osmo-stp_10.42.42.5(pid=3164): stdout: | (launched: 2022-12-09_12:03:46.449313) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:48.445413 run osmo-stp_10.42.42.5(pid=3164): stderr: | 20221209120346735 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120346735 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120346736 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120346736 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120346737 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120346738 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120346738 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:48.590473 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3164): Process ended prematurely: osmo-stp_10.42.42.5(pid=3164) [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3164)] [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:03:48.599158 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:03:48.625540 run osmo-hlr_10.42.42.2(pid=3161): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3161)] 12:03:48.673248 run osmo-hlr_10.42.42.2(pid=3161): stdout: | (launched: 2022-12-09_12:03:45.445680) 12:03:48.722699 run osmo-hlr_10.42.42.2(pid=3161): stderr: | 20221209120345641 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120345641 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120345641 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120345641 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120345641 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120345641 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120345657 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120345667 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120345667 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120345667 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:48.791717 run osmo-msc_10.42.42.6(pid=3167): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3167)] 12:03:48.839668 run osmo-msc_10.42.42.6(pid=3167): stdout: | (launched: 2022-12-09_12:03:47.708519) 12:03:48.889022 run osmo-msc_10.42.42.6(pid=3167): stderr: | 20221209120347978 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209120347978 DLGLOBAL DEBUG validating counter group 0x7f37fab39c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209120347978 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209120347978 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209120347979 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209120347979 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209120347980 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209120347981 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209120347981 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209120347981 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:03:48.938732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3160): Terminating (SIGTERM) 12:03:48.978393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3163): Terminating (SIGTERM) 12:03:49.018057 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3166): Terminating (SIGTERM) 12:03:49.057918 --- ParallelTerminationStrategy: PID 3160 died... 12:03:49.077114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3160): Terminated: ok {rc=0} 12:03:49.121157 --- ParallelTerminationStrategy: PID 3163 died... 12:03:49.139795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3163): Terminated: ok {rc=0} 12:03:49.183605 --- ParallelTerminationStrategy: PID 3166 died... 12:03:49.202419 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3166): Terminated: ok {rc=0} 12:03:49.287368 bus /sierra_3: Setting Powered False 12:03:50.385994 bus /sierra_3: Setting Powered False 12:03:51.505658 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:03:52.659193 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:03:52.671736 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:03:52.743763 tst mo_mt_call_osmux.py: using LAC 21334 12:03:52.874225 tst mo_mt_call_osmux.py: using RAC 169 12:03:52.994684 tst mo_mt_call_osmux.py: using CellId 21334 12:03:53.117148 tst mo_mt_call_osmux.py: using BVCI 21335 12:03:53.229347 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:03:53.240587 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:03:53.251653 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:03:53.262880 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:03:53.274231 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:03:53.285291 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:03:53.405465 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:03:53.531084 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:03:54.038444 run create_hlr_db(pid=3169): Launched 12:03:54.166046 bus /sierra_2: Setting Powered False 12:03:55.230629 run create_hlr_db(pid=3169): Terminated: ok {rc=0} 12:03:55.670084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3171): Launched 12:03:55.982000 run osmo-hlr_10.42.42.2(pid=3172): Launched 12:03:56.099666 run osmo-stp_10.42.42.5: Starting osmo-stp 12:03:56.628037 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3174): Launched 12:03:56.935560 run osmo-stp_10.42.42.5(pid=3175): Launched 12:03:57.052222 run osmo-msc_10.42.42.6: Starting osmo-msc 12:03:57.607472 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3177): Launched 12:03:57.917168 run osmo-msc_10.42.42.6(pid=3178): Launched 12:03:58.088825 run osmo-stp_10.42.42.5(pid=3175): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3175)] 12:03:58.217804 run osmo-stp_10.42.42.5(pid=3175): stdout: | (launched: 2022-12-09_12:03:56.878820) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:58.347233 run osmo-stp_10.42.42.5(pid=3175): stderr: | 20221209120357045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120357046 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120357046 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120357046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120357047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120357047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120357047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:58.474770 run osmo-stp_10.42.42.5(pid=3175): stdout: | (launched: 2022-12-09_12:03:56.878820) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:03:58.596015 run osmo-stp_10.42.42.5(pid=3175): stderr: | 20221209120357045 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120357046 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120357046 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120357046 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120357047 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120357047 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120357047 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:03:58.741498 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3175): Process ended prematurely: osmo-stp_10.42.42.5(pid=3175) [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3175)] [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:03:58.750496 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:03:58.776927 run osmo-hlr_10.42.42.2(pid=3172): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3172)] 12:03:58.824851 run osmo-hlr_10.42.42.2(pid=3172): stdout: | (launched: 2022-12-09_12:03:55.925069) 12:03:58.874457 run osmo-hlr_10.42.42.2(pid=3172): stderr: | 20221209120356097 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120356097 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120356097 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120356097 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120356097 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120356097 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120356114 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120356124 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120356124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120356124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:03:58.943603 run osmo-msc_10.42.42.6(pid=3178): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3178)] 12:03:58.991976 run osmo-msc_10.42.42.6(pid=3178): stdout: | (launched: 2022-12-09_12:03:57.859876) 12:03:59.041557 run osmo-msc_10.42.42.6(pid=3178): stderr: | 20221209120358128 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209120358128 DLGLOBAL DEBUG validating counter group 0x7f7fff991c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209120358129 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209120358129 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209120358129 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209120358129 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209120358131 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209120358131 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209120358131 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209120358131 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:03:59.091630 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3171): Terminating (SIGTERM) 12:03:59.131496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3174): Terminating (SIGTERM) 12:03:59.171460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3177): Terminating (SIGTERM) 12:03:59.211654 --- ParallelTerminationStrategy: PID 3171 died... 12:03:59.230801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3171): Terminated: ok {rc=0} 12:03:59.274921 --- ParallelTerminationStrategy: PID 3174 died... 12:03:59.293687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3174): Terminated: ok {rc=0} 12:03:59.337788 --- ParallelTerminationStrategy: PID 3177 died... 12:03:59.356631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3177): Terminated: ok {rc=0} 12:03:59.440445 bus /sierra_3: Setting Powered False 12:04:00.538533 bus /sierra_3: Setting Powered False 12:04:01.669572 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:04:02.928166 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:04:02.934878 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:04:02.967861 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:04:02.994512 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:04:03.047807 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:04:03.081267 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:04:03.107441 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:04:03.657577 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:04:03.706267 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:04:03.717443 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:04:03.786566 tst mo_mt_call.py: using LAC 21335 12:04:03.908060 tst mo_mt_call.py: using RAC 170 12:04:04.037686 tst mo_mt_call.py: using CellId 21335 12:04:04.167245 tst mo_mt_call.py: using BVCI 21336 12:04:04.286597 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:04:04.298376 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:04:04.310089 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:04:04.322774 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:04:04.334410 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:04:04.346209 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:04:04.468072 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:04:04.588807 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:04:05.094260 run create_hlr_db(pid=3183): Launched 12:04:05.220360 bus /sierra_2: Setting Powered False 12:04:06.285336 run create_hlr_db(pid=3183): Terminated: ok {rc=0} 12:04:06.739964 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3185): Launched 12:04:07.067062 run osmo-hlr_10.42.42.2(pid=3186): Launched 12:04:07.192884 run osmo-stp_10.42.42.5: Starting osmo-stp 12:04:07.754675 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3188): Launched 12:04:08.082621 run osmo-stp_10.42.42.5(pid=3189): Launched 12:04:08.206886 run osmo-msc_10.42.42.6: Starting osmo-msc 12:04:08.796714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3191): Launched 12:04:09.123845 run osmo-msc_10.42.42.6(pid=3192): Launched 12:04:09.305084 run osmo-stp_10.42.42.5(pid=3189): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3189)] 12:04:09.442147 run osmo-stp_10.42.42.5(pid=3189): stdout: | (launched: 2022-12-09_12:04:08.022307) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:09.580032 run osmo-stp_10.42.42.5(pid=3189): stderr: | 20221209120408211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120408211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120408211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120408212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120408212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120408212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120408212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:09.716286 run osmo-stp_10.42.42.5(pid=3189): stdout: | (launched: 2022-12-09_12:04:08.022307) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:09.846459 run osmo-stp_10.42.42.5(pid=3189): stderr: | 20221209120408211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120408211 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120408211 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120408212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120408212 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120408212 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120408212 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:10.001428 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3189): Process ended prematurely: osmo-stp_10.42.42.5(pid=3189) [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3189)] [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:04:10.011285 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:04:10.040236 run osmo-hlr_10.42.42.2(pid=3186): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3186)] 12:04:10.090999 run osmo-hlr_10.42.42.2(pid=3186): stdout: | (launched: 2022-12-09_12:04:07.007411) 12:04:10.143631 run osmo-hlr_10.42.42.2(pid=3186): stderr: | 20221209120407202 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120407202 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120407202 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120407202 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120407202 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120407202 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120407215 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120407226 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120407226 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120407226 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:04:10.216218 run osmo-msc_10.42.42.6(pid=3192): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3192)] 12:04:10.266815 run osmo-msc_10.42.42.6(pid=3192): stdout: | (launched: 2022-12-09_12:04:09.063492) 12:04:10.319747 run osmo-msc_10.42.42.6(pid=3192): stderr: | 20221209120409382 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209120409382 DLGLOBAL DEBUG validating counter group 0x7f78e8749c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209120409382 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209120409383 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209120409383 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209120409383 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209120409385 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209120409385 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209120409385 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209120409385 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:04:10.372839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3185): Terminating (SIGTERM) 12:04:10.415351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3188): Terminating (SIGTERM) 12:04:10.457673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3191): Terminating (SIGTERM) 12:04:10.500658 --- ParallelTerminationStrategy: PID 3185 died... 12:04:10.521340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3185): Terminated: ok {rc=0} 12:04:10.568597 --- ParallelTerminationStrategy: PID 3188 died... 12:04:10.588326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3188): Terminated: ok {rc=0} 12:04:10.635665 --- ParallelTerminationStrategy: PID 3191 died... 12:04:10.655451 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3191): Terminated: ok {rc=0} 12:04:10.746369 bus /sierra_3: Setting Powered False 12:04:11.846726 bus /sierra_3: Setting Powered False 12:04:12.966036 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:04:14.113919 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:04:14.125821 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:04:14.195956 tst mo_mt_call_osmux.py: using LAC 21336 12:04:14.316012 tst mo_mt_call_osmux.py: using RAC 171 12:04:14.438377 tst mo_mt_call_osmux.py: using CellId 21336 12:04:14.560209 tst mo_mt_call_osmux.py: using BVCI 21337 12:04:14.672156 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:04:14.683353 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:04:14.694763 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:04:14.705748 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:04:14.716602 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:04:14.727592 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:04:14.849088 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:04:14.969687 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:04:15.477700 run create_hlr_db(pid=3194): Launched 12:04:15.604400 bus /sierra_2: Setting Powered False 12:04:16.666643 run create_hlr_db(pid=3194): Terminated: ok {rc=0} 12:04:17.127751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3196): Launched 12:04:17.468426 run osmo-hlr_10.42.42.2(pid=3197): Launched 12:04:17.593676 run osmo-stp_10.42.42.5: Starting osmo-stp 12:04:18.159431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3199): Launched 12:04:18.488853 run osmo-stp_10.42.42.5(pid=3200): Launched 12:04:18.613470 run osmo-msc_10.42.42.6: Starting osmo-msc 12:04:19.204527 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3202): Launched 12:04:19.533607 run osmo-msc_10.42.42.6(pid=3203): Launched 12:04:19.718304 run osmo-stp_10.42.42.5(pid=3200): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3200)] 12:04:19.857370 run osmo-stp_10.42.42.5(pid=3200): stdout: | (launched: 2022-12-09_12:04:18.428286) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:19.997113 run osmo-stp_10.42.42.5(pid=3200): stderr: | 20221209120418617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120418617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120418617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120418618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120418618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120418618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120418618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:20.134854 run osmo-stp_10.42.42.5(pid=3200): stdout: | (launched: 2022-12-09_12:04:18.428286) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:20.265371 run osmo-stp_10.42.42.5(pid=3200): stderr: | 20221209120418617 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120418617 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120418617 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120418618 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120418618 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120418618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120418618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:20.421550 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3200): Process ended prematurely: osmo-stp_10.42.42.5(pid=3200) [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3200)] [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:04:20.431344 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:04:20.460496 run osmo-hlr_10.42.42.2(pid=3197): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3197)] 12:04:20.511409 run osmo-hlr_10.42.42.2(pid=3197): stdout: | (launched: 2022-12-09_12:04:17.407845) 12:04:20.564154 run osmo-hlr_10.42.42.2(pid=3197): stderr: | 20221209120417604 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120417604 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120417604 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120417604 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120417604 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120417604 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120417616 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120417625 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120417625 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120417625 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:04:20.637440 run osmo-msc_10.42.42.6(pid=3203): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3203)] 12:04:20.688408 run osmo-msc_10.42.42.6(pid=3203): stdout: | (launched: 2022-12-09_12:04:19.473583) 12:04:20.741284 run osmo-msc_10.42.42.6(pid=3203): stderr: | 20221209120419795 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209120419795 DLGLOBAL DEBUG validating counter group 0x7f06de04ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209120419795 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209120419795 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209120419795 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209120419795 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209120419797 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209120419797 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209120419798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209120419798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:04:20.794309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3196): Terminating (SIGTERM) 12:04:20.837117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3199): Terminating (SIGTERM) 12:04:20.879973 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3202): Terminating (SIGTERM) 12:04:20.923254 --- ParallelTerminationStrategy: PID 3196 died... 12:04:20.943602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3196): Terminated: ok {rc=0} 12:04:20.991349 --- ParallelTerminationStrategy: PID 3199 died... 12:04:21.011286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3199): Terminated: ok {rc=0} 12:04:21.058587 --- ParallelTerminationStrategy: PID 3202 died... 12:04:21.078485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3202): Terminated: ok {rc=0} 12:04:21.167279 bus /sierra_3: Setting Powered False 12:04:22.266925 bus /sierra_3: Setting Powered False 12:04:23.384380 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:04:24.634573 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:04:24.643027 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:04:24.678189 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:04:24.706275 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:04:24.759673 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:04:24.794432 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:04:24.821962 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:04:25.372540 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:04:25.425394 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:04:25.436829 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:04:25.507976 tst mo_mt_call.py: using LAC 21337 12:04:25.635844 tst mo_mt_call.py: using RAC 172 12:04:25.765581 tst mo_mt_call.py: using CellId 21337 12:04:25.886746 tst mo_mt_call.py: using BVCI 21338 12:04:25.998978 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:04:26.010435 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:04:26.021536 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:04:26.033097 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:04:26.044544 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:04:26.056037 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:04:26.177752 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:04:26.301441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:04:26.808899 run create_hlr_db(pid=3208): Launched 12:04:26.935725 bus /sierra_2: Setting Powered False 12:04:28.000101 run create_hlr_db(pid=3208): Terminated: ok {rc=0} 12:04:28.440490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3210): Launched 12:04:28.750763 run osmo-hlr_10.42.42.2(pid=3211): Launched 12:04:28.868089 run osmo-stp_10.42.42.5: Starting osmo-stp 12:04:29.411765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3213): Launched 12:04:29.718571 run osmo-stp_10.42.42.5(pid=3214): Launched 12:04:29.837244 run osmo-msc_10.42.42.6: Starting osmo-msc 12:04:30.390776 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3216): Launched 12:04:30.697748 run osmo-msc_10.42.42.6(pid=3217): Launched 12:04:30.893888 run osmo-stp_10.42.42.5(pid=3214): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3214)] 12:04:31.157855 run osmo-stp_10.42.42.5(pid=3214): stdout: | (launched: 2022-12-09_12:04:29.662009) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:31.377507 run osmo-stp_10.42.42.5(pid=3214): stderr: | 20221209120429829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120429829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120429829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120429830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120429830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120429830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120429830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:31.556210 run osmo-stp_10.42.42.5(pid=3214): stdout: | (launched: 2022-12-09_12:04:29.662009) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:31.685685 run osmo-stp_10.42.42.5(pid=3214): stderr: | 20221209120429829 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120429829 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120429829 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120429830 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120429830 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120429830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120429830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:31.832808 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3214): Process ended prematurely: osmo-stp_10.42.42.5(pid=3214) [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3214)] [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:04:31.843118 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 12:04:31.871371 run osmo-hlr_10.42.42.2(pid=3211): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3211)] 12:04:31.922112 run osmo-hlr_10.42.42.2(pid=3211): stdout: | (launched: 2022-12-09_12:04:28.694006) 12:04:31.973500 run osmo-hlr_10.42.42.2(pid=3211): stderr: | 20221209120428868 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120428868 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120428868 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120428868 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120428868 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120428869 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120428881 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120428889 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120428889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120428889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:04:32.044092 run osmo-msc_10.42.42.6(pid=3217): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3217)] 12:04:32.094224 run osmo-msc_10.42.42.6(pid=3217): stdout: | (launched: 2022-12-09_12:04:30.640920) 12:04:32.145156 run osmo-msc_10.42.42.6(pid=3217): stderr: | 20221209120430996 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209120430996 DLGLOBAL DEBUG validating counter group 0x7f4e61badc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209120430996 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209120430996 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209120430996 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209120430996 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209120430998 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209120430998 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209120430999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209120430999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:04:32.196347 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3210): Terminating (SIGTERM) 12:04:32.237929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3213): Terminating (SIGTERM) 12:04:32.280425 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3216): Terminating (SIGTERM) 12:04:32.321865 --- ParallelTerminationStrategy: PID 3210 died... 12:04:32.341278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3210): Terminated: ok {rc=0} 12:04:32.386389 --- ParallelTerminationStrategy: PID 3213 died... 12:04:32.405112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3213): Terminated: ok {rc=0} 12:04:32.449277 --- ParallelTerminationStrategy: PID 3216 died... 12:04:32.467938 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3216): Terminated: ok {rc=0} 12:04:32.556858 bus /sierra_3: Setting Powered False 12:04:33.658460 bus /sierra_3: Setting Powered False 12:04:34.775593 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:04:35.927160 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:04:35.939486 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:04:36.011904 tst mo_mt_call_osmux.py: using LAC 21338 12:04:36.142296 tst mo_mt_call_osmux.py: using RAC 173 12:04:36.270999 tst mo_mt_call_osmux.py: using CellId 21338 12:04:36.397194 tst mo_mt_call_osmux.py: using BVCI 21339 12:04:36.508317 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:04:36.519575 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:04:36.530600 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:04:36.541616 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:04:36.552671 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:04:36.563565 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:04:36.679945 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:04:36.800813 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:04:37.276847 run create_hlr_db(pid=3219): Launched 12:04:37.401420 bus /sierra_2: Setting Powered False 12:04:38.462742 run create_hlr_db(pid=3219): Terminated: ok {rc=0} 12:04:38.890316 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3221): Launched 12:04:39.197476 run osmo-hlr_10.42.42.2(pid=3222): Launched 12:04:39.314865 run osmo-stp_10.42.42.5: Starting osmo-stp 12:04:39.859255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3224): Launched 12:04:40.167413 run osmo-stp_10.42.42.5(pid=3225): Launched 12:04:40.283942 run osmo-msc_10.42.42.6: Starting osmo-msc 12:04:40.836257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3227): Launched 12:04:41.142352 run osmo-msc_10.42.42.6(pid=3228): Launched 12:04:41.312656 run osmo-stp_10.42.42.5(pid=3225): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3225)] 12:04:41.442070 run osmo-stp_10.42.42.5(pid=3225): stdout: | (launched: 2022-12-09_12:04:40.109502) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:41.570063 run osmo-stp_10.42.42.5(pid=3225): stderr: | 20221209120440279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120440279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120440279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120440280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120440280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120440280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120440281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:41.697188 run osmo-stp_10.42.42.5(pid=3225): stdout: | (launched: 2022-12-09_12:04:40.109502) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:41.817839 run osmo-stp_10.42.42.5(pid=3225): stderr: | 20221209120440279 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120440279 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120440279 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120440280 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120440280 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120440280 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120440281 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:41.962735 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3225): Process ended prematurely: osmo-stp_10.42.42.5(pid=3225) [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3225)] [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:04:41.971595 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:04:41.998227 run osmo-hlr_10.42.42.2(pid=3222): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3222)] 12:04:42.045937 run osmo-hlr_10.42.42.2(pid=3222): stdout: | (launched: 2022-12-09_12:04:39.140636) 12:04:42.095595 run osmo-hlr_10.42.42.2(pid=3222): stderr: | 20221209120439316 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120439316 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120439316 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120439316 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120439316 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120439316 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120439328 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120439339 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120439339 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120439339 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:04:42.165135 run osmo-msc_10.42.42.6(pid=3228): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3228)] 12:04:42.213180 run osmo-msc_10.42.42.6(pid=3228): stdout: | (launched: 2022-12-09_12:04:41.085874) 12:04:42.262514 run osmo-msc_10.42.42.6(pid=3228): stderr: | 20221209120441355 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209120441355 DLGLOBAL DEBUG validating counter group 0x7f88e8909c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209120441356 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209120441356 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209120441356 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209120441356 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209120441358 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209120441358 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209120441358 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209120441358 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:04:42.312056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3221): Terminating (SIGTERM) 12:04:42.351736 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3224): Terminating (SIGTERM) 12:04:42.391620 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3227): Terminating (SIGTERM) 12:04:42.431726 --- ParallelTerminationStrategy: PID 3221 died... 12:04:42.450969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3221): Terminated: ok {rc=0} 12:04:42.495275 --- ParallelTerminationStrategy: PID 3224 died... 12:04:42.514121 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3224): Terminated: ok {rc=0} 12:04:42.558087 --- ParallelTerminationStrategy: PID 3227 died... 12:04:42.576807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3227): Terminated: ok {rc=0} 12:04:42.660900 bus /sierra_3: Setting Powered False 12:04:43.758663 bus /sierra_3: Setting Powered False 12:04:44.874786 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 12:04:46.126167 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:04:46.132900 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 12:04:46.166910 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 12:04:46.195280 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 12:04:46.248677 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 12:04:46.296018 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 12:04:46.335385 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 12:04:46.868781 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 12:04:46.921701 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:04:46.933863 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:04:47.005514 tst mo_mt_call.py: using LAC 21339 12:04:47.128094 tst mo_mt_call.py: using RAC 174 12:04:47.257390 tst mo_mt_call.py: using CellId 21339 12:04:47.388421 tst mo_mt_call.py: using BVCI 21340 12:04:47.507523 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:04:47.519108 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:04:47.530751 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:04:47.542408 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:04:47.554234 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:04:47.565989 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:04:47.685506 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:04:47.804347 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:04:48.279136 run create_hlr_db(pid=3233): Launched 12:04:48.406120 bus /sierra_2: Setting Powered False 12:04:49.467117 run create_hlr_db(pid=3233): Terminated: ok {rc=0} 12:04:49.894817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3235): Launched 12:04:50.201949 run osmo-hlr_10.42.42.2(pid=3236): Launched 12:04:50.318947 run osmo-stp_10.42.42.5: Starting osmo-stp 12:04:50.857823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3238): Launched 12:04:51.164642 run osmo-stp_10.42.42.5(pid=3239): Launched 12:04:51.281091 run osmo-msc_10.42.42.6: Starting osmo-msc 12:04:51.835886 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3241): Launched 12:04:52.142692 run osmo-msc_10.42.42.6(pid=3242): Launched 12:04:52.313876 run osmo-stp_10.42.42.5(pid=3239): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3239)] 12:04:52.442730 run osmo-stp_10.42.42.5(pid=3239): stdout: | (launched: 2022-12-09_12:04:51.107787) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:52.571555 run osmo-stp_10.42.42.5(pid=3239): stderr: | 20221209120451277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120451277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120451277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120451278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120451278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120451278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120451278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:52.699127 run osmo-stp_10.42.42.5(pid=3239): stdout: | (launched: 2022-12-09_12:04:51.107787) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:04:52.820552 run osmo-stp_10.42.42.5(pid=3239): stderr: | 20221209120451277 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120451277 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120451277 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120451278 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120451278 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120451278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120451278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:04:52.966231 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3239): Process ended prematurely: osmo-stp_10.42.42.5(pid=3239) [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3239)] [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 12:04:52.975341 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:04:53.002266 run osmo-hlr_10.42.42.2(pid=3236): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3236)] 12:04:53.050621 run osmo-hlr_10.42.42.2(pid=3236): stdout: | (launched: 2022-12-09_12:04:50.144382) 12:04:53.100683 run osmo-hlr_10.42.42.2(pid=3236): stderr: | 20221209120450321 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120450321 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120450321 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120450321 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120450321 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120450321 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120450333 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120450343 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120450343 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120450343 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:04:53.170489 run osmo-msc_10.42.42.6(pid=3242): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3242)] 12:04:53.218490 run osmo-msc_10.42.42.6(pid=3242): stdout: | (launched: 2022-12-09_12:04:52.085887) 12:04:53.268539 run osmo-msc_10.42.42.6(pid=3242): stderr: | 20221209120452356 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209120452356 DLGLOBAL DEBUG validating counter group 0x7fb322c88c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209120452356 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209120452357 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209120452357 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209120452357 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209120452359 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209120452359 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209120452359 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209120452359 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:04:53.318987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3235): Terminating (SIGTERM) 12:04:53.359149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3238): Terminating (SIGTERM) 12:04:53.399311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3241): Terminating (SIGTERM) 12:04:53.439728 --- ParallelTerminationStrategy: PID 3235 died... 12:04:53.459090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3235): Terminated: ok {rc=0} 12:04:53.504125 --- ParallelTerminationStrategy: PID 3238 died... 12:04:53.523069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3238): Terminated: ok {rc=0} 12:04:53.567672 --- ParallelTerminationStrategy: PID 3241 died... 12:04:53.586505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3241): Terminated: ok {rc=0} 12:04:53.673806 bus /sierra_3: Setting Powered False 12:04:54.775447 bus /sierra_3: Setting Powered False 12:04:55.891463 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 12:04:57.042505 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:04:57.055052 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:04:57.126978 tst mo_mt_call_osmux.py: using LAC 21340 12:04:57.254252 tst mo_mt_call_osmux.py: using RAC 175 12:04:57.384505 tst mo_mt_call_osmux.py: using CellId 21340 12:04:57.514144 tst mo_mt_call_osmux.py: using BVCI 21341 12:04:57.625403 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:04:57.636706 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:04:57.647884 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:04:57.659438 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:04:57.670923 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:04:57.682313 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:04:57.802063 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:04:57.922965 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:04:58.431294 run create_hlr_db(pid=3244): Launched 12:04:58.557833 bus /sierra_2: Setting Powered False 12:04:59.622485 run create_hlr_db(pid=3244): Terminated: ok {rc=0} 12:05:00.061319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3246): Launched 12:05:00.370056 run osmo-hlr_10.42.42.2(pid=3247): Launched 12:05:00.486734 run osmo-stp_10.42.42.5: Starting osmo-stp 12:05:01.067550 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3252): Launched 12:05:01.422417 run osmo-stp_10.42.42.5(pid=3253): Launched 12:05:01.716718 run osmo-msc_10.42.42.6: Starting osmo-msc 12:05:02.512312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3255): Launched 12:05:02.843653 run osmo-msc_10.42.42.6(pid=3256): Launched 12:05:03.027304 run osmo-stp_10.42.42.5(pid=3253): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3253)] 12:05:03.164318 run osmo-stp_10.42.42.5(pid=3253): stdout: | (launched: 2022-12-09_12:05:01.359613) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:03.301971 run osmo-stp_10.42.42.5(pid=3253): stderr: | 20221209120501704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120501704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120501704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120501704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120501707 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120501708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120501708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:03.439145 run osmo-stp_10.42.42.5(pid=3253): stdout: | (launched: 2022-12-09_12:05:01.359613) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:03.569288 run osmo-stp_10.42.42.5(pid=3253): stderr: | 20221209120501704 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120501704 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120501704 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120501704 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120501707 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120501708 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120501708 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:03.724841 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3253): Process ended prematurely: osmo-stp_10.42.42.5(pid=3253) [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3253)] [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 12:05:03.734598 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 12:05:03.763288 run osmo-hlr_10.42.42.2(pid=3247): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3247)] 12:05:03.814124 run osmo-hlr_10.42.42.2(pid=3247): stdout: | (launched: 2022-12-09_12:05:00.312931) 12:05:03.866723 run osmo-hlr_10.42.42.2(pid=3247): stderr: | 20221209120500487 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120500487 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120500487 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120500487 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120500487 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120500487 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120500500 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120500508 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120500508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120500508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:05:03.939578 run osmo-msc_10.42.42.6(pid=3256): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3256)] 12:05:03.990252 run osmo-msc_10.42.42.6(pid=3256): stdout: | (launched: 2022-12-09_12:05:02.782975) 12:05:04.042473 run osmo-msc_10.42.42.6(pid=3256): stderr: | 20221209120503105 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209120503105 DLGLOBAL DEBUG validating counter group 0x7f0a2d722c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209120503105 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209120503105 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209120503105 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209120503106 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209120503107 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209120503108 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209120503108 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209120503108 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:05:04.095152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3246): Terminating (SIGTERM) 12:05:04.137794 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3252): Terminating (SIGTERM) 12:05:04.180313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3255): Terminating (SIGTERM) 12:05:04.222922 --- ParallelTerminationStrategy: PID 3246 died... 12:05:04.242933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3246): Terminated: ok {rc=0} 12:05:04.289923 --- ParallelTerminationStrategy: PID 3252 died... 12:05:04.309471 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3252): Terminated: ok {rc=0} 12:05:04.356347 --- ParallelTerminationStrategy: PID 3255 died... 12:05:04.376096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3255): Terminated: ok {rc=0} 12:05:04.465322 bus /sierra_3: Setting Powered False 12:05:05.565295 bus /sierra_3: Setting Powered False 12:05:06.679467 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:05:07.940615 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:05:07.947692 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:05:07.983874 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:05:08.011525 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:05:08.065110 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:05:08.099481 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:05:08.127425 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:05:08.678656 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:05:08.731969 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:05:08.743451 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:05:08.815928 tst mo_mt_call.py: using LAC 21341 12:05:08.945356 tst mo_mt_call.py: using RAC 176 12:05:09.075932 tst mo_mt_call.py: using CellId 21341 12:05:09.204489 tst mo_mt_call.py: using BVCI 21342 12:05:09.323329 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:05:09.334863 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:05:09.346278 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:05:09.357848 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:05:09.369749 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:05:09.381532 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:05:09.501338 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:05:09.620617 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:05:10.095685 run create_hlr_db(pid=3262): Launched 12:05:10.221260 bus /sierra_2: Setting Powered False 12:05:11.282283 run create_hlr_db(pid=3262): Terminated: ok {rc=0} 12:05:11.709670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3264): Launched 12:05:12.018467 run osmo-hlr_10.42.42.2(pid=3265): Launched 12:05:12.137809 run osmo-stp_10.42.42.5: Starting osmo-stp 12:05:12.663814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3267): Launched 12:05:12.971160 run osmo-stp_10.42.42.5(pid=3268): Launched 12:05:13.089926 run osmo-msc_10.42.42.6: Starting osmo-msc 12:05:13.641635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3270): Launched 12:05:13.950741 run osmo-msc_10.42.42.6(pid=3271): Launched 12:05:14.123958 run osmo-stp_10.42.42.5(pid=3268): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3268)] 12:05:14.252568 run osmo-stp_10.42.42.5(pid=3268): stdout: | (launched: 2022-12-09_12:05:12.914232) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:14.381336 run osmo-stp_10.42.42.5(pid=3268): stderr: | 20221209120513084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120513084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120513084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120513085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120513085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120513085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120513085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:14.509535 run osmo-stp_10.42.42.5(pid=3268): stdout: | (launched: 2022-12-09_12:05:12.914232) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:14.631066 run osmo-stp_10.42.42.5(pid=3268): stderr: | 20221209120513084 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120513084 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120513084 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120513085 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120513085 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120513085 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120513085 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:14.776150 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3268): Process ended prematurely: osmo-stp_10.42.42.5(pid=3268) [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3268)] [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:05:14.785278 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:05:14.812198 run osmo-hlr_10.42.42.2(pid=3265): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3265)] 12:05:14.860602 run osmo-hlr_10.42.42.2(pid=3265): stdout: | (launched: 2022-12-09_12:05:11.961318) 12:05:14.910583 run osmo-hlr_10.42.42.2(pid=3265): stderr: | 20221209120512136 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120512136 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120512136 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120512136 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120512136 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120512136 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120512147 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120512155 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120512155 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120512155 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:05:14.980033 run osmo-msc_10.42.42.6(pid=3271): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3271)] 12:05:15.027934 run osmo-msc_10.42.42.6(pid=3271): stdout: | (launched: 2022-12-09_12:05:13.893676) 12:05:15.077319 run osmo-msc_10.42.42.6(pid=3271): stderr: | 20221209120514163 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209120514163 DLGLOBAL DEBUG validating counter group 0x7fd86193ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209120514163 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209120514164 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209120514164 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209120514164 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209120514166 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209120514166 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209120514166 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209120514166 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:05:15.127432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3264): Terminating (SIGTERM) 12:05:15.167208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3267): Terminating (SIGTERM) 12:05:15.207180 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3270): Terminating (SIGTERM) 12:05:15.247400 --- ParallelTerminationStrategy: PID 3264 died... 12:05:15.266423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3264): Terminated: ok {rc=0} 12:05:15.310574 --- ParallelTerminationStrategy: PID 3267 died... 12:05:15.329115 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3267): Terminated: ok {rc=0} 12:05:15.373208 --- ParallelTerminationStrategy: PID 3270 died... 12:05:15.391916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3270): Terminated: ok {rc=0} 12:05:15.478979 bus /sierra_3: Setting Powered False 12:05:16.580842 bus /sierra_3: Setting Powered False 12:05:17.705743 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:05:18.856159 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:05:18.868715 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:05:18.942276 tst mo_mt_call_osmux.py: using LAC 21342 12:05:19.075147 tst mo_mt_call_osmux.py: using RAC 177 12:05:19.204304 tst mo_mt_call_osmux.py: using CellId 21342 12:05:19.327039 tst mo_mt_call_osmux.py: using BVCI 21343 12:05:19.448238 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:05:19.459907 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:05:19.471351 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:05:19.483187 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:05:19.495114 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:05:19.506889 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:05:19.626017 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:05:19.748591 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:05:20.255872 run create_hlr_db(pid=3273): Launched 12:05:20.380120 bus /sierra_2: Setting Powered False 12:05:21.444893 run create_hlr_db(pid=3273): Terminated: ok {rc=0} 12:05:21.883461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3275): Launched 12:05:22.191687 run osmo-hlr_10.42.42.2(pid=3276): Launched 12:05:22.307869 run osmo-stp_10.42.42.5: Starting osmo-stp 12:05:22.846760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3278): Launched 12:05:23.155091 run osmo-stp_10.42.42.5(pid=3279): Launched 12:05:23.271501 run osmo-msc_10.42.42.6: Starting osmo-msc 12:05:23.824753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3281): Launched 12:05:24.131243 run osmo-msc_10.42.42.6(pid=3282): Launched 12:05:24.302226 run osmo-stp_10.42.42.5(pid=3279): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3279)] 12:05:24.432171 run osmo-stp_10.42.42.5(pid=3279): stdout: | (launched: 2022-12-09_12:05:23.098072) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:24.562074 run osmo-stp_10.42.42.5(pid=3279): stderr: | 20221209120523266 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120523267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120523267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120523267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120523269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120523269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120523269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:24.689775 run osmo-stp_10.42.42.5(pid=3279): stdout: | (launched: 2022-12-09_12:05:23.098072) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:24.811570 run osmo-stp_10.42.42.5(pid=3279): stderr: | 20221209120523266 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120523267 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120523267 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120523267 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120523269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120523269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120523269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:24.957168 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3279): Process ended prematurely: osmo-stp_10.42.42.5(pid=3279) [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3279)] [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:05:24.966152 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:05:24.993169 run osmo-hlr_10.42.42.2(pid=3276): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3276)] 12:05:25.041461 run osmo-hlr_10.42.42.2(pid=3276): stdout: | (launched: 2022-12-09_12:05:22.134381) 12:05:25.091383 run osmo-hlr_10.42.42.2(pid=3276): stderr: | 20221209120522310 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120522310 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120522310 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120522310 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120522310 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120522310 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120522322 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120522331 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120522331 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120522331 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:05:25.160635 run osmo-msc_10.42.42.6(pid=3282): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3282)] 12:05:25.208502 run osmo-msc_10.42.42.6(pid=3282): stdout: | (launched: 2022-12-09_12:05:24.074409) 12:05:25.257811 run osmo-msc_10.42.42.6(pid=3282): stderr: | 20221209120524346 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209120524346 DLGLOBAL DEBUG validating counter group 0x7faf071adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209120524346 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209120524346 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209120524346 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209120524347 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209120524348 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209120524349 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209120524349 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209120524349 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:05:25.307599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3275): Terminating (SIGTERM) 12:05:25.347256 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3278): Terminating (SIGTERM) 12:05:25.387161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3281): Terminating (SIGTERM) 12:05:25.427264 --- ParallelTerminationStrategy: PID 3275 died... 12:05:25.446412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3275): Terminated: ok {rc=0} 12:05:25.490747 --- ParallelTerminationStrategy: PID 3278 died... 12:05:25.509586 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3278): Terminated: ok {rc=0} 12:05:25.553764 --- ParallelTerminationStrategy: PID 3281 died... 12:05:25.572455 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3281): Terminated: ok {rc=0} 12:05:25.658866 bus /sierra_3: Setting Powered False 12:05:26.759126 bus /sierra_3: Setting Powered False 12:05:27.871844 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:05:29.117361 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:05:29.123888 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:05:29.157298 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:05:29.183861 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:05:29.236138 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:05:29.269325 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:05:29.295870 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:05:29.846819 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:05:29.896043 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:05:29.907443 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:05:29.977356 tst mo_mt_call.py: using LAC 21343 12:05:30.098412 tst mo_mt_call.py: using RAC 178 12:05:30.219448 tst mo_mt_call.py: using CellId 21343 12:05:30.340935 tst mo_mt_call.py: using BVCI 21344 12:05:30.450982 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:05:30.462255 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:05:30.473319 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:05:30.484362 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:05:30.495585 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:05:30.506836 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:05:30.625933 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:05:30.744728 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:05:31.239483 run create_hlr_db(pid=3287): Launched 12:05:31.401547 bus /sierra_2: Setting Powered False 12:05:32.466658 run create_hlr_db(pid=3287): Terminated: ok {rc=0} 12:05:32.908092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3289): Launched 12:05:33.216707 run osmo-hlr_10.42.42.2(pid=3290): Launched 12:05:33.333062 run osmo-stp_10.42.42.5: Starting osmo-stp 12:05:33.860454 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3292): Launched 12:05:34.167831 run osmo-stp_10.42.42.5(pid=3293): Launched 12:05:34.283952 run osmo-msc_10.42.42.6: Starting osmo-msc 12:05:34.839698 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3295): Launched 12:05:35.147728 run osmo-msc_10.42.42.6(pid=3296): Launched 12:05:35.319485 run osmo-stp_10.42.42.5(pid=3293): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3293)] 12:05:35.448549 run osmo-stp_10.42.42.5(pid=3293): stdout: | (launched: 2022-12-09_12:05:34.110987) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:35.578059 run osmo-stp_10.42.42.5(pid=3293): stderr: | 20221209120534280 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120534280 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120534281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120534281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120534282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120534282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120534282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:35.705577 run osmo-stp_10.42.42.5(pid=3293): stdout: | (launched: 2022-12-09_12:05:34.110987) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:35.827346 run osmo-stp_10.42.42.5(pid=3293): stderr: | 20221209120534280 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120534280 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120534281 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120534281 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120534282 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120534282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120534282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:35.973149 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3293): Process ended prematurely: osmo-stp_10.42.42.5(pid=3293) [trial-2359↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3293)] [trial-2359↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:05:35.982009 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:05:36.008769 run osmo-hlr_10.42.42.2(pid=3290): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3290)] 12:05:36.057230 run osmo-hlr_10.42.42.2(pid=3290): stdout: | (launched: 2022-12-09_12:05:33.159965) 12:05:36.107430 run osmo-hlr_10.42.42.2(pid=3290): stderr: | 20221209120533334 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120533334 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120533334 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120533334 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120533334 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120533334 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120533346 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120533355 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120533355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120533355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:05:36.177655 run osmo-msc_10.42.42.6(pid=3296): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3296)] 12:05:36.225618 run osmo-msc_10.42.42.6(pid=3296): stdout: | (launched: 2022-12-09_12:05:35.090726) 12:05:36.275278 run osmo-msc_10.42.42.6(pid=3296): stderr: | 20221209120535359 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209120535359 DLGLOBAL DEBUG validating counter group 0x7f1576a02c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209120535359 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209120535360 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209120535360 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209120535360 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209120535362 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209120535362 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209120535362 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209120535363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:05:36.325439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3289): Terminating (SIGTERM) 12:05:36.365161 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3292): Terminating (SIGTERM) 12:05:36.404899 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3295): Terminating (SIGTERM) 12:05:36.444892 --- ParallelTerminationStrategy: PID 3289 died... 12:05:36.464183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3289): Terminated: ok {rc=0} 12:05:36.509085 --- ParallelTerminationStrategy: PID 3292 died... 12:05:36.527630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3292): Terminated: ok {rc=0} 12:05:36.571862 --- ParallelTerminationStrategy: PID 3295 died... 12:05:36.590925 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3295): Terminated: ok {rc=0} 12:05:36.678216 bus /sierra_3: Setting Powered False 12:05:37.781250 bus /sierra_3: Setting Powered False 12:05:38.900215 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:05:40.050197 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:05:40.062892 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:05:40.136368 tst mo_mt_call_osmux.py: using LAC 21344 12:05:40.258206 tst mo_mt_call_osmux.py: using RAC 179 12:05:40.380612 tst mo_mt_call_osmux.py: using CellId 21344 12:05:40.503379 tst mo_mt_call_osmux.py: using BVCI 21345 12:05:40.615090 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:05:40.626934 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:05:40.638274 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:05:40.649333 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:05:40.660437 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:05:40.671559 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:05:40.791118 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:05:40.910099 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:05:41.386032 run create_hlr_db(pid=3298): Launched 12:05:41.513389 bus /sierra_2: Setting Powered False 12:05:42.574890 run create_hlr_db(pid=3298): Terminated: ok {rc=0} 12:05:43.004491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3300): Launched 12:05:43.312288 run osmo-hlr_10.42.42.2(pid=3301): Launched 12:05:43.428682 run osmo-stp_10.42.42.5: Starting osmo-stp 12:05:43.956070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3303): Launched 12:05:44.263179 run osmo-stp_10.42.42.5(pid=3304): Launched 12:05:44.380140 run osmo-msc_10.42.42.6: Starting osmo-msc 12:05:44.941273 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3306): Launched 12:05:45.250044 run osmo-msc_10.42.42.6(pid=3307): Launched 12:05:45.424179 run osmo-stp_10.42.42.5(pid=3304): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3304)] 12:05:45.554486 run osmo-stp_10.42.42.5(pid=3304): stdout: | (launched: 2022-12-09_12:05:44.206568) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:45.684368 run osmo-stp_10.42.42.5(pid=3304): stderr: | 20221209120544376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120544377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120544377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120544377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120544378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120544378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120544378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:45.813295 run osmo-stp_10.42.42.5(pid=3304): stdout: | (launched: 2022-12-09_12:05:44.206568) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:45.944097 run osmo-stp_10.42.42.5(pid=3304): stderr: | 20221209120544376 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120544377 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120544377 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120544377 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120544378 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120544378 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120544378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:46.093566 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3304): Process ended prematurely: osmo-stp_10.42.42.5(pid=3304) [trial-2359↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3304)] [trial-2359↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:05:46.103390 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:05:46.132161 run osmo-hlr_10.42.42.2(pid=3301): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3301)] 12:05:46.182041 run osmo-hlr_10.42.42.2(pid=3301): stdout: | (launched: 2022-12-09_12:05:43.254929) 12:05:46.233315 run osmo-hlr_10.42.42.2(pid=3301): stderr: | 20221209120543427 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120543427 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120543427 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120543427 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120543427 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120543427 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120543440 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120543450 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120543450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120543450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:05:46.304114 run osmo-msc_10.42.42.6(pid=3307): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3307)] 12:05:46.352897 run osmo-msc_10.42.42.6(pid=3307): stdout: | (launched: 2022-12-09_12:05:45.192706) 12:05:46.403457 run osmo-msc_10.42.42.6(pid=3307): stderr: | 20221209120545462 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209120545463 DLGLOBAL DEBUG validating counter group 0x7f4054de6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209120545463 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209120545463 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209120545463 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209120545463 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209120545465 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209120545465 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209120545466 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209120545466 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:05:46.454199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3300): Terminating (SIGTERM) 12:05:46.495166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3303): Terminating (SIGTERM) 12:05:46.537846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3306): Terminating (SIGTERM) 12:05:46.579053 --- ParallelTerminationStrategy: PID 3300 died... 12:05:46.598800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3300): Terminated: ok {rc=0} 12:05:46.643656 --- ParallelTerminationStrategy: PID 3303 died... 12:05:46.663005 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3303): Terminated: ok {rc=0} 12:05:46.708779 --- ParallelTerminationStrategy: PID 3306 died... 12:05:46.728058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3306): Terminated: ok {rc=0} 12:05:46.814497 bus /sierra_3: Setting Powered False 12:05:47.915096 bus /sierra_3: Setting Powered False 12:05:49.030690 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:05:50.286478 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:05:50.292718 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:05:50.328312 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 12:05:50.355822 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 12:05:50.410934 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:05:50.444379 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 12:05:50.470771 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 12:05:51.021828 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 12:05:51.076131 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:05:51.087976 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:05:51.160386 tst mo_mt_call.py: using LAC 21345 12:05:51.290316 tst mo_mt_call.py: using RAC 180 12:05:51.420808 tst mo_mt_call.py: using CellId 21345 12:05:51.555577 tst mo_mt_call.py: using BVCI 21346 12:05:51.677469 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:05:51.688781 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:05:51.699930 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:05:51.711451 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:05:51.723097 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:05:51.734704 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:05:51.852581 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:05:51.969919 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:05:52.445194 run create_hlr_db(pid=3313): Launched 12:05:52.570370 bus /sierra_2: Setting Powered False 12:05:53.631138 run create_hlr_db(pid=3313): Terminated: ok {rc=0} 12:05:54.079566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3315): Launched 12:05:54.410417 run osmo-hlr_10.42.42.2(pid=3316): Launched 12:05:54.535315 run osmo-stp_10.42.42.5: Starting osmo-stp 12:05:55.102250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3318): Launched 12:05:55.430871 run osmo-stp_10.42.42.5(pid=3319): Launched 12:05:55.556701 run osmo-msc_10.42.42.6: Starting osmo-msc 12:05:56.152643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3321): Launched 12:05:56.483451 run osmo-msc_10.42.42.6(pid=3322): Launched 12:05:56.666840 run osmo-stp_10.42.42.5(pid=3319): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3319)] 12:05:56.807374 run osmo-stp_10.42.42.5(pid=3319): stdout: | (launched: 2022-12-09_12:05:55.370286) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:56.946710 run osmo-stp_10.42.42.5(pid=3319): stderr: | 20221209120555560 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120555560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120555560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120555560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120555561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120555561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120555561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:57.083285 run osmo-stp_10.42.42.5(pid=3319): stdout: | (launched: 2022-12-09_12:05:55.370286) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:05:57.213406 run osmo-stp_10.42.42.5(pid=3319): stderr: | 20221209120555560 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120555560 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120555560 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120555560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120555561 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120555561 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120555561 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:05:57.369152 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3319): Process ended prematurely: osmo-stp_10.42.42.5(pid=3319) [trial-2359↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3319)] [trial-2359↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 12:05:57.378865 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:05:57.407632 run osmo-hlr_10.42.42.2(pid=3316): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3316)] 12:05:57.458483 run osmo-hlr_10.42.42.2(pid=3316): stdout: | (launched: 2022-12-09_12:05:54.350317) 12:05:57.511716 run osmo-hlr_10.42.42.2(pid=3316): stderr: | 20221209120554546 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120554546 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120554546 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120554546 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120554546 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120554547 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120554559 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120554568 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120554568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120554568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:05:57.585212 run osmo-msc_10.42.42.6(pid=3322): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3322)] 12:05:57.636214 run osmo-msc_10.42.42.6(pid=3322): stdout: | (launched: 2022-12-09_12:05:56.422823) 12:05:57.689218 run osmo-msc_10.42.42.6(pid=3322): stderr: | 20221209120556742 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209120556742 DLGLOBAL DEBUG validating counter group 0x7fd86f3d4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209120556742 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209120556742 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209120556742 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209120556742 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209120556744 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209120556744 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209120556745 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209120556745 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:05:57.742422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3315): Terminating (SIGTERM) 12:05:57.784739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3318): Terminating (SIGTERM) 12:05:57.827581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3321): Terminating (SIGTERM) 12:05:57.870409 --- ParallelTerminationStrategy: PID 3315 died... 12:05:57.890821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3315): Terminated: ok {rc=0} 12:05:57.938254 --- ParallelTerminationStrategy: PID 3318 died... 12:05:57.958119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3318): Terminated: ok {rc=0} 12:05:58.005227 --- ParallelTerminationStrategy: PID 3321 died... 12:05:58.024818 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3321): Terminated: ok {rc=0} 12:05:58.113365 bus /sierra_3: Setting Powered False 12:05:59.212362 bus /sierra_3: Setting Powered False 12:06:00.328191 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 12:06:01.488477 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:06:01.502166 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:06:01.580047 tst mo_mt_call_osmux.py: using LAC 21346 12:06:01.717287 tst mo_mt_call_osmux.py: using RAC 181 12:06:01.855923 tst mo_mt_call_osmux.py: using CellId 21346 12:06:01.986497 tst mo_mt_call_osmux.py: using BVCI 21347 12:06:02.100299 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:06:02.111538 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:06:02.122706 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:06:02.133787 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:06:02.144609 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:06:02.156249 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:06:02.274506 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:06:02.396125 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:06:02.872249 run create_hlr_db(pid=3324): Launched 12:06:02.997845 bus /sierra_2: Setting Powered False 12:06:04.058945 run create_hlr_db(pid=3324): Terminated: ok {rc=0} 12:06:04.506200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3326): Launched 12:06:04.834668 run osmo-hlr_10.42.42.2(pid=3327): Launched 12:06:04.961817 run osmo-stp_10.42.42.5: Starting osmo-stp 12:06:05.530228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3329): Launched 12:06:05.858789 run osmo-stp_10.42.42.5(pid=3330): Launched 12:06:05.985411 run osmo-msc_10.42.42.6: Starting osmo-msc 12:06:06.576227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3332): Launched 12:06:06.906575 run osmo-msc_10.42.42.6(pid=3333): Launched 12:06:07.090431 run osmo-stp_10.42.42.5(pid=3330): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3330)] 12:06:07.229182 run osmo-stp_10.42.42.5(pid=3330): stdout: | (launched: 2022-12-09_12:06:05.798467) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:07.368314 run osmo-stp_10.42.42.5(pid=3330): stderr: | 20221209120605988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120605988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120605988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120605989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120605989 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120605989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120605989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:07.505517 run osmo-stp_10.42.42.5(pid=3330): stdout: | (launched: 2022-12-09_12:06:05.798467) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:07.636060 run osmo-stp_10.42.42.5(pid=3330): stderr: | 20221209120605988 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120605988 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120605988 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120605989 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120605989 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120605989 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120605989 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:07.792709 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3330): Process ended prematurely: osmo-stp_10.42.42.5(pid=3330) [trial-2359↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3330)] [trial-2359↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 12:06:07.802680 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:06:07.831754 run osmo-hlr_10.42.42.2(pid=3327): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3327)] 12:06:07.883231 run osmo-hlr_10.42.42.2(pid=3327): stdout: | (launched: 2022-12-09_12:06:04.774529) 12:06:07.935705 run osmo-hlr_10.42.42.2(pid=3327): stderr: | 20221209120604970 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120604970 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120604970 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120604970 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120604970 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120604970 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120604983 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120604992 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120604992 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120604992 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:06:08.008802 run osmo-msc_10.42.42.6(pid=3333): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3333)] 12:06:08.059535 run osmo-msc_10.42.42.6(pid=3333): stdout: | (launched: 2022-12-09_12:06:06.846120) 12:06:08.111810 run osmo-msc_10.42.42.6(pid=3333): stderr: | 20221209120607165 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209120607165 DLGLOBAL DEBUG validating counter group 0x7f67fa2cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209120607165 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209120607165 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209120607165 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209120607166 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209120607167 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209120607168 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209120607168 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209120607168 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:06:08.164480 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3326): Terminating (SIGTERM) 12:06:08.207203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3329): Terminating (SIGTERM) 12:06:08.249858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3332): Terminating (SIGTERM) 12:06:08.293119 --- ParallelTerminationStrategy: PID 3326 died... 12:06:08.313693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3326): Terminated: ok {rc=0} 12:06:08.361073 --- ParallelTerminationStrategy: PID 3329 died... 12:06:08.380703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3329): Terminated: ok {rc=0} 12:06:08.428150 --- ParallelTerminationStrategy: PID 3332 died... 12:06:08.448134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3332): Terminated: ok {rc=0} 12:06:08.538496 bus /sierra_3: Setting Powered False 12:06:09.638688 bus /sierra_3: Setting Powered False 12:06:10.758108 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 emergency:trx-lms --------------------------------------------------------------------- 12:06:12.014699 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:06:12.019053 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 12:06:12.052291 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 12:06:12.078747 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 12:06:12.162918 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 12:06:12.195787 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 12:06:12.222220 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 12:06:12.805954 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2359 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 12:06:12.810927 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:06:12.821660 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 12:06:12.870951 tst emergency_mo_mt_call.py: using LAC 21347 12:06:12.991492 tst emergency_mo_mt_call.py: using RAC 182 12:06:13.109429 tst emergency_mo_mt_call.py: using CellId 21347 12:06:13.234406 tst emergency_mo_mt_call.py: using BVCI 21348 12:06:13.351524 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:06:13.363145 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:06:13.374381 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:06:13.385903 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:06:13.397427 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:06:13.408832 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:06:13.528093 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:06:13.654057 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:06:14.120634 run create_hlr_db(pid=3338): Launched 12:06:14.244099 bus /sierra_2: Setting Powered False 12:06:15.305055 run create_hlr_db(pid=3338): Terminated: ok {rc=0} 12:06:15.726422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3340): Launched 12:06:16.044439 run osmo-hlr_10.42.42.2(pid=3341): Launched 12:06:16.168537 run osmo-stp_10.42.42.5: Starting osmo-stp 12:06:16.893826 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3343): Launched 12:06:17.245853 run osmo-stp_10.42.42.5(pid=3344): Launched 12:06:17.435192 tst emergency_mo_mt_call.py: using MSISDN 7197 12:06:17.600607 run osmo-msc_10.42.42.6: Starting osmo-msc 12:06:18.141254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3346): Launched 12:06:18.441716 run osmo-msc_10.42.42.6(pid=3347): Launched 12:06:18.609248 run osmo-stp_10.42.42.5(pid=3344): ERR: Terminated: ERROR {rc=1} [trial-2359↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3344)] 12:06:18.735833 run osmo-stp_10.42.42.5(pid=3344): stdout: | (launched: 2022-12-09_12:06:17.184287) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:18.862499 run osmo-stp_10.42.42.5(pid=3344): stderr: | 20221209120617416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120617416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120617416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120617417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120617418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120617418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120617418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:18.988243 run osmo-stp_10.42.42.5(pid=3344): stdout: | (launched: 2022-12-09_12:06:17.184287) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:19.106941 run osmo-stp_10.42.42.5(pid=3344): stderr: | 20221209120617416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120617416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120617416 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120617417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120617418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120617418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120617418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:19.248857 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=3344): Process ended prematurely: osmo-stp_10.42.42.5(pid=3344) [trial-2359↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3344)] [trial-2359↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 12:06:19.257223 tst emergency_mo_mt_call.py:19: Test FAILED (6.4 sec) 12:06:19.283339 run osmo-hlr_10.42.42.2(pid=3341): ERR: Terminated: ERROR {rc=237} [trial-2359↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3341)] 12:06:19.330931 run osmo-hlr_10.42.42.2(pid=3341): stdout: | (launched: 2022-12-09_12:06:15.986536) 12:06:19.380730 run osmo-hlr_10.42.42.2(pid=3341): stderr: | 20221209120616347 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120616347 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120616347 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120616347 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120616347 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120616347 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120616363 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120616371 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120616372 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120616372 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:06:19.450094 run osmo-msc_10.42.42.6(pid=3347): ERR: Terminated: ERROR {rc=2} [trial-2359↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3347)] 12:06:19.498149 run osmo-msc_10.42.42.6(pid=3347): stdout: | (launched: 2022-12-09_12:06:18.385932) 12:06:19.547690 run osmo-msc_10.42.42.6(pid=3347): stderr: | 20221209120618655 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209120618655 DLGLOBAL DEBUG validating counter group 0x7fde4512cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209120618655 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209120618655 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209120618655 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209120618655 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209120618658 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209120618659 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209120618659 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209120618659 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:06:19.597540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3340): Terminating (SIGTERM) 12:06:19.637314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3343): Terminating (SIGTERM) 12:06:19.677193 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3346): Terminating (SIGTERM) 12:06:19.717420 --- ParallelTerminationStrategy: PID 3340 died... 12:06:19.736657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3340): Terminated: ok {rc=0} 12:06:19.781282 --- ParallelTerminationStrategy: PID 3343 died... 12:06:19.799876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3343): Terminated: ok {rc=0} 12:06:19.844458 --- ParallelTerminationStrategy: PID 3346 died... 12:06:19.863108 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3346): Terminated: ok {rc=0} 12:06:19.947923 bus /sierra_3: Setting Powered False 12:06:21.046779 bus /sierra_3: Setting Powered False 12:06:22.166263 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 12:06:23.254716 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:06:23.266403 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 12:06:23.317637 tst emergency_preemptive_call.py: using LAC 21348 12:06:23.437471 tst emergency_preemptive_call.py: using RAC 183 12:06:23.555281 tst emergency_preemptive_call.py: using CellId 21348 12:06:23.675989 tst emergency_preemptive_call.py: using BVCI 21349 12:06:23.795132 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:06:23.806688 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:06:23.818009 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:06:23.829636 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:06:23.841549 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 12:06:23.853097 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:06:23.971920 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:06:24.088896 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:06:24.210241 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 12:06:24.326515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:06:24.795171 run create_hlr_db(pid=3349): Launched 12:06:24.920757 bus /sierra_2: Setting Powered False 12:06:25.984612 run create_hlr_db(pid=3349): Terminated: ok {rc=0} 12:06:26.418499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3351): Launched 12:06:26.721154 run osmo-hlr_10.42.42.2(pid=3352): Launched 12:06:26.835618 run osmo-stp_10.42.42.5: Starting osmo-stp 12:06:27.354083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3354): Launched 12:06:27.655066 run osmo-stp_10.42.42.5(pid=3355): Launched 12:06:27.779831 tst emergency_preemptive_call.py: using MSISDN 7198 12:06:27.933092 run osmo-msc_10.42.42.6: Starting osmo-msc 12:06:28.477300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3357): Launched 12:06:28.778442 run osmo-msc_10.42.42.6(pid=3358): Launched 12:06:28.948106 run osmo-stp_10.42.42.5(pid=3355): ERR: Terminated: ERROR {rc=1} [trial-2359↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3355)] 12:06:29.075483 run osmo-stp_10.42.42.5(pid=3355): stdout: | (launched: 2022-12-09_12:06:27.598730) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:29.202220 run osmo-stp_10.42.42.5(pid=3355): stderr: | 20221209120627767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120627767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120627767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120627767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120627768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120627768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120627768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:29.327230 run osmo-stp_10.42.42.5(pid=3355): stdout: | (launched: 2022-12-09_12:06:27.598730) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:29.446672 run osmo-stp_10.42.42.5(pid=3355): stderr: | 20221209120627767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120627767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120627767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120627767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120627768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120627768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120627768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:29.589460 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=3355): Process ended prematurely: osmo-stp_10.42.42.5(pid=3355) [trial-2359↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3355)] [trial-2359↪emergency:trx-lms↪emergency_preemptive_call.py:32] 12:06:29.597850 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 12:06:29.624251 run osmo-hlr_10.42.42.2(pid=3352): ERR: Terminated: ERROR {rc=237} [trial-2359↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3352)] 12:06:29.672559 run osmo-hlr_10.42.42.2(pid=3352): stdout: | (launched: 2022-12-09_12:06:26.665237) 12:06:29.722344 run osmo-hlr_10.42.42.2(pid=3352): stderr: | 20221209120626839 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120626839 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120626839 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120626839 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120626839 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120626839 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120626851 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120626860 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120626860 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120626860 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:06:29.791963 run osmo-msc_10.42.42.6(pid=3358): ERR: Terminated: ERROR {rc=2} [trial-2359↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3358)] 12:06:29.840150 run osmo-msc_10.42.42.6(pid=3358): stdout: | (launched: 2022-12-09_12:06:28.722629) 12:06:29.890083 run osmo-msc_10.42.42.6(pid=3358): stderr: | 20221209120628991 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209120628992 DLGLOBAL DEBUG validating counter group 0x7f0702581c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209120628992 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209120628992 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209120628992 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209120628992 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209120628994 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209120628994 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209120628995 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209120628995 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:06:29.940612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3351): Terminating (SIGTERM) 12:06:29.980682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3354): Terminating (SIGTERM) 12:06:30.020515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3357): Terminating (SIGTERM) 12:06:30.060602 --- ParallelTerminationStrategy: PID 3351 died... 12:06:30.079897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3351): Terminated: ok {rc=0} 12:06:30.124659 --- ParallelTerminationStrategy: PID 3354 died... 12:06:30.143793 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3354): Terminated: ok {rc=0} 12:06:30.188059 --- ParallelTerminationStrategy: PID 3357 died... 12:06:30.206963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3357): Terminated: ok {rc=0} 12:06:30.290567 bus /sierra_9: Setting Powered False 12:06:31.405336 bus /sierra_9: Setting Powered False 12:06:32.531627 bus /sierra_8: Setting Powered False 12:06:33.627279 bus /sierra_8: Setting Powered False 12:06:34.743453 bus /sierra_3: Setting Powered False 12:06:35.846490 bus /sierra_3: Setting Powered False 12:06:36.965762 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-lms --------------------------------------------------------------------- 12:06:38.248307 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:06:38.253111 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 12:06:38.288123 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 12:06:38.328111 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 12:06:38.417882 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 12:06:38.452149 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 12:06:38.491978 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 12:06:39.082896 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 12:06:39.137108 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:06:39.148253 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 12:06:39.200804 tst cs_paging_gprs_active.py: using LAC 21349 12:06:39.329358 tst cs_paging_gprs_active.py: using RAC 184 12:06:39.456501 tst cs_paging_gprs_active.py: using CellId 21349 12:06:39.583685 tst cs_paging_gprs_active.py: using BVCI 21350 12:06:39.703600 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:06:39.714775 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:06:39.725722 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:06:39.736728 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:06:39.747888 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:06:39.758984 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:06:39.770275 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:06:39.781462 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:06:39.792360 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:06:39.911830 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:06:40.033511 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:06:40.256009 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:40.587300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3363): Launched 12:06:40.878309 run iperf3-srv_10.42.42.10(pid=3364): Launched 12:06:41.003073 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:06:41.225128 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:41.555931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3365): Launched 12:06:41.842578 run iperf3-srv_10.42.42.10(pid=3366): Launched 12:06:41.968853 tst cs_paging_gprs_active.py:38: start network... 12:06:42.190902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:06:42.701841 run create_hlr_db(pid=3367): Launched 12:06:42.829617 bus /sierra_2: Setting Powered False 12:06:43.894366 run create_hlr_db(pid=3367): Terminated: ok {rc=0} 12:06:44.334015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3369): Launched 12:06:44.642786 run osmo-hlr_10.42.42.2(pid=3370): Launched 12:06:44.760680 run osmo-stp_10.42.42.5: Starting osmo-stp 12:06:45.291735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3372): Launched 12:06:45.600588 run osmo-stp_10.42.42.5(pid=3373): Launched 12:06:45.719279 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:06:46.304741 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3375): Launched 12:06:46.444598 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:06:46.733483 run patchelf(pid=3376): Launched 12:06:46.925371 run osmo-stp_10.42.42.5(pid=3373): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3373)] 12:06:47.058604 run osmo-stp_10.42.42.5(pid=3373): stdout: | (launched: 2022-12-09_12:06:45.543422) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:47.192741 run osmo-stp_10.42.42.5(pid=3373): stderr: | 20221209120645714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120645714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120645714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120645714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120645715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120645715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120645715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:47.324259 run osmo-stp_10.42.42.5(pid=3373): stdout: | (launched: 2022-12-09_12:06:45.543422) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:47.451029 run osmo-stp_10.42.42.5(pid=3373): stderr: | 20221209120645714 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120645714 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120645714 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120645714 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120645715 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120645715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120645715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:47.600336 run patchelf(pid=3376): Terminating (SIGINT) 12:06:47.775686 run patchelf(pid=3376): Terminated: ok {rc=0} 12:06:47.901699 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3373): Process ended prematurely: osmo-stp_10.42.42.5(pid=3373) [trial-2359↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3373)] [trial-2359↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 12:06:47.911362 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 12:06:47.939141 run osmo-hlr_10.42.42.2(pid=3370): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3370)] 12:06:47.987697 run osmo-hlr_10.42.42.2(pid=3370): stdout: | (launched: 2022-12-09_12:06:44.585849) 12:06:48.037917 run osmo-hlr_10.42.42.2(pid=3370): stderr: | 20221209120644761 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120644761 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120644761 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120644761 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120644761 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120644761 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120644777 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120644786 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120644786 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120644786 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:06:48.088578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3363): Terminating (SIGTERM) 12:06:48.129073 run iperf3-srv_10.42.42.10(pid=3364): Terminating (SIGTERM) 12:06:48.169348 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3365): Terminating (SIGTERM) 12:06:48.209688 run iperf3-srv_10.42.42.10(pid=3366): Terminating (SIGTERM) 12:06:48.249887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3369): Terminating (SIGTERM) 12:06:48.290218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3372): Terminating (SIGTERM) 12:06:48.330407 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3375): Terminating (SIGTERM) 12:06:48.370596 --- ParallelTerminationStrategy: PID 3363 died... 12:06:48.389766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3363): Terminated: ok {rc=0} 12:06:48.434284 --- ParallelTerminationStrategy: PID 3364 died... 12:06:48.452921 run iperf3-srv_10.42.42.10(pid=3364): Terminated {rc=256} 12:06:48.497132 --- ParallelTerminationStrategy: PID 3365 died... 12:06:48.515876 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3365): Terminated: ok {rc=0} 12:06:48.559832 --- ParallelTerminationStrategy: PID 3366 died... 12:06:48.578563 run iperf3-srv_10.42.42.10(pid=3366): Terminated {rc=256} 12:06:48.622704 --- ParallelTerminationStrategy: PID 3369 died... 12:06:48.641556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3369): Terminated: ok {rc=0} 12:06:48.685805 --- ParallelTerminationStrategy: PID 3372 died... 12:06:48.704648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3372): Terminated: ok {rc=0} 12:06:48.748777 --- ParallelTerminationStrategy: PID 3375 died... 12:06:48.767786 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3375): Terminated: ok {rc=0} 12:06:48.855061 bus /gobi_0: Setting Powered False 12:06:49.956172 bus /gobi_0: Setting Powered False 12:06:51.072930 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms iperf3.py ---------------------------------------------- 12:06:52.220827 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:06:52.232359 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 12:06:52.284266 tst iperf3.py: using LAC 21350 12:06:52.405005 tst iperf3.py: using RAC 185 12:06:52.526353 tst iperf3.py: using CellId 21350 12:06:52.649154 tst iperf3.py: using BVCI 21351 12:06:52.761785 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:06:52.772488 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:06:52.783126 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:06:52.793727 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:06:52.804107 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:06:52.814573 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:06:52.825825 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:06:52.836341 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:06:52.846850 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:06:52.963548 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:06:53.170667 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:06:53.480602 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3377): Launched 12:06:53.749984 run iperf3-srv_10.42.42.10(pid=3378): Launched 12:06:53.868336 tst iperf3.py:8: start network... 12:06:54.074379 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:06:54.553873 run create_hlr_db(pid=3379): Launched 12:06:54.679810 bus /gobi_6: Setting Powered False 12:06:55.740533 run create_hlr_db(pid=3379): Terminated: ok {rc=0} 12:06:56.190786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3381): Launched 12:06:56.521492 run osmo-hlr_10.42.42.2(pid=3382): Launched 12:06:56.650269 run osmo-stp_10.42.42.5: Starting osmo-stp 12:06:57.220211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3384): Launched 12:06:57.551834 run osmo-stp_10.42.42.5(pid=3385): Launched 12:06:57.679905 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:06:58.248592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3387): Launched 12:06:58.377733 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:06:58.655730 run patchelf(pid=3388): Launched 12:06:58.841622 run osmo-stp_10.42.42.5(pid=3385): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3385)] 12:06:58.981368 run osmo-stp_10.42.42.5(pid=3385): stdout: | (launched: 2022-12-09_12:06:57.491261) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:59.122121 run osmo-stp_10.42.42.5(pid=3385): stderr: | 20221209120657682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120657682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120657683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120657683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120657684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120657684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120657684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:59.263030 run osmo-stp_10.42.42.5(pid=3385): stdout: | (launched: 2022-12-09_12:06:57.491261) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:06:59.398247 run osmo-stp_10.42.42.5(pid=3385): stderr: | 20221209120657682 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120657682 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120657683 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120657683 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120657684 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120657684 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120657684 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:06:59.557928 run patchelf(pid=3388): Terminating (SIGINT) 12:06:59.743489 run patchelf(pid=3388): Terminated: ok {rc=0} 12:06:59.878452 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3385): Process ended prematurely: osmo-stp_10.42.42.5(pid=3385) [trial-2359↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3385)] [trial-2359↪gprs:trx-lms↪iperf3.py:8] 12:06:59.888546 tst iperf3.py:8: Test FAILED (7.7 sec) 12:06:59.918087 run osmo-hlr_10.42.42.2(pid=3382): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3382)] 12:06:59.969288 run osmo-hlr_10.42.42.2(pid=3382): stdout: | (launched: 2022-12-09_12:06:56.461115) 12:07:00.022504 run osmo-hlr_10.42.42.2(pid=3382): stderr: | 20221209120656658 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120656658 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120656658 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120656658 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120656658 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120656658 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120656670 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120656680 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120656680 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120656680 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:07:00.075990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3377): Terminating (SIGTERM) 12:07:00.118880 run iperf3-srv_10.42.42.10(pid=3378): Terminating (SIGTERM) 12:07:00.161717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3381): Terminating (SIGTERM) 12:07:00.204633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3384): Terminating (SIGTERM) 12:07:00.247910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3387): Terminating (SIGTERM) 12:07:00.290978 --- ParallelTerminationStrategy: PID 3377 died... 12:07:00.311419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3377): Terminated: ok {rc=0} 12:07:00.359221 --- ParallelTerminationStrategy: PID 3378 died... 12:07:00.379218 run iperf3-srv_10.42.42.10(pid=3378): Terminated {rc=256} 12:07:00.426474 --- ParallelTerminationStrategy: PID 3381 died... 12:07:00.446503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3381): Terminated: ok {rc=0} 12:07:00.494001 --- ParallelTerminationStrategy: PID 3384 died... 12:07:00.513967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3384): Terminated: ok {rc=0} 12:07:00.561378 --- ParallelTerminationStrategy: PID 3387 died... 12:07:00.581374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3387): Terminated: ok {rc=0} 12:07:00.671190 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms iperf3m4.py ---------------------------------------------- 12:07:01.823437 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:01.836297 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 12:07:01.889395 tst iperf3m4.py: using LAC 21351 12:07:02.019136 tst iperf3m4.py: using RAC 186 12:07:02.171850 tst iperf3m4.py: using CellId 21351 12:07:02.294372 tst iperf3m4.py: using BVCI 21352 12:07:02.406221 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:02.417022 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:02.427576 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:02.438227 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:02.448389 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:02.458846 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:02.469809 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:02.480173 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:02.490664 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:07:02.605805 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:07:02.732184 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:07:02.852259 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:07:02.969685 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:07:03.176305 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:07:03.485205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3389): Launched 12:07:03.753781 run iperf3-srv_10.42.42.10(pid=3390): Launched 12:07:03.870180 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:07:04.076424 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:07:04.386104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3391): Launched 12:07:04.656723 run iperf3-srv_10.42.42.10(pid=3392): Launched 12:07:04.772716 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:07:04.977580 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:07:05.285367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3393): Launched 12:07:05.555537 run iperf3-srv_10.42.42.10(pid=3394): Launched 12:07:05.671272 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:07:05.876149 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:07:06.183620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3395): Launched 12:07:06.452167 run iperf3-srv_10.42.42.10(pid=3396): Launched 12:07:06.568232 tst iperf3m4.py:8: start network... 12:07:06.773972 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:07:07.250480 run create_hlr_db(pid=3397): Launched 12:07:07.378945 bus /gobi_6: Setting Powered False 12:07:08.439863 run create_hlr_db(pid=3397): Terminated: ok {rc=0} 12:07:08.888607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3399): Launched 12:07:09.203368 run osmo-hlr_10.42.42.2(pid=3400): Launched 12:07:09.320285 run osmo-stp_10.42.42.5: Starting osmo-stp 12:07:09.854367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3402): Launched 12:07:10.163848 run osmo-stp_10.42.42.5(pid=3403): Launched 12:07:10.280033 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:07:10.807712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3405): Launched 12:07:10.927327 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:07:11.186109 run patchelf(pid=3406): Launched 12:07:11.357516 run osmo-stp_10.42.42.5(pid=3403): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3403)] 12:07:11.487151 run osmo-stp_10.42.42.5(pid=3403): stdout: | (launched: 2022-12-09_12:07:10.106886) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:11.618173 run osmo-stp_10.42.42.5(pid=3403): stderr: | 20221209120710275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120710276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120710276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120710276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120710277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120710277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120710277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:11.748841 run osmo-stp_10.42.42.5(pid=3403): stdout: | (launched: 2022-12-09_12:07:10.106886) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:11.874626 run osmo-stp_10.42.42.5(pid=3403): stderr: | 20221209120710275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120710276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120710276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120710276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120710277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120710277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120710277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:12.023124 run patchelf(pid=3406): Terminating (SIGINT) 12:07:12.196140 run patchelf(pid=3406): Terminated: ok {rc=0} 12:07:12.321266 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3403): Process ended prematurely: osmo-stp_10.42.42.5(pid=3403) [trial-2359↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3403)] [trial-2359↪gprs:trx-lms↪iperf3m4.py:8] 12:07:12.330737 tst iperf3m4.py:8: Test FAILED (10.5 sec) 12:07:12.358226 run osmo-hlr_10.42.42.2(pid=3400): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3400)] 12:07:12.405658 run osmo-hlr_10.42.42.2(pid=3400): stdout: | (launched: 2022-12-09_12:07:09.146275) 12:07:12.455214 run osmo-hlr_10.42.42.2(pid=3400): stderr: | 20221209120709323 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120709323 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120709323 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120709323 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120709323 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120709323 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120709335 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120709344 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120709345 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120709345 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:07:12.505262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3389): Terminating (SIGTERM) 12:07:12.544829 run iperf3-srv_10.42.42.10(pid=3390): Terminating (SIGTERM) 12:07:12.584552 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3391): Terminating (SIGTERM) 12:07:12.624184 run iperf3-srv_10.42.42.10(pid=3392): Terminating (SIGTERM) 12:07:12.663760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3393): Terminating (SIGTERM) 12:07:12.703790 run iperf3-srv_10.42.42.10(pid=3394): Terminating (SIGTERM) 12:07:12.743498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3395): Terminating (SIGTERM) 12:07:12.783010 run iperf3-srv_10.42.42.10(pid=3396): Terminating (SIGTERM) 12:07:12.822592 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3399): Terminating (SIGTERM) 12:07:12.862444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3402): Terminating (SIGTERM) 12:07:12.902160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3405): Terminating (SIGTERM) 12:07:12.942162 --- ParallelTerminationStrategy: PID 3389 died... 12:07:12.961140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3389): Terminated: ok {rc=0} 12:07:13.005666 --- ParallelTerminationStrategy: PID 3390 died... 12:07:13.024142 run iperf3-srv_10.42.42.10(pid=3390): Terminated {rc=256} 12:07:13.068574 --- ParallelTerminationStrategy: PID 3391 died... 12:07:13.087342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3391): Terminated: ok {rc=0} 12:07:13.131028 --- ParallelTerminationStrategy: PID 3392 died... 12:07:13.149580 run iperf3-srv_10.42.42.10(pid=3392): Terminated {rc=256} 12:07:13.193267 --- ParallelTerminationStrategy: PID 3393 died... 12:07:13.211895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3393): Terminated: ok {rc=0} 12:07:13.255619 --- ParallelTerminationStrategy: PID 3394 died... 12:07:13.274144 run iperf3-srv_10.42.42.10(pid=3394): Terminated {rc=256} 12:07:13.317917 --- ParallelTerminationStrategy: PID 3395 died... 12:07:13.336677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3395): Terminated: ok {rc=0} 12:07:13.381144 --- ParallelTerminationStrategy: PID 3396 died... 12:07:13.399885 run iperf3-srv_10.42.42.10(pid=3396): Terminated {rc=256} 12:07:13.443381 --- ParallelTerminationStrategy: PID 3399 died... 12:07:13.461970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3399): Terminated: ok {rc=0} 12:07:13.505692 --- ParallelTerminationStrategy: PID 3402 died... 12:07:13.524398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3402): Terminated: ok {rc=0} 12:07:13.568202 --- ParallelTerminationStrategy: PID 3405 died... 12:07:13.586961 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3405): Terminated: ok {rc=0} 12:07:13.672575 bus /gobi_4: Setting Powered False 12:07:14.772878 bus /gobi_4: Setting Powered False 12:07:15.912246 bus /gobi_1: Setting Powered False 12:07:17.024196 bus /gobi_1: Setting Powered False 12:07:18.161723 bus /gobi_0: Setting Powered False 12:07:19.262162 bus /gobi_0: Setting Powered False 12:07:20.378640 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms ping.py ---------------------------------------------- 12:07:21.483778 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:21.495220 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 12:07:21.544167 tst ping.py: using LAC 21352 12:07:21.664116 tst ping.py: using RAC 187 12:07:21.783018 tst ping.py: using CellId 21352 12:07:21.902720 tst ping.py: using BVCI 21353 12:07:22.012644 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:22.023294 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:22.033769 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:22.044207 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:22.054541 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:22.064859 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:22.075346 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:22.085836 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:07:22.203483 tst ping.py:19: start network... 12:07:22.405454 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:07:22.870753 run create_hlr_db(pid=3408): Launched 12:07:23.008174 bus /gobi_6: Setting Powered False 12:07:24.072613 run create_hlr_db(pid=3408): Terminated: ok {rc=0} 12:07:24.504673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3410): Launched 12:07:24.808111 run osmo-hlr_10.42.42.2(pid=3411): Launched 12:07:24.922903 run osmo-stp_10.42.42.5: Starting osmo-stp 12:07:25.458763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3413): Launched 12:07:25.762881 run osmo-stp_10.42.42.5(pid=3414): Launched 12:07:25.876827 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:07:26.394504 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3416): Launched 12:07:26.509822 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:07:26.763724 run patchelf(pid=3417): Launched 12:07:26.931865 run osmo-stp_10.42.42.5(pid=3414): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3414)] 12:07:27.059961 run osmo-stp_10.42.42.5(pid=3414): stdout: | (launched: 2022-12-09_12:07:25.706326) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:27.189449 run osmo-stp_10.42.42.5(pid=3414): stderr: | 20221209120725875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120725875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120725875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120725876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120725876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120725876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120725876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:27.319107 run osmo-stp_10.42.42.5(pid=3414): stdout: | (launched: 2022-12-09_12:07:25.706326) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:27.442823 run osmo-stp_10.42.42.5(pid=3414): stderr: | 20221209120725875 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120725875 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120725875 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120725876 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120725876 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120725876 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120725876 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:27.590035 run patchelf(pid=3417): Terminating (SIGINT) 12:07:27.760815 run patchelf(pid=3417): Terminated: ok {rc=0} 12:07:27.884316 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3414): Process ended prematurely: osmo-stp_10.42.42.5(pid=3414) [trial-2359↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3414)] [trial-2359↪gprs:trx-lms↪ping.py:22] 12:07:27.893674 tst ping.py:22: Test FAILED (6.4 sec) 12:07:27.920819 run osmo-hlr_10.42.42.2(pid=3411): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3411)] 12:07:27.968865 run osmo-hlr_10.42.42.2(pid=3411): stdout: | (launched: 2022-12-09_12:07:24.752126) 12:07:28.018679 run osmo-hlr_10.42.42.2(pid=3411): stderr: | 20221209120724927 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120724927 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120724927 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120724927 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120724928 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120724928 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120724939 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120724950 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120724950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120724950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:07:28.069168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3410): Terminating (SIGTERM) 12:07:28.109211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3413): Terminating (SIGTERM) 12:07:28.149334 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3416): Terminating (SIGTERM) 12:07:28.189550 --- ParallelTerminationStrategy: PID 3410 died... 12:07:28.208514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3410): Terminated: ok {rc=0} 12:07:28.252899 --- ParallelTerminationStrategy: PID 3413 died... 12:07:28.271786 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3413): Terminated: ok {rc=0} 12:07:28.315935 --- ParallelTerminationStrategy: PID 3416 died... 12:07:28.334717 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3416): Terminated: ok {rc=0} 12:07:28.420541 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 12:07:29.508236 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:29.519789 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 12:07:29.569963 tst ping_idle_ping.py: using LAC 21353 12:07:29.689559 tst ping_idle_ping.py: using RAC 188 12:07:29.807637 tst ping_idle_ping.py: using CellId 21353 12:07:29.936700 tst ping_idle_ping.py: using BVCI 21354 12:07:30.046931 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:30.057825 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:30.068757 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:30.079557 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:30.090287 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:30.100559 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:30.111126 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 12:07:30.121628 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 12:07:30.240461 tst ping_idle_ping.py:24: start network... 12:07:30.460152 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:07:30.986106 run create_hlr_db(pid=3418): Launched 12:07:31.146149 bus /gobi_6: Setting Powered False 12:07:32.205173 run create_hlr_db(pid=3418): Terminated: ok {rc=0} 12:07:32.666939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3420): Launched 12:07:32.992809 run osmo-hlr_10.42.42.2(pid=3421): Launched 12:07:33.117258 run osmo-stp_10.42.42.5: Starting osmo-stp 12:07:33.679239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3423): Launched 12:07:34.002610 run osmo-stp_10.42.42.5(pid=3424): Launched 12:07:34.127486 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:07:34.684266 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3426): Launched 12:07:34.808306 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:07:35.081656 run patchelf(pid=3427): Launched 12:07:35.263081 run osmo-stp_10.42.42.5(pid=3424): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3424)] 12:07:35.400863 run osmo-stp_10.42.42.5(pid=3424): stdout: | (launched: 2022-12-09_12:07:33.943310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:35.539452 run osmo-stp_10.42.42.5(pid=3424): stderr: | 20221209120734132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120734132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120734132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120734133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120734133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120734133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120734134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:35.678324 run osmo-stp_10.42.42.5(pid=3424): stdout: | (launched: 2022-12-09_12:07:33.943310) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:35.811475 run osmo-stp_10.42.42.5(pid=3424): stderr: | 20221209120734132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120734132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120734132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120734133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120734133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120734133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120734134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:35.971373 run patchelf(pid=3427): Terminating (SIGINT) 12:07:36.154897 run patchelf(pid=3427): Terminated: ok {rc=0} 12:07:36.287065 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3424): Process ended prematurely: osmo-stp_10.42.42.5(pid=3424) [trial-2359↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3424)] [trial-2359↪gprs:trx-lms↪ping_idle_ping.py:27] 12:07:36.296667 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 12:07:36.325654 run osmo-hlr_10.42.42.2(pid=3421): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3421)] 12:07:36.376293 run osmo-hlr_10.42.42.2(pid=3421): stdout: | (launched: 2022-12-09_12:07:32.933657) 12:07:36.429137 run osmo-hlr_10.42.42.2(pid=3421): stderr: | 20221209120733128 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120733128 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120733128 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120733128 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120733128 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120733128 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120733140 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120733149 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120733149 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120733149 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:07:36.481686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3420): Terminating (SIGTERM) 12:07:36.524050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3423): Terminating (SIGTERM) 12:07:36.566269 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3426): Terminating (SIGTERM) 12:07:36.608903 --- ParallelTerminationStrategy: PID 3420 died... 12:07:36.629042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3420): Terminated: ok {rc=0} 12:07:36.676116 --- ParallelTerminationStrategy: PID 3423 died... 12:07:36.695766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3423): Terminated: ok {rc=0} 12:07:36.742496 --- ParallelTerminationStrategy: PID 3426 died... 12:07:36.762068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3426): Terminated: ok {rc=0} 12:07:36.850652 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 12:07:38.155947 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:07:38.161672 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:07:38.196288 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:07:38.235974 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:07:38.325723 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:07:38.360093 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:07:38.399812 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:07:38.994564 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:07:39.047816 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:39.059232 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:07:39.111194 tst cs_paging_gprs_active.py: using LAC 21354 12:07:39.240825 tst cs_paging_gprs_active.py: using RAC 189 12:07:39.370276 tst cs_paging_gprs_active.py: using CellId 21354 12:07:39.500782 tst cs_paging_gprs_active.py: using BVCI 21355 12:07:39.616103 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:39.627181 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:39.637865 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:39.648643 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:39.659361 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:39.670158 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:39.680903 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:39.691963 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:39.702691 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:07:39.824161 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:07:39.941652 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:07:40.148615 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:07:40.458803 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3437): Launched 12:07:40.731416 run iperf3-srv_10.42.42.10(pid=3438): Launched 12:07:40.847836 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:07:41.053531 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:07:41.362933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3439): Launched 12:07:41.635725 run iperf3-srv_10.42.42.10(pid=3440): Launched 12:07:41.752099 tst cs_paging_gprs_active.py:38: start network... 12:07:41.958518 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:07:42.436348 run create_hlr_db(pid=3441): Launched 12:07:42.562769 bus /gobi_6: Setting Powered False 12:07:43.624736 run create_hlr_db(pid=3441): Terminated: ok {rc=0} 12:07:44.074865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3443): Launched 12:07:44.405874 run osmo-hlr_10.42.42.2(pid=3444): Launched 12:07:44.534429 run osmo-stp_10.42.42.5: Starting osmo-stp 12:07:45.104668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3446): Launched 12:07:45.435581 run osmo-stp_10.42.42.5(pid=3447): Launched 12:07:45.562446 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:07:46.162272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3449): Launched 12:07:46.295321 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:07:46.564237 run patchelf(pid=3450): Launched 12:07:46.759996 run osmo-stp_10.42.42.5(pid=3447): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3447)] 12:07:46.896590 run osmo-stp_10.42.42.5(pid=3447): stdout: | (launched: 2022-12-09_12:07:45.374863) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:47.031889 run osmo-stp_10.42.42.5(pid=3447): stderr: | 20221209120745565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120745565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120745565 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120745565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120745566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120745566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120745566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:47.167854 run osmo-stp_10.42.42.5(pid=3447): stdout: | (launched: 2022-12-09_12:07:45.374863) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:47.295068 run osmo-stp_10.42.42.5(pid=3447): stderr: | 20221209120745565 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120745565 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120745565 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120745565 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120745566 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120745566 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120745566 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:47.445491 run patchelf(pid=3450): Terminating (SIGINT) 12:07:47.621156 run patchelf(pid=3450): Terminated: ok {rc=0} 12:07:47.747940 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3447): Process ended prematurely: osmo-stp_10.42.42.5(pid=3447) [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3447)] [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:07:47.758159 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 12:07:47.785758 run osmo-hlr_10.42.42.2(pid=3444): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3444)] 12:07:47.834537 run osmo-hlr_10.42.42.2(pid=3444): stdout: | (launched: 2022-12-09_12:07:44.345163) 12:07:47.884894 run osmo-hlr_10.42.42.2(pid=3444): stderr: | 20221209120744542 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120744542 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120744542 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120744542 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120744542 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120744542 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120744554 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120744562 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120744563 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120744563 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:07:47.935683 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3437): Terminating (SIGTERM) 12:07:47.976283 run iperf3-srv_10.42.42.10(pid=3438): Terminating (SIGTERM) 12:07:48.016578 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3439): Terminating (SIGTERM) 12:07:48.056999 run iperf3-srv_10.42.42.10(pid=3440): Terminating (SIGTERM) 12:07:48.097264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3443): Terminating (SIGTERM) 12:07:48.137638 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3446): Terminating (SIGTERM) 12:07:48.178160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3449): Terminating (SIGTERM) 12:07:48.218958 --- ParallelTerminationStrategy: PID 3437 died... 12:07:48.238499 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3437): Terminated: ok {rc=0} 12:07:48.283347 --- ParallelTerminationStrategy: PID 3438 died... 12:07:48.302325 run iperf3-srv_10.42.42.10(pid=3438): Terminated {rc=256} 12:07:48.346838 --- ParallelTerminationStrategy: PID 3439 died... 12:07:48.365826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3439): Terminated: ok {rc=0} 12:07:48.410330 --- ParallelTerminationStrategy: PID 3440 died... 12:07:48.429196 run iperf3-srv_10.42.42.10(pid=3440): Terminated {rc=256} 12:07:48.473749 --- ParallelTerminationStrategy: PID 3443 died... 12:07:48.492641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3443): Terminated: ok {rc=0} 12:07:48.537316 --- ParallelTerminationStrategy: PID 3446 died... 12:07:48.556201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3446): Terminated: ok {rc=0} 12:07:48.601239 --- ParallelTerminationStrategy: PID 3449 died... 12:07:48.620129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3449): Terminated: ok {rc=0} 12:07:48.705530 bus /gobi_0: Setting Powered False 12:07:49.803516 bus /gobi_0: Setting Powered False 12:07:50.920266 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:07:52.070544 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:52.083643 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:07:52.137069 tst iperf3.py: using LAC 21355 12:07:52.266823 tst iperf3.py: using RAC 190 12:07:52.395174 tst iperf3.py: using CellId 21355 12:07:52.523933 tst iperf3.py: using BVCI 21356 12:07:52.645197 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:52.656611 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:52.667876 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:52.679820 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:52.691621 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:52.703377 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:52.715436 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:52.727209 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:07:52.739238 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:07:52.860116 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:07:53.067356 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:07:53.376718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3451): Launched 12:07:53.644850 run iperf3-srv_10.42.42.10(pid=3452): Launched 12:07:53.760922 tst iperf3.py:8: start network... 12:07:53.965595 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:07:54.439893 run create_hlr_db(pid=3453): Launched 12:07:54.565224 bus /gobi_6: Setting Powered False 12:07:55.626527 run create_hlr_db(pid=3453): Terminated: ok {rc=0} 12:07:56.055598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3455): Launched 12:07:56.362939 run osmo-hlr_10.42.42.2(pid=3456): Launched 12:07:56.479332 run osmo-stp_10.42.42.5: Starting osmo-stp 12:07:57.010196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3458): Launched 12:07:57.317720 run osmo-stp_10.42.42.5(pid=3459): Launched 12:07:57.434597 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:07:57.963949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3461): Launched 12:07:58.082324 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:07:58.342059 run patchelf(pid=3462): Launched 12:07:58.515129 run osmo-stp_10.42.42.5(pid=3459): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3459)] 12:07:58.644866 run osmo-stp_10.42.42.5(pid=3459): stdout: | (launched: 2022-12-09_12:07:57.261077) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:58.776378 run osmo-stp_10.42.42.5(pid=3459): stderr: | 20221209120757429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120757429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120757429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120757430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120757430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120757430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120757430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:58.907877 run osmo-stp_10.42.42.5(pid=3459): stdout: | (launched: 2022-12-09_12:07:57.261077) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:07:59.034278 run osmo-stp_10.42.42.5(pid=3459): stderr: | 20221209120757429 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120757429 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120757429 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120757430 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120757430 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120757430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120757430 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:07:59.183537 run patchelf(pid=3462): Terminating (SIGINT) 12:07:59.357496 run patchelf(pid=3462): Terminated: ok {rc=0} 12:07:59.483093 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3459): Process ended prematurely: osmo-stp_10.42.42.5(pid=3459) [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3459)] [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 12:07:59.492505 tst iperf3.py:8: Test FAILED (7.5 sec) 12:07:59.519864 run osmo-hlr_10.42.42.2(pid=3456): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3456)] 12:07:59.567648 run osmo-hlr_10.42.42.2(pid=3456): stdout: | (launched: 2022-12-09_12:07:56.306039) 12:07:59.617341 run osmo-hlr_10.42.42.2(pid=3456): stderr: | 20221209120756481 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120756481 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120756482 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120756482 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120756482 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120756482 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120756494 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120756505 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120756505 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120756505 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:07:59.667311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3451): Terminating (SIGTERM) 12:07:59.707417 run iperf3-srv_10.42.42.10(pid=3452): Terminating (SIGTERM) 12:07:59.747999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3455): Terminating (SIGTERM) 12:07:59.788222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3458): Terminating (SIGTERM) 12:07:59.828278 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3461): Terminating (SIGTERM) 12:07:59.868581 --- ParallelTerminationStrategy: PID 3451 died... 12:07:59.887892 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3451): Terminated: ok {rc=0} 12:07:59.932236 --- ParallelTerminationStrategy: PID 3452 died... 12:07:59.951185 run iperf3-srv_10.42.42.10(pid=3452): Terminated {rc=256} 12:07:59.995246 --- ParallelTerminationStrategy: PID 3455 died... 12:08:00.014150 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3455): Terminated: ok {rc=0} 12:08:00.058212 --- ParallelTerminationStrategy: PID 3458 died... 12:08:00.076943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3458): Terminated: ok {rc=0} 12:08:00.121108 --- ParallelTerminationStrategy: PID 3461 died... 12:08:00.139930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3461): Terminated: ok {rc=0} 12:08:00.224108 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:08:01.371425 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:01.383939 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:08:01.438400 tst iperf3m4.py: using LAC 21356 12:08:01.571758 tst iperf3m4.py: using RAC 191 12:08:01.714661 tst iperf3m4.py: using CellId 21356 12:08:01.905116 tst iperf3m4.py: using BVCI 21357 12:08:02.090723 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:02.107701 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:02.129424 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:02.148397 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:02.169395 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:02.182964 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:02.197978 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:02.213710 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:02.232206 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:08:02.392357 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:08:02.547077 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:08:02.688513 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:08:02.847413 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:08:03.123156 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:08:03.529825 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3572): Launched 12:08:03.917766 run iperf3-srv_10.42.42.10(pid=3636): Launched 12:08:04.071341 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:08:04.327963 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:08:04.711764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3734): Launched 12:08:05.098869 run iperf3-srv_10.42.42.10(pid=3736): Launched 12:08:05.236371 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:08:05.466661 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:08:05.807721 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3737): Launched 12:08:06.114577 run iperf3-srv_10.42.42.10(pid=3738): Launched 12:08:06.257207 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:08:06.486727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:08:06.829713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3741): Launched 12:08:07.108504 run iperf3-srv_10.42.42.10(pid=3742): Launched 12:08:07.241149 tst iperf3m4.py:8: start network... 12:08:07.451285 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:08:07.934813 run create_hlr_db(pid=3743): Launched 12:08:08.093953 bus /gobi_6: Setting Powered False 12:08:09.154949 run create_hlr_db(pid=3743): Terminated: ok {rc=0} 12:08:09.595826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3745): Launched 12:08:09.928884 run osmo-hlr_10.42.42.2(pid=3746): Launched 12:08:10.176597 run osmo-stp_10.42.42.5: Starting osmo-stp 12:08:10.890032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3748): Launched 12:08:11.221251 run osmo-stp_10.42.42.5(pid=3749): Launched 12:08:11.459287 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:08:12.155077 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3751): Launched 12:08:12.289048 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:08:12.556021 run patchelf(pid=3752): Launched 12:08:12.748482 run osmo-stp_10.42.42.5(pid=3749): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3749)] 12:08:12.885486 run osmo-stp_10.42.42.5(pid=3749): stdout: | (launched: 2022-12-09_12:08:11.162531) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:13.019873 run osmo-stp_10.42.42.5(pid=3749): stderr: | 20221209120811489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120811489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120811490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120811490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120811490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120811491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120811491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:13.155903 run osmo-stp_10.42.42.5(pid=3749): stdout: | (launched: 2022-12-09_12:08:11.162531) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:13.287121 run osmo-stp_10.42.42.5(pid=3749): stderr: | 20221209120811489 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120811489 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120811490 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120811490 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120811490 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120811491 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120811491 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:13.440466 run patchelf(pid=3752): Terminating (SIGINT) 12:08:13.620306 run patchelf(pid=3752): Terminated: ok {rc=0} 12:08:13.751467 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3749): Process ended prematurely: osmo-stp_10.42.42.5(pid=3749) [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3749)] [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 12:08:13.762194 tst iperf3m4.py:8: Test FAILED (12.4 sec) 12:08:13.791880 run osmo-hlr_10.42.42.2(pid=3746): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3746)] 12:08:13.842535 run osmo-hlr_10.42.42.2(pid=3746): stdout: | (launched: 2022-12-09_12:08:09.869840) 12:08:13.896523 run osmo-hlr_10.42.42.2(pid=3746): stderr: | 20221209120810208 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120810208 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120810208 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120810208 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120810209 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120810209 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120810234 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120810245 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120810245 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120810246 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:08:13.948536 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3572): Terminating (SIGTERM) 12:08:13.991252 run iperf3-srv_10.42.42.10(pid=3636): Terminating (SIGTERM) 12:08:14.036480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3734): Terminating (SIGTERM) 12:08:14.080830 run iperf3-srv_10.42.42.10(pid=3736): Terminating (SIGTERM) 12:08:14.126060 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3737): Terminating (SIGTERM) 12:08:14.169115 run iperf3-srv_10.42.42.10(pid=3738): Terminating (SIGTERM) 12:08:14.214022 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3741): Terminating (SIGTERM) 12:08:14.256688 run iperf3-srv_10.42.42.10(pid=3742): Terminating (SIGTERM) 12:08:14.303141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3745): Terminating (SIGTERM) 12:08:14.345970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3748): Terminating (SIGTERM) 12:08:14.390918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3751): Terminating (SIGTERM) 12:08:14.435617 --- ParallelTerminationStrategy: PID 3572 died... 12:08:14.455849 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3572): Terminated: ok {rc=0} 12:08:14.504551 --- ParallelTerminationStrategy: PID 3636 died... 12:08:14.524926 run iperf3-srv_10.42.42.10(pid=3636): Terminated {rc=256} 12:08:14.570825 --- ParallelTerminationStrategy: PID 3734 died... 12:08:14.590951 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3734): Terminated: ok {rc=0} 12:08:14.636748 --- ParallelTerminationStrategy: PID 3736 died... 12:08:14.657139 run iperf3-srv_10.42.42.10(pid=3736): Terminated {rc=256} 12:08:14.704777 --- ParallelTerminationStrategy: PID 3737 died... 12:08:14.725397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3737): Terminated: ok {rc=0} 12:08:14.771328 --- ParallelTerminationStrategy: PID 3738 died... 12:08:14.791242 run iperf3-srv_10.42.42.10(pid=3738): Terminated {rc=256} 12:08:14.836938 --- ParallelTerminationStrategy: PID 3741 died... 12:08:14.858259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3741): Terminated: ok {rc=0} 12:08:14.906376 --- ParallelTerminationStrategy: PID 3742 died... 12:08:14.926396 run iperf3-srv_10.42.42.10(pid=3742): Terminated {rc=256} 12:08:14.972443 --- ParallelTerminationStrategy: PID 3745 died... 12:08:14.992322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3745): Terminated: ok {rc=0} 12:08:15.037527 --- ParallelTerminationStrategy: PID 3748 died... 12:08:15.056814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3748): Terminated: ok {rc=0} 12:08:15.103063 --- ParallelTerminationStrategy: PID 3751 died... 12:08:15.122647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3751): Terminated: ok {rc=0} 12:08:15.210004 bus /gobi_4: Setting Powered False 12:08:16.342143 bus /gobi_4: Setting Powered False 12:08:17.506862 bus /gobi_1: Setting Powered False 12:08:18.605495 bus /gobi_1: Setting Powered False 12:08:19.724527 bus /gobi_0: Setting Powered False 12:08:20.824844 bus /gobi_0: Setting Powered False 12:08:21.945570 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 12:08:23.051101 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:23.063913 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:08:23.118037 tst ping.py: using LAC 21357 12:08:23.239067 tst ping.py: using RAC 192 12:08:23.361611 tst ping.py: using CellId 21357 12:08:23.483554 tst ping.py: using BVCI 21358 12:08:23.599003 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:23.610982 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:23.623031 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:23.634389 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:23.646148 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:23.658258 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:23.671501 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:23.684511 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:08:23.806502 tst ping.py:19: start network... 12:08:24.016815 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:08:24.498621 run create_hlr_db(pid=3753): Launched 12:08:24.661233 bus /gobi_6: Setting Powered False 12:08:25.721431 run create_hlr_db(pid=3753): Terminated: ok {rc=0} 12:08:26.146217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3755): Launched 12:08:26.447201 run osmo-hlr_10.42.42.2(pid=3756): Launched 12:08:26.561765 run osmo-stp_10.42.42.5: Starting osmo-stp 12:08:27.089703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3758): Launched 12:08:27.392510 run osmo-stp_10.42.42.5(pid=3759): Launched 12:08:27.507132 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:08:28.028513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3761): Launched 12:08:28.144353 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:08:28.398827 run patchelf(pid=3762): Launched 12:08:28.569171 run osmo-stp_10.42.42.5(pid=3759): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3759)] 12:08:28.697351 run osmo-stp_10.42.42.5(pid=3759): stdout: | (launched: 2022-12-09_12:08:27.336272) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:28.826528 run osmo-stp_10.42.42.5(pid=3759): stderr: | 20221209120827506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120827506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120827507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120827507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120827508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120827508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120827508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:28.955323 run osmo-stp_10.42.42.5(pid=3759): stdout: | (launched: 2022-12-09_12:08:27.336272) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:29.078389 run osmo-stp_10.42.42.5(pid=3759): stderr: | 20221209120827506 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120827506 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120827507 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120827507 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120827508 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120827508 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120827508 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:29.224279 run patchelf(pid=3762): Terminating (SIGINT) 12:08:29.394964 run patchelf(pid=3762): Terminated: ok {rc=0} 12:08:29.517430 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3759): Process ended prematurely: osmo-stp_10.42.42.5(pid=3759) [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3759)] [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 12:08:29.526247 tst ping.py:22: Test FAILED (6.5 sec) 12:08:29.553293 run osmo-hlr_10.42.42.2(pid=3756): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3756)] 12:08:29.601133 run osmo-hlr_10.42.42.2(pid=3756): stdout: | (launched: 2022-12-09_12:08:26.391608) 12:08:29.650645 run osmo-hlr_10.42.42.2(pid=3756): stderr: | 20221209120826564 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120826564 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120826564 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120826564 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120826564 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120826564 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120826577 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120826586 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120826586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120826586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:08:29.700500 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3755): Terminating (SIGTERM) 12:08:29.740602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3758): Terminating (SIGTERM) 12:08:29.780757 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3761): Terminating (SIGTERM) 12:08:29.821174 --- ParallelTerminationStrategy: PID 3755 died... 12:08:29.840436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3755): Terminated: ok {rc=0} 12:08:29.884693 --- ParallelTerminationStrategy: PID 3758 died... 12:08:29.903512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3758): Terminated: ok {rc=0} 12:08:29.947632 --- ParallelTerminationStrategy: PID 3761 died... 12:08:29.966647 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3761): Terminated: ok {rc=0} 12:08:30.052561 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:08:31.155687 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:31.172108 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:08:31.234235 tst ping_idle_ping.py: using LAC 21358 12:08:31.363260 tst ping_idle_ping.py: using RAC 193 12:08:31.507465 tst ping_idle_ping.py: using CellId 21358 12:08:31.636904 tst ping_idle_ping.py: using BVCI 21359 12:08:31.780678 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:31.794302 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:31.806683 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:31.818761 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:31.830720 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:31.841993 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:31.854153 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:08:31.866074 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:08:31.996488 tst ping_idle_ping.py:24: start network... 12:08:32.205171 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:08:32.717543 run create_hlr_db(pid=3763): Launched 12:08:32.843903 bus /gobi_6: Setting Powered False 12:08:33.908653 run create_hlr_db(pid=3763): Terminated: ok {rc=0} 12:08:34.361856 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3765): Launched 12:08:34.686423 run osmo-hlr_10.42.42.2(pid=3766): Launched 12:08:34.811712 run osmo-stp_10.42.42.5: Starting osmo-stp 12:08:35.368304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3768): Launched 12:08:35.695273 run osmo-stp_10.42.42.5(pid=3769): Launched 12:08:35.821462 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:08:36.382595 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3771): Launched 12:08:36.509012 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:08:36.783370 run patchelf(pid=3772): Launched 12:08:36.966742 run osmo-stp_10.42.42.5(pid=3769): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3769)] 12:08:37.104457 run osmo-stp_10.42.42.5(pid=3769): stdout: | (launched: 2022-12-09_12:08:35.635581) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:37.243384 run osmo-stp_10.42.42.5(pid=3769): stderr: | 20221209120835823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120835823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120835824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120835824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120835824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120835825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120835825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:37.382234 run osmo-stp_10.42.42.5(pid=3769): stdout: | (launched: 2022-12-09_12:08:35.635581) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:37.514981 run osmo-stp_10.42.42.5(pid=3769): stderr: | 20221209120835823 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120835823 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120835824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120835824 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120835824 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120835825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120835825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:37.672357 run patchelf(pid=3772): Terminating (SIGINT) 12:08:37.856005 run patchelf(pid=3772): Terminated: ok {rc=0} 12:08:37.988779 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3769): Process ended prematurely: osmo-stp_10.42.42.5(pid=3769) [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3769)] [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 12:08:37.998471 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 12:08:38.027525 run osmo-hlr_10.42.42.2(pid=3766): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3766)] 12:08:38.078243 run osmo-hlr_10.42.42.2(pid=3766): stdout: | (launched: 2022-12-09_12:08:34.626628) 12:08:38.130872 run osmo-hlr_10.42.42.2(pid=3766): stderr: | 20221209120834821 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120834821 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120834821 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120834821 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120834821 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120834822 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120834834 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120834843 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120834843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120834843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:08:38.184105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3765): Terminating (SIGTERM) 12:08:38.227174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3768): Terminating (SIGTERM) 12:08:38.269909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3771): Terminating (SIGTERM) 12:08:38.313313 --- ParallelTerminationStrategy: PID 3765 died... 12:08:38.333644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3765): Terminated: ok {rc=0} 12:08:38.381980 --- ParallelTerminationStrategy: PID 3768 died... 12:08:38.402042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3768): Terminated: ok {rc=0} 12:08:38.449412 --- ParallelTerminationStrategy: PID 3771 died... 12:08:38.469466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3771): Terminated: ok {rc=0} 12:08:38.559160 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:08:39.866671 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:08:39.873143 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:08:39.906329 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:08:39.944657 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:08:40.032184 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:08:40.065760 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:08:40.103822 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:08:40.696912 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:08:40.746378 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:40.757280 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:08:40.826683 tst cs_paging_gprs_active.py: using LAC 21359 12:08:40.949189 tst cs_paging_gprs_active.py: using RAC 194 12:08:41.070708 tst cs_paging_gprs_active.py: using CellId 21359 12:08:41.194888 tst cs_paging_gprs_active.py: using BVCI 21360 12:08:41.309337 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:41.320132 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:41.330824 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:41.341480 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:41.352060 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:41.362738 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:41.373508 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:41.384006 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:41.394766 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:08:41.514947 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:08:41.636235 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:08:41.860328 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:08:42.197852 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3779): Launched 12:08:42.492275 run iperf3-srv_10.42.42.10(pid=3780): Launched 12:08:42.618496 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:08:42.841248 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:08:43.173894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3781): Launched 12:08:43.462531 run iperf3-srv_10.42.42.10(pid=3782): Launched 12:08:43.587396 tst cs_paging_gprs_active.py:38: start network... 12:08:43.809955 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:08:44.321383 run create_hlr_db(pid=3783): Launched 12:08:44.449777 bus /gobi_6: Setting Powered False 12:08:45.515019 run create_hlr_db(pid=3783): Terminated: ok {rc=0} 12:08:45.991446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3785): Launched 12:08:46.327222 run osmo-hlr_10.42.42.2(pid=3786): Launched 12:08:46.588280 run osmo-stp_10.42.42.5: Starting osmo-stp 12:08:47.298395 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3788): Launched 12:08:47.617524 run osmo-stp_10.42.42.5(pid=3789): Launched 12:08:47.736623 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:08:48.272225 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3791): Launched 12:08:48.392482 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:08:48.660320 run patchelf(pid=3792): Launched 12:08:48.833628 run osmo-stp_10.42.42.5(pid=3789): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3789)] 12:08:48.964053 run osmo-stp_10.42.42.5(pid=3789): stdout: | (launched: 2022-12-09_12:08:47.559712) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:49.095742 run osmo-stp_10.42.42.5(pid=3789): stderr: | 20221209120847730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120847730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120847730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120847731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120847731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120847731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120847731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:49.227696 run osmo-stp_10.42.42.5(pid=3789): stdout: | (launched: 2022-12-09_12:08:47.559712) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:08:49.354228 run osmo-stp_10.42.42.5(pid=3789): stderr: | 20221209120847730 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120847730 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120847730 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120847731 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120847731 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120847731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120847731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:08:49.504045 run patchelf(pid=3792): Terminating (SIGINT) 12:08:49.679068 run patchelf(pid=3792): Terminated: ok {rc=0} 12:08:49.805056 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3789): Process ended prematurely: osmo-stp_10.42.42.5(pid=3789) [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3789)] [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:08:49.814577 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 12:08:49.841870 run osmo-hlr_10.42.42.2(pid=3786): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3786)] 12:08:49.889447 run osmo-hlr_10.42.42.2(pid=3786): stdout: | (launched: 2022-12-09_12:08:46.266771) 12:08:49.938859 run osmo-hlr_10.42.42.2(pid=3786): stderr: | 20221209120846602 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120846602 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120846602 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120846602 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120846602 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120846602 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120846622 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120846644 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120846644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120846644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:08:49.988561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3779): Terminating (SIGTERM) 12:08:50.028389 run iperf3-srv_10.42.42.10(pid=3780): Terminating (SIGTERM) 12:08:50.068396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3781): Terminating (SIGTERM) 12:08:50.108291 run iperf3-srv_10.42.42.10(pid=3782): Terminating (SIGTERM) 12:08:50.148170 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3785): Terminating (SIGTERM) 12:08:50.187918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3788): Terminating (SIGTERM) 12:08:50.227543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3791): Terminating (SIGTERM) 12:08:50.267416 --- ParallelTerminationStrategy: PID 3779 died... 12:08:50.286648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3779): Terminated: ok {rc=0} 12:08:50.330824 --- ParallelTerminationStrategy: PID 3780 died... 12:08:50.349491 run iperf3-srv_10.42.42.10(pid=3780): Terminated {rc=256} 12:08:50.393452 --- ParallelTerminationStrategy: PID 3781 died... 12:08:50.411995 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3781): Terminated: ok {rc=0} 12:08:50.456264 --- ParallelTerminationStrategy: PID 3782 died... 12:08:50.474972 run iperf3-srv_10.42.42.10(pid=3782): Terminated {rc=256} 12:08:50.519511 --- ParallelTerminationStrategy: PID 3785 died... 12:08:50.538330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3785): Terminated: ok {rc=0} 12:08:50.582445 --- ParallelTerminationStrategy: PID 3788 died... 12:08:50.601193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3788): Terminated: ok {rc=0} 12:08:50.645252 --- ParallelTerminationStrategy: PID 3791 died... 12:08:50.663866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3791): Terminated: ok {rc=0} 12:08:50.750606 bus /gobi_0: Setting Powered False 12:08:51.852121 bus /gobi_0: Setting Powered False 12:08:52.967953 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:08:54.115430 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:54.127111 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:08:54.200499 tst iperf3.py: using LAC 21360 12:08:54.322089 tst iperf3.py: using RAC 195 12:08:54.440666 tst iperf3.py: using CellId 21360 12:08:54.563104 tst iperf3.py: using BVCI 21361 12:08:54.675989 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:54.686941 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:54.697681 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:54.708403 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:54.719570 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:54.730341 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:54.741158 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:54.751787 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:08:54.762632 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:08:54.878969 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:08:55.084757 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:08:55.393544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3793): Launched 12:08:55.664598 run iperf3-srv_10.42.42.10(pid=3794): Launched 12:08:55.781146 tst iperf3.py:8: start network... 12:08:55.987504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:08:56.465619 run create_hlr_db(pid=3795): Launched 12:08:56.591511 bus /gobi_6: Setting Powered False 12:08:57.652182 run create_hlr_db(pid=3795): Terminated: ok {rc=0} 12:08:58.101560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3797): Launched 12:08:58.434542 run osmo-hlr_10.42.42.2(pid=3798): Launched 12:08:58.560437 run osmo-stp_10.42.42.5: Starting osmo-stp 12:08:59.136351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3800): Launched 12:08:59.470117 run osmo-stp_10.42.42.5(pid=3801): Launched 12:08:59.597601 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:09:00.166304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3803): Launched 12:09:00.293764 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:09:00.572674 run patchelf(pid=3804): Launched 12:09:00.758376 run osmo-stp_10.42.42.5(pid=3801): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3801)] 12:09:00.933591 run osmo-stp_10.42.42.5(pid=3801): stdout: | (launched: 2022-12-09_12:08:59.409425) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:01.080429 run osmo-stp_10.42.42.5(pid=3801): stderr: | 20221209120859599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120859599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120859599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120859600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120859600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120859600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120859600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:01.224594 run osmo-stp_10.42.42.5(pid=3801): stdout: | (launched: 2022-12-09_12:08:59.409425) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:01.362802 run osmo-stp_10.42.42.5(pid=3801): stderr: | 20221209120859599 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120859599 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120859599 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120859600 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120859600 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120859600 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120859600 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:01.527165 run patchelf(pid=3804): Terminating (SIGINT) 12:09:01.717904 run patchelf(pid=3804): Terminated: ok {rc=0} 12:09:01.857463 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3801): Process ended prematurely: osmo-stp_10.42.42.5(pid=3801) [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3801)] [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 12:09:01.868851 tst iperf3.py:8: Test FAILED (7.8 sec) 12:09:01.901839 run osmo-hlr_10.42.42.2(pid=3798): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3798)] 12:09:01.955168 run osmo-hlr_10.42.42.2(pid=3798): stdout: | (launched: 2022-12-09_12:08:58.373300) 12:09:02.010313 run osmo-hlr_10.42.42.2(pid=3798): stderr: | 20221209120858571 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120858571 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120858571 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120858571 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120858571 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120858571 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120858587 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120858597 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120858597 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120858598 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:09:02.065793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3793): Terminating (SIGTERM) 12:09:02.111269 run iperf3-srv_10.42.42.10(pid=3794): Terminating (SIGTERM) 12:09:02.158889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3797): Terminating (SIGTERM) 12:09:02.204329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3800): Terminating (SIGTERM) 12:09:02.247700 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3803): Terminating (SIGTERM) 12:09:02.291208 --- ParallelTerminationStrategy: PID 3793 died... 12:09:02.311154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3793): Terminated: ok {rc=0} 12:09:02.358823 --- ParallelTerminationStrategy: PID 3794 died... 12:09:02.378699 run iperf3-srv_10.42.42.10(pid=3794): Terminated {rc=256} 12:09:02.426016 --- ParallelTerminationStrategy: PID 3797 died... 12:09:02.445867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3797): Terminated: ok {rc=0} 12:09:02.493191 --- ParallelTerminationStrategy: PID 3800 died... 12:09:02.513033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3800): Terminated: ok {rc=0} 12:09:02.560442 --- ParallelTerminationStrategy: PID 3803 died... 12:09:02.580389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3803): Terminated: ok {rc=0} 12:09:02.669479 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:09:03.822337 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:03.834411 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:09:03.909160 tst iperf3m4.py: using LAC 21361 12:09:04.043329 tst iperf3m4.py: using RAC 196 12:09:04.173223 tst iperf3m4.py: using CellId 21361 12:09:04.302925 tst iperf3m4.py: using BVCI 21362 12:09:04.423368 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:04.434887 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:04.446308 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:04.458493 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:04.470407 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:04.483062 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:04.494416 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:04.506340 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:04.519302 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:09:04.644181 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:09:04.768473 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:09:04.884709 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:09:05.002185 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:09:05.208381 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:09:05.516700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3805): Launched 12:09:05.786028 run iperf3-srv_10.42.42.10(pid=3806): Launched 12:09:05.904241 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:09:06.110406 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:09:06.420413 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3807): Launched 12:09:06.688244 run iperf3-srv_10.42.42.10(pid=3808): Launched 12:09:06.803521 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:09:07.008178 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:09:07.315743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3809): Launched 12:09:07.583840 run iperf3-srv_10.42.42.10(pid=3810): Launched 12:09:07.699665 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:09:07.904261 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:09:08.212087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3811): Launched 12:09:08.481386 run iperf3-srv_10.42.42.10(pid=3812): Launched 12:09:08.597532 tst iperf3m4.py:8: start network... 12:09:08.803284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:09:09.281594 run create_hlr_db(pid=3813): Launched 12:09:09.409268 bus /gobi_6: Setting Powered False 12:09:10.470220 run create_hlr_db(pid=3813): Terminated: ok {rc=0} 12:09:10.919700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3815): Launched 12:09:11.251855 run osmo-hlr_10.42.42.2(pid=3816): Launched 12:09:11.379076 run osmo-stp_10.42.42.5: Starting osmo-stp 12:09:11.953041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3818): Launched 12:09:12.284386 run osmo-stp_10.42.42.5(pid=3819): Launched 12:09:12.411397 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:09:12.979839 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3821): Launched 12:09:13.108072 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:09:13.386794 run patchelf(pid=3822): Launched 12:09:13.569955 run osmo-stp_10.42.42.5(pid=3819): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3819)] 12:09:13.709202 run osmo-stp_10.42.42.5(pid=3819): stdout: | (launched: 2022-12-09_12:09:12.223498) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:13.849379 run osmo-stp_10.42.42.5(pid=3819): stderr: | 20221209120912415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120912415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120912415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120912415 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120912416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120912416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120912416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:13.990412 run osmo-stp_10.42.42.5(pid=3819): stdout: | (launched: 2022-12-09_12:09:12.223498) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:14.125113 run osmo-stp_10.42.42.5(pid=3819): stderr: | 20221209120912415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120912415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120912415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120912415 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120912416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120912416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120912416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:14.284502 run patchelf(pid=3822): Terminating (SIGINT) 12:09:14.469664 run patchelf(pid=3822): Terminated: ok {rc=0} 12:09:14.603875 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3819): Process ended prematurely: osmo-stp_10.42.42.5(pid=3819) [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3819)] [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:09:14.614241 tst iperf3m4.py:8: Test FAILED (10.8 sec) 12:09:14.644040 run osmo-hlr_10.42.42.2(pid=3816): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3816)] 12:09:14.694916 run osmo-hlr_10.42.42.2(pid=3816): stdout: | (launched: 2022-12-09_12:09:11.191434) 12:09:14.747514 run osmo-hlr_10.42.42.2(pid=3816): stderr: | 20221209120911388 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120911388 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120911388 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120911388 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120911388 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120911388 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120911400 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120911409 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120911410 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120911410 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:09:14.800668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3805): Terminating (SIGTERM) 12:09:14.843436 run iperf3-srv_10.42.42.10(pid=3806): Terminating (SIGTERM) 12:09:14.886029 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3807): Terminating (SIGTERM) 12:09:14.929159 run iperf3-srv_10.42.42.10(pid=3808): Terminating (SIGTERM) 12:09:14.971755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3809): Terminating (SIGTERM) 12:09:15.014336 run iperf3-srv_10.42.42.10(pid=3810): Terminating (SIGTERM) 12:09:15.056762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3811): Terminating (SIGTERM) 12:09:15.099314 run iperf3-srv_10.42.42.10(pid=3812): Terminating (SIGTERM) 12:09:15.141599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3815): Terminating (SIGTERM) 12:09:15.184300 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3818): Terminating (SIGTERM) 12:09:15.226970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3821): Terminating (SIGTERM) 12:09:15.269701 --- ParallelTerminationStrategy: PID 3805 died... 12:09:15.289976 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3805): Terminated: ok {rc=0} 12:09:15.337314 --- ParallelTerminationStrategy: PID 3806 died... 12:09:15.357065 run iperf3-srv_10.42.42.10(pid=3806): Terminated {rc=256} 12:09:15.403802 --- ParallelTerminationStrategy: PID 3807 died... 12:09:15.423501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3807): Terminated: ok {rc=0} 12:09:15.470299 --- ParallelTerminationStrategy: PID 3808 died... 12:09:15.490008 run iperf3-srv_10.42.42.10(pid=3808): Terminated {rc=256} 12:09:15.537019 --- ParallelTerminationStrategy: PID 3809 died... 12:09:15.556844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3809): Terminated: ok {rc=0} 12:09:15.603953 --- ParallelTerminationStrategy: PID 3810 died... 12:09:15.623678 run iperf3-srv_10.42.42.10(pid=3810): Terminated {rc=256} 12:09:15.670603 --- ParallelTerminationStrategy: PID 3811 died... 12:09:15.690356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3811): Terminated: ok {rc=0} 12:09:15.737368 --- ParallelTerminationStrategy: PID 3812 died... 12:09:15.757242 run iperf3-srv_10.42.42.10(pid=3812): Terminated {rc=256} 12:09:15.804087 --- ParallelTerminationStrategy: PID 3815 died... 12:09:15.823799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3815): Terminated: ok {rc=0} 12:09:15.872011 --- ParallelTerminationStrategy: PID 3818 died... 12:09:15.892343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3818): Terminated: ok {rc=0} 12:09:15.940813 --- ParallelTerminationStrategy: PID 3821 died... 12:09:15.961381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3821): Terminated: ok {rc=0} 12:09:16.058224 bus /gobi_4: Setting Powered False 12:09:17.160827 bus /gobi_4: Setting Powered False 12:09:18.298143 bus /gobi_1: Setting Powered False 12:09:19.397778 bus /gobi_1: Setting Powered False 12:09:20.514843 bus /gobi_0: Setting Powered False 12:09:21.614315 bus /gobi_0: Setting Powered False 12:09:22.734061 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:09:23.840101 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:23.852397 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:09:23.926425 tst ping.py: using LAC 21362 12:09:24.054607 tst ping.py: using RAC 197 12:09:24.184078 tst ping.py: using CellId 21362 12:09:24.308515 tst ping.py: using BVCI 21363 12:09:24.427586 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:24.439176 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:24.450428 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:24.462012 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:24.473641 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:24.485843 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:24.497615 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:24.509201 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:09:24.629330 tst ping.py:19: start network... 12:09:24.846965 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:09:25.347234 run create_hlr_db(pid=3823): Launched 12:09:25.471441 bus /gobi_6: Setting Powered False 12:09:26.535359 run create_hlr_db(pid=3823): Terminated: ok {rc=0} 12:09:26.986711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3825): Launched 12:09:27.313737 run osmo-hlr_10.42.42.2(pid=3826): Launched 12:09:27.438417 run osmo-stp_10.42.42.5: Starting osmo-stp 12:09:27.996926 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3828): Launched 12:09:28.320766 run osmo-stp_10.42.42.5(pid=3829): Launched 12:09:28.446280 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:09:29.007841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3838): Launched 12:09:29.132090 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:09:29.405488 run patchelf(pid=3839): Launched 12:09:29.586815 run osmo-stp_10.42.42.5(pid=3829): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3829)] 12:09:29.724763 run osmo-stp_10.42.42.5(pid=3829): stdout: | (launched: 2022-12-09_12:09:28.261335) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:29.863792 run osmo-stp_10.42.42.5(pid=3829): stderr: | 20221209120928451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120928451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120928451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120928452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120928452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120928452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120928452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:30.003419 run osmo-stp_10.42.42.5(pid=3829): stdout: | (launched: 2022-12-09_12:09:28.261335) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:30.136917 run osmo-stp_10.42.42.5(pid=3829): stderr: | 20221209120928451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120928451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120928451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120928452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120928452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120928452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120928452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:30.294834 run patchelf(pid=3839): Terminating (SIGINT) 12:09:30.478949 run patchelf(pid=3839): Terminated: ok {rc=0} 12:09:30.611565 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3829): Process ended prematurely: osmo-stp_10.42.42.5(pid=3829) [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3829)] [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 12:09:30.621288 tst ping.py:22: Test FAILED (6.8 sec) 12:09:30.650686 run osmo-hlr_10.42.42.2(pid=3826): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3826)] 12:09:30.701729 run osmo-hlr_10.42.42.2(pid=3826): stdout: | (launched: 2022-12-09_12:09:27.253956) 12:09:30.754554 run osmo-hlr_10.42.42.2(pid=3826): stderr: | 20221209120927449 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120927449 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120927449 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120927449 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120927449 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120927449 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120927462 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120927471 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120927471 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120927471 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:09:30.807684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3825): Terminating (SIGTERM) 12:09:30.857103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3828): Terminating (SIGTERM) 12:09:30.907129 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3838): Terminating (SIGTERM) 12:09:30.952791 --- ParallelTerminationStrategy: PID 3825 died... 12:09:30.973923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3825): Terminated: ok {rc=0} 12:09:31.023226 --- ParallelTerminationStrategy: PID 3828 died... 12:09:31.044288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3828): Terminated: ok {rc=0} 12:09:31.092643 --- ParallelTerminationStrategy: PID 3838 died... 12:09:31.113204 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3838): Terminated: ok {rc=0} 12:09:31.203483 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:09:32.298519 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:32.310638 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:09:32.384570 tst ping_idle_ping.py: using LAC 21363 12:09:32.513672 tst ping_idle_ping.py: using RAC 198 12:09:32.634318 tst ping_idle_ping.py: using CellId 21363 12:09:32.754866 tst ping_idle_ping.py: using BVCI 21364 12:09:32.865308 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:32.876307 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:32.887309 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:32.898546 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:32.909839 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:32.921079 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:32.932422 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:09:32.943645 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:09:33.059275 tst ping_idle_ping.py:24: start network... 12:09:33.266058 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:09:33.746700 run create_hlr_db(pid=3840): Launched 12:09:33.871228 bus /gobi_6: Setting Powered False 12:09:34.935407 run create_hlr_db(pid=3840): Terminated: ok {rc=0} 12:09:35.382618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3842): Launched 12:09:35.702620 run osmo-hlr_10.42.42.2(pid=3843): Launched 12:09:35.824339 run osmo-stp_10.42.42.5: Starting osmo-stp 12:09:36.375373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3845): Launched 12:09:36.694752 run osmo-stp_10.42.42.5(pid=3846): Launched 12:09:36.810167 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:09:37.324774 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3848): Launched 12:09:37.439359 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:09:37.690998 run patchelf(pid=3849): Launched 12:09:37.857391 run osmo-stp_10.42.42.5(pid=3846): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3846)] 12:09:37.984272 run osmo-stp_10.42.42.5(pid=3846): stdout: | (launched: 2022-12-09_12:09:36.635942) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:38.112604 run osmo-stp_10.42.42.5(pid=3846): stderr: | 20221209120936805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120936805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120936805 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120936806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120936806 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120936806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120936806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:38.240647 run osmo-stp_10.42.42.5(pid=3846): stdout: | (launched: 2022-12-09_12:09:36.635942) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:38.362804 run osmo-stp_10.42.42.5(pid=3846): stderr: | 20221209120936805 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120936805 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120936805 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120936806 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120936806 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120936806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120936806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:38.507263 run patchelf(pid=3849): Terminating (SIGINT) 12:09:38.676176 run patchelf(pid=3849): Terminated: ok {rc=0} 12:09:38.798071 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3846): Process ended prematurely: osmo-stp_10.42.42.5(pid=3846) [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3846)] [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:09:38.806927 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 12:09:38.833852 run osmo-hlr_10.42.42.2(pid=3843): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3843)] 12:09:38.881366 run osmo-hlr_10.42.42.2(pid=3843): stdout: | (launched: 2022-12-09_12:09:35.643059) 12:09:38.930656 run osmo-hlr_10.42.42.2(pid=3843): stderr: | 20221209120935836 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120935836 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120935836 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120935836 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120935836 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120935836 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120935848 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120935857 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120935857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120935857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:09:38.980228 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3842): Terminating (SIGTERM) 12:09:39.019931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3845): Terminating (SIGTERM) 12:09:39.059574 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3848): Terminating (SIGTERM) 12:09:39.099654 --- ParallelTerminationStrategy: PID 3842 died... 12:09:39.118883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3842): Terminated: ok {rc=0} 12:09:39.162892 --- ParallelTerminationStrategy: PID 3845 died... 12:09:39.181621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3845): Terminated: ok {rc=0} 12:09:39.225613 --- ParallelTerminationStrategy: PID 3848 died... 12:09:39.244272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3848): Terminated: ok {rc=0} 12:09:39.330690 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:09:40.637236 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:09:40.643504 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:09:40.676490 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 12:09:40.714485 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 12:09:40.803207 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:09:40.838397 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 12:09:40.877876 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 12:09:41.464819 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 12:09:41.513851 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:41.524886 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:09:41.597409 tst cs_paging_gprs_active.py: using LAC 21364 12:09:41.716759 tst cs_paging_gprs_active.py: using RAC 199 12:09:41.834413 tst cs_paging_gprs_active.py: using CellId 21364 12:09:41.953932 tst cs_paging_gprs_active.py: using BVCI 21365 12:09:42.063629 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:42.074523 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:42.085168 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:42.095807 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:42.106518 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:42.117200 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:42.127968 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:42.138572 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:42.149435 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:09:42.270738 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:09:42.400153 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:09:42.603809 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:09:42.906880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3853): Launched 12:09:43.171081 run iperf3-srv_10.42.42.10(pid=3854): Launched 12:09:43.284856 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:09:43.486837 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:09:43.789715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3855): Launched 12:09:44.053907 run iperf3-srv_10.42.42.10(pid=3856): Launched 12:09:44.167591 tst cs_paging_gprs_active.py:38: start network... 12:09:44.368300 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:09:44.837310 run create_hlr_db(pid=3857): Launched 12:09:44.962150 bus /gobi_6: Setting Powered False 12:09:46.023875 run create_hlr_db(pid=3857): Terminated: ok {rc=0} 12:09:46.457731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3859): Launched 12:09:46.787266 run osmo-hlr_10.42.42.2(pid=3860): Launched 12:09:47.022993 run osmo-stp_10.42.42.5: Starting osmo-stp 12:09:47.645599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3862): Launched 12:09:47.974749 run osmo-stp_10.42.42.5(pid=3863): Launched 12:09:48.099895 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:09:48.662316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3865): Launched 12:09:48.787935 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:09:49.064489 run patchelf(pid=3866): Launched 12:09:49.248236 run osmo-stp_10.42.42.5(pid=3863): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3863)] 12:09:49.385945 run osmo-stp_10.42.42.5(pid=3863): stdout: | (launched: 2022-12-09_12:09:47.913795) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:49.524913 run osmo-stp_10.42.42.5(pid=3863): stderr: | 20221209120948103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120948104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120948104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120948104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120948105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120948105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120948105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:49.663655 run osmo-stp_10.42.42.5(pid=3863): stdout: | (launched: 2022-12-09_12:09:47.913795) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:09:49.797622 run osmo-stp_10.42.42.5(pid=3863): stderr: | 20221209120948103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209120948104 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209120948104 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209120948104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209120948105 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209120948105 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209120948105 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:09:49.956231 run patchelf(pid=3866): Terminating (SIGINT) 12:09:50.140489 run patchelf(pid=3866): Terminated: ok {rc=0} 12:09:50.272882 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=3863): Process ended prematurely: osmo-stp_10.42.42.5(pid=3863) [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3863)] [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 12:09:50.283307 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 12:09:50.312605 run osmo-hlr_10.42.42.2(pid=3860): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3860)] 12:09:50.363079 run osmo-hlr_10.42.42.2(pid=3860): stdout: | (launched: 2022-12-09_12:09:46.716464) 12:09:50.415275 run osmo-hlr_10.42.42.2(pid=3860): stderr: | 20221209120947044 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120947045 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120947045 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120947045 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120947045 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120947045 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120947062 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120947079 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120947079 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120947079 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:09:50.467613 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3853): Terminating (SIGTERM) 12:09:50.509818 run iperf3-srv_10.42.42.10(pid=3854): Terminating (SIGTERM) 12:09:50.551873 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3855): Terminating (SIGTERM) 12:09:50.594137 run iperf3-srv_10.42.42.10(pid=3856): Terminating (SIGTERM) 12:09:50.636752 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3859): Terminating (SIGTERM) 12:09:50.678939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3862): Terminating (SIGTERM) 12:09:50.720800 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3865): Terminating (SIGTERM) 12:09:50.763039 --- ParallelTerminationStrategy: PID 3853 died... 12:09:50.783157 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3853): Terminated: ok {rc=0} 12:09:50.830000 --- ParallelTerminationStrategy: PID 3854 died... 12:09:50.849518 run iperf3-srv_10.42.42.10(pid=3854): Terminated {rc=256} 12:09:50.896112 --- ParallelTerminationStrategy: PID 3855 died... 12:09:50.915859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3855): Terminated: ok {rc=0} 12:09:50.962941 --- ParallelTerminationStrategy: PID 3856 died... 12:09:50.982416 run iperf3-srv_10.42.42.10(pid=3856): Terminated {rc=256} 12:09:51.029052 --- ParallelTerminationStrategy: PID 3859 died... 12:09:51.048567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3859): Terminated: ok {rc=0} 12:09:51.094948 --- ParallelTerminationStrategy: PID 3862 died... 12:09:51.114531 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3862): Terminated: ok {rc=0} 12:09:51.161095 --- ParallelTerminationStrategy: PID 3865 died... 12:09:51.180635 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3865): Terminated: ok {rc=0} 12:09:51.268280 bus /gobi_0: Setting Powered False 12:09:52.367315 bus /gobi_0: Setting Powered False 12:09:53.485565 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 12:09:54.634482 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:54.646669 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:09:54.720191 tst iperf3.py: using LAC 21365 12:09:54.847719 tst iperf3.py: using RAC 200 12:09:54.974920 tst iperf3.py: using CellId 21365 12:09:55.101914 tst iperf3.py: using BVCI 21366 12:09:55.220536 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:55.231974 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:55.243188 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:55.254581 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:55.265876 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:55.277423 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:55.288752 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:55.300181 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:09:55.311676 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:09:55.431219 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:09:55.650009 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:09:55.976365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3867): Launched 12:09:56.260634 run iperf3-srv_10.42.42.10(pid=3868): Launched 12:09:56.383440 tst iperf3.py:8: start network... 12:09:56.602416 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:09:57.107825 run create_hlr_db(pid=3869): Launched 12:09:57.231841 bus /gobi_6: Setting Powered False 12:09:58.295846 run create_hlr_db(pid=3869): Terminated: ok {rc=0} 12:09:58.734032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3871): Launched 12:09:59.041019 run osmo-hlr_10.42.42.2(pid=3872): Launched 12:09:59.156891 run osmo-stp_10.42.42.5: Starting osmo-stp 12:09:59.687107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3874): Launched 12:09:59.992619 run osmo-stp_10.42.42.5(pid=3875): Launched 12:10:00.108184 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:10:00.631721 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3877): Launched 12:10:00.748878 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:10:01.026434 run patchelf(pid=3878): Launched 12:10:01.224422 run osmo-stp_10.42.42.5(pid=3875): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3875)] 12:10:01.355089 run osmo-stp_10.42.42.5(pid=3875): stdout: | (launched: 2022-12-09_12:09:59.935535) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:01.487052 run osmo-stp_10.42.42.5(pid=3875): stderr: | 20221209121000104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121000105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121000105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121000105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121000106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121000106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121000106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:01.618924 run osmo-stp_10.42.42.5(pid=3875): stdout: | (launched: 2022-12-09_12:09:59.935535) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:01.745406 run osmo-stp_10.42.42.5(pid=3875): stderr: | 20221209121000104 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121000105 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121000105 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121000105 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121000106 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121000106 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121000106 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:01.894981 run patchelf(pid=3878): Terminating (SIGINT) 12:10:02.069845 run patchelf(pid=3878): Terminated: ok {rc=0} 12:10:02.195935 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3875): Process ended prematurely: osmo-stp_10.42.42.5(pid=3875) [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3875)] [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 12:10:02.206154 tst iperf3.py:8: Test FAILED (7.6 sec) 12:10:02.234600 run osmo-hlr_10.42.42.2(pid=3872): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3872)] 12:10:02.283183 run osmo-hlr_10.42.42.2(pid=3872): stdout: | (launched: 2022-12-09_12:09:58.984071) 12:10:02.333919 run osmo-hlr_10.42.42.2(pid=3872): stderr: | 20221209120959159 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209120959159 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209120959159 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209120959159 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209120959159 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209120959160 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209120959172 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209120959181 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209120959181 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209120959181 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:10:02.384465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3867): Terminating (SIGTERM) 12:10:02.424326 run iperf3-srv_10.42.42.10(pid=3868): Terminating (SIGTERM) 12:10:02.463955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3871): Terminating (SIGTERM) 12:10:02.503629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3874): Terminating (SIGTERM) 12:10:02.543282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3877): Terminating (SIGTERM) 12:10:02.583550 --- ParallelTerminationStrategy: PID 3867 died... 12:10:02.602715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3867): Terminated: ok {rc=0} 12:10:02.646652 --- ParallelTerminationStrategy: PID 3868 died... 12:10:02.665253 run iperf3-srv_10.42.42.10(pid=3868): Terminated {rc=256} 12:10:02.709496 --- ParallelTerminationStrategy: PID 3871 died... 12:10:02.728415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3871): Terminated: ok {rc=0} 12:10:02.772289 --- ParallelTerminationStrategy: PID 3874 died... 12:10:02.790989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3874): Terminated: ok {rc=0} 12:10:02.834897 --- ParallelTerminationStrategy: PID 3877 died... 12:10:02.853612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3877): Terminated: ok {rc=0} 12:10:02.939497 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 12:10:04.087677 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:04.099313 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:10:04.171734 tst iperf3m4.py: using LAC 21366 12:10:04.295144 tst iperf3m4.py: using RAC 201 12:10:04.416531 tst iperf3m4.py: using CellId 21366 12:10:04.538711 tst iperf3m4.py: using BVCI 21367 12:10:04.649791 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:04.660710 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:04.671527 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:04.682251 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:04.692793 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:04.703535 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:04.714841 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:04.725544 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:04.736459 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:10:04.857398 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:10:04.979686 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:10:05.100399 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:10:05.222171 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:10:05.442542 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:10:05.769724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3882): Launched 12:10:06.054994 run iperf3-srv_10.42.42.10(pid=3883): Launched 12:10:06.177876 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:10:06.396330 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:10:06.723525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3884): Launched 12:10:07.009558 run iperf3-srv_10.42.42.10(pid=3885): Launched 12:10:07.133180 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:10:07.353046 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:10:07.681316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3886): Launched 12:10:07.966562 run iperf3-srv_10.42.42.10(pid=3887): Launched 12:10:08.089482 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:10:08.308395 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:10:08.635546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3888): Launched 12:10:08.920069 run iperf3-srv_10.42.42.10(pid=3889): Launched 12:10:09.042799 tst iperf3m4.py:8: start network... 12:10:09.261277 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:10:09.764051 run create_hlr_db(pid=3890): Launched 12:10:09.888512 bus /gobi_6: Setting Powered False 12:10:10.953741 run create_hlr_db(pid=3890): Terminated: ok {rc=0} 12:10:11.407493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3892): Launched 12:10:11.733637 run osmo-hlr_10.42.42.2(pid=3893): Launched 12:10:11.858669 run osmo-stp_10.42.42.5: Starting osmo-stp 12:10:12.423714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3895): Launched 12:10:12.748903 run osmo-stp_10.42.42.5(pid=3896): Launched 12:10:12.872576 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:10:13.431987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3898): Launched 12:10:13.556705 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:10:13.830745 run patchelf(pid=3899): Launched 12:10:14.012322 run osmo-stp_10.42.42.5(pid=3896): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3896)] 12:10:14.149954 run osmo-stp_10.42.42.5(pid=3896): stdout: | (launched: 2022-12-09_12:10:12.688857) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:14.288655 run osmo-stp_10.42.42.5(pid=3896): stderr: | 20221209121012877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121012877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121012878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121012878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121012879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121012879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121012879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:14.427333 run osmo-stp_10.42.42.5(pid=3896): stdout: | (launched: 2022-12-09_12:10:12.688857) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:14.560327 run osmo-stp_10.42.42.5(pid=3896): stderr: | 20221209121012877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121012877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121012878 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121012878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121012879 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121012879 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121012879 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:14.721866 run patchelf(pid=3899): Terminating (SIGINT) 12:10:14.905477 run patchelf(pid=3899): Terminated: ok {rc=0} 12:10:15.038689 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3896): Process ended prematurely: osmo-stp_10.42.42.5(pid=3896) [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3896)] [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 12:10:15.048843 tst iperf3m4.py:8: Test FAILED (11.0 sec) 12:10:15.078700 run osmo-hlr_10.42.42.2(pid=3893): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3893)] 12:10:15.129561 run osmo-hlr_10.42.42.2(pid=3893): stdout: | (launched: 2022-12-09_12:10:11.673447) 12:10:15.181961 run osmo-hlr_10.42.42.2(pid=3893): stderr: | 20221209121011865 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121011865 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121011865 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121011865 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121011865 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121011866 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121011879 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121011889 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121011889 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121011889 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:10:15.234677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3882): Terminating (SIGTERM) 12:10:15.277033 run iperf3-srv_10.42.42.10(pid=3883): Terminating (SIGTERM) 12:10:15.319485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3884): Terminating (SIGTERM) 12:10:15.361881 run iperf3-srv_10.42.42.10(pid=3885): Terminating (SIGTERM) 12:10:15.403832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3886): Terminating (SIGTERM) 12:10:15.446083 run iperf3-srv_10.42.42.10(pid=3887): Terminating (SIGTERM) 12:10:15.488023 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3888): Terminating (SIGTERM) 12:10:15.530181 run iperf3-srv_10.42.42.10(pid=3889): Terminating (SIGTERM) 12:10:15.572222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3892): Terminating (SIGTERM) 12:10:15.614506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3895): Terminating (SIGTERM) 12:10:15.656674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3898): Terminating (SIGTERM) 12:10:15.699796 --- ParallelTerminationStrategy: PID 3882 died... 12:10:15.719944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3882): Terminated: ok {rc=0} 12:10:15.767001 --- ParallelTerminationStrategy: PID 3883 died... 12:10:15.786557 run iperf3-srv_10.42.42.10(pid=3883): Terminated {rc=256} 12:10:15.833558 --- ParallelTerminationStrategy: PID 3884 died... 12:10:15.859116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3884): Terminated: ok {rc=0} 12:10:15.914679 --- ParallelTerminationStrategy: PID 3885 died... 12:10:15.934944 run iperf3-srv_10.42.42.10(pid=3885): Terminated {rc=256} 12:10:15.982709 --- ParallelTerminationStrategy: PID 3886 died... 12:10:16.003130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3886): Terminated: ok {rc=0} 12:10:16.050701 --- ParallelTerminationStrategy: PID 3887 died... 12:10:16.070988 run iperf3-srv_10.42.42.10(pid=3887): Terminated {rc=256} 12:10:16.118614 --- ParallelTerminationStrategy: PID 3888 died... 12:10:16.138886 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=3888): Terminated: ok {rc=0} 12:10:16.186355 --- ParallelTerminationStrategy: PID 3889 died... 12:10:16.206531 run iperf3-srv_10.42.42.10(pid=3889): Terminated {rc=256} 12:10:16.254018 --- ParallelTerminationStrategy: PID 3892 died... 12:10:16.274467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3892): Terminated: ok {rc=0} 12:10:16.321976 --- ParallelTerminationStrategy: PID 3895 died... 12:10:16.341892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3895): Terminated: ok {rc=0} 12:10:16.389890 --- ParallelTerminationStrategy: PID 3898 died... 12:10:16.410125 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3898): Terminated: ok {rc=0} 12:10:16.499598 bus /gobi_4: Setting Powered False 12:10:17.598977 bus /gobi_4: Setting Powered False 12:10:18.717652 bus /gobi_1: Setting Powered False 12:10:19.816530 bus /gobi_1: Setting Powered False 12:10:20.929202 bus /gobi_0: Setting Powered False 12:10:22.027846 bus /gobi_0: Setting Powered False 12:10:23.146217 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 12:10:24.249787 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:24.261735 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:10:24.334608 tst ping.py: using LAC 21367 12:10:24.460156 tst ping.py: using RAC 202 12:10:24.587180 tst ping.py: using CellId 21367 12:10:24.710657 tst ping.py: using BVCI 21368 12:10:24.827640 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:24.839041 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:24.850158 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:24.861656 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:24.872806 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:24.884186 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:24.895573 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:24.907268 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:10:25.024911 tst ping.py:19: start network... 12:10:25.223532 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:10:25.681744 run create_hlr_db(pid=3900): Launched 12:10:25.806044 bus /gobi_6: Setting Powered False 12:10:26.866507 run create_hlr_db(pid=3900): Terminated: ok {rc=0} 12:10:27.311555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3902): Launched 12:10:27.636552 run osmo-hlr_10.42.42.2(pid=3903): Launched 12:10:27.761437 run osmo-stp_10.42.42.5: Starting osmo-stp 12:10:28.317035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3905): Launched 12:10:28.639802 run osmo-stp_10.42.42.5(pid=3906): Launched 12:10:28.764720 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:10:29.322360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3908): Launched 12:10:29.446835 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:10:29.720310 run patchelf(pid=3909): Launched 12:10:29.902479 run osmo-stp_10.42.42.5(pid=3906): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3906)] 12:10:30.040275 run osmo-stp_10.42.42.5(pid=3906): stdout: | (launched: 2022-12-09_12:10:28.580608) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:30.178751 run osmo-stp_10.42.42.5(pid=3906): stderr: | 20221209121028771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121028772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121028772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121028772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121028773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121028773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121028773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:30.317491 run osmo-stp_10.42.42.5(pid=3906): stdout: | (launched: 2022-12-09_12:10:28.580608) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:30.450249 run osmo-stp_10.42.42.5(pid=3906): stderr: | 20221209121028771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121028772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121028772 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121028772 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121028773 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121028773 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121028773 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:30.607356 run patchelf(pid=3909): Terminating (SIGINT) 12:10:30.790469 run patchelf(pid=3909): Terminated: ok {rc=0} 12:10:30.944050 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=3906): Process ended prematurely: osmo-stp_10.42.42.5(pid=3906) [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3906)] [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 12:10:30.955400 tst ping.py:22: Test FAILED (6.7 sec) 12:10:30.988042 run osmo-hlr_10.42.42.2(pid=3903): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3903)] 12:10:31.041445 run osmo-hlr_10.42.42.2(pid=3903): stdout: | (launched: 2022-12-09_12:10:27.577734) 12:10:31.097504 run osmo-hlr_10.42.42.2(pid=3903): stderr: | 20221209121027770 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121027770 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121027770 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121027771 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121027771 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121027771 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121027786 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121027795 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121027795 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121027795 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:10:31.153123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3902): Terminating (SIGTERM) 12:10:31.198313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3905): Terminating (SIGTERM) 12:10:31.244472 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3908): Terminating (SIGTERM) 12:10:31.289833 --- ParallelTerminationStrategy: PID 3902 died... 12:10:31.310949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3902): Terminated: ok {rc=0} 12:10:31.361486 --- ParallelTerminationStrategy: PID 3905 died... 12:10:31.382011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3905): Terminated: ok {rc=0} 12:10:31.432634 --- ParallelTerminationStrategy: PID 3908 died... 12:10:31.453576 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3908): Terminated: ok {rc=0} 12:10:31.546558 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 12:10:32.635743 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:32.647494 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:10:32.719165 tst ping_idle_ping.py: using LAC 21368 12:10:32.838217 tst ping_idle_ping.py: using RAC 203 12:10:32.961035 tst ping_idle_ping.py: using CellId 21368 12:10:33.078501 tst ping_idle_ping.py: using BVCI 21369 12:10:33.197736 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:33.209443 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:33.221716 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:33.233259 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:33.245485 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:33.258592 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:33.270114 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:10:33.282277 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:10:33.400626 tst ping_idle_ping.py:24: start network... 12:10:33.603008 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:10:34.074112 run create_hlr_db(pid=3910): Launched 12:10:34.198694 bus /gobi_6: Setting Powered False 12:10:35.259431 run create_hlr_db(pid=3910): Terminated: ok {rc=0} 12:10:35.683039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3912): Launched 12:10:35.984661 run osmo-hlr_10.42.42.2(pid=3913): Launched 12:10:36.098830 run osmo-stp_10.42.42.5: Starting osmo-stp 12:10:36.633014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3915): Launched 12:10:36.936217 run osmo-stp_10.42.42.5(pid=3916): Launched 12:10:37.052103 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:10:37.572272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3918): Launched 12:10:37.688333 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:10:37.943287 run patchelf(pid=3919): Launched 12:10:38.114476 run osmo-stp_10.42.42.5(pid=3916): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3916)] 12:10:38.244009 run osmo-stp_10.42.42.5(pid=3916): stdout: | (launched: 2022-12-09_12:10:36.880224) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:38.374473 run osmo-stp_10.42.42.5(pid=3916): stderr: | 20221209121037048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121037048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121037049 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121037049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121037050 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121037050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121037050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:38.504839 run osmo-stp_10.42.42.5(pid=3916): stdout: | (launched: 2022-12-09_12:10:36.880224) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:38.629160 run osmo-stp_10.42.42.5(pid=3916): stderr: | 20221209121037048 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121037048 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121037049 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121037049 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121037050 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121037050 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121037050 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:38.776861 run patchelf(pid=3919): Terminating (SIGINT) 12:10:38.948570 run patchelf(pid=3919): Terminated: ok {rc=0} 12:10:39.073579 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=3916): Process ended prematurely: osmo-stp_10.42.42.5(pid=3916) [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3916)] [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 12:10:39.082588 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 12:10:39.109922 run osmo-hlr_10.42.42.2(pid=3913): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3913)] 12:10:39.158118 run osmo-hlr_10.42.42.2(pid=3913): stdout: | (launched: 2022-12-09_12:10:35.928672) 12:10:39.207864 run osmo-hlr_10.42.42.2(pid=3913): stderr: | 20221209121036102 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121036102 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121036102 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121036102 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121036102 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121036102 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121036115 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121036123 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121036124 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121036124 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:10:39.258306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3912): Terminating (SIGTERM) 12:10:39.298664 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3915): Terminating (SIGTERM) 12:10:39.338978 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3918): Terminating (SIGTERM) 12:10:39.379737 --- ParallelTerminationStrategy: PID 3912 died... 12:10:39.398912 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3912): Terminated: ok {rc=0} 12:10:39.443721 --- ParallelTerminationStrategy: PID 3915 died... 12:10:39.462860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3915): Terminated: ok {rc=0} 12:10:39.507410 --- ParallelTerminationStrategy: PID 3918 died... 12:10:39.526533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3918): Terminated: ok {rc=0} 12:10:39.613602 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:10:40.919945 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:10:40.926908 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:10:40.960300 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:10:40.994740 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:10:41.045928 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:10:41.078693 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:10:41.112442 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:10:41.672162 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2359 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:10:41.677208 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:10:41.688217 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:10:41.755727 tst switch_tch_pdch.py: using LAC 21369 12:10:41.885451 tst switch_tch_pdch.py: using RAC 204 12:10:42.028796 tst switch_tch_pdch.py: using CellId 21369 12:10:42.154492 tst switch_tch_pdch.py: using BVCI 21370 12:10:42.273934 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:10:42.285764 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:10:42.297480 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:10:42.309834 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:10:42.322410 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:10:42.335318 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:10:42.346995 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:10:42.359060 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:10:42.477832 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:10:42.601352 tst switch_tch_pdch.py:51: start network... 12:10:42.803751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:10:43.270701 run create_hlr_db(pid=3924): Launched 12:10:43.394630 bus /gobi_6: Setting Powered False 12:10:44.454066 run create_hlr_db(pid=3924): Terminated: ok {rc=0} 12:10:44.897245 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3926): Launched 12:10:45.221111 run osmo-hlr_10.42.42.2(pid=3927): Launched 12:10:45.346560 run osmo-stp_10.42.42.5: Starting osmo-stp 12:10:45.930568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3929): Launched 12:10:46.271943 run osmo-stp_10.42.42.5(pid=3930): Launched 12:10:46.528004 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:10:47.091609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3932): Launched 12:10:47.228151 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:10:47.501777 run patchelf(pid=3933): Launched 12:10:47.682522 run osmo-stp_10.42.42.5(pid=3930): ERR: Terminated: ERROR {rc=1} [trial-2359↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3930)] 12:10:47.820098 run osmo-stp_10.42.42.5(pid=3930): stdout: | (launched: 2022-12-09_12:10:46.207546) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:47.958810 run osmo-stp_10.42.42.5(pid=3930): stderr: | 20221209121046393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121046393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121046393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121046394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121046394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121046395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121046395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:48.098188 run osmo-stp_10.42.42.5(pid=3930): stdout: | (launched: 2022-12-09_12:10:46.207546) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:48.231066 run osmo-stp_10.42.42.5(pid=3930): stderr: | 20221209121046393 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121046393 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121046393 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121046394 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121046394 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121046395 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121046395 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:48.388340 run patchelf(pid=3933): Terminating (SIGINT) 12:10:48.571901 run patchelf(pid=3933): Terminated: ok {rc=0} 12:10:48.703900 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3930): Process ended prematurely: osmo-stp_10.42.42.5(pid=3930) [trial-2359↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3930)] [trial-2359↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:10:48.713612 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 12:10:48.742263 run osmo-hlr_10.42.42.2(pid=3927): ERR: Terminated: ERROR {rc=237} [trial-2359↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3927)] 12:10:48.793387 run osmo-hlr_10.42.42.2(pid=3927): stdout: | (launched: 2022-12-09_12:10:45.162388) 12:10:48.845959 run osmo-hlr_10.42.42.2(pid=3927): stderr: | 20221209121045356 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121045356 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121045356 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121045356 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121045356 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121045356 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121045369 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121045377 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121045377 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121045378 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:10:48.898831 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3926): Terminating (SIGTERM) 12:10:48.941149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3929): Terminating (SIGTERM) 12:10:48.983891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3932): Terminating (SIGTERM) 12:10:49.026588 --- ParallelTerminationStrategy: PID 3926 died... 12:10:49.046759 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3926): Terminated: ok {rc=0} 12:10:49.094222 --- ParallelTerminationStrategy: PID 3929 died... 12:10:49.113988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3929): Terminated: ok {rc=0} 12:10:49.161055 --- ParallelTerminationStrategy: PID 3932 died... 12:10:49.180729 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3932): Terminated: ok {rc=0} 12:10:49.269929 bus /gobi_0: Setting Powered False 12:10:50.368666 bus /gobi_0: Setting Powered False 12:10:51.485557 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 12:10:52.744440 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:10:52.750776 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 12:10:52.785490 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 12:10:52.820895 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 12:10:52.874791 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 12:10:52.908884 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 12:10:52.944363 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 12:10:53.500874 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2359 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 12:10:53.506133 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:10:53.517509 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 12:10:53.588753 tst switch_tch_pdch.py: using LAC 21370 12:10:53.716152 tst switch_tch_pdch.py: using RAC 205 12:10:53.842212 tst switch_tch_pdch.py: using CellId 21370 12:10:53.971418 tst switch_tch_pdch.py: using BVCI 21371 12:10:54.089895 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:10:54.101429 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:10:54.112591 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:10:54.124080 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:10:54.135522 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:10:54.147091 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:10:54.158555 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:10:54.169980 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:10:54.286802 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:10:54.406675 tst switch_tch_pdch.py:51: start network... 12:10:54.624011 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:10:55.094552 run create_hlr_db(pid=3937): Launched 12:10:55.219309 bus /gobi_6: Setting Powered False 12:10:56.282395 run create_hlr_db(pid=3937): Terminated: ok {rc=0} 12:10:56.688789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3939): Launched 12:10:56.989668 run osmo-hlr_10.42.42.2(pid=3940): Launched 12:10:57.104065 run osmo-stp_10.42.42.5: Starting osmo-stp 12:10:57.599342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3942): Launched 12:10:57.900024 run osmo-stp_10.42.42.5(pid=3943): Launched 12:10:58.013922 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:10:58.506295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3945): Launched 12:10:58.621926 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:10:58.876050 run patchelf(pid=3946): Launched 12:10:59.044069 run osmo-stp_10.42.42.5(pid=3943): ERR: Terminated: ERROR {rc=1} [trial-2359↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3943)] 12:10:59.172419 run osmo-stp_10.42.42.5(pid=3943): stdout: | (launched: 2022-12-09_12:10:57.844776) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:59.301273 run osmo-stp_10.42.42.5(pid=3943): stderr: | 20221209121058012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121058012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121058012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121058013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121058013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121058013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121058013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:59.430006 run osmo-stp_10.42.42.5(pid=3943): stdout: | (launched: 2022-12-09_12:10:57.844776) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:10:59.553255 run osmo-stp_10.42.42.5(pid=3943): stderr: | 20221209121058012 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121058012 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121058012 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121058013 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121058013 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121058013 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121058013 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:10:59.698735 run patchelf(pid=3946): Terminating (SIGINT) 12:10:59.869910 run patchelf(pid=3946): Terminated: ok {rc=0} 12:10:59.993605 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=3943): Process ended prematurely: osmo-stp_10.42.42.5(pid=3943) [trial-2359↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3943)] [trial-2359↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 12:11:00.002647 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 12:11:00.029273 run osmo-hlr_10.42.42.2(pid=3940): ERR: Terminated: ERROR {rc=237} [trial-2359↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3940)] 12:11:00.077309 run osmo-hlr_10.42.42.2(pid=3940): stdout: | (launched: 2022-12-09_12:10:56.934391) 12:11:00.127088 run osmo-hlr_10.42.42.2(pid=3940): stderr: | 20221209121057106 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121057106 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121057106 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121057106 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121057107 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121057107 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121057119 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121057127 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121057128 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121057128 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:11:00.177396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3939): Terminating (SIGTERM) 12:11:00.217352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3942): Terminating (SIGTERM) 12:11:00.257287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3945): Terminating (SIGTERM) 12:11:00.298810 --- ParallelTerminationStrategy: PID 3939 died... 12:11:00.318126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3939): Terminated: ok {rc=0} 12:11:00.362628 --- ParallelTerminationStrategy: PID 3942 died... 12:11:00.381354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3942): Terminated: ok {rc=0} 12:11:00.425543 --- ParallelTerminationStrategy: PID 3945 died... 12:11:00.444281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=3945): Terminated: ok {rc=0} 12:11:00.530958 bus /gobi_0: Setting Powered False 12:11:01.639916 bus /gobi_0: Setting Powered False 12:11:02.765922 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 12:11:04.019171 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:11:04.023693 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:11:04.054352 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 12:11:04.061409 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:11:04.115476 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:11:04.144549 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 12:11:04.151381 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:11:04.691164 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 12:11:04.696233 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 12:11:04.708021 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:11:04.754952 tst mo_mt_sms.py: using LAC 21371 12:11:04.883380 tst mo_mt_sms.py: using RAC 206 12:11:05.011547 tst mo_mt_sms.py: using CellId 21371 12:11:05.137359 tst mo_mt_sms.py: using BVCI 21372 12:11:05.253958 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:11:05.371964 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:11:05.487479 tst mo_mt_sms.py:9: start nitb and bts... 12:11:05.690415 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:11:06.303471 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3951): Launched 12:11:06.605403 run osmo-nitb_10.42.42.2(pid=3952): Launched 12:11:06.774186 run osmo-nitb_10.42.42.2(pid=3952): ERR: Terminated: ERROR {rc=2} [trial-2359↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3952)] 12:11:06.910761 run osmo-nitb_10.42.42.2(pid=3952): stdout: | (launched: 2022-12-09_12:11:06.550032) 12:11:07.048917 run osmo-nitb_10.42.42.2(pid=3952): stderr: | (launched: 2022-12-09_12:11:06.594652) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:11:07.187460 run osmo-nitb_10.42.42.2(pid=3952): stdout: | (launched: 2022-12-09_12:11:06.550032) 12:11:07.319961 run osmo-nitb_10.42.42.2(pid=3952): stderr: | (launched: 2022-12-09_12:11:06.594652) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3952): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3952) [trial-2359↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3952)] 12:11:07.719872 tst osmo-nitb_10.42.42.2(pid=3952): stdout: | (launched: 2022-12-09_12:11:06.550032) 12:11:07.842438 tst osmo-nitb_10.42.42.2(pid=3952): stderr: | (launched: 2022-12-09_12:11:06.594652) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:11:07.986629 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=3952): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3952) [trial-2359↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3952)] [trial-2359↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 12:11:07.995158 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 12:11:08.001942 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3951): Terminating (SIGTERM) 12:11:08.211532 --- ParallelTerminationStrategy: PID 3951 died... 12:11:08.232420 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3951): Terminated: ok {rc=0} 12:11:08.317383 bus /sierra_3: Setting Powered False 12:11:09.417759 bus /sierra_3: Setting Powered False 12:11:10.537858 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 12:11:11.733551 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:11:11.737521 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:11:11.766703 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:11:11.793482 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:11:11.846680 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:11:11.877373 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:11:11.903956 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:11:12.449058 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 12:11:12.454199 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:11:12.465279 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:11:12.512413 tst mo_mt_sms.py: using LAC 21372 12:11:12.630329 tst mo_mt_sms.py: using RAC 207 12:11:12.746274 tst mo_mt_sms.py: using CellId 21372 12:11:12.864719 tst mo_mt_sms.py: using BVCI 21373 12:11:12.972699 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:11:12.983495 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:11:12.994184 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:11:13.004894 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:11:13.015557 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:11:13.026269 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:11:13.144339 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:11:13.265729 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:11:13.763972 run create_hlr_db(pid=3956): Launched 12:11:13.887140 bus /sierra_2: Setting Powered False 12:11:14.950911 run create_hlr_db(pid=3956): Terminated: ok {rc=0} 12:11:15.384719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3958): Launched 12:11:15.686941 run osmo-hlr_10.42.42.2(pid=3959): Launched 12:11:15.800712 run osmo-stp_10.42.42.5: Starting osmo-stp 12:11:16.438979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3961): Launched 12:11:16.753232 run osmo-stp_10.42.42.5(pid=3962): Launched 12:11:16.940627 run osmo-msc_10.42.42.6: Starting osmo-msc 12:11:17.637726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3964): Launched 12:11:17.939596 run osmo-msc_10.42.42.6(pid=3965): Launched 12:11:18.107560 run osmo-stp_10.42.42.5(pid=3962): ERR: Terminated: ERROR {rc=1} [trial-2359↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3962)] 12:11:18.234434 run osmo-stp_10.42.42.5(pid=3962): stdout: | (launched: 2022-12-09_12:11:16.696338) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:18.361278 run osmo-stp_10.42.42.5(pid=3962): stderr: | 20221209121117027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121117028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121117028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121117028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121117037 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121117037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121117037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:18.486830 run osmo-stp_10.42.42.5(pid=3962): stdout: | (launched: 2022-12-09_12:11:16.696338) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:18.606795 run osmo-stp_10.42.42.5(pid=3962): stderr: | 20221209121117027 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121117028 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121117028 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121117028 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121117037 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121117037 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121117037 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:18.750162 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=3962): Process ended prematurely: osmo-stp_10.42.42.5(pid=3962) [trial-2359↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3962)] [trial-2359↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 12:11:18.758539 tst mo_mt_sms.py:16: Test FAILED (6.3 sec) 12:11:18.785375 run osmo-hlr_10.42.42.2(pid=3959): ERR: Terminated: ERROR {rc=237} [trial-2359↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3959)] 12:11:18.834270 run osmo-hlr_10.42.42.2(pid=3959): stdout: | (launched: 2022-12-09_12:11:15.631272) 12:11:18.884457 run osmo-hlr_10.42.42.2(pid=3959): stderr: | 20221209121115805 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121115805 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121115805 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121115805 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121115805 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121115805 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121115817 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121115826 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121115826 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121115826 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:11:18.954240 run osmo-msc_10.42.42.6(pid=3965): ERR: Terminated: ERROR {rc=2} [trial-2359↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3965)] 12:11:19.002677 run osmo-msc_10.42.42.6(pid=3965): stdout: | (launched: 2022-12-09_12:11:17.883775) 12:11:19.052391 run osmo-msc_10.42.42.6(pid=3965): stderr: | 20221209121118154 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121118154 DLGLOBAL DEBUG validating counter group 0x7fe62b134c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121118154 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121118154 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121118155 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121118155 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121118156 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121118157 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121118157 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121118157 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:11:19.102923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3958): Terminating (SIGTERM) 12:11:19.143457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3961): Terminating (SIGTERM) 12:11:19.184008 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3964): Terminating (SIGTERM) 12:11:19.224836 --- ParallelTerminationStrategy: PID 3958 died... 12:11:19.244237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3958): Terminated: ok {rc=0} 12:11:19.289130 --- ParallelTerminationStrategy: PID 3961 died... 12:11:19.308335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3961): Terminated: ok {rc=0} 12:11:19.353938 --- ParallelTerminationStrategy: PID 3964 died... 12:11:19.373044 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3964): Terminated: ok {rc=0} 12:11:19.460686 bus /sierra_3: Setting Powered False 12:11:20.562655 bus /sierra_3: Setting Powered False 12:11:21.676815 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 12:11:22.906605 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:11:22.910646 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:11:22.941254 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 12:11:22.948330 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 12:11:22.984493 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:11:23.015515 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 12:11:23.022591 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 12:11:23.543025 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2359 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 12:11:23.548354 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 12:11:23.559918 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:11:23.605633 tst assert_extension.py: using LAC 21373 12:11:23.727853 tst assert_extension.py: using RAC 208 12:11:23.848514 tst assert_extension.py: using CellId 21373 12:11:23.967821 tst assert_extension.py: using BVCI 21374 12:11:24.078055 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 12:11:24.195690 tst assert_extension.py:10: start nitb and bts... 12:11:24.398700 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:11:25.014909 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3972): Launched 12:11:25.316283 run osmo-nitb_10.42.42.2(pid=3973): Launched 12:11:25.484111 run osmo-nitb_10.42.42.2(pid=3973): ERR: Terminated: ERROR {rc=2} [trial-2359↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3973)] 12:11:25.619297 run osmo-nitb_10.42.42.2(pid=3973): stdout: | (launched: 2022-12-09_12:11:25.260817) 12:11:25.755804 run osmo-nitb_10.42.42.2(pid=3973): stderr: | (launched: 2022-12-09_12:11:25.305651) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:11:25.892614 run osmo-nitb_10.42.42.2(pid=3973): stdout: | (launched: 2022-12-09_12:11:25.260817) 12:11:26.023105 run osmo-nitb_10.42.42.2(pid=3973): stderr: | (launched: 2022-12-09_12:11:25.305651) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=3973): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3973) [trial-2359↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3973)] 12:11:26.430212 tst osmo-nitb_10.42.42.2(pid=3973): stdout: | (launched: 2022-12-09_12:11:25.260817) 12:11:26.551881 tst osmo-nitb_10.42.42.2(pid=3973): stderr: | (launched: 2022-12-09_12:11:25.305651) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:11:26.694974 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=3973): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3973) [trial-2359↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3973)] [trial-2359↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 12:11:26.703661 tst assert_extension.py:12: Test FAILED (3.1 sec) 12:11:26.710441 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3972): Terminating (SIGTERM) 12:11:26.919217 --- ParallelTerminationStrategy: PID 3972 died... 12:11:26.940886 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=3972): Terminated: ok {rc=0} 12:11:27.026181 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 12:11:28.202254 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:11:28.207379 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:11:28.238467 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:11:28.265987 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 12:11:28.302605 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:11:28.332163 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:11:28.358865 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 12:11:28.890606 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2359 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 12:11:28.896825 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:11:28.908897 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:11:28.954670 tst assert_extension.py: using LAC 21374 12:11:29.083515 tst assert_extension.py: using RAC 209 12:11:29.210740 tst assert_extension.py: using CellId 21374 12:11:29.336447 tst assert_extension.py: using BVCI 21375 12:11:29.455160 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:11:29.466493 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:11:29.477628 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:11:29.489002 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:11:29.500213 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:11:29.511525 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 12:11:29.627726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:11:30.094647 run create_hlr_db(pid=3977): Launched 12:11:30.219887 bus /sierra_2: Setting Powered False 12:11:31.279394 run create_hlr_db(pid=3977): Terminated: ok {rc=0} 12:11:31.746927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3979): Launched 12:11:32.085374 run osmo-hlr_10.42.42.2(pid=3980): Launched 12:11:32.245313 run osmo-stp_10.42.42.5: Starting osmo-stp 12:11:32.771869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3982): Launched 12:11:33.075431 run osmo-stp_10.42.42.5(pid=3983): Launched 12:11:33.190487 run osmo-msc_10.42.42.6: Starting osmo-msc 12:11:33.734800 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3985): Launched 12:11:34.036210 run osmo-msc_10.42.42.6(pid=3986): Launched 12:11:34.203651 run osmo-stp_10.42.42.5(pid=3983): ERR: Terminated: ERROR {rc=1} [trial-2359↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3983)] 12:11:34.330709 run osmo-stp_10.42.42.5(pid=3983): stdout: | (launched: 2022-12-09_12:11:33.019697) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:34.457883 run osmo-stp_10.42.42.5(pid=3983): stderr: | 20221209121133186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121133187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121133187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121133187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121133188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121133188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121133188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:34.582994 run osmo-stp_10.42.42.5(pid=3983): stdout: | (launched: 2022-12-09_12:11:33.019697) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:34.702074 run osmo-stp_10.42.42.5(pid=3983): stderr: | 20221209121133186 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121133187 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121133187 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121133187 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121133188 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121133188 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121133188 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:34.845323 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=3983): Process ended prematurely: osmo-stp_10.42.42.5(pid=3983) [trial-2359↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3983)] [trial-2359↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 12:11:34.853617 tst assert_extension.py:17: Test FAILED (6.0 sec) 12:11:34.880029 run osmo-hlr_10.42.42.2(pid=3980): ERR: Terminated: ERROR {rc=237} [trial-2359↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3980)] 12:11:34.927844 run osmo-hlr_10.42.42.2(pid=3980): stdout: | (launched: 2022-12-09_12:11:32.026425) 12:11:34.977770 run osmo-hlr_10.42.42.2(pid=3980): stderr: | 20221209121132311 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121132311 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121132311 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121132311 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121132311 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121132311 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121132323 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121132332 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121132332 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121132332 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:11:35.047087 run osmo-msc_10.42.42.6(pid=3986): ERR: Terminated: ERROR {rc=2} [trial-2359↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=3986)] 12:11:35.094609 run osmo-msc_10.42.42.6(pid=3986): stdout: | (launched: 2022-12-09_12:11:33.980641) 12:11:35.143937 run osmo-msc_10.42.42.6(pid=3986): stderr: | 20221209121134250 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121134250 DLGLOBAL DEBUG validating counter group 0x7f8fcf286c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121134250 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121134250 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121134251 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121134251 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121134252 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121134253 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121134254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121134254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:11:35.193631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3979): Terminating (SIGTERM) 12:11:35.233507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3982): Terminating (SIGTERM) 12:11:35.273640 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3985): Terminating (SIGTERM) 12:11:35.314156 --- ParallelTerminationStrategy: PID 3979 died... 12:11:35.333598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3979): Terminated: ok {rc=0} 12:11:35.378373 --- ParallelTerminationStrategy: PID 3982 died... 12:11:35.397428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3982): Terminated: ok {rc=0} 12:11:35.442314 --- ParallelTerminationStrategy: PID 3985 died... 12:11:35.461496 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3985): Terminated: ok {rc=0} 12:11:35.548330 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:11:36.758882 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:11:36.765672 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:11:36.794804 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:11:36.822085 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:11:36.873437 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:11:36.902414 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:11:36.928710 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:11:37.482206 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:11:37.532002 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:37.543316 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:11:37.608885 tst mo_mt_call.py: using LAC 21375 12:11:37.730590 tst mo_mt_call.py: using RAC 210 12:11:37.861376 tst mo_mt_call.py: using CellId 21375 12:11:37.989440 tst mo_mt_call.py: using BVCI 21376 12:11:38.102120 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:38.113651 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:38.125022 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:38.136084 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:38.147465 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:38.158762 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:11:38.277333 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:11:38.394034 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:11:38.870591 run create_hlr_db(pid=3991): Launched 12:11:38.997902 bus /sierra_2: Setting Powered False 12:11:40.059372 run create_hlr_db(pid=3991): Terminated: ok {rc=0} 12:11:40.509610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3993): Launched 12:11:40.841245 run osmo-hlr_10.42.42.2(pid=3994): Launched 12:11:40.968155 run osmo-stp_10.42.42.5: Starting osmo-stp 12:11:41.536255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3996): Launched 12:11:41.867043 run osmo-stp_10.42.42.5(pid=3997): Launched 12:11:41.993985 run osmo-msc_10.42.42.6: Starting osmo-msc 12:11:42.587306 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3999): Launched 12:11:42.918264 run osmo-msc_10.42.42.6(pid=4000): Launched 12:11:43.103484 run osmo-stp_10.42.42.5(pid=3997): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3997)] 12:11:43.242385 run osmo-stp_10.42.42.5(pid=3997): stdout: | (launched: 2022-12-09_12:11:41.807129) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:43.382119 run osmo-stp_10.42.42.5(pid=3997): stderr: | 20221209121141995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121141995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121141995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121141996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121141996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121141996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121141996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:43.519266 run osmo-stp_10.42.42.5(pid=3997): stdout: | (launched: 2022-12-09_12:11:41.807129) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:43.650485 run osmo-stp_10.42.42.5(pid=3997): stderr: | 20221209121141995 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121141995 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121141995 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121141996 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121141996 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121141996 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121141996 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:43.807303 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=3997): Process ended prematurely: osmo-stp_10.42.42.5(pid=3997) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3997)] [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:11:43.816835 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:11:43.845987 run osmo-hlr_10.42.42.2(pid=3994): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=3994)] 12:11:43.896892 run osmo-hlr_10.42.42.2(pid=3994): stdout: | (launched: 2022-12-09_12:11:40.780587) 12:11:43.949715 run osmo-hlr_10.42.42.2(pid=3994): stderr: | 20221209121140974 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121140974 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121140974 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121140974 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121140974 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121140974 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121140986 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121140994 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121140994 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121140994 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:11:44.023523 run osmo-msc_10.42.42.6(pid=4000): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4000)] 12:11:44.074474 run osmo-msc_10.42.42.6(pid=4000): stdout: | (launched: 2022-12-09_12:11:42.858122) 12:11:44.127081 run osmo-msc_10.42.42.6(pid=4000): stderr: | 20221209121143175 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121143175 DLGLOBAL DEBUG validating counter group 0x7f1e309dec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121143175 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121143175 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121143175 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121143175 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121143177 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121143177 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121143178 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121143178 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:11:44.179876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3993): Terminating (SIGTERM) 12:11:44.222484 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3996): Terminating (SIGTERM) 12:11:44.265265 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3999): Terminating (SIGTERM) 12:11:44.308270 --- ParallelTerminationStrategy: PID 3993 died... 12:11:44.328638 run pcap-recorder_any(filters='host 10.42.42.2')(pid=3993): Terminated: ok {rc=0} 12:11:44.376187 --- ParallelTerminationStrategy: PID 3996 died... 12:11:44.396138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=3996): Terminated: ok {rc=0} 12:11:44.443501 --- ParallelTerminationStrategy: PID 3999 died... 12:11:44.463463 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=3999): Terminated: ok {rc=0} 12:11:44.553003 bus /sierra_3: Setting Powered False 12:11:45.652324 bus /sierra_3: Setting Powered False 12:11:46.783210 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:11:47.935143 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:47.947775 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:11:48.018495 tst mo_mt_call_osmux.py: using LAC 21376 12:11:48.149450 tst mo_mt_call_osmux.py: using RAC 211 12:11:48.272207 tst mo_mt_call_osmux.py: using CellId 21376 12:11:48.397614 tst mo_mt_call_osmux.py: using BVCI 21377 12:11:48.510501 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:48.522314 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:48.533741 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:48.545354 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:48.556844 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:11:48.568426 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:11:48.690301 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:11:48.808367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:11:49.286797 run create_hlr_db(pid=4002): Launched 12:11:49.412832 bus /sierra_2: Setting Powered False 12:11:50.473292 run create_hlr_db(pid=4002): Terminated: ok {rc=0} 12:11:50.925531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4004): Launched 12:11:51.258425 run osmo-hlr_10.42.42.2(pid=4005): Launched 12:11:51.383604 run osmo-stp_10.42.42.5: Starting osmo-stp 12:11:51.958413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4007): Launched 12:11:52.290281 run osmo-stp_10.42.42.5(pid=4008): Launched 12:11:52.415138 run osmo-msc_10.42.42.6: Starting osmo-msc 12:11:53.014426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4010): Launched 12:11:53.344228 run osmo-msc_10.42.42.6(pid=4011): Launched 12:11:53.529872 run osmo-stp_10.42.42.5(pid=4008): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4008)] 12:11:53.668563 run osmo-stp_10.42.42.5(pid=4008): stdout: | (launched: 2022-12-09_12:11:52.230043) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:53.807809 run osmo-stp_10.42.42.5(pid=4008): stderr: | 20221209121152418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121152419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121152419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121152419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121152420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121152420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121152420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:53.945939 run osmo-stp_10.42.42.5(pid=4008): stdout: | (launched: 2022-12-09_12:11:52.230043) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:11:54.077952 run osmo-stp_10.42.42.5(pid=4008): stderr: | 20221209121152418 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121152419 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121152419 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121152419 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121152420 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121152420 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121152420 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:11:54.235447 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4008): Process ended prematurely: osmo-stp_10.42.42.5(pid=4008) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4008)] [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:11:54.245165 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:11:54.274042 run osmo-hlr_10.42.42.2(pid=4005): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4005)] 12:11:54.325101 run osmo-hlr_10.42.42.2(pid=4005): stdout: | (launched: 2022-12-09_12:11:51.198141) 12:11:54.377677 run osmo-hlr_10.42.42.2(pid=4005): stderr: | 20221209121151392 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121151392 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121151392 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121151392 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121151392 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121151393 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121151405 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121151414 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121151414 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121151414 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:11:54.450940 run osmo-msc_10.42.42.6(pid=4011): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4011)] 12:11:54.501626 run osmo-msc_10.42.42.6(pid=4011): stdout: | (launched: 2022-12-09_12:11:53.283770) 12:11:54.554326 run osmo-msc_10.42.42.6(pid=4011): stderr: | 20221209121153602 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121153603 DLGLOBAL DEBUG validating counter group 0x7fbc7f1d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121153603 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121153603 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121153603 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121153603 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121153605 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121153605 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121153606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121153606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:11:54.607372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4004): Terminating (SIGTERM) 12:11:54.649962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4007): Terminating (SIGTERM) 12:11:54.692579 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4010): Terminating (SIGTERM) 12:11:54.736094 --- ParallelTerminationStrategy: PID 4004 died... 12:11:54.756394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4004): Terminated: ok {rc=0} 12:11:54.803678 --- ParallelTerminationStrategy: PID 4007 died... 12:11:54.823606 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4007): Terminated: ok {rc=0} 12:11:54.871134 --- ParallelTerminationStrategy: PID 4010 died... 12:11:54.890992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4010): Terminated: ok {rc=0} 12:11:54.981097 bus /sierra_3: Setting Powered False 12:11:56.079686 bus /sierra_3: Setting Powered False 12:11:57.195514 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:11:58.447790 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:11:58.455188 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:11:58.485954 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:11:58.513725 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:11:58.567416 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:11:58.597275 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:11:58.624467 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:11:59.178163 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:11:59.232673 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:11:59.244641 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:11:59.313452 tst mo_mt_call.py: using LAC 21377 12:11:59.443485 tst mo_mt_call.py: using RAC 212 12:11:59.573124 tst mo_mt_call.py: using CellId 21377 12:11:59.696574 tst mo_mt_call.py: using BVCI 21378 12:11:59.817426 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:11:59.829436 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:11:59.841307 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:11:59.853388 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:11:59.866128 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:11:59.878489 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:11:59.997318 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:12:00.113390 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:00.624514 run create_hlr_db(pid=4016): Launched 12:12:00.751232 bus /sierra_2: Setting Powered False 12:12:01.812247 run create_hlr_db(pid=4016): Terminated: ok {rc=0} 12:12:02.276506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4018): Launched 12:12:02.607618 run osmo-hlr_10.42.42.2(pid=4019): Launched 12:12:02.732801 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:03.303919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4021): Launched 12:12:03.636459 run osmo-stp_10.42.42.5(pid=4022): Launched 12:12:03.761625 run osmo-msc_10.42.42.6: Starting osmo-msc 12:12:04.357576 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4024): Launched 12:12:04.690453 run osmo-msc_10.42.42.6(pid=4025): Launched 12:12:04.876027 run osmo-stp_10.42.42.5(pid=4022): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4022)] 12:12:05.015572 run osmo-stp_10.42.42.5(pid=4022): stdout: | (launched: 2022-12-09_12:12:03.576084) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:05.155201 run osmo-stp_10.42.42.5(pid=4022): stderr: | 20221209121203767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121203767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121203767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121203767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121203768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121203768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121203768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:05.292659 run osmo-stp_10.42.42.5(pid=4022): stdout: | (launched: 2022-12-09_12:12:03.576084) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:05.423448 run osmo-stp_10.42.42.5(pid=4022): stderr: | 20221209121203767 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121203767 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121203767 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121203767 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121203768 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121203768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121203768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:05.580061 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4022): Process ended prematurely: osmo-stp_10.42.42.5(pid=4022) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4022)] [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:12:05.589744 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:12:05.618442 run osmo-hlr_10.42.42.2(pid=4019): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4019)] 12:12:05.669128 run osmo-hlr_10.42.42.2(pid=4019): stdout: | (launched: 2022-12-09_12:12:02.547200) 12:12:05.721688 run osmo-hlr_10.42.42.2(pid=4019): stderr: | 20221209121202742 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121202742 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121202742 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121202742 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121202742 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121202742 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121202754 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121202762 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121202763 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121202763 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:12:05.794719 run osmo-msc_10.42.42.6(pid=4025): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4025)] 12:12:05.844886 run osmo-msc_10.42.42.6(pid=4025): stdout: | (launched: 2022-12-09_12:12:04.629435) 12:12:05.896710 run osmo-msc_10.42.42.6(pid=4025): stderr: | 20221209121204949 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121204949 DLGLOBAL DEBUG validating counter group 0x7fad19babc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121204949 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121204949 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121204949 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121204950 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121204951 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121204952 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121204952 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121204952 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:12:05.949070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4018): Terminating (SIGTERM) 12:12:05.991566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4021): Terminating (SIGTERM) 12:12:06.034350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4024): Terminating (SIGTERM) 12:12:06.077112 --- ParallelTerminationStrategy: PID 4018 died... 12:12:06.097231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4018): Terminated: ok {rc=0} 12:12:06.143938 --- ParallelTerminationStrategy: PID 4021 died... 12:12:06.163641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4021): Terminated: ok {rc=0} 12:12:06.210479 --- ParallelTerminationStrategy: PID 4024 died... 12:12:06.230100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4024): Terminated: ok {rc=0} 12:12:06.319197 bus /sierra_3: Setting Powered False 12:12:07.418959 bus /sierra_3: Setting Powered False 12:12:08.534695 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:12:09.686657 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:12:09.699290 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:12:09.767233 tst mo_mt_call_osmux.py: using LAC 21378 12:12:09.895945 tst mo_mt_call_osmux.py: using RAC 213 12:12:10.025030 tst mo_mt_call_osmux.py: using CellId 21378 12:12:10.154138 tst mo_mt_call_osmux.py: using BVCI 21379 12:12:10.274325 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:12:10.286155 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:12:10.297805 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:12:10.309749 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:12:10.321695 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:12:10.333575 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:12:10.454223 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:12:10.578925 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:11.092736 run create_hlr_db(pid=4027): Launched 12:12:11.218234 bus /sierra_2: Setting Powered False 12:12:12.283620 run create_hlr_db(pid=4027): Terminated: ok {rc=0} 12:12:12.725792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4029): Launched 12:12:13.037573 run osmo-hlr_10.42.42.2(pid=4030): Launched 12:12:13.155917 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:13.718547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4032): Launched 12:12:14.050180 run osmo-stp_10.42.42.5(pid=4033): Launched 12:12:14.175344 run osmo-msc_10.42.42.6: Starting osmo-msc 12:12:14.770676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4035): Launched 12:12:15.103841 run osmo-msc_10.42.42.6(pid=4036): Launched 12:12:15.289273 run osmo-stp_10.42.42.5(pid=4033): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4033)] 12:12:15.428479 run osmo-stp_10.42.42.5(pid=4033): stdout: | (launched: 2022-12-09_12:12:13.989201) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:15.567946 run osmo-stp_10.42.42.5(pid=4033): stderr: | 20221209121214178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121214179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121214179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121214179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121214180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121214180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121214180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:15.705769 run osmo-stp_10.42.42.5(pid=4033): stdout: | (launched: 2022-12-09_12:12:13.989201) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:15.846798 run osmo-stp_10.42.42.5(pid=4033): stderr: | 20221209121214178 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121214179 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121214179 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121214179 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121214180 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121214180 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121214180 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:16.021075 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4033): Process ended prematurely: osmo-stp_10.42.42.5(pid=4033) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4033)] [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:12:16.031867 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:12:16.063461 run osmo-hlr_10.42.42.2(pid=4030): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4030)] 12:12:16.116351 run osmo-hlr_10.42.42.2(pid=4030): stdout: | (launched: 2022-12-09_12:12:12.979899) 12:12:16.171114 run osmo-hlr_10.42.42.2(pid=4030): stderr: | 20221209121213154 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121213154 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121213154 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121213154 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121213154 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121213154 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121213166 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121213174 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121213175 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121213175 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:12:16.246682 run osmo-msc_10.42.42.6(pid=4036): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4036)] 12:12:16.299802 run osmo-msc_10.42.42.6(pid=4036): stdout: | (launched: 2022-12-09_12:12:15.042339) 12:12:16.354688 run osmo-msc_10.42.42.6(pid=4036): stderr: | 20221209121215360 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121215360 DLGLOBAL DEBUG validating counter group 0x7fcc45db5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121215360 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121215360 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121215360 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121215361 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121215362 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121215363 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121215363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121215363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:12:16.410075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4029): Terminating (SIGTERM) 12:12:16.455046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4032): Terminating (SIGTERM) 12:12:16.501705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4035): Terminating (SIGTERM) 12:12:16.547980 --- ParallelTerminationStrategy: PID 4029 died... 12:12:16.569179 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4029): Terminated: ok {rc=0} 12:12:16.619165 --- ParallelTerminationStrategy: PID 4032 died... 12:12:16.640007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4032): Terminated: ok {rc=0} 12:12:16.690100 --- ParallelTerminationStrategy: PID 4035 died... 12:12:16.710928 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4035): Terminated: ok {rc=0} 12:12:16.818939 bus /sierra_3: Setting Powered False 12:12:17.914498 bus /sierra_3: Setting Powered False 12:12:19.030429 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:12:20.275874 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:12:20.282493 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:12:20.311658 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:12:20.338299 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:12:20.390385 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:12:20.419173 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:12:20.445613 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:12:20.998247 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:12:21.047147 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:21.058514 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:12:21.124039 tst mo_mt_call.py: using LAC 21379 12:12:21.247214 tst mo_mt_call.py: using RAC 214 12:12:21.367606 tst mo_mt_call.py: using CellId 21379 12:12:21.486361 tst mo_mt_call.py: using BVCI 21380 12:12:21.599418 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:21.610690 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:21.621838 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:21.632829 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:21.643967 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:21.654976 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:12:21.775752 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:12:21.896862 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:22.409492 run create_hlr_db(pid=4041): Launched 12:12:22.539276 bus /sierra_2: Setting Powered False 12:12:23.605330 run create_hlr_db(pid=4041): Terminated: ok {rc=0} 12:12:24.047975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4043): Launched 12:12:24.358626 run osmo-hlr_10.42.42.2(pid=4044): Launched 12:12:24.475839 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:25.017556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4046): Launched 12:12:25.326139 run osmo-stp_10.42.42.5(pid=4047): Launched 12:12:25.442390 run osmo-msc_10.42.42.6: Starting osmo-msc 12:12:26.001729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4049): Launched 12:12:26.313204 run osmo-msc_10.42.42.6(pid=4050): Launched 12:12:26.485098 run osmo-stp_10.42.42.5(pid=4047): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4047)] 12:12:26.615153 run osmo-stp_10.42.42.5(pid=4047): stdout: | (launched: 2022-12-09_12:12:25.269166) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:26.745120 run osmo-stp_10.42.42.5(pid=4047): stderr: | 20221209121225437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121225437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121225438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121225438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121225438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121225439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121225439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:26.873266 run osmo-stp_10.42.42.5(pid=4047): stdout: | (launched: 2022-12-09_12:12:25.269166) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:26.995468 run osmo-stp_10.42.42.5(pid=4047): stderr: | 20221209121225437 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121225437 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121225438 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121225438 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121225438 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121225439 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121225439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:27.141803 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4047): Process ended prematurely: osmo-stp_10.42.42.5(pid=4047) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4047)] [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:12:27.150739 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 12:12:27.177529 run osmo-hlr_10.42.42.2(pid=4044): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4044)] 12:12:27.225862 run osmo-hlr_10.42.42.2(pid=4044): stdout: | (launched: 2022-12-09_12:12:24.301104) 12:12:27.275763 run osmo-hlr_10.42.42.2(pid=4044): stderr: | 20221209121224474 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121224474 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121224474 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121224474 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121224474 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121224475 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121224487 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121224495 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121224496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121224496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:12:27.345998 run osmo-msc_10.42.42.6(pid=4050): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4050)] 12:12:27.394250 run osmo-msc_10.42.42.6(pid=4050): stdout: | (launched: 2022-12-09_12:12:26.255007) 12:12:27.443942 run osmo-msc_10.42.42.6(pid=4050): stderr: | 20221209121226527 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121226527 DLGLOBAL DEBUG validating counter group 0x7f22895e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121226527 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121226527 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121226528 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121226528 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121226530 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121226530 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121226530 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121226530 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:12:27.493936 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4043): Terminating (SIGTERM) 12:12:27.533766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4046): Terminating (SIGTERM) 12:12:27.573723 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4049): Terminating (SIGTERM) 12:12:27.613995 --- ParallelTerminationStrategy: PID 4043 died... 12:12:27.633377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4043): Terminated: ok {rc=0} 12:12:27.677988 --- ParallelTerminationStrategy: PID 4046 died... 12:12:27.696609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4046): Terminated: ok {rc=0} 12:12:27.740832 --- ParallelTerminationStrategy: PID 4049 died... 12:12:27.760000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4049): Terminated: ok {rc=0} 12:12:27.846517 bus /sierra_3: Setting Powered False 12:12:28.944716 bus /sierra_3: Setting Powered False 12:12:30.058012 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:12:31.208557 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:31.222257 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:12:31.293300 tst mo_mt_call_osmux.py: using LAC 21380 12:12:31.417669 tst mo_mt_call_osmux.py: using RAC 215 12:12:31.544521 tst mo_mt_call_osmux.py: using CellId 21380 12:12:31.666914 tst mo_mt_call_osmux.py: using BVCI 21381 12:12:31.820244 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:31.832459 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:31.844523 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:31.856501 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:31.868804 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:12:31.880617 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:12:32.004286 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:12:32.142916 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:32.677398 run create_hlr_db(pid=4052): Launched 12:12:32.803238 bus /sierra_2: Setting Powered False 12:12:33.869148 run create_hlr_db(pid=4052): Terminated: ok {rc=0} 12:12:34.327355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4054): Launched 12:12:34.658246 run osmo-hlr_10.42.42.2(pid=4055): Launched 12:12:34.785092 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:35.355706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4057): Launched 12:12:35.688919 run osmo-stp_10.42.42.5(pid=4058): Launched 12:12:35.817106 run osmo-msc_10.42.42.6: Starting osmo-msc 12:12:36.416781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4060): Launched 12:12:36.747342 run osmo-msc_10.42.42.6(pid=4061): Launched 12:12:36.931647 run osmo-stp_10.42.42.5(pid=4058): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4058)] 12:12:37.071005 run osmo-stp_10.42.42.5(pid=4058): stdout: | (launched: 2022-12-09_12:12:35.628094) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:37.210676 run osmo-stp_10.42.42.5(pid=4058): stderr: | 20221209121235821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121235821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121235822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121235822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121235822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121235823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121235823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:37.347754 run osmo-stp_10.42.42.5(pid=4058): stdout: | (launched: 2022-12-09_12:12:35.628094) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:37.478867 run osmo-stp_10.42.42.5(pid=4058): stderr: | 20221209121235821 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121235821 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121235822 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121235822 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121235822 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121235823 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121235823 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:37.635619 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4058): Process ended prematurely: osmo-stp_10.42.42.5(pid=4058) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4058)] [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:12:37.645105 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 12:12:37.674141 run osmo-hlr_10.42.42.2(pid=4055): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4055)] 12:12:37.724937 run osmo-hlr_10.42.42.2(pid=4055): stdout: | (launched: 2022-12-09_12:12:34.597864) 12:12:37.777852 run osmo-hlr_10.42.42.2(pid=4055): stderr: | 20221209121234793 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121234793 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121234793 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121234793 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121234793 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121234793 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121234805 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121234813 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121234813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121234813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:12:37.850902 run osmo-msc_10.42.42.6(pid=4061): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4061)] 12:12:37.902295 run osmo-msc_10.42.42.6(pid=4061): stdout: | (launched: 2022-12-09_12:12:36.686969) 12:12:37.954924 run osmo-msc_10.42.42.6(pid=4061): stderr: | 20221209121237005 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121237005 DLGLOBAL DEBUG validating counter group 0x7f93222c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121237005 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121237005 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121237005 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121237006 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121237007 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121237008 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121237008 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121237008 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:12:38.008133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4054): Terminating (SIGTERM) 12:12:38.051192 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4057): Terminating (SIGTERM) 12:12:38.094167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4060): Terminating (SIGTERM) 12:12:38.137152 --- ParallelTerminationStrategy: PID 4054 died... 12:12:38.157441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4054): Terminated: ok {rc=0} 12:12:38.204618 --- ParallelTerminationStrategy: PID 4057 died... 12:12:38.224465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4057): Terminated: ok {rc=0} 12:12:38.271713 --- ParallelTerminationStrategy: PID 4060 died... 12:12:38.291649 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4060): Terminated: ok {rc=0} 12:12:38.381703 bus /sierra_3: Setting Powered False 12:12:39.481125 bus /sierra_3: Setting Powered False 12:12:40.597448 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 12:12:41.850287 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:12:41.857244 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 12:12:41.888189 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 12:12:41.916031 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 12:12:41.968559 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 12:12:41.998643 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 12:12:42.026524 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 12:12:42.580208 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 12:12:42.633370 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:42.645078 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:12:42.711559 tst mo_mt_call.py: using LAC 21381 12:12:42.841387 tst mo_mt_call.py: using RAC 216 12:12:42.968773 tst mo_mt_call.py: using CellId 21381 12:12:43.096626 tst mo_mt_call.py: using BVCI 21382 12:12:43.215664 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:43.227515 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:43.239113 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:43.251424 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:43.263552 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:43.275343 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:12:43.393720 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:12:43.515333 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:44.028176 run create_hlr_db(pid=4066): Launched 12:12:44.156266 bus /sierra_2: Setting Powered False 12:12:45.222015 run create_hlr_db(pid=4066): Terminated: ok {rc=0} 12:12:45.663705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4068): Launched 12:12:46.009748 run osmo-hlr_10.42.42.2(pid=4069): Launched 12:12:46.263108 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:46.915238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4071): Launched 12:12:47.275221 run osmo-stp_10.42.42.5(pid=4072): Launched 12:12:47.435175 run osmo-msc_10.42.42.6: Starting osmo-msc 12:12:48.034903 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4074): Launched 12:12:48.368248 run osmo-msc_10.42.42.6(pid=4075): Launched 12:12:48.555052 run osmo-stp_10.42.42.5(pid=4072): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4072)] 12:12:48.694959 run osmo-stp_10.42.42.5(pid=4072): stdout: | (launched: 2022-12-09_12:12:47.216918) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:48.835323 run osmo-stp_10.42.42.5(pid=4072): stderr: | 20221209121247442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121247442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121247442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121247443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121247443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121247443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121247443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:48.973215 run osmo-stp_10.42.42.5(pid=4072): stdout: | (launched: 2022-12-09_12:12:47.216918) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:49.105200 run osmo-stp_10.42.42.5(pid=4072): stderr: | 20221209121247442 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121247442 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121247442 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121247443 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121247443 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121247443 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121247443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:49.262487 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4072): Process ended prematurely: osmo-stp_10.42.42.5(pid=4072) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4072)] [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 12:12:49.272193 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 12:12:49.301399 run osmo-hlr_10.42.42.2(pid=4069): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4069)] 12:12:49.352772 run osmo-hlr_10.42.42.2(pid=4069): stdout: | (launched: 2022-12-09_12:12:45.945431) 12:12:49.405586 run osmo-hlr_10.42.42.2(pid=4069): stderr: | 20221209121246375 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121246375 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121246375 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121246375 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121246375 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121246375 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121246402 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121246430 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121246430 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121246431 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:12:49.479070 run osmo-msc_10.42.42.6(pid=4075): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4075)] 12:12:49.529743 run osmo-msc_10.42.42.6(pid=4075): stdout: | (launched: 2022-12-09_12:12:48.307312) 12:12:49.582194 run osmo-msc_10.42.42.6(pid=4075): stderr: | 20221209121248626 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121248626 DLGLOBAL DEBUG validating counter group 0x7f92e4ebac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121248626 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121248627 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121248627 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121248627 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121248629 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121248629 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121248629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121248629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:12:49.635377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4068): Terminating (SIGTERM) 12:12:49.677986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4071): Terminating (SIGTERM) 12:12:49.720543 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4074): Terminating (SIGTERM) 12:12:49.764057 --- ParallelTerminationStrategy: PID 4068 died... 12:12:49.784380 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4068): Terminated: ok {rc=0} 12:12:49.831912 --- ParallelTerminationStrategy: PID 4071 died... 12:12:49.852075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4071): Terminated: ok {rc=0} 12:12:49.899053 --- ParallelTerminationStrategy: PID 4074 died... 12:12:49.918988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4074): Terminated: ok {rc=0} 12:12:50.009175 bus /sierra_3: Setting Powered False 12:12:51.110008 bus /sierra_3: Setting Powered False 12:12:52.228722 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 12:12:53.382408 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:53.395186 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 12:12:53.467529 tst mo_mt_call_osmux.py: using LAC 21382 12:12:53.597602 tst mo_mt_call_osmux.py: using RAC 217 12:12:53.718556 tst mo_mt_call_osmux.py: using CellId 21382 12:12:53.839311 tst mo_mt_call_osmux.py: using BVCI 21383 12:12:53.952396 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:53.963914 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:53.975127 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:53.986311 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:53.997704 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 12:12:54.009357 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:12:54.131401 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 12:12:54.250768 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:12:54.728706 run create_hlr_db(pid=4077): Launched 12:12:54.854554 bus /sierra_2: Setting Powered False 12:12:55.916567 run create_hlr_db(pid=4077): Terminated: ok {rc=0} 12:12:56.367987 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4079): Launched 12:12:56.700326 run osmo-hlr_10.42.42.2(pid=4080): Launched 12:12:56.825820 run osmo-stp_10.42.42.5: Starting osmo-stp 12:12:57.397498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4082): Launched 12:12:57.729887 run osmo-stp_10.42.42.5(pid=4083): Launched 12:12:57.857088 run osmo-msc_10.42.42.6: Starting osmo-msc 12:12:58.455318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4085): Launched 12:12:58.788441 run osmo-msc_10.42.42.6(pid=4086): Launched 12:12:58.972186 run osmo-stp_10.42.42.5(pid=4083): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4083)] 12:12:59.111828 run osmo-stp_10.42.42.5(pid=4083): stdout: | (launched: 2022-12-09_12:12:57.668838) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:59.251667 run osmo-stp_10.42.42.5(pid=4083): stderr: | 20221209121257856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121257856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121257856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121257857 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121257857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121257857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121257857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:59.389224 run osmo-stp_10.42.42.5(pid=4083): stdout: | (launched: 2022-12-09_12:12:57.668838) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:12:59.520071 run osmo-stp_10.42.42.5(pid=4083): stderr: | 20221209121257856 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121257856 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121257856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121257857 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121257857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121257857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121257857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:12:59.676882 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4083): Process ended prematurely: osmo-stp_10.42.42.5(pid=4083) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4083)] [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 12:12:59.686529 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 12:12:59.715459 run osmo-hlr_10.42.42.2(pid=4080): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4080)] 12:12:59.766514 run osmo-hlr_10.42.42.2(pid=4080): stdout: | (launched: 2022-12-09_12:12:56.639554) 12:12:59.819619 run osmo-hlr_10.42.42.2(pid=4080): stderr: | 20221209121256834 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121256834 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121256834 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121256834 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121256834 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121256834 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121256847 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121256857 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121256857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121256857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:12:59.893733 run osmo-msc_10.42.42.6(pid=4086): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4086)] 12:12:59.944631 run osmo-msc_10.42.42.6(pid=4086): stdout: | (launched: 2022-12-09_12:12:58.727440) 12:12:59.997542 run osmo-msc_10.42.42.6(pid=4086): stderr: | 20221209121259046 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121259046 DLGLOBAL DEBUG validating counter group 0x7f27df21dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121259046 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121259046 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121259046 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121259046 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121259048 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121259049 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121259049 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121259049 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:13:00.051074 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4079): Terminating (SIGTERM) 12:13:00.093754 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4082): Terminating (SIGTERM) 12:13:00.136577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4085): Terminating (SIGTERM) 12:13:00.179608 --- ParallelTerminationStrategy: PID 4079 died... 12:13:00.199827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4079): Terminated: ok {rc=0} 12:13:00.247121 --- ParallelTerminationStrategy: PID 4082 died... 12:13:00.267025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4082): Terminated: ok {rc=0} 12:13:00.314282 --- ParallelTerminationStrategy: PID 4085 died... 12:13:00.334223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4085): Terminated: ok {rc=0} 12:13:00.423981 bus /sierra_3: Setting Powered False 12:13:01.522657 bus /sierra_3: Setting Powered False 12:13:02.638301 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:13:03.891447 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:13:03.898597 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:13:03.929086 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:13:03.956520 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:13:04.010891 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:13:04.042511 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:13:04.070048 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:13:04.625785 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:13:04.678897 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:13:04.690750 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:13:04.757613 tst mo_mt_call.py: using LAC 21383 12:13:04.881697 tst mo_mt_call.py: using RAC 218 12:13:05.002494 tst mo_mt_call.py: using CellId 21383 12:13:05.124870 tst mo_mt_call.py: using BVCI 21384 12:13:05.238182 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:13:05.249721 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:13:05.260707 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:13:05.271937 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:13:05.283127 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:13:05.294452 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:13:05.409782 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:13:05.526811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:13:06.003716 run create_hlr_db(pid=4091): Launched 12:13:06.130468 bus /sierra_2: Setting Powered False 12:13:07.192255 run create_hlr_db(pid=4091): Terminated: ok {rc=0} 12:13:07.644600 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4093): Launched 12:13:07.975473 run osmo-hlr_10.42.42.2(pid=4094): Launched 12:13:08.102782 run osmo-stp_10.42.42.5: Starting osmo-stp 12:13:08.671040 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4096): Launched 12:13:09.002236 run osmo-stp_10.42.42.5(pid=4097): Launched 12:13:09.129688 run osmo-msc_10.42.42.6: Starting osmo-msc 12:13:09.723627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4099): Launched 12:13:10.056731 run osmo-msc_10.42.42.6(pid=4100): Launched 12:13:10.241274 run osmo-stp_10.42.42.5(pid=4097): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4097)] 12:13:10.380537 run osmo-stp_10.42.42.5(pid=4097): stdout: | (launched: 2022-12-09_12:13:08.941801) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:10.520222 run osmo-stp_10.42.42.5(pid=4097): stderr: | 20221209121309132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121309132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121309132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121309133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121309133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121309133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121309133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:10.657928 run osmo-stp_10.42.42.5(pid=4097): stdout: | (launched: 2022-12-09_12:13:08.941801) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:10.788917 run osmo-stp_10.42.42.5(pid=4097): stderr: | 20221209121309132 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121309132 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121309132 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121309133 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121309133 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121309133 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121309133 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:10.945925 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4097): Process ended prematurely: osmo-stp_10.42.42.5(pid=4097) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4097)] [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:13:10.955865 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:13:10.985088 run osmo-hlr_10.42.42.2(pid=4094): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4094)] 12:13:11.036221 run osmo-hlr_10.42.42.2(pid=4094): stdout: | (launched: 2022-12-09_12:13:07.915333) 12:13:11.088630 run osmo-hlr_10.42.42.2(pid=4094): stderr: | 20221209121308111 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121308111 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121308111 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121308111 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121308111 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121308111 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121308124 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121308134 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121308134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121308135 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:13:11.161887 run osmo-msc_10.42.42.6(pid=4100): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4100)] 12:13:11.212710 run osmo-msc_10.42.42.6(pid=4100): stdout: | (launched: 2022-12-09_12:13:09.995768) 12:13:11.265152 run osmo-msc_10.42.42.6(pid=4100): stderr: | 20221209121310316 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121310316 DLGLOBAL DEBUG validating counter group 0x7f14fc294c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121310317 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121310317 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121310317 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121310317 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121310319 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121310319 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121310319 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121310319 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:13:11.318069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4093): Terminating (SIGTERM) 12:13:11.360690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4096): Terminating (SIGTERM) 12:13:11.403373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4099): Terminating (SIGTERM) 12:13:11.446409 --- ParallelTerminationStrategy: PID 4093 died... 12:13:11.466679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4093): Terminated: ok {rc=0} 12:13:11.514198 --- ParallelTerminationStrategy: PID 4096 died... 12:13:11.534118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4096): Terminated: ok {rc=0} 12:13:11.581507 --- ParallelTerminationStrategy: PID 4099 died... 12:13:11.601475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4099): Terminated: ok {rc=0} 12:13:11.690711 bus /sierra_3: Setting Powered False 12:13:12.790900 bus /sierra_3: Setting Powered False 12:13:13.910358 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:13:15.060167 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:13:15.072844 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:13:15.146286 tst mo_mt_call_osmux.py: using LAC 21384 12:13:15.267120 tst mo_mt_call_osmux.py: using RAC 219 12:13:15.388351 tst mo_mt_call_osmux.py: using CellId 21384 12:13:15.508684 tst mo_mt_call_osmux.py: using BVCI 21385 12:13:15.620526 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:13:15.632027 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:13:15.643140 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:13:15.654283 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:13:15.665542 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:13:15.677169 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:13:15.799860 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:13:15.937884 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:13:16.482906 run create_hlr_db(pid=4102): Launched 12:13:16.648672 bus /sierra_2: Setting Powered False 12:13:17.714720 run create_hlr_db(pid=4102): Terminated: ok {rc=0} 12:13:18.158566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4104): Launched 12:13:18.470833 run osmo-hlr_10.42.42.2(pid=4105): Launched 12:13:18.592720 run osmo-stp_10.42.42.5: Starting osmo-stp 12:13:19.136876 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4107): Launched 12:13:19.444177 run osmo-stp_10.42.42.5(pid=4108): Launched 12:13:19.560355 run osmo-msc_10.42.42.6: Starting osmo-msc 12:13:20.115004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4110): Launched 12:13:20.424395 run osmo-msc_10.42.42.6(pid=4111): Launched 12:13:20.596713 run osmo-stp_10.42.42.5(pid=4108): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4108)] 12:13:20.726404 run osmo-stp_10.42.42.5(pid=4108): stdout: | (launched: 2022-12-09_12:13:19.387656) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:20.855539 run osmo-stp_10.42.42.5(pid=4108): stderr: | 20221209121319557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121319557 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121319558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121319558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121319559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121319559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121319559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:20.983351 run osmo-stp_10.42.42.5(pid=4108): stdout: | (launched: 2022-12-09_12:13:19.387656) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:21.105112 run osmo-stp_10.42.42.5(pid=4108): stderr: | 20221209121319557 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121319557 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121319558 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121319558 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121319559 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121319559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121319559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:21.250956 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4108): Process ended prematurely: osmo-stp_10.42.42.5(pid=4108) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4108)] [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:13:21.259892 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:13:21.286724 run osmo-hlr_10.42.42.2(pid=4105): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4105)] 12:13:21.334400 run osmo-hlr_10.42.42.2(pid=4105): stdout: | (launched: 2022-12-09_12:13:18.413783) 12:13:21.383981 run osmo-hlr_10.42.42.2(pid=4105): stderr: | 20221209121318588 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121318588 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121318588 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121318588 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121318588 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121318588 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121318600 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121318608 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121318609 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121318609 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:13:21.453258 run osmo-msc_10.42.42.6(pid=4111): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4111)] 12:13:21.501065 run osmo-msc_10.42.42.6(pid=4111): stdout: | (launched: 2022-12-09_12:13:20.367446) 12:13:21.550480 run osmo-msc_10.42.42.6(pid=4111): stderr: | 20221209121320639 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121320639 DLGLOBAL DEBUG validating counter group 0x7fa20b7f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121320639 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121320639 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121320639 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121320640 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121320641 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121320642 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121320642 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121320642 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:13:21.600507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4104): Terminating (SIGTERM) 12:13:21.640479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4107): Terminating (SIGTERM) 12:13:21.680682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4110): Terminating (SIGTERM) 12:13:21.721156 --- ParallelTerminationStrategy: PID 4104 died... 12:13:21.740498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4104): Terminated: ok {rc=0} 12:13:21.785294 --- ParallelTerminationStrategy: PID 4107 died... 12:13:21.804044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4107): Terminated: ok {rc=0} 12:13:21.848471 --- ParallelTerminationStrategy: PID 4110 died... 12:13:21.867309 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4110): Terminated: ok {rc=0} 12:13:21.954359 bus /sierra_3: Setting Powered False 12:13:23.054353 bus /sierra_3: Setting Powered False 12:13:24.167042 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:13:25.410018 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:13:25.416248 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:13:25.445379 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:13:25.472040 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:13:25.524051 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:13:25.552707 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:13:25.579035 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:13:26.133576 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:13:26.182450 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:26.193991 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:13:26.260798 tst mo_mt_call.py: using LAC 21385 12:13:26.382496 tst mo_mt_call.py: using RAC 220 12:13:26.503895 tst mo_mt_call.py: using CellId 21385 12:13:26.636846 tst mo_mt_call.py: using BVCI 21386 12:13:26.757608 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:26.769558 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:26.781564 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:26.793442 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:26.805689 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:26.817676 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:13:26.936424 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:13:27.053575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:13:27.531620 run create_hlr_db(pid=4116): Launched 12:13:27.658676 bus /sierra_2: Setting Powered False 12:13:28.719877 run create_hlr_db(pid=4116): Terminated: ok {rc=0} 12:13:29.172042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4118): Launched 12:13:29.505476 run osmo-hlr_10.42.42.2(pid=4119): Launched 12:13:29.632289 run osmo-stp_10.42.42.5: Starting osmo-stp 12:13:30.205948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4121): Launched 12:13:30.538521 run osmo-stp_10.42.42.5(pid=4122): Launched 12:13:30.666752 run osmo-msc_10.42.42.6: Starting osmo-msc 12:13:31.272491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4124): Launched 12:13:31.620256 run osmo-msc_10.42.42.6(pid=4125): Launched 12:13:31.944455 run osmo-stp_10.42.42.5(pid=4122): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4122)] 12:13:32.194454 run osmo-stp_10.42.42.5(pid=4122): stdout: | (launched: 2022-12-09_12:13:30.478257) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:32.370938 run osmo-stp_10.42.42.5(pid=4122): stderr: | 20221209121330667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121330667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121330667 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121330667 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121330668 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121330668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121330668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:32.509793 run osmo-stp_10.42.42.5(pid=4122): stdout: | (launched: 2022-12-09_12:13:30.478257) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:32.641744 run osmo-stp_10.42.42.5(pid=4122): stderr: | 20221209121330667 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121330667 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121330667 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121330667 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121330668 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121330668 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121330668 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:32.799539 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4122): Process ended prematurely: osmo-stp_10.42.42.5(pid=4122) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4122)] [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:13:32.809411 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 12:13:32.838651 run osmo-hlr_10.42.42.2(pid=4119): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4119)] 12:13:32.890076 run osmo-hlr_10.42.42.2(pid=4119): stdout: | (launched: 2022-12-09_12:13:29.444207) 12:13:32.943254 run osmo-hlr_10.42.42.2(pid=4119): stderr: | 20221209121329638 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121329638 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121329638 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121329638 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121329638 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121329639 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121329650 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121329660 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121329660 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121329660 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:13:33.017253 run osmo-msc_10.42.42.6(pid=4125): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4125)] 12:13:33.068712 run osmo-msc_10.42.42.6(pid=4125): stdout: | (launched: 2022-12-09_12:13:31.558686) 12:13:33.121900 run osmo-msc_10.42.42.6(pid=4125): stderr: | 20221209121331987 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121331988 DLGLOBAL DEBUG validating counter group 0x7f6250cbec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121331988 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121331988 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121331988 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121331988 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121331990 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121331990 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121331990 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121331991 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:13:33.175369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4118): Terminating (SIGTERM) 12:13:33.217904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4121): Terminating (SIGTERM) 12:13:33.260722 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4124): Terminating (SIGTERM) 12:13:33.304066 --- ParallelTerminationStrategy: PID 4118 died... 12:13:33.325208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4118): Terminated: ok {rc=0} 12:13:33.373142 --- ParallelTerminationStrategy: PID 4121 died... 12:13:33.393240 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4121): Terminated: ok {rc=0} 12:13:33.441144 --- ParallelTerminationStrategy: PID 4124 died... 12:13:33.461227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4124): Terminated: ok {rc=0} 12:13:33.550481 bus /sierra_3: Setting Powered False 12:13:34.650699 bus /sierra_3: Setting Powered False 12:13:35.769224 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:13:36.919946 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:36.932653 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:13:37.001173 tst mo_mt_call_osmux.py: using LAC 21386 12:13:37.133147 tst mo_mt_call_osmux.py: using RAC 221 12:13:37.262602 tst mo_mt_call_osmux.py: using CellId 21386 12:13:37.393247 tst mo_mt_call_osmux.py: using BVCI 21387 12:13:37.515198 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:37.527181 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:37.538993 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:37.551071 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:37.563180 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:13:37.575152 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:13:37.693637 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:13:37.813486 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:13:38.314734 run create_hlr_db(pid=4127): Launched 12:13:38.441980 bus /sierra_2: Setting Powered False 12:13:39.503672 run create_hlr_db(pid=4127): Terminated: ok {rc=0} 12:13:39.955888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4129): Launched 12:13:40.290065 run osmo-hlr_10.42.42.2(pid=4130): Launched 12:13:40.417578 run osmo-stp_10.42.42.5: Starting osmo-stp 12:13:40.993301 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4132): Launched 12:13:41.326501 run osmo-stp_10.42.42.5(pid=4133): Launched 12:13:41.453801 run osmo-msc_10.42.42.6: Starting osmo-msc 12:13:42.050514 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4135): Launched 12:13:42.381727 run osmo-msc_10.42.42.6(pid=4136): Launched 12:13:42.566634 run osmo-stp_10.42.42.5(pid=4133): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4133)] 12:13:42.707345 run osmo-stp_10.42.42.5(pid=4133): stdout: | (launched: 2022-12-09_12:13:41.265810) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:42.848702 run osmo-stp_10.42.42.5(pid=4133): stderr: | 20221209121341452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121341453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121341453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121341453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121341454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121341454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121341454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:42.986647 run osmo-stp_10.42.42.5(pid=4133): stdout: | (launched: 2022-12-09_12:13:41.265810) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:43.118946 run osmo-stp_10.42.42.5(pid=4133): stderr: | 20221209121341452 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121341453 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121341453 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121341453 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121341454 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121341454 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121341454 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:43.276072 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4133): Process ended prematurely: osmo-stp_10.42.42.5(pid=4133) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4133)] [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:13:43.285648 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:13:43.314540 run osmo-hlr_10.42.42.2(pid=4130): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4130)] 12:13:43.365595 run osmo-hlr_10.42.42.2(pid=4130): stdout: | (launched: 2022-12-09_12:13:40.229344) 12:13:43.417970 run osmo-hlr_10.42.42.2(pid=4130): stderr: | 20221209121340424 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121340424 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121340424 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121340424 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121340424 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121340425 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121340436 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121340445 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121340446 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121340446 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:13:43.491237 run osmo-msc_10.42.42.6(pid=4136): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4136)] 12:13:43.541983 run osmo-msc_10.42.42.6(pid=4136): stdout: | (launched: 2022-12-09_12:13:42.320357) 12:13:43.594562 run osmo-msc_10.42.42.6(pid=4136): stderr: | 20221209121342640 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121342640 DLGLOBAL DEBUG validating counter group 0x7ff7d755ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121342640 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121342640 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121342640 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121342640 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121342642 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121342642 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121342643 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121342643 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:13:43.647402 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4129): Terminating (SIGTERM) 12:13:43.689865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4132): Terminating (SIGTERM) 12:13:43.732444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4135): Terminating (SIGTERM) 12:13:43.775376 --- ParallelTerminationStrategy: PID 4129 died... 12:13:43.795687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4129): Terminated: ok {rc=0} 12:13:43.843041 --- ParallelTerminationStrategy: PID 4132 died... 12:13:43.862912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4132): Terminated: ok {rc=0} 12:13:43.910045 --- ParallelTerminationStrategy: PID 4135 died... 12:13:43.929849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4135): Terminated: ok {rc=0} 12:13:44.019055 bus /sierra_3: Setting Powered False 12:13:45.117179 bus /sierra_3: Setting Powered False 12:13:46.230411 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:13:47.480647 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:13:47.487411 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:13:47.516665 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 12:13:47.543193 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 12:13:47.594656 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:13:47.623380 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 12:13:47.649792 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 12:13:48.201683 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 12:13:48.250698 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:48.261915 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:13:48.327730 tst mo_mt_call.py: using LAC 21387 12:13:48.448833 tst mo_mt_call.py: using RAC 222 12:13:48.571962 tst mo_mt_call.py: using CellId 21387 12:13:48.703376 tst mo_mt_call.py: using BVCI 21388 12:13:48.825685 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:48.837194 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:48.848621 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:48.860289 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:48.872256 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:48.884356 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:13:49.003004 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:13:49.120515 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:13:49.599072 run create_hlr_db(pid=4141): Launched 12:13:49.725621 bus /sierra_2: Setting Powered False 12:13:50.787490 run create_hlr_db(pid=4141): Terminated: ok {rc=0} 12:13:51.239513 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4143): Launched 12:13:51.572662 run osmo-hlr_10.42.42.2(pid=4144): Launched 12:13:51.698790 run osmo-stp_10.42.42.5: Starting osmo-stp 12:13:52.264376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4146): Launched 12:13:52.594869 run osmo-stp_10.42.42.5(pid=4147): Launched 12:13:52.721806 run osmo-msc_10.42.42.6: Starting osmo-msc 12:13:53.318316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4149): Launched 12:13:53.650571 run osmo-msc_10.42.42.6(pid=4150): Launched 12:13:53.836287 run osmo-stp_10.42.42.5(pid=4147): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4147)] 12:13:53.975989 run osmo-stp_10.42.42.5(pid=4147): stdout: | (launched: 2022-12-09_12:13:52.534397) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:54.117519 run osmo-stp_10.42.42.5(pid=4147): stderr: | 20221209121352723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121352723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121352723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121352724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121352724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121352725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121352725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:54.255110 run osmo-stp_10.42.42.5(pid=4147): stdout: | (launched: 2022-12-09_12:13:52.534397) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:13:54.386453 run osmo-stp_10.42.42.5(pid=4147): stderr: | 20221209121352723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121352723 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121352723 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121352724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121352724 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121352725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121352725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:13:54.543332 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4147): Process ended prematurely: osmo-stp_10.42.42.5(pid=4147) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4147)] [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 12:13:54.553130 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:13:54.581940 run osmo-hlr_10.42.42.2(pid=4144): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4144)] 12:13:54.632751 run osmo-hlr_10.42.42.2(pid=4144): stdout: | (launched: 2022-12-09_12:13:51.512190) 12:13:54.685588 run osmo-hlr_10.42.42.2(pid=4144): stderr: | 20221209121351708 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121351708 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121351708 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121351708 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121351708 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121351708 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121351721 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121351730 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121351731 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121351731 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:13:54.759237 run osmo-msc_10.42.42.6(pid=4150): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4150)] 12:13:54.810279 run osmo-msc_10.42.42.6(pid=4150): stdout: | (launched: 2022-12-09_12:13:53.590041) 12:13:54.863105 run osmo-msc_10.42.42.6(pid=4150): stderr: | 20221209121353909 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121353909 DLGLOBAL DEBUG validating counter group 0x7f075e6eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121353909 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121353909 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121353910 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121353910 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121353911 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121353912 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121353912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121353912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:13:54.915937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4143): Terminating (SIGTERM) 12:13:54.958230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4146): Terminating (SIGTERM) 12:13:55.001061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4149): Terminating (SIGTERM) 12:13:55.043799 --- ParallelTerminationStrategy: PID 4143 died... 12:13:55.064294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4143): Terminated: ok {rc=0} 12:13:55.111734 --- ParallelTerminationStrategy: PID 4146 died... 12:13:55.131636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4146): Terminated: ok {rc=0} 12:13:55.179476 --- ParallelTerminationStrategy: PID 4149 died... 12:13:55.199494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4149): Terminated: ok {rc=0} 12:13:55.290621 bus /sierra_3: Setting Powered False 12:13:56.391552 bus /sierra_3: Setting Powered False 12:13:57.512366 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 12:13:58.660705 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:58.672750 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:13:58.739595 tst mo_mt_call_osmux.py: using LAC 21388 12:13:58.863623 tst mo_mt_call_osmux.py: using RAC 223 12:13:58.983978 tst mo_mt_call_osmux.py: using CellId 21388 12:13:59.103911 tst mo_mt_call_osmux.py: using BVCI 21389 12:13:59.216080 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:59.227250 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:59.238214 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:59.249333 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:59.260327 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 12:13:59.271182 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:13:59.391553 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 12:13:59.513669 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:13:59.991760 run create_hlr_db(pid=4152): Launched 12:14:00.117261 bus /sierra_2: Setting Powered False 12:14:01.210789 run create_hlr_db(pid=4152): Terminated: ok {rc=0} 12:14:01.683092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4154): Launched 12:14:02.031887 run osmo-hlr_10.42.42.2(pid=4155): Launched 12:14:02.194033 run osmo-stp_10.42.42.5: Starting osmo-stp 12:14:02.769429 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4157): Launched 12:14:03.101931 run osmo-stp_10.42.42.5(pid=4158): Launched 12:14:03.227824 run osmo-msc_10.42.42.6: Starting osmo-msc 12:14:03.826186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4160): Launched 12:14:04.157666 run osmo-msc_10.42.42.6(pid=4161): Launched 12:14:04.343698 run osmo-stp_10.42.42.5(pid=4158): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4158)] 12:14:04.483237 run osmo-stp_10.42.42.5(pid=4158): stdout: | (launched: 2022-12-09_12:14:03.040441) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:04.623298 run osmo-stp_10.42.42.5(pid=4158): stderr: | 20221209121403230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121403230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121403231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121403231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121403231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121403232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121403232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:04.761561 run osmo-stp_10.42.42.5(pid=4158): stdout: | (launched: 2022-12-09_12:14:03.040441) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:04.893036 run osmo-stp_10.42.42.5(pid=4158): stderr: | 20221209121403230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121403230 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121403231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121403231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121403231 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121403232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121403232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:05.050618 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4158): Process ended prematurely: osmo-stp_10.42.42.5(pid=4158) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4158)] [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 12:14:05.060529 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:14:05.088755 run osmo-hlr_10.42.42.2(pid=4155): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4155)] 12:14:05.139263 run osmo-hlr_10.42.42.2(pid=4155): stdout: | (launched: 2022-12-09_12:14:01.971376) 12:14:05.191459 run osmo-hlr_10.42.42.2(pid=4155): stderr: | 20221209121402260 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121402260 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121402260 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121402260 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121402260 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121402260 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121402274 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121402282 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121402282 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121402282 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:14:05.264044 run osmo-msc_10.42.42.6(pid=4161): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4161)] 12:14:05.314379 run osmo-msc_10.42.42.6(pid=4161): stdout: | (launched: 2022-12-09_12:14:04.096741) 12:14:05.366480 run osmo-msc_10.42.42.6(pid=4161): stderr: | 20221209121404416 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121404416 DLGLOBAL DEBUG validating counter group 0x7f41fbd6ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121404416 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121404417 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121404417 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121404417 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121404419 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121404419 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121404419 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121404419 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:14:05.418740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4154): Terminating (SIGTERM) 12:14:05.460703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4157): Terminating (SIGTERM) 12:14:05.502713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4160): Terminating (SIGTERM) 12:14:05.545167 --- ParallelTerminationStrategy: PID 4154 died... 12:14:05.565362 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4154): Terminated: ok {rc=0} 12:14:05.612433 --- ParallelTerminationStrategy: PID 4157 died... 12:14:05.632172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4157): Terminated: ok {rc=0} 12:14:05.678879 --- ParallelTerminationStrategy: PID 4160 died... 12:14:05.698595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4160): Terminated: ok {rc=0} 12:14:05.786997 bus /sierra_3: Setting Powered False 12:14:06.886701 bus /sierra_3: Setting Powered False 12:14:08.003224 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 12:14:09.260321 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:14:09.264622 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:14:09.293532 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:14:09.320218 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 12:14:09.405159 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:14:09.433871 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:14:09.460182 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 12:14:10.046628 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2359 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 12:14:10.051597 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:14:10.062558 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:14:10.108009 tst emergency_mo_mt_call.py: using LAC 21389 12:14:10.226896 tst emergency_mo_mt_call.py: using RAC 224 12:14:10.346425 tst emergency_mo_mt_call.py: using CellId 21389 12:14:10.466551 tst emergency_mo_mt_call.py: using BVCI 21390 12:14:10.577084 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:14:10.588052 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:14:10.598836 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:14:10.609789 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:14:10.620457 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:14:10.631148 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:14:10.747749 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:14:10.869212 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:14:11.371525 run create_hlr_db(pid=4166): Launched 12:14:11.495185 bus /sierra_2: Setting Powered False 12:14:12.559684 run create_hlr_db(pid=4166): Terminated: ok {rc=0} 12:14:12.994396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4168): Launched 12:14:13.297464 run osmo-hlr_10.42.42.2(pid=4169): Launched 12:14:13.413535 run osmo-stp_10.42.42.5: Starting osmo-stp 12:14:13.935938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4171): Launched 12:14:14.238216 run osmo-stp_10.42.42.5(pid=4172): Launched 12:14:14.362968 tst emergency_mo_mt_call.py: using MSISDN 7199 12:14:14.516020 run osmo-msc_10.42.42.6: Starting osmo-msc 12:14:15.065753 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4174): Launched 12:14:15.369114 run osmo-msc_10.42.42.6(pid=4175): Launched 12:14:15.537353 run osmo-stp_10.42.42.5(pid=4172): ERR: Terminated: ERROR {rc=1} [trial-2359↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4172)] 12:14:15.664485 run osmo-stp_10.42.42.5(pid=4172): stdout: | (launched: 2022-12-09_12:14:14.182407) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:15.791349 run osmo-stp_10.42.42.5(pid=4172): stderr: | 20221209121414350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121414350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121414351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121414351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121414351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121414351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121414352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:15.960767 run osmo-stp_10.42.42.5(pid=4172): stdout: | (launched: 2022-12-09_12:14:14.182407) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:16.113083 run osmo-stp_10.42.42.5(pid=4172): stderr: | 20221209121414350 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121414350 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121414351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121414351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121414351 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121414351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121414352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:16.290246 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=4172): Process ended prematurely: osmo-stp_10.42.42.5(pid=4172) [trial-2359↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4172)] [trial-2359↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 12:14:16.300134 tst emergency_mo_mt_call.py:19: Test FAILED (6.2 sec) 12:14:16.331510 run osmo-hlr_10.42.42.2(pid=4169): ERR: Terminated: ERROR {rc=237} [trial-2359↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4169)] 12:14:16.391468 run osmo-hlr_10.42.42.2(pid=4169): stdout: | (launched: 2022-12-09_12:14:13.241678) 12:14:16.453427 run osmo-hlr_10.42.42.2(pid=4169): stderr: | 20221209121413415 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121413415 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121413415 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121413415 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121413415 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121413415 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121413427 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121413436 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121413436 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121413436 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:14:16.534802 run osmo-msc_10.42.42.6(pid=4175): ERR: Terminated: ERROR {rc=2} [trial-2359↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4175)] 12:14:16.600254 run osmo-msc_10.42.42.6(pid=4175): stdout: | (launched: 2022-12-09_12:14:15.312867) 12:14:16.659624 run osmo-msc_10.42.42.6(pid=4175): stderr: | 20221209121415583 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121415583 DLGLOBAL DEBUG validating counter group 0x7f2b785edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121415583 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121415583 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121415584 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121415584 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121415586 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121415586 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121415586 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121415586 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:14:16.716782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4168): Terminating (SIGTERM) 12:14:16.762883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4171): Terminating (SIGTERM) 12:14:16.809920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4174): Terminating (SIGTERM) 12:14:16.856930 --- ParallelTerminationStrategy: PID 4168 died... 12:14:16.878223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4168): Terminated: ok {rc=0} 12:14:16.930681 --- ParallelTerminationStrategy: PID 4171 died... 12:14:16.951995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4171): Terminated: ok {rc=0} 12:14:17.002213 --- ParallelTerminationStrategy: PID 4174 died... 12:14:17.023256 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4174): Terminated: ok {rc=0} 12:14:17.117080 bus /sierra_3: Setting Powered False 12:14:18.218704 bus /sierra_3: Setting Powered False 12:14:19.334408 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 12:14:20.422157 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:14:20.434503 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:14:20.484384 tst emergency_preemptive_call.py: using LAC 21390 12:14:20.613735 tst emergency_preemptive_call.py: using RAC 225 12:14:20.747498 tst emergency_preemptive_call.py: using CellId 21390 12:14:20.866735 tst emergency_preemptive_call.py: using BVCI 21391 12:14:20.978886 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:14:20.990246 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:14:21.000815 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:14:21.011437 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:14:21.022079 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:14:21.032631 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:14:21.148575 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:14:21.267697 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:14:21.393181 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:14:21.512733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:14:22.015275 run create_hlr_db(pid=4177): Launched 12:14:22.139773 bus /sierra_2: Setting Powered False 12:14:23.204819 run create_hlr_db(pid=4177): Terminated: ok {rc=0} 12:14:23.640086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4179): Launched 12:14:23.966535 run osmo-hlr_10.42.42.2(pid=4180): Launched 12:14:24.090773 run osmo-stp_10.42.42.5: Starting osmo-stp 12:14:24.651231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4182): Launched 12:14:24.977804 run osmo-stp_10.42.42.5(pid=4183): Launched 12:14:25.116484 tst emergency_preemptive_call.py: using MSISDN 7200 12:14:25.287791 run osmo-msc_10.42.42.6: Starting osmo-msc 12:14:25.870369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4185): Launched 12:14:26.195356 run osmo-msc_10.42.42.6(pid=4186): Launched 12:14:26.377669 run osmo-stp_10.42.42.5(pid=4183): ERR: Terminated: ERROR {rc=1} [trial-2359↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4183)] 12:14:26.514633 run osmo-stp_10.42.42.5(pid=4183): stdout: | (launched: 2022-12-09_12:14:24.918266) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:26.651803 run osmo-stp_10.42.42.5(pid=4183): stderr: | 20221209121425108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121425108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121425108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121425109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121425109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121425109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121425110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:26.787244 run osmo-stp_10.42.42.5(pid=4183): stdout: | (launched: 2022-12-09_12:14:24.918266) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:26.916721 run osmo-stp_10.42.42.5(pid=4183): stderr: | 20221209121425108 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121425108 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121425108 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121425109 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121425109 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121425109 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121425110 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:27.071704 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=4183): Process ended prematurely: osmo-stp_10.42.42.5(pid=4183) [trial-2359↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4183)] [trial-2359↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 12:14:27.080749 tst emergency_preemptive_call.py:32: Test FAILED (6.7 sec) 12:14:27.109309 run osmo-hlr_10.42.42.2(pid=4180): ERR: Terminated: ERROR {rc=237} [trial-2359↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4180)] 12:14:27.160322 run osmo-hlr_10.42.42.2(pid=4180): stdout: | (launched: 2022-12-09_12:14:23.906815) 12:14:27.212927 run osmo-hlr_10.42.42.2(pid=4180): stderr: | 20221209121424099 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121424099 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121424099 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121424099 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121424099 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121424099 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121424113 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121424121 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121424122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121424122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:14:27.285817 run osmo-msc_10.42.42.6(pid=4186): ERR: Terminated: ERROR {rc=2} [trial-2359↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4186)] 12:14:27.336363 run osmo-msc_10.42.42.6(pid=4186): stdout: | (launched: 2022-12-09_12:14:26.135871) 12:14:27.388465 run osmo-msc_10.42.42.6(pid=4186): stderr: | 20221209121426452 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121426453 DLGLOBAL DEBUG validating counter group 0x7f1ad5f50c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121426453 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121426453 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121426453 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121426453 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121426455 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121426455 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121426455 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121426456 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:14:27.441401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4179): Terminating (SIGTERM) 12:14:27.484018 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4182): Terminating (SIGTERM) 12:14:27.526701 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4185): Terminating (SIGTERM) 12:14:27.569353 --- ParallelTerminationStrategy: PID 4179 died... 12:14:27.589634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4179): Terminated: ok {rc=0} 12:14:27.636889 --- ParallelTerminationStrategy: PID 4182 died... 12:14:27.656862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4182): Terminated: ok {rc=0} 12:14:27.703965 --- ParallelTerminationStrategy: PID 4185 died... 12:14:27.723921 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4185): Terminated: ok {rc=0} 12:14:27.813331 bus /sierra_9: Setting Powered False 12:14:28.911317 bus /sierra_9: Setting Powered False 12:14:30.028026 bus /sierra_8: Setting Powered False 12:14:31.125947 bus /sierra_8: Setting Powered False 12:14:32.246700 bus /sierra_3: Setting Powered False 12:14:33.345610 bus /sierra_3: Setting Powered False 12:14:34.462902 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 12:14:35.741245 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:14:35.745833 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 12:14:35.776928 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 12:14:35.816497 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 12:14:35.905915 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 12:14:35.936208 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 12:14:35.975758 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 12:14:36.572208 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 12:14:36.626665 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:36.638010 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:14:36.684420 tst cs_paging_gprs_active.py: using LAC 21391 12:14:36.814302 tst cs_paging_gprs_active.py: using RAC 226 12:14:36.944020 tst cs_paging_gprs_active.py: using CellId 21391 12:14:37.073654 tst cs_paging_gprs_active.py: using BVCI 21392 12:14:37.196247 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:37.207641 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:37.218768 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:37.230251 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:37.241579 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:37.252801 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:37.264280 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:37.275519 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:37.287007 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:14:37.410315 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:14:37.532632 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:14:37.756329 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:38.088658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4192): Launched 12:14:38.379144 run iperf3-srv_10.42.42.10(pid=4193): Launched 12:14:38.506126 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:14:38.729973 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:39.063021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4194): Launched 12:14:39.352303 run iperf3-srv_10.42.42.10(pid=4195): Launched 12:14:39.478802 tst cs_paging_gprs_active.py:38: start network... 12:14:39.701688 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:14:40.214992 run create_hlr_db(pid=4196): Launched 12:14:40.341750 bus /sierra_2: Setting Powered False 12:14:41.407000 run create_hlr_db(pid=4196): Terminated: ok {rc=0} 12:14:41.846333 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4198): Launched 12:14:42.155408 run osmo-hlr_10.42.42.2(pid=4199): Launched 12:14:42.272790 run osmo-stp_10.42.42.5: Starting osmo-stp 12:14:42.801948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4201): Launched 12:14:43.110421 run osmo-stp_10.42.42.5(pid=4202): Launched 12:14:43.227744 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:14:43.757454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4204): Launched 12:14:43.876283 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:14:44.138234 run patchelf(pid=4205): Launched 12:14:44.310692 run osmo-stp_10.42.42.5(pid=4202): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4202)] 12:14:44.440817 run osmo-stp_10.42.42.5(pid=4202): stdout: | (launched: 2022-12-09_12:14:43.053505) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:44.572529 run osmo-stp_10.42.42.5(pid=4202): stderr: | 20221209121443222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121443222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121443222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121443222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121443223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121443223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121443223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:44.703946 run osmo-stp_10.42.42.5(pid=4202): stdout: | (launched: 2022-12-09_12:14:43.053505) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:44.830230 run osmo-stp_10.42.42.5(pid=4202): stderr: | 20221209121443222 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121443222 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121443222 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121443222 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121443223 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121443223 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121443223 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:44.980733 run patchelf(pid=4205): Terminating (SIGINT) 12:14:45.155843 run patchelf(pid=4205): Terminated: ok {rc=0} 12:14:45.281202 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4202): Process ended prematurely: osmo-stp_10.42.42.5(pid=4202) [trial-2359↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4202)] [trial-2359↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 12:14:45.290666 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 12:14:45.318060 run osmo-hlr_10.42.42.2(pid=4199): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4199)] 12:14:45.365511 run osmo-hlr_10.42.42.2(pid=4199): stdout: | (launched: 2022-12-09_12:14:42.098379) 12:14:45.414895 run osmo-hlr_10.42.42.2(pid=4199): stderr: | 20221209121442272 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121442272 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121442272 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121442272 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121442272 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121442273 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121442285 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121442295 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121442295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121442295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:14:45.464508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4192): Terminating (SIGTERM) 12:14:45.505078 run iperf3-srv_10.42.42.10(pid=4193): Terminating (SIGTERM) 12:14:45.546454 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4194): Terminating (SIGTERM) 12:14:45.586905 run iperf3-srv_10.42.42.10(pid=4195): Terminating (SIGTERM) 12:14:45.626525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4198): Terminating (SIGTERM) 12:14:45.666109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4201): Terminating (SIGTERM) 12:14:45.705707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4204): Terminating (SIGTERM) 12:14:45.745813 --- ParallelTerminationStrategy: PID 4192 died... 12:14:45.765112 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4192): Terminated: ok {rc=0} 12:14:45.809732 --- ParallelTerminationStrategy: PID 4193 died... 12:14:45.828275 run iperf3-srv_10.42.42.10(pid=4193): Terminated {rc=256} 12:14:45.881708 --- ParallelTerminationStrategy: PID 4194 died... 12:14:45.901392 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4194): Terminated: ok {rc=0} 12:14:45.954620 --- ParallelTerminationStrategy: PID 4195 died... 12:14:45.975448 run iperf3-srv_10.42.42.10(pid=4195): Terminated {rc=256} 12:14:46.025610 --- ParallelTerminationStrategy: PID 4198 died... 12:14:46.046529 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4198): Terminated: ok {rc=0} 12:14:46.097498 --- ParallelTerminationStrategy: PID 4201 died... 12:14:46.119443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4201): Terminated: ok {rc=0} 12:14:46.170210 --- ParallelTerminationStrategy: PID 4204 died... 12:14:46.191309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4204): Terminated: ok {rc=0} 12:14:46.286756 bus /gobi_0: Setting Powered False 12:14:47.393974 bus /gobi_0: Setting Powered False 12:14:48.510866 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 12:14:49.661478 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:49.674158 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:14:49.723819 tst iperf3.py: using LAC 21392 12:14:49.853466 tst iperf3.py: using RAC 227 12:14:49.982978 tst iperf3.py: using CellId 21392 12:14:50.113846 tst iperf3.py: using BVCI 21393 12:14:50.234242 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:50.245782 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:50.256935 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:50.268382 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:50.279625 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:50.291072 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:50.302773 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:50.314456 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:50.326135 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:14:50.444240 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:14:50.652320 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:14:50.962132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4206): Launched 12:14:51.234809 run iperf3-srv_10.42.42.10(pid=4207): Launched 12:14:51.351421 tst iperf3.py:8: start network... 12:14:51.557827 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:14:52.034697 run create_hlr_db(pid=4208): Launched 12:14:52.162918 bus /gobi_6: Setting Powered False 12:14:53.224474 run create_hlr_db(pid=4208): Terminated: ok {rc=0} 12:14:53.674788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4210): Launched 12:14:53.987249 run osmo-hlr_10.42.42.2(pid=4211): Launched 12:14:54.104006 run osmo-stp_10.42.42.5: Starting osmo-stp 12:14:54.636724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4213): Launched 12:14:54.944805 run osmo-stp_10.42.42.5(pid=4214): Launched 12:14:55.064703 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:14:55.593287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4216): Launched 12:14:55.710934 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:14:55.970613 run patchelf(pid=4217): Launched 12:14:56.142754 run osmo-stp_10.42.42.5(pid=4214): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4214)] 12:14:56.273069 run osmo-stp_10.42.42.5(pid=4214): stdout: | (launched: 2022-12-09_12:14:54.887725) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:56.404583 run osmo-stp_10.42.42.5(pid=4214): stderr: | 20221209121455056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121455056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121455056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121455057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121455057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121455057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121455058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:56.536298 run osmo-stp_10.42.42.5(pid=4214): stdout: | (launched: 2022-12-09_12:14:54.887725) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:14:56.662645 run osmo-stp_10.42.42.5(pid=4214): stderr: | 20221209121455056 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121455056 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121455056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121455057 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121455057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121455057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121455058 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:14:56.812051 run patchelf(pid=4217): Terminating (SIGINT) 12:14:56.986609 run patchelf(pid=4217): Terminated: ok {rc=0} 12:14:57.113696 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4214): Process ended prematurely: osmo-stp_10.42.42.5(pid=4214) [trial-2359↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4214)] [trial-2359↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 12:14:57.123150 tst iperf3.py:8: Test FAILED (7.5 sec) 12:14:57.150760 run osmo-hlr_10.42.42.2(pid=4211): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4211)] 12:14:57.198567 run osmo-hlr_10.42.42.2(pid=4211): stdout: | (launched: 2022-12-09_12:14:53.930462) 12:14:57.248220 run osmo-hlr_10.42.42.2(pid=4211): stderr: | 20221209121454106 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121454107 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121454107 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121454107 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121454107 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121454107 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121454119 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121454128 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121454129 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121454129 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:14:57.298290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4206): Terminating (SIGTERM) 12:14:57.338617 run iperf3-srv_10.42.42.10(pid=4207): Terminating (SIGTERM) 12:14:57.378900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4210): Terminating (SIGTERM) 12:14:57.419459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4213): Terminating (SIGTERM) 12:14:57.459780 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4216): Terminating (SIGTERM) 12:14:57.500366 --- ParallelTerminationStrategy: PID 4206 died... 12:14:57.519831 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4206): Terminated: ok {rc=0} 12:14:57.564650 --- ParallelTerminationStrategy: PID 4207 died... 12:14:57.583645 run iperf3-srv_10.42.42.10(pid=4207): Terminated {rc=256} 12:14:57.627963 --- ParallelTerminationStrategy: PID 4210 died... 12:14:57.646938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4210): Terminated: ok {rc=0} 12:14:57.691495 --- ParallelTerminationStrategy: PID 4213 died... 12:14:57.710517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4213): Terminated: ok {rc=0} 12:14:57.754967 --- ParallelTerminationStrategy: PID 4216 died... 12:14:57.774020 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4216): Terminated: ok {rc=0} 12:14:57.860591 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 12:14:59.009918 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:59.021905 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:14:59.067585 tst iperf3m4.py: using LAC 21393 12:14:59.193569 tst iperf3m4.py: using RAC 228 12:14:59.319021 tst iperf3m4.py: using CellId 21393 12:14:59.438428 tst iperf3m4.py: using BVCI 21394 12:14:59.551143 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:59.562375 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:59.573247 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:59.583985 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:59.594508 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:59.605049 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:59.615953 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:59.626705 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:14:59.637433 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:14:59.758611 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:14:59.883187 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:15:00.004904 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:15:00.128427 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:15:00.336566 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:15:00.645513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4218): Launched 12:15:00.941636 run iperf3-srv_10.42.42.10(pid=4219): Launched 12:15:01.110375 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:15:01.328652 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:15:01.641213 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4223): Launched 12:15:01.964636 run iperf3-srv_10.42.42.10(pid=4224): Launched 12:15:02.096545 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:15:02.306736 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:15:02.616820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4225): Launched 12:15:02.885441 run iperf3-srv_10.42.42.10(pid=4226): Launched 12:15:03.002067 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:15:03.209723 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:15:03.520457 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4227): Launched 12:15:03.789224 run iperf3-srv_10.42.42.10(pid=4228): Launched 12:15:03.904522 tst iperf3m4.py:8: start network... 12:15:04.110087 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:15:04.587525 run create_hlr_db(pid=4229): Launched 12:15:04.713306 bus /gobi_6: Setting Powered False 12:15:05.774842 run create_hlr_db(pid=4229): Terminated: ok {rc=0} 12:15:06.225822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4231): Launched 12:15:06.560707 run osmo-hlr_10.42.42.2(pid=4232): Launched 12:15:06.687595 run osmo-stp_10.42.42.5: Starting osmo-stp 12:15:07.365904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4234): Launched 12:15:07.690291 run osmo-stp_10.42.42.5(pid=4235): Launched 12:15:07.814167 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:15:08.374561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4237): Launched 12:15:08.499658 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:15:08.773634 run patchelf(pid=4238): Launched 12:15:08.955180 run osmo-stp_10.42.42.5(pid=4235): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4235)] 12:15:09.093080 run osmo-stp_10.42.42.5(pid=4235): stdout: | (launched: 2022-12-09_12:15:07.630889) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:09.232860 run osmo-stp_10.42.42.5(pid=4235): stderr: | 20221209121507819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121507819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121507819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121507820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121507820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121507820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121507820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:09.371859 run osmo-stp_10.42.42.5(pid=4235): stdout: | (launched: 2022-12-09_12:15:07.630889) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:09.505115 run osmo-stp_10.42.42.5(pid=4235): stderr: | 20221209121507819 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121507819 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121507819 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121507820 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121507820 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121507820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121507820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:09.663313 run patchelf(pid=4238): Terminating (SIGINT) 12:15:09.847318 run patchelf(pid=4238): Terminated: ok {rc=0} 12:15:09.980526 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4235): Process ended prematurely: osmo-stp_10.42.42.5(pid=4235) [trial-2359↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4235)] [trial-2359↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 12:15:09.990848 tst iperf3m4.py:8: Test FAILED (11.0 sec) 12:15:10.020610 run osmo-hlr_10.42.42.2(pid=4232): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4232)] 12:15:10.071119 run osmo-hlr_10.42.42.2(pid=4232): stdout: | (launched: 2022-12-09_12:15:06.499626) 12:15:10.124201 run osmo-hlr_10.42.42.2(pid=4232): stderr: | 20221209121506693 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121506693 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121506693 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121506693 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121506693 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121506693 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121506707 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121506716 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121506716 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121506716 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:15:10.177058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4218): Terminating (SIGTERM) 12:15:10.219179 run iperf3-srv_10.42.42.10(pid=4219): Terminating (SIGTERM) 12:15:10.261777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4223): Terminating (SIGTERM) 12:15:10.304037 run iperf3-srv_10.42.42.10(pid=4224): Terminating (SIGTERM) 12:15:10.346564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4225): Terminating (SIGTERM) 12:15:10.388677 run iperf3-srv_10.42.42.10(pid=4226): Terminating (SIGTERM) 12:15:10.430824 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4227): Terminating (SIGTERM) 12:15:10.472864 run iperf3-srv_10.42.42.10(pid=4228): Terminating (SIGTERM) 12:15:10.514913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4231): Terminating (SIGTERM) 12:15:10.557331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4234): Terminating (SIGTERM) 12:15:10.599458 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4237): Terminating (SIGTERM) 12:15:10.642017 --- ParallelTerminationStrategy: PID 4218 died... 12:15:10.661961 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4218): Terminated: ok {rc=0} 12:15:10.708895 --- ParallelTerminationStrategy: PID 4219 died... 12:15:10.728502 run iperf3-srv_10.42.42.10(pid=4219): Terminated {rc=256} 12:15:10.775167 --- ParallelTerminationStrategy: PID 4223 died... 12:15:10.794890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4223): Terminated: ok {rc=0} 12:15:10.842128 --- ParallelTerminationStrategy: PID 4224 died... 12:15:10.861740 run iperf3-srv_10.42.42.10(pid=4224): Terminated {rc=256} 12:15:10.908519 --- ParallelTerminationStrategy: PID 4225 died... 12:15:10.928269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4225): Terminated: ok {rc=0} 12:15:10.975081 --- ParallelTerminationStrategy: PID 4226 died... 12:15:10.994791 run iperf3-srv_10.42.42.10(pid=4226): Terminated {rc=256} 12:15:11.041404 --- ParallelTerminationStrategy: PID 4227 died... 12:15:11.061161 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4227): Terminated: ok {rc=0} 12:15:11.108323 --- ParallelTerminationStrategy: PID 4228 died... 12:15:11.128070 run iperf3-srv_10.42.42.10(pid=4228): Terminated {rc=256} 12:15:11.175245 --- ParallelTerminationStrategy: PID 4231 died... 12:15:11.195081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4231): Terminated: ok {rc=0} 12:15:11.241768 --- ParallelTerminationStrategy: PID 4234 died... 12:15:11.261377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4234): Terminated: ok {rc=0} 12:15:11.308111 --- ParallelTerminationStrategy: PID 4237 died... 12:15:11.327609 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4237): Terminated: ok {rc=0} 12:15:11.416025 bus /gobi_4: Setting Powered False 12:15:12.515668 bus /gobi_4: Setting Powered False 12:15:13.632735 bus /gobi_1: Setting Powered False 12:15:14.730972 bus /gobi_1: Setting Powered False 12:15:15.847377 bus /gobi_0: Setting Powered False 12:15:16.945380 bus /gobi_0: Setting Powered False 12:15:18.061287 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 12:15:19.165243 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:15:19.177115 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:15:19.224722 tst ping.py: using LAC 21394 12:15:19.350697 tst ping.py: using RAC 229 12:15:19.477135 tst ping.py: using CellId 21394 12:15:19.601650 tst ping.py: using BVCI 21395 12:15:19.719672 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:15:19.731185 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:15:19.742359 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:15:19.753717 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:15:19.764861 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:15:19.776166 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:15:19.787648 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:15:19.799021 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:15:19.917827 tst ping.py:19: start network... 12:15:20.117618 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:15:20.579005 run create_hlr_db(pid=4239): Launched 12:15:20.702697 bus /gobi_6: Setting Powered False 12:15:21.762462 run create_hlr_db(pid=4239): Terminated: ok {rc=0} 12:15:22.180411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4241): Launched 12:15:22.479709 run osmo-hlr_10.42.42.2(pid=4242): Launched 12:15:22.592742 run osmo-stp_10.42.42.5: Starting osmo-stp 12:15:23.111887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4244): Launched 12:15:23.412396 run osmo-stp_10.42.42.5(pid=4245): Launched 12:15:23.535831 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:15:24.052274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4247): Launched 12:15:24.166759 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:15:24.418925 run patchelf(pid=4248): Launched 12:15:24.585786 run osmo-stp_10.42.42.5(pid=4245): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4245)] 12:15:24.712528 run osmo-stp_10.42.42.5(pid=4245): stdout: | (launched: 2022-12-09_12:15:23.356633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:24.840599 run osmo-stp_10.42.42.5(pid=4245): stderr: | 20221209121523534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121523535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121523535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121523535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121523536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121523536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121523536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:24.968508 run osmo-stp_10.42.42.5(pid=4245): stdout: | (launched: 2022-12-09_12:15:23.356633) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:25.090944 run osmo-stp_10.42.42.5(pid=4245): stderr: | 20221209121523534 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121523535 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121523535 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121523535 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121523536 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121523536 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121523536 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:25.235520 run patchelf(pid=4248): Terminating (SIGINT) 12:15:25.406015 run patchelf(pid=4248): Terminated: ok {rc=0} 12:15:25.528348 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4245): Process ended prematurely: osmo-stp_10.42.42.5(pid=4245) [trial-2359↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4245)] [trial-2359↪gprs:trx-lms-limenet-micro↪ping.py:22] 12:15:25.537337 tst ping.py:22: Test FAILED (6.4 sec) 12:15:25.563905 run osmo-hlr_10.42.42.2(pid=4242): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4242)] 12:15:25.611398 run osmo-hlr_10.42.42.2(pid=4242): stdout: | (launched: 2022-12-09_12:15:22.424823) 12:15:25.660696 run osmo-hlr_10.42.42.2(pid=4242): stderr: | 20221209121522598 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121522599 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121522599 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121522599 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121522599 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121522599 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121522611 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121522620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121522620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121522620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:15:25.710423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4241): Terminating (SIGTERM) 12:15:25.750374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4244): Terminating (SIGTERM) 12:15:25.790270 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4247): Terminating (SIGTERM) 12:15:25.830523 --- ParallelTerminationStrategy: PID 4241 died... 12:15:25.849607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4241): Terminated: ok {rc=0} 12:15:25.893808 --- ParallelTerminationStrategy: PID 4244 died... 12:15:25.912392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4244): Terminated: ok {rc=0} 12:15:25.956482 --- ParallelTerminationStrategy: PID 4247 died... 12:15:25.974969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4247): Terminated: ok {rc=0} 12:15:26.061518 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 12:15:27.151336 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:15:27.163349 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 12:15:27.211169 tst ping_idle_ping.py: using LAC 21395 12:15:27.338783 tst ping_idle_ping.py: using RAC 230 12:15:27.465115 tst ping_idle_ping.py: using CellId 21395 12:15:27.590662 tst ping_idle_ping.py: using BVCI 21396 12:15:27.709376 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:15:27.720717 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:15:27.732103 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:15:27.744015 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:15:27.755920 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:15:27.767809 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:15:27.779631 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 12:15:27.791321 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 12:15:27.907918 tst ping_idle_ping.py:24: start network... 12:15:28.109770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:15:28.575920 run create_hlr_db(pid=4249): Launched 12:15:28.699004 bus /gobi_6: Setting Powered False 12:15:29.758822 run create_hlr_db(pid=4249): Terminated: ok {rc=0} 12:15:30.199442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4251): Launched 12:15:30.522037 run osmo-hlr_10.42.42.2(pid=4252): Launched 12:15:30.644917 run osmo-stp_10.42.42.5: Starting osmo-stp 12:15:31.234314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4254): Launched 12:15:31.562185 run osmo-stp_10.42.42.5(pid=4255): Launched 12:15:31.816290 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:15:32.459377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4257): Launched 12:15:32.574835 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:15:32.829281 run patchelf(pid=4258): Launched 12:15:32.996150 run osmo-stp_10.42.42.5(pid=4255): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4255)] 12:15:33.123992 run osmo-stp_10.42.42.5(pid=4255): stdout: | (launched: 2022-12-09_12:15:31.503781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:33.252524 run osmo-stp_10.42.42.5(pid=4255): stderr: | 20221209121531771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121531771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121531771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121531771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121531772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121531772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121531772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:33.382145 run osmo-stp_10.42.42.5(pid=4255): stdout: | (launched: 2022-12-09_12:15:31.503781) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:33.504925 run osmo-stp_10.42.42.5(pid=4255): stderr: | 20221209121531771 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121531771 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121531771 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121531771 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121531772 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121531772 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121531772 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:33.650589 run patchelf(pid=4258): Terminating (SIGINT) 12:15:33.820171 run patchelf(pid=4258): Terminated: ok {rc=0} 12:15:33.942551 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4255): Process ended prematurely: osmo-stp_10.42.42.5(pid=4255) [trial-2359↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4255)] [trial-2359↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 12:15:33.951447 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 12:15:33.978030 run osmo-hlr_10.42.42.2(pid=4252): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4252)] 12:15:34.025373 run osmo-hlr_10.42.42.2(pid=4252): stdout: | (launched: 2022-12-09_12:15:30.462944) 12:15:34.074527 run osmo-hlr_10.42.42.2(pid=4252): stderr: | 20221209121530654 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121530654 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121530654 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121530654 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121530654 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121530654 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121530667 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121530678 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121530678 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121530678 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:15:34.124456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4251): Terminating (SIGTERM) 12:15:34.164335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4254): Terminating (SIGTERM) 12:15:34.204346 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4257): Terminating (SIGTERM) 12:15:34.244383 --- ParallelTerminationStrategy: PID 4251 died... 12:15:34.263589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4251): Terminated: ok {rc=0} 12:15:34.308020 --- ParallelTerminationStrategy: PID 4254 died... 12:15:34.326765 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4254): Terminated: ok {rc=0} 12:15:34.370762 --- ParallelTerminationStrategy: PID 4257 died... 12:15:34.389533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4257): Terminated: ok {rc=0} 12:15:34.476140 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 12:15:35.775044 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:15:35.780100 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:15:35.809188 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:15:35.847392 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:15:35.934612 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:15:35.963193 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:15:36.000875 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:15:36.597438 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:15:36.646094 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:36.657223 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:15:36.703640 tst cs_paging_gprs_active.py: using LAC 21396 12:15:36.830412 tst cs_paging_gprs_active.py: using RAC 231 12:15:36.949133 tst cs_paging_gprs_active.py: using CellId 21396 12:15:37.066743 tst cs_paging_gprs_active.py: using BVCI 21397 12:15:37.179331 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:37.190347 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:37.201137 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:37.212051 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:37.222777 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:37.233931 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:37.244729 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:37.255478 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:37.266434 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:15:37.384734 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:15:37.506207 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:15:37.726891 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:15:38.054822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4262): Launched 12:15:38.339733 run iperf3-srv_10.42.42.10(pid=4263): Launched 12:15:38.464457 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:15:38.684212 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:15:39.012008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4264): Launched 12:15:39.297188 run iperf3-srv_10.42.42.10(pid=4265): Launched 12:15:39.420360 tst cs_paging_gprs_active.py:38: start network... 12:15:39.639781 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:15:40.145544 run create_hlr_db(pid=4266): Launched 12:15:40.272309 bus /gobi_6: Setting Powered False 12:15:41.337318 run create_hlr_db(pid=4266): Terminated: ok {rc=0} 12:15:41.791472 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4268): Launched 12:15:42.118771 run osmo-hlr_10.42.42.2(pid=4269): Launched 12:15:42.244293 run osmo-stp_10.42.42.5: Starting osmo-stp 12:15:42.803123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4271): Launched 12:15:43.129956 run osmo-stp_10.42.42.5(pid=4272): Launched 12:15:43.256017 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:15:43.818669 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4274): Launched 12:15:43.943925 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:15:44.221991 run patchelf(pid=4275): Launched 12:15:44.404183 run osmo-stp_10.42.42.5(pid=4272): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4272)] 12:15:44.542489 run osmo-stp_10.42.42.5(pid=4272): stdout: | (launched: 2022-12-09_12:15:43.069349) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:44.681998 run osmo-stp_10.42.42.5(pid=4272): stderr: | 20221209121543257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121543257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121543258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121543258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121543258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121543259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121543259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:44.821406 run osmo-stp_10.42.42.5(pid=4272): stdout: | (launched: 2022-12-09_12:15:43.069349) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:44.955442 run osmo-stp_10.42.42.5(pid=4272): stderr: | 20221209121543257 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121543257 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121543258 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121543258 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121543258 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121543259 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121543259 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:45.114556 run patchelf(pid=4275): Terminating (SIGINT) 12:15:45.299904 run patchelf(pid=4275): Terminated: ok {rc=0} 12:15:45.433244 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4272): Process ended prematurely: osmo-stp_10.42.42.5(pid=4272) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4272)] [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:15:45.443476 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 12:15:45.472677 run osmo-hlr_10.42.42.2(pid=4269): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4269)] 12:15:45.523031 run osmo-hlr_10.42.42.2(pid=4269): stdout: | (launched: 2022-12-09_12:15:42.058106) 12:15:45.575042 run osmo-hlr_10.42.42.2(pid=4269): stderr: | 20221209121542252 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121542252 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121542253 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121542253 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121542253 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121542253 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121542265 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121542274 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121542274 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121542274 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:15:45.627798 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4262): Terminating (SIGTERM) 12:15:45.670040 run iperf3-srv_10.42.42.10(pid=4263): Terminating (SIGTERM) 12:15:45.712098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4264): Terminating (SIGTERM) 12:15:45.754536 run iperf3-srv_10.42.42.10(pid=4265): Terminating (SIGTERM) 12:15:45.796617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4268): Terminating (SIGTERM) 12:15:45.847941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4271): Terminating (SIGTERM) 12:15:45.903992 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4274): Terminating (SIGTERM) 12:15:45.948310 --- ParallelTerminationStrategy: PID 4262 died... 12:15:45.968906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4262): Terminated: ok {rc=0} 12:15:46.018404 --- ParallelTerminationStrategy: PID 4263 died... 12:15:46.038915 run iperf3-srv_10.42.42.10(pid=4263): Terminated {rc=256} 12:15:46.087998 --- ParallelTerminationStrategy: PID 4264 died... 12:15:46.108941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4264): Terminated: ok {rc=0} 12:15:46.158208 --- ParallelTerminationStrategy: PID 4265 died... 12:15:46.178980 run iperf3-srv_10.42.42.10(pid=4265): Terminated {rc=256} 12:15:46.228042 --- ParallelTerminationStrategy: PID 4268 died... 12:15:46.248768 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4268): Terminated: ok {rc=0} 12:15:46.297542 --- ParallelTerminationStrategy: PID 4271 died... 12:15:46.318349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4271): Terminated: ok {rc=0} 12:15:46.367564 --- ParallelTerminationStrategy: PID 4274 died... 12:15:46.388350 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4274): Terminated: ok {rc=0} 12:15:46.482261 bus /gobi_0: Setting Powered False 12:15:47.582473 bus /gobi_0: Setting Powered False 12:15:48.698850 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:15:49.846265 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:49.858162 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:15:49.905300 tst iperf3.py: using LAC 21397 12:15:50.038332 tst iperf3.py: using RAC 232 12:15:50.166458 tst iperf3.py: using CellId 21397 12:15:50.292629 tst iperf3.py: using BVCI 21398 12:15:50.411380 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:50.422943 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:50.434495 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:50.446036 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:50.457607 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:50.469196 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:50.480772 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:50.492246 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:50.504068 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:15:50.621835 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:15:50.826841 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:15:51.153496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4276): Launched 12:15:51.438742 run iperf3-srv_10.42.42.10(pid=4277): Launched 12:15:51.562921 tst iperf3.py:8: start network... 12:15:51.781497 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:15:52.284368 run create_hlr_db(pid=4278): Launched 12:15:52.411422 bus /gobi_6: Setting Powered False 12:15:53.475352 run create_hlr_db(pid=4278): Terminated: ok {rc=0} 12:15:53.912265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4280): Launched 12:15:54.217790 run osmo-hlr_10.42.42.2(pid=4281): Launched 12:15:54.334205 run osmo-stp_10.42.42.5: Starting osmo-stp 12:15:54.860283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4283): Launched 12:15:55.164809 run osmo-stp_10.42.42.5(pid=4284): Launched 12:15:55.280637 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:15:55.804236 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4286): Launched 12:15:55.920809 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:15:56.177512 run patchelf(pid=4287): Launched 12:15:56.348114 run osmo-stp_10.42.42.5(pid=4284): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4284)] 12:15:56.477299 run osmo-stp_10.42.42.5(pid=4284): stdout: | (launched: 2022-12-09_12:15:55.108415) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:56.607506 run osmo-stp_10.42.42.5(pid=4284): stderr: | 20221209121555276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121555276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121555276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121555277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121555277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121555278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121555278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:56.738261 run osmo-stp_10.42.42.5(pid=4284): stdout: | (launched: 2022-12-09_12:15:55.108415) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:15:56.863181 run osmo-stp_10.42.42.5(pid=4284): stderr: | 20221209121555276 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121555276 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121555276 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121555277 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121555277 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121555278 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121555278 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:15:57.011368 run patchelf(pid=4287): Terminating (SIGINT) 12:15:57.183828 run patchelf(pid=4287): Terminated: ok {rc=0} 12:15:57.309362 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4284): Process ended prematurely: osmo-stp_10.42.42.5(pid=4284) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4284)] [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 12:15:57.318734 tst iperf3.py:8: Test FAILED (7.5 sec) 12:15:57.345950 run osmo-hlr_10.42.42.2(pid=4281): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4281)] 12:15:57.393418 run osmo-hlr_10.42.42.2(pid=4281): stdout: | (launched: 2022-12-09_12:15:54.160862) 12:15:57.443110 run osmo-hlr_10.42.42.2(pid=4281): stderr: | 20221209121554335 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121554335 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121554335 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121554335 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121554335 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121554335 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121554347 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121554355 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121554355 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121554355 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:15:57.493197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4276): Terminating (SIGTERM) 12:15:57.533541 run iperf3-srv_10.42.42.10(pid=4277): Terminating (SIGTERM) 12:15:57.573679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4280): Terminating (SIGTERM) 12:15:57.613749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4283): Terminating (SIGTERM) 12:15:57.653561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4286): Terminating (SIGTERM) 12:15:57.693710 --- ParallelTerminationStrategy: PID 4276 died... 12:15:57.712746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4276): Terminated: ok {rc=0} 12:15:57.757075 --- ParallelTerminationStrategy: PID 4277 died... 12:15:57.775699 run iperf3-srv_10.42.42.10(pid=4277): Terminated {rc=256} 12:15:57.819539 --- ParallelTerminationStrategy: PID 4280 died... 12:15:57.838423 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4280): Terminated: ok {rc=0} 12:15:57.882393 --- ParallelTerminationStrategy: PID 4283 died... 12:15:57.901165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4283): Terminated: ok {rc=0} 12:15:57.945238 --- ParallelTerminationStrategy: PID 4286 died... 12:15:57.963965 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4286): Terminated: ok {rc=0} 12:15:58.048502 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:15:59.198039 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:59.210635 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:15:59.260771 tst iperf3m4.py: using LAC 21398 12:15:59.390426 tst iperf3m4.py: using RAC 233 12:15:59.517428 tst iperf3m4.py: using CellId 21398 12:15:59.640572 tst iperf3m4.py: using BVCI 21399 12:15:59.752918 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:59.764183 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:59.775336 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:59.786958 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:59.798490 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:59.810161 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:59.821807 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:59.833073 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:15:59.844517 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:15:59.972761 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:16:00.093403 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:16:00.210826 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:16:00.327884 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:16:00.532555 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:16:00.844793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4288): Launched 12:16:01.128594 run iperf3-srv_10.42.42.10(pid=4289): Launched 12:16:01.275046 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:16:01.501715 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:16:01.839080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4290): Launched 12:16:02.144557 run iperf3-srv_10.42.42.10(pid=4291): Launched 12:16:02.281465 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:16:02.485640 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:16:02.791572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4292): Launched 12:16:03.057833 run iperf3-srv_10.42.42.10(pid=4293): Launched 12:16:03.173179 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:16:03.377580 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:16:03.685338 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4294): Launched 12:16:03.951810 run iperf3-srv_10.42.42.10(pid=4295): Launched 12:16:04.066594 tst iperf3m4.py:8: start network... 12:16:04.269811 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:16:04.743122 run create_hlr_db(pid=4296): Launched 12:16:04.867245 bus /gobi_6: Setting Powered False 12:16:05.927372 run create_hlr_db(pid=4296): Terminated: ok {rc=0} 12:16:06.352564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4298): Launched 12:16:06.658527 run osmo-hlr_10.42.42.2(pid=4299): Launched 12:16:06.773530 run osmo-stp_10.42.42.5: Starting osmo-stp 12:16:07.297694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4301): Launched 12:16:07.604256 run osmo-stp_10.42.42.5(pid=4302): Launched 12:16:07.720479 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:16:08.244931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4304): Launched 12:16:08.361498 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:16:08.618646 run patchelf(pid=4305): Launched 12:16:08.788294 run osmo-stp_10.42.42.5(pid=4302): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4302)] 12:16:08.916837 run osmo-stp_10.42.42.5(pid=4302): stdout: | (launched: 2022-12-09_12:16:07.547234) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:09.046675 run osmo-stp_10.42.42.5(pid=4302): stderr: | 20221209121607716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121607716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121607717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121607717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121607718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121607718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121607718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:09.176632 run osmo-stp_10.42.42.5(pid=4302): stdout: | (launched: 2022-12-09_12:16:07.547234) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:09.301210 run osmo-stp_10.42.42.5(pid=4302): stderr: | 20221209121607716 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121607716 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121607717 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121607717 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121607718 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121607718 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121607718 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:09.448538 run patchelf(pid=4305): Terminating (SIGINT) 12:16:09.621318 run patchelf(pid=4305): Terminated: ok {rc=0} 12:16:09.745971 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4302): Process ended prematurely: osmo-stp_10.42.42.5(pid=4302) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4302)] [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 12:16:09.755529 tst iperf3m4.py:8: Test FAILED (10.6 sec) 12:16:09.782792 run osmo-hlr_10.42.42.2(pid=4299): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4299)] 12:16:09.830080 run osmo-hlr_10.42.42.2(pid=4299): stdout: | (launched: 2022-12-09_12:16:06.601374) 12:16:09.879292 run osmo-hlr_10.42.42.2(pid=4299): stderr: | 20221209121606777 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121606777 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121606777 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121606777 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121606777 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121606777 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121606791 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121606802 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121606802 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121606803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:16:09.929501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4288): Terminating (SIGTERM) 12:16:09.969286 run iperf3-srv_10.42.42.10(pid=4289): Terminating (SIGTERM) 12:16:10.008806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4290): Terminating (SIGTERM) 12:16:10.048539 run iperf3-srv_10.42.42.10(pid=4291): Terminating (SIGTERM) 12:16:10.088111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4292): Terminating (SIGTERM) 12:16:10.127957 run iperf3-srv_10.42.42.10(pid=4293): Terminating (SIGTERM) 12:16:10.167478 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4294): Terminating (SIGTERM) 12:16:10.207164 run iperf3-srv_10.42.42.10(pid=4295): Terminating (SIGTERM) 12:16:10.246729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4298): Terminating (SIGTERM) 12:16:10.286563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4301): Terminating (SIGTERM) 12:16:10.326473 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4304): Terminating (SIGTERM) 12:16:10.366348 --- ParallelTerminationStrategy: PID 4288 died... 12:16:10.385344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4288): Terminated: ok {rc=0} 12:16:10.429328 --- ParallelTerminationStrategy: PID 4289 died... 12:16:10.447895 run iperf3-srv_10.42.42.10(pid=4289): Terminated {rc=256} 12:16:10.491445 --- ParallelTerminationStrategy: PID 4290 died... 12:16:10.509974 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4290): Terminated: ok {rc=0} 12:16:10.553748 --- ParallelTerminationStrategy: PID 4291 died... 12:16:10.572103 run iperf3-srv_10.42.42.10(pid=4291): Terminated {rc=256} 12:16:10.615894 --- ParallelTerminationStrategy: PID 4292 died... 12:16:10.634498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4292): Terminated: ok {rc=0} 12:16:10.678109 --- ParallelTerminationStrategy: PID 4293 died... 12:16:10.696586 run iperf3-srv_10.42.42.10(pid=4293): Terminated {rc=256} 12:16:10.740543 --- ParallelTerminationStrategy: PID 4294 died... 12:16:10.759177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4294): Terminated: ok {rc=0} 12:16:10.802790 --- ParallelTerminationStrategy: PID 4295 died... 12:16:10.821288 run iperf3-srv_10.42.42.10(pid=4295): Terminated {rc=256} 12:16:10.865449 --- ParallelTerminationStrategy: PID 4298 died... 12:16:10.883913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4298): Terminated: ok {rc=0} 12:16:10.927760 --- ParallelTerminationStrategy: PID 4301 died... 12:16:10.946353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4301): Terminated: ok {rc=0} 12:16:10.990839 --- ParallelTerminationStrategy: PID 4304 died... 12:16:11.009428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4304): Terminated: ok {rc=0} 12:16:11.094840 bus /gobi_4: Setting Powered False 12:16:12.195083 bus /gobi_4: Setting Powered False 12:16:13.309882 bus /gobi_1: Setting Powered False 12:16:14.408061 bus /gobi_1: Setting Powered False 12:16:15.524615 bus /gobi_0: Setting Powered False 12:16:16.618929 bus /gobi_0: Setting Powered False 12:16:17.733572 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 12:16:18.834410 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:18.846028 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:16:18.896318 tst ping.py: using LAC 21399 12:16:19.012833 tst ping.py: using RAC 234 12:16:19.129065 tst ping.py: using CellId 21399 12:16:19.254907 tst ping.py: using BVCI 21400 12:16:19.364897 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:19.375977 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:19.386823 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:19.397637 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:19.408389 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:19.419182 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:19.430160 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:19.440830 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:16:19.556403 tst ping.py:19: start network... 12:16:19.758269 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:16:20.219771 run create_hlr_db(pid=4307): Launched 12:16:20.341620 bus /gobi_6: Setting Powered False 12:16:21.401246 run create_hlr_db(pid=4307): Terminated: ok {rc=0} 12:16:21.840607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4309): Launched 12:16:22.159587 run osmo-hlr_10.42.42.2(pid=4310): Launched 12:16:22.281506 run osmo-stp_10.42.42.5: Starting osmo-stp 12:16:22.839578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4312): Launched 12:16:23.159139 run osmo-stp_10.42.42.5(pid=4313): Launched 12:16:23.280105 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:16:23.814296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4316): Launched 12:16:23.929705 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:16:24.182934 run patchelf(pid=4317): Launched 12:16:24.349702 run osmo-stp_10.42.42.5(pid=4313): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4313)] 12:16:24.476648 run osmo-stp_10.42.42.5(pid=4313): stdout: | (launched: 2022-12-09_12:16:23.100144) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:24.604723 run osmo-stp_10.42.42.5(pid=4313): stderr: | 20221209121623287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121623287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121623288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121623288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121623288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121623289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121623289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:24.733150 run osmo-stp_10.42.42.5(pid=4313): stdout: | (launched: 2022-12-09_12:16:23.100144) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:24.855664 run osmo-stp_10.42.42.5(pid=4313): stderr: | 20221209121623287 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121623287 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121623288 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121623288 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121623288 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121623289 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121623289 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:25.000373 run patchelf(pid=4317): Terminating (SIGINT) 12:16:25.170160 run patchelf(pid=4317): Terminated: ok {rc=0} 12:16:25.292611 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4313): Process ended prematurely: osmo-stp_10.42.42.5(pid=4313) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4313)] [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 12:16:25.301527 tst ping.py:22: Test FAILED (6.5 sec) 12:16:25.328327 run osmo-hlr_10.42.42.2(pid=4310): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4310)] 12:16:25.376275 run osmo-hlr_10.42.42.2(pid=4310): stdout: | (launched: 2022-12-09_12:16:22.100850) 12:16:25.426084 run osmo-hlr_10.42.42.2(pid=4310): stderr: | 20221209121622295 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121622295 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121622295 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121622295 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121622295 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121622295 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121622308 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121622316 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121622316 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121622317 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:16:25.476491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4309): Terminating (SIGTERM) 12:16:25.516623 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4312): Terminating (SIGTERM) 12:16:25.556610 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4316): Terminating (SIGTERM) 12:16:25.596673 --- ParallelTerminationStrategy: PID 4309 died... 12:16:25.615842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4309): Terminated: ok {rc=0} 12:16:25.660047 --- ParallelTerminationStrategy: PID 4312 died... 12:16:25.678772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4312): Terminated: ok {rc=0} 12:16:25.722795 --- ParallelTerminationStrategy: PID 4316 died... 12:16:25.741942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4316): Terminated: ok {rc=0} 12:16:25.828926 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:16:26.918066 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:26.930450 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:16:26.978091 tst ping_idle_ping.py: using LAC 21400 12:16:27.097359 tst ping_idle_ping.py: using RAC 235 12:16:27.215455 tst ping_idle_ping.py: using CellId 21400 12:16:27.334362 tst ping_idle_ping.py: using BVCI 21401 12:16:27.442487 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:27.453714 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:27.464637 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:27.475734 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:27.486687 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:27.497637 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:27.508570 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:16:27.519343 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:16:27.636785 tst ping_idle_ping.py:24: start network... 12:16:27.838793 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:16:28.305747 run create_hlr_db(pid=4318): Launched 12:16:28.430050 bus /gobi_6: Setting Powered False 12:16:29.490269 run create_hlr_db(pid=4318): Terminated: ok {rc=0} 12:16:29.931877 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4320): Launched 12:16:30.253976 run osmo-hlr_10.42.42.2(pid=4321): Launched 12:16:30.377119 run osmo-stp_10.42.42.5: Starting osmo-stp 12:16:30.955477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4323): Launched 12:16:31.293771 run osmo-stp_10.42.42.5(pid=4324): Launched 12:16:31.530088 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:16:32.169913 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4326): Launched 12:16:32.288640 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:16:32.544499 run patchelf(pid=4327): Launched 12:16:32.713675 run osmo-stp_10.42.42.5(pid=4324): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4324)] 12:16:32.842076 run osmo-stp_10.42.42.5(pid=4324): stdout: | (launched: 2022-12-09_12:16:31.233302) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:32.971462 run osmo-stp_10.42.42.5(pid=4324): stderr: | 20221209121631520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121631520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121631520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121631520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121631521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121631521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121631521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:33.100900 run osmo-stp_10.42.42.5(pid=4324): stdout: | (launched: 2022-12-09_12:16:31.233302) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:33.224218 run osmo-stp_10.42.42.5(pid=4324): stderr: | 20221209121631520 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121631520 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121631520 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121631520 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121631521 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121631521 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121631521 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:33.370302 run patchelf(pid=4327): Terminating (SIGINT) 12:16:33.540865 run patchelf(pid=4327): Terminated: ok {rc=0} 12:16:33.664247 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4324): Process ended prematurely: osmo-stp_10.42.42.5(pid=4324) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4324)] [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 12:16:33.673322 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 12:16:33.700134 run osmo-hlr_10.42.42.2(pid=4321): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4321)] 12:16:33.748060 run osmo-hlr_10.42.42.2(pid=4321): stdout: | (launched: 2022-12-09_12:16:30.194513) 12:16:33.797628 run osmo-hlr_10.42.42.2(pid=4321): stderr: | 20221209121630388 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121630388 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121630389 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121630389 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121630389 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121630389 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121630404 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121630412 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121630412 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121630412 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:16:33.848141 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4320): Terminating (SIGTERM) 12:16:33.887997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4323): Terminating (SIGTERM) 12:16:33.928056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4326): Terminating (SIGTERM) 12:16:33.968349 --- ParallelTerminationStrategy: PID 4320 died... 12:16:33.987579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4320): Terminated: ok {rc=0} 12:16:34.032004 --- ParallelTerminationStrategy: PID 4323 died... 12:16:34.050791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4323): Terminated: ok {rc=0} 12:16:34.095134 --- ParallelTerminationStrategy: PID 4326 died... 12:16:34.114092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4326): Terminated: ok {rc=0} 12:16:34.202007 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:16:35.507605 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:16:35.513970 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:16:35.543969 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:16:35.582448 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:16:35.669615 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:16:35.698951 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:16:35.737231 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:16:36.334482 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:16:36.384418 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:36.395829 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:16:36.461924 tst cs_paging_gprs_active.py: using LAC 21401 12:16:36.584263 tst cs_paging_gprs_active.py: using RAC 236 12:16:36.707070 tst cs_paging_gprs_active.py: using CellId 21401 12:16:36.836454 tst cs_paging_gprs_active.py: using BVCI 21402 12:16:36.956462 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:36.968240 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:36.979654 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:36.991299 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:37.003029 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:37.014727 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:37.026517 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:37.038082 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:37.049902 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:16:37.170248 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:16:37.292873 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:16:37.515193 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:16:37.845788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4332): Launched 12:16:38.134919 run iperf3-srv_10.42.42.10(pid=4333): Launched 12:16:38.259373 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:16:38.480730 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:16:38.811326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4334): Launched 12:16:39.098751 run iperf3-srv_10.42.42.10(pid=4335): Launched 12:16:39.223303 tst cs_paging_gprs_active.py:38: start network... 12:16:39.445452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:16:39.954884 run create_hlr_db(pid=4336): Launched 12:16:40.080715 bus /gobi_6: Setting Powered False 12:16:41.146187 run create_hlr_db(pid=4336): Terminated: ok {rc=0} 12:16:41.603373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4338): Launched 12:16:41.933164 run osmo-hlr_10.42.42.2(pid=4339): Launched 12:16:42.058722 run osmo-stp_10.42.42.5: Starting osmo-stp 12:16:42.623473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4341): Launched 12:16:42.953718 run osmo-stp_10.42.42.5(pid=4342): Launched 12:16:43.080357 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:16:43.650304 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4344): Launched 12:16:43.777742 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:16:44.055668 run patchelf(pid=4345): Launched 12:16:44.241579 run osmo-stp_10.42.42.5(pid=4342): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4342)] 12:16:44.380444 run osmo-stp_10.42.42.5(pid=4342): stdout: | (launched: 2022-12-09_12:16:42.892511) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:44.520561 run osmo-stp_10.42.42.5(pid=4342): stderr: | 20221209121643080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121643080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121643081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121643081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121643082 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121643082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121643082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:44.660211 run osmo-stp_10.42.42.5(pid=4342): stdout: | (launched: 2022-12-09_12:16:42.892511) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:44.795246 run osmo-stp_10.42.42.5(pid=4342): stderr: | 20221209121643080 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121643080 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121643081 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121643081 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121643082 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121643082 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121643082 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:44.954765 run patchelf(pid=4345): Terminating (SIGINT) 12:16:45.141180 run patchelf(pid=4345): Terminated: ok {rc=0} 12:16:45.274602 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4342): Process ended prematurely: osmo-stp_10.42.42.5(pid=4342) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4342)] [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:16:45.284684 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 12:16:45.314048 run osmo-hlr_10.42.42.2(pid=4339): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4339)] 12:16:45.365196 run osmo-hlr_10.42.42.2(pid=4339): stdout: | (launched: 2022-12-09_12:16:41.871701) 12:16:45.417725 run osmo-hlr_10.42.42.2(pid=4339): stderr: | 20221209121642067 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121642067 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121642067 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121642067 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121642067 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121642067 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121642079 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121642088 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121642088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121642088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:16:45.470518 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4332): Terminating (SIGTERM) 12:16:45.512930 run iperf3-srv_10.42.42.10(pid=4333): Terminating (SIGTERM) 12:16:45.555374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4334): Terminating (SIGTERM) 12:16:45.597674 run iperf3-srv_10.42.42.10(pid=4335): Terminating (SIGTERM) 12:16:45.639906 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4338): Terminating (SIGTERM) 12:16:45.682482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4341): Terminating (SIGTERM) 12:16:45.724988 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4344): Terminating (SIGTERM) 12:16:45.767552 --- ParallelTerminationStrategy: PID 4332 died... 12:16:45.787762 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4332): Terminated: ok {rc=0} 12:16:45.839508 --- ParallelTerminationStrategy: PID 4333 died... 12:16:45.862157 run iperf3-srv_10.42.42.10(pid=4333): Terminated {rc=256} 12:16:45.917488 --- ParallelTerminationStrategy: PID 4334 died... 12:16:45.938566 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4334): Terminated: ok {rc=0} 12:16:45.988431 --- ParallelTerminationStrategy: PID 4335 died... 12:16:46.009520 run iperf3-srv_10.42.42.10(pid=4335): Terminated {rc=256} 12:16:46.058439 --- ParallelTerminationStrategy: PID 4338 died... 12:16:46.079010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4338): Terminated: ok {rc=0} 12:16:46.127998 --- ParallelTerminationStrategy: PID 4341 died... 12:16:46.149016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4341): Terminated: ok {rc=0} 12:16:46.198064 --- ParallelTerminationStrategy: PID 4344 died... 12:16:46.218654 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4344): Terminated: ok {rc=0} 12:16:46.310475 bus /gobi_0: Setting Powered False 12:16:47.407062 bus /gobi_0: Setting Powered False 12:16:48.521136 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:16:49.671734 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:49.684141 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:16:49.754843 tst iperf3.py: using LAC 21402 12:16:49.885328 tst iperf3.py: using RAC 237 12:16:50.013452 tst iperf3.py: using CellId 21402 12:16:50.135903 tst iperf3.py: using BVCI 21403 12:16:50.249289 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:50.260541 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:50.271728 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:50.283208 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:50.294555 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:50.305851 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:50.317639 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:50.328789 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:50.340327 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:16:50.460653 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:16:50.681141 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:16:51.010400 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4346): Launched 12:16:51.297584 run iperf3-srv_10.42.42.10(pid=4347): Launched 12:16:51.422060 tst iperf3.py:8: start network... 12:16:51.643719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:16:52.154100 run create_hlr_db(pid=4348): Launched 12:16:52.279886 bus /gobi_6: Setting Powered False 12:16:53.344368 run create_hlr_db(pid=4348): Terminated: ok {rc=0} 12:16:53.782137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4350): Launched 12:16:54.090683 run osmo-hlr_10.42.42.2(pid=4351): Launched 12:16:54.206950 run osmo-stp_10.42.42.5: Starting osmo-stp 12:16:54.740130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4353): Launched 12:16:55.048458 run osmo-stp_10.42.42.5(pid=4354): Launched 12:16:55.165467 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:16:55.693689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4356): Launched 12:16:55.812398 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:16:56.074422 run patchelf(pid=4357): Launched 12:16:56.246324 run osmo-stp_10.42.42.5(pid=4354): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4354)] 12:16:56.376039 run osmo-stp_10.42.42.5(pid=4354): stdout: | (launched: 2022-12-09_12:16:54.991061) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:56.507319 run osmo-stp_10.42.42.5(pid=4354): stderr: | 20221209121655160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121655160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121655160 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121655161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121655161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121655161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121655161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:56.639302 run osmo-stp_10.42.42.5(pid=4354): stdout: | (launched: 2022-12-09_12:16:54.991061) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:16:56.765318 run osmo-stp_10.42.42.5(pid=4354): stderr: | 20221209121655160 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121655160 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121655160 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121655161 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121655161 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121655161 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121655161 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:16:56.914430 run patchelf(pid=4357): Terminating (SIGINT) 12:16:57.087909 run patchelf(pid=4357): Terminated: ok {rc=0} 12:16:57.214220 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4354): Process ended prematurely: osmo-stp_10.42.42.5(pid=4354) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4354)] [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 12:16:57.223998 tst iperf3.py:8: Test FAILED (7.6 sec) 12:16:57.251744 run osmo-hlr_10.42.42.2(pid=4351): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4351)] 12:16:57.300128 run osmo-hlr_10.42.42.2(pid=4351): stdout: | (launched: 2022-12-09_12:16:54.033129) 12:16:57.350085 run osmo-hlr_10.42.42.2(pid=4351): stderr: | 20221209121654209 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121654209 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121654209 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121654209 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121654209 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121654209 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121654222 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121654230 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121654230 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121654230 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:16:57.400352 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4346): Terminating (SIGTERM) 12:16:57.440666 run iperf3-srv_10.42.42.10(pid=4347): Terminating (SIGTERM) 12:16:57.480735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4350): Terminating (SIGTERM) 12:16:57.522134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4353): Terminating (SIGTERM) 12:16:57.562479 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4356): Terminating (SIGTERM) 12:16:57.602713 --- ParallelTerminationStrategy: PID 4346 died... 12:16:57.622158 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4346): Terminated: ok {rc=0} 12:16:57.666727 --- ParallelTerminationStrategy: PID 4347 died... 12:16:57.685584 run iperf3-srv_10.42.42.10(pid=4347): Terminated {rc=256} 12:16:57.729840 --- ParallelTerminationStrategy: PID 4350 died... 12:16:57.748761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4350): Terminated: ok {rc=0} 12:16:57.793065 --- ParallelTerminationStrategy: PID 4353 died... 12:16:57.811880 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4353): Terminated: ok {rc=0} 12:16:57.856071 --- ParallelTerminationStrategy: PID 4356 died... 12:16:57.874970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4356): Terminated: ok {rc=0} 12:16:57.959079 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:16:59.102736 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:59.114694 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:16:59.180563 tst iperf3m4.py: using LAC 21403 12:16:59.301670 tst iperf3m4.py: using RAC 238 12:16:59.422482 tst iperf3m4.py: using CellId 21403 12:16:59.542287 tst iperf3m4.py: using BVCI 21404 12:16:59.655312 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:59.666663 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:59.677724 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:59.688936 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:59.700442 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:59.711521 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:59.722712 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:59.733826 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:16:59.744848 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:16:59.865657 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:16:59.990363 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:17:00.110410 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:17:00.231387 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:17:00.453482 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:17:00.783786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4358): Launched 12:17:01.078841 run iperf3-srv_10.42.42.10(pid=4359): Launched 12:17:01.210144 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:17:01.436933 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:17:01.764612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4363): Launched 12:17:02.048369 run iperf3-srv_10.42.42.10(pid=4364): Launched 12:17:02.182119 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:17:02.388752 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:17:02.738779 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4365): Launched 12:17:03.026339 run iperf3-srv_10.42.42.10(pid=4366): Launched 12:17:03.150433 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:17:03.371410 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:17:03.701722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4367): Launched 12:17:03.990390 run iperf3-srv_10.42.42.10(pid=4368): Launched 12:17:04.114653 tst iperf3m4.py:8: start network... 12:17:04.335995 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:17:04.843892 run create_hlr_db(pid=4369): Launched 12:17:04.970461 bus /gobi_6: Setting Powered False 12:17:06.035161 run create_hlr_db(pid=4369): Terminated: ok {rc=0} 12:17:06.492844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4371): Launched 12:17:06.821730 run osmo-hlr_10.42.42.2(pid=4372): Launched 12:17:06.948348 run osmo-stp_10.42.42.5: Starting osmo-stp 12:17:07.516870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4374): Launched 12:17:07.846274 run osmo-stp_10.42.42.5(pid=4375): Launched 12:17:07.973551 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:17:08.541066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4377): Launched 12:17:08.668708 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:17:08.946741 run patchelf(pid=4378): Launched 12:17:09.129749 run osmo-stp_10.42.42.5(pid=4375): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4375)] 12:17:09.269337 run osmo-stp_10.42.42.5(pid=4375): stdout: | (launched: 2022-12-09_12:17:07.785374) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:09.409870 run osmo-stp_10.42.42.5(pid=4375): stderr: | 20221209121707973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121707973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121707973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121707974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121707974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121707974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121707974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:09.550132 run osmo-stp_10.42.42.5(pid=4375): stdout: | (launched: 2022-12-09_12:17:07.785374) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:09.684600 run osmo-stp_10.42.42.5(pid=4375): stderr: | 20221209121707973 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121707973 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121707973 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121707974 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121707974 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121707974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121707974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:09.844185 run patchelf(pid=4378): Terminating (SIGINT) 12:17:10.029518 run patchelf(pid=4378): Terminated: ok {rc=0} 12:17:10.164301 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4375): Process ended prematurely: osmo-stp_10.42.42.5(pid=4375) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4375)] [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:17:10.174723 tst iperf3m4.py:8: Test FAILED (11.1 sec) 12:17:10.204384 run osmo-hlr_10.42.42.2(pid=4372): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4372)] 12:17:10.255372 run osmo-hlr_10.42.42.2(pid=4372): stdout: | (launched: 2022-12-09_12:17:06.760626) 12:17:10.308197 run osmo-hlr_10.42.42.2(pid=4372): stderr: | 20221209121706956 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121706956 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121706956 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121706956 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121706956 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121706956 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121706968 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121706977 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121706977 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121706977 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:17:10.361585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4358): Terminating (SIGTERM) 12:17:10.404339 run iperf3-srv_10.42.42.10(pid=4359): Terminating (SIGTERM) 12:17:10.447081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4363): Terminating (SIGTERM) 12:17:10.489966 run iperf3-srv_10.42.42.10(pid=4364): Terminating (SIGTERM) 12:17:10.532134 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4365): Terminating (SIGTERM) 12:17:10.574692 run iperf3-srv_10.42.42.10(pid=4366): Terminating (SIGTERM) 12:17:10.616837 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4367): Terminating (SIGTERM) 12:17:10.659244 run iperf3-srv_10.42.42.10(pid=4368): Terminating (SIGTERM) 12:17:10.701469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4371): Terminating (SIGTERM) 12:17:10.743832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4374): Terminating (SIGTERM) 12:17:10.786211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4377): Terminating (SIGTERM) 12:17:10.828762 --- ParallelTerminationStrategy: PID 4358 died... 12:17:10.849001 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4358): Terminated: ok {rc=0} 12:17:10.895794 --- ParallelTerminationStrategy: PID 4359 died... 12:17:10.915345 run iperf3-srv_10.42.42.10(pid=4359): Terminated {rc=256} 12:17:10.961918 --- ParallelTerminationStrategy: PID 4363 died... 12:17:10.981436 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4363): Terminated: ok {rc=0} 12:17:11.028176 --- ParallelTerminationStrategy: PID 4364 died... 12:17:11.047846 run iperf3-srv_10.42.42.10(pid=4364): Terminated {rc=256} 12:17:11.094698 --- ParallelTerminationStrategy: PID 4365 died... 12:17:11.114444 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4365): Terminated: ok {rc=0} 12:17:11.161986 --- ParallelTerminationStrategy: PID 4366 died... 12:17:11.181645 run iperf3-srv_10.42.42.10(pid=4366): Terminated {rc=256} 12:17:11.229064 --- ParallelTerminationStrategy: PID 4367 died... 12:17:11.248722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4367): Terminated: ok {rc=0} 12:17:11.295829 --- ParallelTerminationStrategy: PID 4368 died... 12:17:11.315829 run iperf3-srv_10.42.42.10(pid=4368): Terminated {rc=256} 12:17:11.362893 --- ParallelTerminationStrategy: PID 4371 died... 12:17:11.382637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4371): Terminated: ok {rc=0} 12:17:11.429867 --- ParallelTerminationStrategy: PID 4374 died... 12:17:11.449671 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4374): Terminated: ok {rc=0} 12:17:11.497344 --- ParallelTerminationStrategy: PID 4377 died... 12:17:11.517210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4377): Terminated: ok {rc=0} 12:17:11.606123 bus /gobi_4: Setting Powered False 12:17:12.705147 bus /gobi_4: Setting Powered False 12:17:13.821630 bus /gobi_1: Setting Powered False 12:17:14.922295 bus /gobi_1: Setting Powered False 12:17:16.037465 bus /gobi_0: Setting Powered False 12:17:17.138660 bus /gobi_0: Setting Powered False 12:17:18.255040 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:17:19.358765 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:19.371262 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:17:19.440588 tst ping.py: using LAC 21404 12:17:19.566799 tst ping.py: using RAC 239 12:17:19.693913 tst ping.py: using CellId 21404 12:17:19.821272 tst ping.py: using BVCI 21405 12:17:19.937772 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:19.949594 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:19.961126 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:19.972818 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:19.984427 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:19.996266 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:20.008171 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:20.019834 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:17:20.139422 tst ping.py:19: start network... 12:17:20.358258 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:17:20.856664 run create_hlr_db(pid=4380): Launched 12:17:20.980655 bus /gobi_6: Setting Powered False 12:17:22.044686 run create_hlr_db(pid=4380): Terminated: ok {rc=0} 12:17:22.477786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4382): Launched 12:17:22.780340 run osmo-hlr_10.42.42.2(pid=4383): Launched 12:17:22.895140 run osmo-stp_10.42.42.5: Starting osmo-stp 12:17:23.419950 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4385): Launched 12:17:23.721667 run osmo-stp_10.42.42.5(pid=4386): Launched 12:17:23.836103 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:17:24.359147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4388): Launched 12:17:24.474475 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:17:24.728657 run patchelf(pid=4389): Launched 12:17:24.896515 run osmo-stp_10.42.42.5(pid=4386): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4386)] 12:17:25.024887 run osmo-stp_10.42.42.5(pid=4386): stdout: | (launched: 2022-12-09_12:17:23.665811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:25.153905 run osmo-stp_10.42.42.5(pid=4386): stderr: | 20221209121723834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121723834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121723834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121723834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121723835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121723835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121723835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:25.282892 run osmo-stp_10.42.42.5(pid=4386): stdout: | (launched: 2022-12-09_12:17:23.665811) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:25.405842 run osmo-stp_10.42.42.5(pid=4386): stderr: | 20221209121723834 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121723834 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121723834 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121723834 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121723835 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121723835 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121723835 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:25.551663 run patchelf(pid=4389): Terminating (SIGINT) 12:17:25.722192 run patchelf(pid=4389): Terminated: ok {rc=0} 12:17:25.845158 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4386): Process ended prematurely: osmo-stp_10.42.42.5(pid=4386) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4386)] [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 12:17:25.854398 tst ping.py:22: Test FAILED (6.5 sec) 12:17:25.881261 run osmo-hlr_10.42.42.2(pid=4383): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4383)] 12:17:25.928882 run osmo-hlr_10.42.42.2(pid=4383): stdout: | (launched: 2022-12-09_12:17:22.724192) 12:17:25.978655 run osmo-hlr_10.42.42.2(pid=4383): stderr: | 20221209121722897 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121722897 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121722898 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121722898 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121722898 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121722898 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121722911 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121722922 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121722922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121722922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:17:26.028603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4382): Terminating (SIGTERM) 12:17:26.068636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4385): Terminating (SIGTERM) 12:17:26.108682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4388): Terminating (SIGTERM) 12:17:26.149091 --- ParallelTerminationStrategy: PID 4382 died... 12:17:26.167962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4382): Terminated: ok {rc=0} 12:17:26.212163 --- ParallelTerminationStrategy: PID 4385 died... 12:17:26.231158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4385): Terminated: ok {rc=0} 12:17:26.275324 --- ParallelTerminationStrategy: PID 4388 died... 12:17:26.294075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4388): Terminated: ok {rc=0} 12:17:26.380064 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:17:27.469416 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:27.481954 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:17:27.555988 tst ping_idle_ping.py: using LAC 21405 12:17:27.675905 tst ping_idle_ping.py: using RAC 240 12:17:27.794876 tst ping_idle_ping.py: using CellId 21405 12:17:27.914927 tst ping_idle_ping.py: using BVCI 21406 12:17:28.026513 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:28.037702 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:28.048589 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:28.060072 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:28.073887 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:28.086542 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:28.098392 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:17:28.110422 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:17:28.232817 tst ping_idle_ping.py:24: start network... 12:17:28.451283 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:17:28.952324 run create_hlr_db(pid=4390): Launched 12:17:29.077988 bus /gobi_6: Setting Powered False 12:17:30.142330 run create_hlr_db(pid=4390): Terminated: ok {rc=0} 12:17:30.579155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4392): Launched 12:17:30.897779 run osmo-hlr_10.42.42.2(pid=4393): Launched 12:17:31.199697 run osmo-stp_10.42.42.5: Starting osmo-stp 12:17:31.792210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4395): Launched 12:17:32.134688 run osmo-stp_10.42.42.5(pid=4396): Launched 12:17:32.400002 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:17:32.920581 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4398): Launched 12:17:33.037466 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:17:33.294438 run patchelf(pid=4399): Launched 12:17:33.463709 run osmo-stp_10.42.42.5(pid=4396): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4396)] 12:17:33.592181 run osmo-stp_10.42.42.5(pid=4396): stdout: | (launched: 2022-12-09_12:17:32.074088) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:33.721392 run osmo-stp_10.42.42.5(pid=4396): stderr: | 20221209121732268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121732268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121732268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121732269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121732269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121732269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121732269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:33.850617 run osmo-stp_10.42.42.5(pid=4396): stdout: | (launched: 2022-12-09_12:17:32.074088) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:33.974176 run osmo-stp_10.42.42.5(pid=4396): stderr: | 20221209121732268 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121732268 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121732268 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121732269 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121732269 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121732269 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121732269 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:34.120045 run patchelf(pid=4399): Terminating (SIGINT) 12:17:34.291781 run patchelf(pid=4399): Terminated: ok {rc=0} 12:17:34.415547 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4396): Process ended prematurely: osmo-stp_10.42.42.5(pid=4396) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4396)] [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:17:34.424514 tst ping_idle_ping.py:27: Test FAILED (6.9 sec) 12:17:34.451416 run osmo-hlr_10.42.42.2(pid=4393): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4393)] 12:17:34.499091 run osmo-hlr_10.42.42.2(pid=4393): stdout: | (launched: 2022-12-09_12:17:30.827718) 12:17:34.548570 run osmo-hlr_10.42.42.2(pid=4393): stderr: | 20221209121731064 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121731064 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121731064 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121731064 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121731064 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121731064 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121731082 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121731096 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121731096 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121731096 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:17:34.598346 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4392): Terminating (SIGTERM) 12:17:34.637879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4395): Terminating (SIGTERM) 12:17:34.677696 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4398): Terminating (SIGTERM) 12:17:34.717699 --- ParallelTerminationStrategy: PID 4392 died... 12:17:34.736751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4392): Terminated: ok {rc=0} 12:17:34.781340 --- ParallelTerminationStrategy: PID 4395 died... 12:17:34.799888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4395): Terminated: ok {rc=0} 12:17:34.844038 --- ParallelTerminationStrategy: PID 4398 died... 12:17:34.862923 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4398): Terminated: ok {rc=0} 12:17:34.948521 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 12:17:36.253918 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:17:36.259726 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 12:17:36.289289 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 12:17:36.328883 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 12:17:36.417886 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 12:17:36.447893 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 12:17:36.486577 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 12:17:37.081960 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 12:17:37.138301 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:37.149901 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:17:37.219854 tst cs_paging_gprs_active.py: using LAC 21406 12:17:37.341395 tst cs_paging_gprs_active.py: using RAC 241 12:17:37.464411 tst cs_paging_gprs_active.py: using CellId 21406 12:17:37.587568 tst cs_paging_gprs_active.py: using BVCI 21407 12:17:37.698946 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:37.710174 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:37.721419 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:37.732427 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:37.743371 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:37.754271 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:37.765298 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:37.776091 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:37.787264 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:17:37.908338 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:17:38.030987 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:17:38.254719 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:17:38.585991 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4404): Launched 12:17:38.874410 run iperf3-srv_10.42.42.10(pid=4405): Launched 12:17:39.000846 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:17:39.223925 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:17:39.555397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4406): Launched 12:17:39.846161 run iperf3-srv_10.42.42.10(pid=4407): Launched 12:17:39.970608 tst cs_paging_gprs_active.py:38: start network... 12:17:40.193596 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:17:40.705256 run create_hlr_db(pid=4408): Launched 12:17:40.832449 bus /gobi_6: Setting Powered False 12:17:41.898171 run create_hlr_db(pid=4408): Terminated: ok {rc=0} 12:17:42.338753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4410): Launched 12:17:42.672723 run osmo-hlr_10.42.42.2(pid=4411): Launched 12:17:42.798509 run osmo-stp_10.42.42.5: Starting osmo-stp 12:17:43.363767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4413): Launched 12:17:43.695899 run osmo-stp_10.42.42.5(pid=4414): Launched 12:17:43.823404 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:17:44.392206 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4416): Launched 12:17:44.520894 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:17:44.807882 run patchelf(pid=4417): Launched 12:17:44.982743 run osmo-stp_10.42.42.5(pid=4414): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4414)] 12:17:45.114094 run osmo-stp_10.42.42.5(pid=4414): stdout: | (launched: 2022-12-09_12:17:43.635181) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:45.246818 run osmo-stp_10.42.42.5(pid=4414): stderr: | 20221209121743824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121743824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121743824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121743825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121743825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121743825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121743825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:45.379119 run osmo-stp_10.42.42.5(pid=4414): stdout: | (launched: 2022-12-09_12:17:43.635181) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:45.506125 run osmo-stp_10.42.42.5(pid=4414): stderr: | 20221209121743824 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121743824 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121743824 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121743825 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121743825 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121743825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121743825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:45.656667 run patchelf(pid=4417): Terminating (SIGINT) 12:17:45.833334 run patchelf(pid=4417): Terminated: ok {rc=0} 12:17:45.981185 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4414): Process ended prematurely: osmo-stp_10.42.42.5(pid=4414) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4414)] [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 12:17:45.992851 tst cs_paging_gprs_active.py:38: Test FAILED (8.9 sec) 12:17:46.033808 run osmo-hlr_10.42.42.2(pid=4411): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4411)] 12:17:46.087892 run osmo-hlr_10.42.42.2(pid=4411): stdout: | (launched: 2022-12-09_12:17:42.611358) 12:17:46.144186 run osmo-hlr_10.42.42.2(pid=4411): stderr: | 20221209121742809 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121742809 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121742809 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121742809 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121742809 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121742809 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121742822 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121742830 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121742830 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121742830 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:17:46.200432 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4404): Terminating (SIGTERM) 12:17:46.245828 run iperf3-srv_10.42.42.10(pid=4405): Terminating (SIGTERM) 12:17:46.290987 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4406): Terminating (SIGTERM) 12:17:46.338317 run iperf3-srv_10.42.42.10(pid=4407): Terminating (SIGTERM) 12:17:46.385477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4410): Terminating (SIGTERM) 12:17:46.431447 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4413): Terminating (SIGTERM) 12:17:46.477469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4416): Terminating (SIGTERM) 12:17:46.523699 --- ParallelTerminationStrategy: PID 4404 died... 12:17:46.544646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4404): Terminated: ok {rc=0} 12:17:46.595998 --- ParallelTerminationStrategy: PID 4405 died... 12:17:46.616773 run iperf3-srv_10.42.42.10(pid=4405): Terminated {rc=256} 12:17:46.666974 --- ParallelTerminationStrategy: PID 4406 died... 12:17:46.687999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4406): Terminated: ok {rc=0} 12:17:46.739485 --- ParallelTerminationStrategy: PID 4407 died... 12:17:46.760614 run iperf3-srv_10.42.42.10(pid=4407): Terminated {rc=256} 12:17:46.810872 --- ParallelTerminationStrategy: PID 4410 died... 12:17:46.832210 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4410): Terminated: ok {rc=0} 12:17:46.882940 --- ParallelTerminationStrategy: PID 4413 died... 12:17:46.903761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4413): Terminated: ok {rc=0} 12:17:46.954996 --- ParallelTerminationStrategy: PID 4416 died... 12:17:46.976093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4416): Terminated: ok {rc=0} 12:17:47.069635 bus /gobi_0: Setting Powered False 12:17:48.168638 bus /gobi_0: Setting Powered False 12:17:49.281224 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 12:17:50.426765 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:50.438646 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:17:50.505487 tst iperf3.py: using LAC 21407 12:17:50.626275 tst iperf3.py: using RAC 242 12:17:50.746256 tst iperf3.py: using CellId 21407 12:17:50.868541 tst iperf3.py: using BVCI 21408 12:17:50.981127 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:50.992239 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:51.003292 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:51.014336 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:51.025265 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:51.036107 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:51.047172 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:51.058035 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:51.069052 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:17:51.189651 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:17:51.411347 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:17:51.742248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4418): Launched 12:17:52.029175 run iperf3-srv_10.42.42.10(pid=4419): Launched 12:17:52.153146 tst iperf3.py:8: start network... 12:17:52.374686 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:17:52.884314 run create_hlr_db(pid=4420): Launched 12:17:53.012883 bus /gobi_6: Setting Powered False 12:17:54.078298 run create_hlr_db(pid=4420): Terminated: ok {rc=0} 12:17:54.520611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4422): Launched 12:17:54.831672 run osmo-hlr_10.42.42.2(pid=4423): Launched 12:17:54.949370 run osmo-stp_10.42.42.5: Starting osmo-stp 12:17:55.481735 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4425): Launched 12:17:55.790776 run osmo-stp_10.42.42.5(pid=4426): Launched 12:17:55.908337 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:17:56.438090 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4428): Launched 12:17:56.556669 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:17:56.816677 run patchelf(pid=4429): Launched 12:17:56.988094 run osmo-stp_10.42.42.5(pid=4426): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4426)] 12:17:57.118043 run osmo-stp_10.42.42.5(pid=4426): stdout: | (launched: 2022-12-09_12:17:55.733290) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:57.249548 run osmo-stp_10.42.42.5(pid=4426): stderr: | 20221209121755901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121755901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121755902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121755902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121755903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121755903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121755903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:57.380926 run osmo-stp_10.42.42.5(pid=4426): stdout: | (launched: 2022-12-09_12:17:55.733290) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:17:57.506965 run osmo-stp_10.42.42.5(pid=4426): stderr: | 20221209121755901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121755901 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121755902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121755902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121755903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121755903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121755903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:17:57.656212 run patchelf(pid=4429): Terminating (SIGINT) 12:17:57.830492 run patchelf(pid=4429): Terminated: ok {rc=0} 12:17:57.956401 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4426): Process ended prematurely: osmo-stp_10.42.42.5(pid=4426) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4426)] [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 12:17:57.966090 tst iperf3.py:8: Test FAILED (7.6 sec) 12:17:57.993574 run osmo-hlr_10.42.42.2(pid=4423): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4423)] 12:17:58.041335 run osmo-hlr_10.42.42.2(pid=4423): stdout: | (launched: 2022-12-09_12:17:54.774765) 12:17:58.090973 run osmo-hlr_10.42.42.2(pid=4423): stderr: | 20221209121754948 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121754948 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121754948 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121754948 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121754948 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121754948 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121754961 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121754969 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121754969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121754969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:17:58.141008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4418): Terminating (SIGTERM) 12:17:58.181058 run iperf3-srv_10.42.42.10(pid=4419): Terminating (SIGTERM) 12:17:58.220990 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4422): Terminating (SIGTERM) 12:17:58.261028 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4425): Terminating (SIGTERM) 12:17:58.300866 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4428): Terminating (SIGTERM) 12:17:58.340900 --- ParallelTerminationStrategy: PID 4418 died... 12:17:58.360117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4418): Terminated: ok {rc=0} 12:17:58.404847 --- ParallelTerminationStrategy: PID 4419 died... 12:17:58.424103 run iperf3-srv_10.42.42.10(pid=4419): Terminated {rc=256} 12:17:58.468268 --- ParallelTerminationStrategy: PID 4422 died... 12:17:58.487369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4422): Terminated: ok {rc=0} 12:17:58.531541 --- ParallelTerminationStrategy: PID 4425 died... 12:17:58.550234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4425): Terminated: ok {rc=0} 12:17:58.594168 --- ParallelTerminationStrategy: PID 4428 died... 12:17:58.613075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4428): Terminated: ok {rc=0} 12:17:58.698059 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 12:17:59.841515 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:17:59.853384 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:17:59.921054 tst iperf3m4.py: using LAC 21408 12:18:00.043928 tst iperf3m4.py: using RAC 243 12:18:00.163138 tst iperf3m4.py: using CellId 21408 12:18:00.285440 tst iperf3m4.py: using BVCI 21409 12:18:00.397539 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:00.408586 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:00.419493 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:00.430498 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:00.441452 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:00.452248 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:00.463182 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:00.474061 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:00.485058 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:18:00.602464 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:18:00.726556 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:18:00.852817 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:18:00.982655 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:18:01.209831 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:18:01.546584 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4430): Launched 12:18:01.849319 run iperf3-srv_10.42.42.10(pid=4431): Launched 12:18:02.029060 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:18:02.240595 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:18:02.550966 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4432): Launched 12:18:02.821683 run iperf3-srv_10.42.42.10(pid=4433): Launched 12:18:02.938402 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:18:03.144552 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:18:03.454743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4434): Launched 12:18:03.725481 run iperf3-srv_10.42.42.10(pid=4435): Launched 12:18:03.842210 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:18:04.047957 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:18:04.359120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4436): Launched 12:18:04.630733 run iperf3-srv_10.42.42.10(pid=4437): Launched 12:18:04.748133 tst iperf3m4.py:8: start network... 12:18:04.952838 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:18:05.430444 run create_hlr_db(pid=4438): Launched 12:18:05.557957 bus /gobi_6: Setting Powered False 12:18:06.618951 run create_hlr_db(pid=4438): Terminated: ok {rc=0} 12:18:07.048498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4440): Launched 12:18:07.358074 run osmo-hlr_10.42.42.2(pid=4441): Launched 12:18:07.474006 run osmo-stp_10.42.42.5: Starting osmo-stp 12:18:08.005239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4443): Launched 12:18:08.315964 run osmo-stp_10.42.42.5(pid=4444): Launched 12:18:08.433709 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:18:08.999736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4446): Launched 12:18:09.126043 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:18:09.405207 run patchelf(pid=4447): Launched 12:18:09.588590 run osmo-stp_10.42.42.5(pid=4444): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4444)] 12:18:09.727863 run osmo-stp_10.42.42.5(pid=4444): stdout: | (launched: 2022-12-09_12:18:08.258444) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:09.868042 run osmo-stp_10.42.42.5(pid=4444): stderr: | 20221209121808428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121808428 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121808428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121808429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121808429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121808429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121808429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:10.008193 run osmo-stp_10.42.42.5(pid=4444): stdout: | (launched: 2022-12-09_12:18:08.258444) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:10.142758 run osmo-stp_10.42.42.5(pid=4444): stderr: | 20221209121808428 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121808428 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121808428 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121808429 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121808429 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121808429 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121808429 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:10.303045 run patchelf(pid=4447): Terminating (SIGINT) 12:18:10.488805 run patchelf(pid=4447): Terminated: ok {rc=0} 12:18:10.623695 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4444): Process ended prematurely: osmo-stp_10.42.42.5(pid=4444) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4444)] [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 12:18:10.634488 tst iperf3m4.py:8: Test FAILED (10.8 sec) 12:18:10.664288 run osmo-hlr_10.42.42.2(pid=4441): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4441)] 12:18:10.715190 run osmo-hlr_10.42.42.2(pid=4441): stdout: | (launched: 2022-12-09_12:18:07.300464) 12:18:10.767789 run osmo-hlr_10.42.42.2(pid=4441): stderr: | 20221209121807474 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121807474 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121807474 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121807474 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121807474 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121807474 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121807486 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121807494 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121807494 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121807494 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:18:10.820834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4430): Terminating (SIGTERM) 12:18:10.863627 run iperf3-srv_10.42.42.10(pid=4431): Terminating (SIGTERM) 12:18:10.906083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4432): Terminating (SIGTERM) 12:18:10.948594 run iperf3-srv_10.42.42.10(pid=4433): Terminating (SIGTERM) 12:18:10.991129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4434): Terminating (SIGTERM) 12:18:11.033805 run iperf3-srv_10.42.42.10(pid=4435): Terminating (SIGTERM) 12:18:11.076151 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4436): Terminating (SIGTERM) 12:18:11.118676 run iperf3-srv_10.42.42.10(pid=4437): Terminating (SIGTERM) 12:18:11.162588 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4440): Terminating (SIGTERM) 12:18:11.205822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4443): Terminating (SIGTERM) 12:18:11.248517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4446): Terminating (SIGTERM) 12:18:11.291195 --- ParallelTerminationStrategy: PID 4430 died... 12:18:11.311473 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4430): Terminated: ok {rc=0} 12:18:11.359041 --- ParallelTerminationStrategy: PID 4431 died... 12:18:11.378814 run iperf3-srv_10.42.42.10(pid=4431): Terminated {rc=256} 12:18:11.425714 --- ParallelTerminationStrategy: PID 4432 died... 12:18:11.445511 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4432): Terminated: ok {rc=0} 12:18:11.492276 --- ParallelTerminationStrategy: PID 4433 died... 12:18:11.512049 run iperf3-srv_10.42.42.10(pid=4433): Terminated {rc=256} 12:18:11.558935 --- ParallelTerminationStrategy: PID 4434 died... 12:18:11.578793 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4434): Terminated: ok {rc=0} 12:18:11.625625 --- ParallelTerminationStrategy: PID 4435 died... 12:18:11.645377 run iperf3-srv_10.42.42.10(pid=4435): Terminated {rc=256} 12:18:11.692246 --- ParallelTerminationStrategy: PID 4436 died... 12:18:11.712072 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4436): Terminated: ok {rc=0} 12:18:11.758969 --- ParallelTerminationStrategy: PID 4437 died... 12:18:11.778990 run iperf3-srv_10.42.42.10(pid=4437): Terminated {rc=256} 12:18:11.825626 --- ParallelTerminationStrategy: PID 4440 died... 12:18:11.845444 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4440): Terminated: ok {rc=0} 12:18:11.892245 --- ParallelTerminationStrategy: PID 4443 died... 12:18:11.912025 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4443): Terminated: ok {rc=0} 12:18:11.959045 --- ParallelTerminationStrategy: PID 4446 died... 12:18:11.978895 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4446): Terminated: ok {rc=0} 12:18:12.067886 bus /gobi_4: Setting Powered False 12:18:13.166585 bus /gobi_4: Setting Powered False 12:18:14.283128 bus /gobi_1: Setting Powered False 12:18:15.382759 bus /gobi_1: Setting Powered False 12:18:16.505995 bus /gobi_0: Setting Powered False 12:18:17.607200 bus /gobi_0: Setting Powered False 12:18:18.723569 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 12:18:19.828220 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:19.840060 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:18:19.907223 tst ping.py: using LAC 21409 12:18:20.039158 tst ping.py: using RAC 244 12:18:20.164567 tst ping.py: using CellId 21409 12:18:20.289366 tst ping.py: using BVCI 21410 12:18:20.405937 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:20.417828 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:20.429488 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:20.441557 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:20.453305 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:20.464915 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:20.476717 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:20.488495 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:18:20.606967 tst ping.py:19: start network... 12:18:20.810461 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:18:21.277236 run create_hlr_db(pid=4448): Launched 12:18:21.401572 bus /gobi_6: Setting Powered False 12:18:22.462504 run create_hlr_db(pid=4448): Terminated: ok {rc=0} 12:18:22.905497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4450): Launched 12:18:23.230392 run osmo-hlr_10.42.42.2(pid=4451): Launched 12:18:23.354433 run osmo-stp_10.42.42.5: Starting osmo-stp 12:18:23.918973 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4453): Launched 12:18:24.244277 run osmo-stp_10.42.42.5(pid=4454): Launched 12:18:24.368813 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:18:24.927573 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4456): Launched 12:18:25.053617 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:18:25.326806 run patchelf(pid=4457): Launched 12:18:25.507930 run osmo-stp_10.42.42.5(pid=4454): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4454)] 12:18:25.645375 run osmo-stp_10.42.42.5(pid=4454): stdout: | (launched: 2022-12-09_12:18:24.184666) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:25.783736 run osmo-stp_10.42.42.5(pid=4454): stderr: | 20221209121824373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121824373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121824373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121824374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121824374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121824374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121824374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:25.922289 run osmo-stp_10.42.42.5(pid=4454): stdout: | (launched: 2022-12-09_12:18:24.184666) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:26.054909 run osmo-stp_10.42.42.5(pid=4454): stderr: | 20221209121824373 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121824373 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121824373 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121824374 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121824374 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121824374 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121824374 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:26.211899 run patchelf(pid=4457): Terminating (SIGINT) 12:18:26.394743 run patchelf(pid=4457): Terminated: ok {rc=0} 12:18:26.526450 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4454): Process ended prematurely: osmo-stp_10.42.42.5(pid=4454) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4454)] [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 12:18:26.536109 tst ping.py:22: Test FAILED (6.7 sec) 12:18:26.565097 run osmo-hlr_10.42.42.2(pid=4451): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4451)] 12:18:26.616248 run osmo-hlr_10.42.42.2(pid=4451): stdout: | (launched: 2022-12-09_12:18:23.170706) 12:18:26.669367 run osmo-hlr_10.42.42.2(pid=4451): stderr: | 20221209121823365 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121823366 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121823366 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121823366 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121823366 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121823366 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121823379 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121823389 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121823389 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121823389 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:18:26.722808 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4450): Terminating (SIGTERM) 12:18:26.765629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4453): Terminating (SIGTERM) 12:18:26.808209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4456): Terminating (SIGTERM) 12:18:26.851307 --- ParallelTerminationStrategy: PID 4450 died... 12:18:26.871619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4450): Terminated: ok {rc=0} 12:18:26.919215 --- ParallelTerminationStrategy: PID 4453 died... 12:18:26.939172 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4453): Terminated: ok {rc=0} 12:18:26.986080 --- ParallelTerminationStrategy: PID 4456 died... 12:18:27.005718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4456): Terminated: ok {rc=0} 12:18:27.094890 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 12:18:28.183250 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:28.195664 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 12:18:28.268474 tst ping_idle_ping.py: using LAC 21410 12:18:28.387423 tst ping_idle_ping.py: using RAC 245 12:18:28.506229 tst ping_idle_ping.py: using CellId 21410 12:18:28.626278 tst ping_idle_ping.py: using BVCI 21411 12:18:28.738526 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:28.749846 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:28.760847 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:28.772517 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:28.783980 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:28.795600 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:28.807157 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 12:18:28.818832 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 12:18:28.935359 tst ping_idle_ping.py:24: start network... 12:18:29.138872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:18:29.609682 run create_hlr_db(pid=4458): Launched 12:18:29.733559 bus /gobi_6: Setting Powered False 12:18:30.793728 run create_hlr_db(pid=4458): Terminated: ok {rc=0} 12:18:31.276637 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4460): Launched 12:18:31.623567 run osmo-hlr_10.42.42.2(pid=4461): Launched 12:18:31.860653 run osmo-stp_10.42.42.5: Starting osmo-stp 12:18:32.494588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4463): Launched 12:18:32.804616 run osmo-stp_10.42.42.5(pid=4464): Launched 12:18:32.919886 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:18:33.444825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4466): Launched 12:18:33.561216 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:18:33.817314 run patchelf(pid=4467): Launched 12:18:33.986575 run osmo-stp_10.42.42.5(pid=4464): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4464)] 12:18:34.114748 run osmo-stp_10.42.42.5(pid=4464): stdout: | (launched: 2022-12-09_12:18:32.747773) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:34.244162 run osmo-stp_10.42.42.5(pid=4464): stderr: | 20221209121832918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121832918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121832918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121832918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121832919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121832919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121832919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:34.373720 run osmo-stp_10.42.42.5(pid=4464): stdout: | (launched: 2022-12-09_12:18:32.747773) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:34.497451 run osmo-stp_10.42.42.5(pid=4464): stderr: | 20221209121832918 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121832918 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121832918 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121832918 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121832919 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121832919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121832919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:34.643729 run patchelf(pid=4467): Terminating (SIGINT) 12:18:34.815756 run patchelf(pid=4467): Terminated: ok {rc=0} 12:18:34.939989 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4464): Process ended prematurely: osmo-stp_10.42.42.5(pid=4464) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4464)] [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 12:18:34.949026 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 12:18:34.975996 run osmo-hlr_10.42.42.2(pid=4461): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4461)] 12:18:35.023730 run osmo-hlr_10.42.42.2(pid=4461): stdout: | (launched: 2022-12-09_12:18:31.561060) 12:18:35.073390 run osmo-hlr_10.42.42.2(pid=4461): stderr: | 20221209121831779 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121831779 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121831779 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121831779 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121831779 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121831779 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121831794 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121831812 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121831812 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121831812 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:18:35.123439 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4460): Terminating (SIGTERM) 12:18:35.163275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4463): Terminating (SIGTERM) 12:18:35.203373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4466): Terminating (SIGTERM) 12:18:35.243552 --- ParallelTerminationStrategy: PID 4460 died... 12:18:35.262704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4460): Terminated: ok {rc=0} 12:18:35.306657 --- ParallelTerminationStrategy: PID 4463 died... 12:18:35.325330 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4463): Terminated: ok {rc=0} 12:18:35.369166 --- ParallelTerminationStrategy: PID 4466 died... 12:18:35.387781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4466): Terminated: ok {rc=0} 12:18:35.472165 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:18:36.780457 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:18:36.788681 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:18:36.820425 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:18:36.856509 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:18:36.911325 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:18:36.942230 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:18:36.978040 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:18:37.539043 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2359 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:18:37.544673 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:18:37.556825 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:18:37.625375 tst switch_tch_pdch.py: using LAC 21411 12:18:37.750347 tst switch_tch_pdch.py: using RAC 246 12:18:37.878117 tst switch_tch_pdch.py: using CellId 21411 12:18:38.004472 tst switch_tch_pdch.py: using BVCI 21412 12:18:38.121476 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:18:38.133696 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:18:38.145605 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:18:38.157877 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:18:38.170828 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:18:38.182647 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:18:38.195312 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:18:38.207747 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:18:38.327190 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:18:38.448575 tst switch_tch_pdch.py:51: start network... 12:18:38.666422 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:18:39.166386 run create_hlr_db(pid=4471): Launched 12:18:39.291485 bus /gobi_6: Setting Powered False 12:18:40.355443 run create_hlr_db(pid=4471): Terminated: ok {rc=0} 12:18:40.790967 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4473): Launched 12:18:41.095540 run osmo-hlr_10.42.42.2(pid=4474): Launched 12:18:41.210718 run osmo-stp_10.42.42.5: Starting osmo-stp 12:18:41.736660 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4476): Launched 12:18:42.039779 run osmo-stp_10.42.42.5(pid=4477): Launched 12:18:42.154950 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:18:42.675098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4479): Launched 12:18:42.792618 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:18:43.048675 run patchelf(pid=4480): Launched 12:18:43.217659 run osmo-stp_10.42.42.5(pid=4477): ERR: Terminated: ERROR {rc=1} [trial-2359↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4477)] 12:18:43.345945 run osmo-stp_10.42.42.5(pid=4477): stdout: | (launched: 2022-12-09_12:18:41.983711) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:43.475296 run osmo-stp_10.42.42.5(pid=4477): stderr: | 20221209121842152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121842152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121842152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121842153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121842153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121842154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121842154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:43.604629 run osmo-stp_10.42.42.5(pid=4477): stdout: | (launched: 2022-12-09_12:18:41.983711) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:43.728054 run osmo-stp_10.42.42.5(pid=4477): stderr: | 20221209121842152 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121842152 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121842152 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121842153 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121842153 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121842154 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121842154 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:43.874090 run patchelf(pid=4480): Terminating (SIGINT) 12:18:44.044669 run patchelf(pid=4480): Terminated: ok {rc=0} 12:18:44.167789 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4477): Process ended prematurely: osmo-stp_10.42.42.5(pid=4477) [trial-2359↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4477)] [trial-2359↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:18:44.176873 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 12:18:44.203714 run osmo-hlr_10.42.42.2(pid=4474): ERR: Terminated: ERROR {rc=237} [trial-2359↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4474)] 12:18:44.251384 run osmo-hlr_10.42.42.2(pid=4474): stdout: | (launched: 2022-12-09_12:18:41.039043) 12:18:44.301101 run osmo-hlr_10.42.42.2(pid=4474): stderr: | 20221209121841213 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121841213 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121841213 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121841213 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121841213 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121841213 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121841226 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121841236 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121841236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121841236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:18:44.351584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4473): Terminating (SIGTERM) 12:18:44.391601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4476): Terminating (SIGTERM) 12:18:44.431547 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4479): Terminating (SIGTERM) 12:18:44.471841 --- ParallelTerminationStrategy: PID 4473 died... 12:18:44.491126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4473): Terminated: ok {rc=0} 12:18:44.535485 --- ParallelTerminationStrategy: PID 4476 died... 12:18:44.554451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4476): Terminated: ok {rc=0} 12:18:44.598564 --- ParallelTerminationStrategy: PID 4479 died... 12:18:44.617502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4479): Terminated: ok {rc=0} 12:18:44.703844 bus /gobi_0: Setting Powered False 12:18:45.803871 bus /gobi_0: Setting Powered False 12:18:46.921473 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 12:18:48.184851 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:18:48.191287 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 12:18:48.223162 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 12:18:48.259224 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 12:18:48.314201 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 12:18:48.344583 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 12:18:48.380509 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 12:18:48.935309 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2359 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 12:18:48.941391 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:48.953129 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 12:18:49.021248 tst switch_tch_pdch.py: using LAC 21412 12:18:49.140423 tst switch_tch_pdch.py: using RAC 247 12:18:49.259769 tst switch_tch_pdch.py: using CellId 21412 12:18:49.384038 tst switch_tch_pdch.py: using BVCI 21413 12:18:49.494923 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:49.506184 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:49.517170 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:49.528620 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:49.540078 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:49.551550 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:49.563176 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 12:18:49.574728 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:18:49.693909 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 12:18:49.814227 tst switch_tch_pdch.py:51: start network... 12:18:50.016938 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:18:50.459719 run create_hlr_db(pid=4484): Launched 12:18:50.583160 bus /gobi_6: Setting Powered False 12:18:51.643668 run create_hlr_db(pid=4484): Terminated: ok {rc=0} 12:18:52.058890 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4486): Launched 12:18:52.382948 run osmo-hlr_10.42.42.2(pid=4487): Launched 12:18:52.509106 run osmo-stp_10.42.42.5: Starting osmo-stp 12:18:53.038807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4489): Launched 12:18:53.363791 run osmo-stp_10.42.42.5(pid=4490): Launched 12:18:53.487789 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:18:54.016719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4492): Launched 12:18:54.142931 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:18:54.416719 run patchelf(pid=4493): Launched 12:18:54.599054 run osmo-stp_10.42.42.5(pid=4490): ERR: Terminated: ERROR {rc=1} [trial-2359↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4490)] 12:18:54.736693 run osmo-stp_10.42.42.5(pid=4490): stdout: | (launched: 2022-12-09_12:18:53.304447) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:54.875381 run osmo-stp_10.42.42.5(pid=4490): stderr: | 20221209121853491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121853491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121853491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121853492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121853492 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121853492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121853492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:55.014517 run osmo-stp_10.42.42.5(pid=4490): stdout: | (launched: 2022-12-09_12:18:53.304447) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:18:55.147147 run osmo-stp_10.42.42.5(pid=4490): stderr: | 20221209121853491 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121853491 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121853491 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121853492 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121853492 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121853492 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121853492 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:18:55.305139 run patchelf(pid=4493): Terminating (SIGINT) 12:18:55.488337 run patchelf(pid=4493): Terminated: ok {rc=0} 12:18:55.620680 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=4490): Process ended prematurely: osmo-stp_10.42.42.5(pid=4490) [trial-2359↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4490)] [trial-2359↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 12:18:55.630782 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 12:18:55.659701 run osmo-hlr_10.42.42.2(pid=4487): ERR: Terminated: ERROR {rc=237} [trial-2359↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4487)] 12:18:55.711148 run osmo-hlr_10.42.42.2(pid=4487): stdout: | (launched: 2022-12-09_12:18:52.323766) 12:18:55.764330 run osmo-hlr_10.42.42.2(pid=4487): stderr: | 20221209121852517 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121852517 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121852517 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121852517 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121852517 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121852517 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121852530 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121852539 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121852539 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121852539 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:18:55.817621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4486): Terminating (SIGTERM) 12:18:55.860530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4489): Terminating (SIGTERM) 12:18:55.903679 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4492): Terminating (SIGTERM) 12:18:55.946915 --- ParallelTerminationStrategy: PID 4486 died... 12:18:55.967239 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4486): Terminated: ok {rc=0} 12:18:56.015093 --- ParallelTerminationStrategy: PID 4489 died... 12:18:56.034830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4489): Terminated: ok {rc=0} 12:18:56.082413 --- ParallelTerminationStrategy: PID 4492 died... 12:18:56.102287 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4492): Terminated: ok {rc=0} 12:18:56.191754 bus /gobi_0: Setting Powered False 12:18:57.290735 bus /gobi_0: Setting Powered False 12:18:58.407517 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 nitb_sms:nanobts --------------------------------------------------------------------- 12:18:59.656687 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:18:59.660486 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 12:18:59.684048 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 12:18:59.691076 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 12:18:59.742853 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 12:18:59.766427 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 12:18:59.773043 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 12:19:00.314606 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 12:19:00.320630 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 12:19:00.332088 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 12:19:00.373107 tst mo_mt_sms.py: using LAC 21413 12:19:00.500443 tst mo_mt_sms.py: using RAC 248 12:19:00.630025 tst mo_mt_sms.py: using CellId 21413 12:19:00.759247 tst mo_mt_sms.py: using BVCI 21414 12:19:00.883568 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 12:19:01.030201 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 12:19:01.165913 tst mo_mt_sms.py:9: start nitb and bts... 12:19:01.424352 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:19:02.093327 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4498): Launched 12:19:02.431631 run osmo-nitb_10.42.42.2(pid=4499): Launched 12:19:02.611005 run osmo-nitb_10.42.42.2(pid=4499): ERR: Terminated: ERROR {rc=2} [trial-2359↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4499)] 12:19:02.755862 run osmo-nitb_10.42.42.2(pid=4499): stdout: | (launched: 2022-12-09_12:19:02.372123) 12:19:02.902509 run osmo-nitb_10.42.42.2(pid=4499): stderr: | (launched: 2022-12-09_12:19:02.420121) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:19:03.049553 run osmo-nitb_10.42.42.2(pid=4499): stdout: | (launched: 2022-12-09_12:19:02.372123) 12:19:03.189706 run osmo-nitb_10.42.42.2(pid=4499): stderr: | (launched: 2022-12-09_12:19:02.420121) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4499): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4499) [trial-2359↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4499)] 12:19:03.553488 tst osmo-nitb_10.42.42.2(pid=4499): stdout: | (launched: 2022-12-09_12:19:02.372123) 12:19:03.683719 tst osmo-nitb_10.42.42.2(pid=4499): stderr: | (launched: 2022-12-09_12:19:02.420121) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:19:03.837729 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=4499): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4499) [trial-2359↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4499)] [trial-2359↪nitb_sms:nanobts↪mo_mt_sms.py:11] 12:19:03.847094 tst mo_mt_sms.py:11: Test FAILED (3.5 sec) 12:19:03.854529 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4498): Terminating (SIGTERM) 12:19:04.066571 --- ParallelTerminationStrategy: PID 4498 died... 12:19:04.088916 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4498): Terminated: ok {rc=0} 12:19:04.178469 bus /sierra_3: Setting Powered False 12:19:05.279548 bus /sierra_3: Setting Powered False 12:19:06.399878 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 sms:nanobts+band-1900 --------------------------------------------------------------------- 12:19:07.588849 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:19:07.594517 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 12:19:07.620467 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 12:19:07.648792 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 12:19:07.702886 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 12:19:07.728105 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 12:19:07.755892 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 12:19:08.299964 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 12:19:08.305252 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:19:08.316096 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:19:08.353956 tst mo_mt_sms.py: using LAC 21414 12:19:08.469926 tst mo_mt_sms.py: using RAC 249 12:19:08.586163 tst mo_mt_sms.py: using CellId 21414 12:19:08.702626 tst mo_mt_sms.py: using BVCI 21415 12:19:08.812029 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:19:08.822804 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:19:08.833549 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:19:08.844044 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:19:08.854609 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:19:08.865285 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 12:19:08.982545 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 12:19:09.099592 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:19:09.599608 run create_hlr_db(pid=4503): Launched 12:19:09.723600 bus /sierra_2: Setting Powered False 12:19:10.787006 run create_hlr_db(pid=4503): Terminated: ok {rc=0} 12:19:11.238128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4505): Launched 12:19:11.561873 run osmo-hlr_10.42.42.2(pid=4506): Launched 12:19:11.686493 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:12.239819 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4508): Launched 12:19:12.565200 run osmo-stp_10.42.42.5(pid=4509): Launched 12:19:12.689221 run osmo-msc_10.42.42.6: Starting osmo-msc 12:19:13.273304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4511): Launched 12:19:13.597615 run osmo-msc_10.42.42.6(pid=4512): Launched 12:19:13.778883 run osmo-stp_10.42.42.5(pid=4509): ERR: Terminated: ERROR {rc=1} [trial-2359↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4509)] 12:19:13.916062 run osmo-stp_10.42.42.5(pid=4509): stdout: | (launched: 2022-12-09_12:19:12.505628) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:14.054092 run osmo-stp_10.42.42.5(pid=4509): stderr: | 20221209121912692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121912692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121912692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121912693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121912693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121912693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121912693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:14.189800 run osmo-stp_10.42.42.5(pid=4509): stdout: | (launched: 2022-12-09_12:19:12.505628) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:14.320300 run osmo-stp_10.42.42.5(pid=4509): stderr: | 20221209121912692 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121912692 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121912692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121912693 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121912693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121912693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121912693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:14.475691 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=4509): Process ended prematurely: osmo-stp_10.42.42.5(pid=4509) [trial-2359↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4509)] [trial-2359↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 12:19:14.484868 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 12:19:14.513150 run osmo-hlr_10.42.42.2(pid=4506): ERR: Terminated: ERROR {rc=237} [trial-2359↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4506)] 12:19:14.563762 run osmo-hlr_10.42.42.2(pid=4506): stdout: | (launched: 2022-12-09_12:19:11.502355) 12:19:14.616931 run osmo-hlr_10.42.42.2(pid=4506): stderr: | 20221209121911696 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121911696 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121911697 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121911697 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121911697 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121911697 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121911725 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121911735 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121911735 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121911735 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:19:14.689880 run osmo-msc_10.42.42.6(pid=4512): ERR: Terminated: ERROR {rc=2} [trial-2359↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4512)] 12:19:14.740562 run osmo-msc_10.42.42.6(pid=4512): stdout: | (launched: 2022-12-09_12:19:13.537611) 12:19:14.792499 run osmo-msc_10.42.42.6(pid=4512): stderr: | 20221209121913856 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121913856 DLGLOBAL DEBUG validating counter group 0x7f8f5084bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121913856 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121913856 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121913857 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121913857 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121913858 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121913859 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121913859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121913859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:19:14.845565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4505): Terminating (SIGTERM) 12:19:14.888182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4508): Terminating (SIGTERM) 12:19:14.930390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4511): Terminating (SIGTERM) 12:19:14.973093 --- ParallelTerminationStrategy: PID 4505 died... 12:19:14.993464 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4505): Terminated: ok {rc=0} 12:19:15.040033 --- ParallelTerminationStrategy: PID 4508 died... 12:19:15.060521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4508): Terminated: ok {rc=0} 12:19:15.107323 --- ParallelTerminationStrategy: PID 4511 died... 12:19:15.126900 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4511): Terminated: ok {rc=0} 12:19:15.214496 bus /sierra_3: Setting Powered False 12:19:16.315046 bus /sierra_3: Setting Powered False 12:19:17.433881 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 12:19:18.658689 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:19:18.663808 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 12:19:18.688279 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 12:19:18.695309 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 12:19:18.730368 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 12:19:18.754440 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 12:19:18.761354 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 12:19:19.280812 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2359 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 12:19:19.286862 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 12:19:19.298685 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:19:19.339207 tst assert_extension.py: using LAC 21415 12:19:19.471308 tst assert_extension.py: using RAC 250 12:19:19.598123 tst assert_extension.py: using CellId 21415 12:19:19.725649 tst assert_extension.py: using BVCI 21416 12:19:19.837643 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 12:19:19.957540 tst assert_extension.py:10: start nitb and bts... 12:19:20.175265 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:19:20.833585 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4518): Launched 12:19:21.160088 run osmo-nitb_10.42.42.2(pid=4519): Launched 12:19:21.341197 run osmo-nitb_10.42.42.2(pid=4519): ERR: Terminated: ERROR {rc=2} [trial-2359↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4519)] 12:19:21.485670 run osmo-nitb_10.42.42.2(pid=4519): stdout: | (launched: 2022-12-09_12:19:21.100216) 12:19:21.632167 run osmo-nitb_10.42.42.2(pid=4519): stderr: | (launched: 2022-12-09_12:19:21.148636) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:19:21.778366 run osmo-nitb_10.42.42.2(pid=4519): stdout: | (launched: 2022-12-09_12:19:21.100216) 12:19:21.918190 run osmo-nitb_10.42.42.2(pid=4519): stderr: | (launched: 2022-12-09_12:19:21.148636) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=4519): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4519) [trial-2359↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4519)] 12:19:22.283700 tst osmo-nitb_10.42.42.2(pid=4519): stdout: | (launched: 2022-12-09_12:19:21.100216) 12:19:22.415661 tst osmo-nitb_10.42.42.2(pid=4519): stderr: | (launched: 2022-12-09_12:19:21.148636) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:19:22.569971 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=4519): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4519) [trial-2359↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4519)] [trial-2359↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 12:19:22.579333 tst assert_extension.py:12: Test FAILED (3.3 sec) 12:19:22.586671 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4518): Terminating (SIGTERM) 12:19:22.798526 --- ParallelTerminationStrategy: PID 4518 died... 12:19:22.820501 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=4518): Terminated: ok {rc=0} 12:19:22.910366 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 ussd:nanobts+band-1900 --------------------------------------------------------------------- 12:19:24.073831 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:19:24.078427 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 12:19:24.101956 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 12:19:24.128598 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 12:19:24.165852 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 12:19:24.190620 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 12:19:24.218813 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 12:19:24.743266 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2359 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 12:19:24.748395 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:19:24.759160 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:19:24.796875 tst assert_extension.py: using LAC 21416 12:19:24.923869 tst assert_extension.py: using RAC 251 12:19:25.051781 tst assert_extension.py: using CellId 21416 12:19:25.178095 tst assert_extension.py: using BVCI 21417 12:19:25.295772 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:19:25.307187 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:19:25.318282 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:19:25.329653 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:19:25.340881 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:19:25.352217 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 12:19:25.472905 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:19:25.971125 run create_hlr_db(pid=4523): Launched 12:19:26.093471 bus /sierra_2: Setting Powered False 12:19:27.156525 run create_hlr_db(pid=4523): Terminated: ok {rc=0} 12:19:27.608553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4525): Launched 12:19:27.933573 run osmo-hlr_10.42.42.2(pid=4526): Launched 12:19:28.058973 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:28.620281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4528): Launched 12:19:28.944499 run osmo-stp_10.42.42.5(pid=4529): Launched 12:19:29.069304 run osmo-msc_10.42.42.6: Starting osmo-msc 12:19:29.652071 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4531): Launched 12:19:29.978798 run osmo-msc_10.42.42.6(pid=4532): Launched 12:19:30.158238 run osmo-stp_10.42.42.5(pid=4529): ERR: Terminated: ERROR {rc=1} [trial-2359↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4529)] 12:19:30.294942 run osmo-stp_10.42.42.5(pid=4529): stdout: | (launched: 2022-12-09_12:19:28.885264) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:30.431341 run osmo-stp_10.42.42.5(pid=4529): stderr: | 20221209121929071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121929072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121929072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121929072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121929073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121929073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121929073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:30.566956 run osmo-stp_10.42.42.5(pid=4529): stdout: | (launched: 2022-12-09_12:19:28.885264) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:30.695194 run osmo-stp_10.42.42.5(pid=4529): stderr: | 20221209121929071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121929072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121929072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121929072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121929073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121929073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121929073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:30.862678 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=4529): Process ended prematurely: osmo-stp_10.42.42.5(pid=4529) [trial-2359↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4529)] [trial-2359↪ussd:nanobts+band-1900↪assert_extension.py:17] 12:19:30.876783 tst assert_extension.py:17: Test FAILED (6.1 sec) 12:19:30.923486 run osmo-hlr_10.42.42.2(pid=4526): ERR: Terminated: ERROR {rc=237} [trial-2359↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4526)] 12:19:30.975885 run osmo-hlr_10.42.42.2(pid=4526): stdout: | (launched: 2022-12-09_12:19:27.874128) 12:19:31.029770 run osmo-hlr_10.42.42.2(pid=4526): stderr: | 20221209121928067 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121928067 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121928067 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121928067 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121928067 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121928067 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121928079 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121928088 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121928088 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121928088 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:19:31.104429 run osmo-msc_10.42.42.6(pid=4532): ERR: Terminated: ERROR {rc=2} [trial-2359↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4532)] 12:19:31.156460 run osmo-msc_10.42.42.6(pid=4532): stdout: | (launched: 2022-12-09_12:19:29.918925) 12:19:31.209998 run osmo-msc_10.42.42.6(pid=4532): stderr: | 20221209121930235 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121930235 DLGLOBAL DEBUG validating counter group 0x7ffab0ef7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121930235 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121930235 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121930235 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121930236 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121930237 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121930238 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121930238 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121930238 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:19:31.264619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4525): Terminating (SIGTERM) 12:19:31.308696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4528): Terminating (SIGTERM) 12:19:31.353961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4531): Terminating (SIGTERM) 12:19:31.398043 --- ParallelTerminationStrategy: PID 4525 died... 12:19:31.418506 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4525): Terminated: ok {rc=0} 12:19:31.467205 --- ParallelTerminationStrategy: PID 4528 died... 12:19:31.487665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4528): Terminated: ok {rc=0} 12:19:31.535591 --- ParallelTerminationStrategy: PID 4531 died... 12:19:31.555808 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4531): Terminated: ok {rc=0} 12:19:31.646065 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:19:32.847186 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:19:32.854904 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:19:32.880398 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:19:32.907328 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:19:32.960343 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:19:32.984119 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:19:33.011285 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:19:33.566723 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:19:33.621686 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:33.633625 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:19:33.698507 tst mo_mt_call.py: using LAC 21417 12:19:33.826866 tst mo_mt_call.py: using RAC 252 12:19:33.955154 tst mo_mt_call.py: using CellId 21417 12:19:34.083643 tst mo_mt_call.py: using BVCI 21418 12:19:34.203344 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:34.215259 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:34.227134 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:34.239094 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:34.251232 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:34.263107 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:19:34.381731 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:19:34.504249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:19:35.014225 run create_hlr_db(pid=4537): Launched 12:19:35.142286 bus /sierra_2: Setting Powered False 12:19:36.207053 run create_hlr_db(pid=4537): Terminated: ok {rc=0} 12:19:36.665032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4539): Launched 12:19:36.994963 run osmo-hlr_10.42.42.2(pid=4540): Launched 12:19:37.120283 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:37.692742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4542): Launched 12:19:38.022722 run osmo-stp_10.42.42.5(pid=4543): Launched 12:19:38.149252 run osmo-msc_10.42.42.6: Starting osmo-msc 12:19:38.746379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4545): Launched 12:19:39.077051 run osmo-msc_10.42.42.6(pid=4546): Launched 12:19:39.260675 run osmo-stp_10.42.42.5(pid=4543): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4543)] 12:19:39.399532 run osmo-stp_10.42.42.5(pid=4543): stdout: | (launched: 2022-12-09_12:19:37.962378) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:39.538795 run osmo-stp_10.42.42.5(pid=4543): stderr: | 20221209121938151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121938151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121938151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121938152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121938152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121938152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121938152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:39.676347 run osmo-stp_10.42.42.5(pid=4543): stdout: | (launched: 2022-12-09_12:19:37.962378) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:39.807034 run osmo-stp_10.42.42.5(pid=4543): stderr: | 20221209121938151 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121938151 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121938151 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121938152 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121938152 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121938152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121938152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:39.963815 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4543): Process ended prematurely: osmo-stp_10.42.42.5(pid=4543) [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4543)] [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:19:39.974074 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:19:40.003236 run osmo-hlr_10.42.42.2(pid=4540): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4540)] 12:19:40.054234 run osmo-hlr_10.42.42.2(pid=4540): stdout: | (launched: 2022-12-09_12:19:36.933996) 12:19:40.107091 run osmo-hlr_10.42.42.2(pid=4540): stderr: | 20221209121937129 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121937129 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121937129 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121937129 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121937129 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121937129 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121937144 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121937152 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121937152 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121937152 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:19:40.180548 run osmo-msc_10.42.42.6(pid=4546): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4546)] 12:19:40.231925 run osmo-msc_10.42.42.6(pid=4546): stdout: | (launched: 2022-12-09_12:19:39.015923) 12:19:40.284898 run osmo-msc_10.42.42.6(pid=4546): stderr: | 20221209121939337 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121939337 DLGLOBAL DEBUG validating counter group 0x7f78eb732c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121939338 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121939338 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121939338 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121939338 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121939340 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121939340 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121939340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121939340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:19:40.338236 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4539): Terminating (SIGTERM) 12:19:40.381079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4542): Terminating (SIGTERM) 12:19:40.424015 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4545): Terminating (SIGTERM) 12:19:40.467316 --- ParallelTerminationStrategy: PID 4539 died... 12:19:40.487610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4539): Terminated: ok {rc=0} 12:19:40.535245 --- ParallelTerminationStrategy: PID 4542 died... 12:19:40.555210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4542): Terminated: ok {rc=0} 12:19:40.602829 --- ParallelTerminationStrategy: PID 4545 died... 12:19:40.622718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4545): Terminated: ok {rc=0} 12:19:40.712143 bus /sierra_3: Setting Powered False 12:19:41.812023 bus /sierra_3: Setting Powered False 12:19:42.931250 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:19:44.078225 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:44.090373 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:19:44.150749 tst mo_mt_call_osmux.py: using LAC 21418 12:19:44.271873 tst mo_mt_call_osmux.py: using RAC 253 12:19:44.403077 tst mo_mt_call_osmux.py: using CellId 21418 12:19:44.537497 tst mo_mt_call_osmux.py: using BVCI 21419 12:19:44.659375 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:44.671450 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:44.683176 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:44.695984 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:44.708580 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:19:44.721150 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:19:44.840929 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:19:44.964282 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:19:45.476123 run create_hlr_db(pid=4548): Launched 12:19:45.602209 bus /sierra_2: Setting Powered False 12:19:46.665881 run create_hlr_db(pid=4548): Terminated: ok {rc=0} 12:19:47.130509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4550): Launched 12:19:47.471093 run osmo-hlr_10.42.42.2(pid=4551): Launched 12:19:47.598602 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:48.165419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4553): Launched 12:19:48.499561 run osmo-stp_10.42.42.5(pid=4554): Launched 12:19:48.625354 run osmo-msc_10.42.42.6: Starting osmo-msc 12:19:49.220729 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4556): Launched 12:19:49.553536 run osmo-msc_10.42.42.6(pid=4557): Launched 12:19:49.738615 run osmo-stp_10.42.42.5(pid=4554): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4554)] 12:19:49.878543 run osmo-stp_10.42.42.5(pid=4554): stdout: | (launched: 2022-12-09_12:19:48.438198) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:50.018699 run osmo-stp_10.42.42.5(pid=4554): stderr: | 20221209121948628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121948628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121948628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121948629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121948629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121948629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121948629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:50.155975 run osmo-stp_10.42.42.5(pid=4554): stdout: | (launched: 2022-12-09_12:19:48.438198) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:19:50.287615 run osmo-stp_10.42.42.5(pid=4554): stderr: | 20221209121948628 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121948628 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121948628 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121948629 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121948629 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121948629 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121948629 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:19:50.444740 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4554): Process ended prematurely: osmo-stp_10.42.42.5(pid=4554) [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4554)] [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:19:50.454501 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:19:50.482852 run osmo-hlr_10.42.42.2(pid=4551): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4551)] 12:19:50.534109 run osmo-hlr_10.42.42.2(pid=4551): stdout: | (launched: 2022-12-09_12:19:47.410347) 12:19:50.586589 run osmo-hlr_10.42.42.2(pid=4551): stderr: | 20221209121947605 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121947605 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121947605 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121947605 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121947606 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121947606 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121947617 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121947627 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121947627 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121947627 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:19:50.659873 run osmo-msc_10.42.42.6(pid=4557): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4557)] 12:19:50.710443 run osmo-msc_10.42.42.6(pid=4557): stdout: | (launched: 2022-12-09_12:19:49.492775) 12:19:50.762754 run osmo-msc_10.42.42.6(pid=4557): stderr: | 20221209121949810 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209121949810 DLGLOBAL DEBUG validating counter group 0x7f7f79345c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209121949810 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209121949810 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209121949810 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209121949811 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209121949812 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209121949813 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209121949813 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209121949813 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:19:50.815340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4550): Terminating (SIGTERM) 12:19:50.857778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4553): Terminating (SIGTERM) 12:19:50.900490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4556): Terminating (SIGTERM) 12:19:50.943264 --- ParallelTerminationStrategy: PID 4550 died... 12:19:50.963405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4550): Terminated: ok {rc=0} 12:19:51.010450 --- ParallelTerminationStrategy: PID 4553 died... 12:19:51.030118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4553): Terminated: ok {rc=0} 12:19:51.076763 --- ParallelTerminationStrategy: PID 4556 died... 12:19:51.096713 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4556): Terminated: ok {rc=0} 12:19:51.185417 bus /sierra_3: Setting Powered False 12:19:52.283812 bus /sierra_3: Setting Powered False 12:19:53.401534 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:19:54.652105 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:19:54.660138 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:19:54.685260 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:19:54.713391 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:19:54.766082 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:19:54.790504 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:19:54.817899 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:19:55.368542 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:19:55.423193 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:55.434884 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:19:55.496669 tst mo_mt_call.py: using LAC 21419 12:19:55.626405 tst mo_mt_call.py: using RAC 254 12:19:55.755959 tst mo_mt_call.py: using CellId 21419 12:19:55.884837 tst mo_mt_call.py: using BVCI 21420 12:19:55.997598 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:56.008839 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:56.020014 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:56.031205 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:56.042617 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:19:56.053718 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:19:56.173386 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:19:56.296172 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:19:56.804558 run create_hlr_db(pid=4563): Launched 12:19:56.935128 bus /sierra_2: Setting Powered False 12:19:57.996342 run create_hlr_db(pid=4563): Terminated: ok {rc=0} 12:19:58.444101 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4565): Launched 12:19:58.774635 run osmo-hlr_10.42.42.2(pid=4566): Launched 12:19:58.901577 run osmo-stp_10.42.42.5: Starting osmo-stp 12:19:59.470584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4568): Launched 12:19:59.800466 run osmo-stp_10.42.42.5(pid=4569): Launched 12:19:59.927488 run osmo-msc_10.42.42.6: Starting osmo-msc 12:20:00.521661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4571): Launched 12:20:00.857667 run osmo-msc_10.42.42.6(pid=4572): Launched 12:20:01.196387 run osmo-stp_10.42.42.5(pid=4569): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4569)] 12:20:01.593838 run osmo-stp_10.42.42.5(pid=4569): stdout: | (launched: 2022-12-09_12:19:59.739932) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:01.825489 run osmo-stp_10.42.42.5(pid=4569): stderr: | 20221209121959928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121959928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121959929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121959929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121959930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121959930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121959930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:02.008100 run osmo-stp_10.42.42.5(pid=4569): stdout: | (launched: 2022-12-09_12:19:59.739932) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:02.158894 run osmo-stp_10.42.42.5(pid=4569): stderr: | 20221209121959928 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209121959928 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209121959929 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209121959929 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209121959930 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209121959930 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209121959930 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:02.309672 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4569): Process ended prematurely: osmo-stp_10.42.42.5(pid=4569) [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4569)] [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:20:02.320174 tst mo_mt_call.py:8: Test FAILED (6.9 sec) 12:20:02.348696 run osmo-hlr_10.42.42.2(pid=4566): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4566)] 12:20:02.398471 run osmo-hlr_10.42.42.2(pid=4566): stdout: | (launched: 2022-12-09_12:19:58.714256) 12:20:02.449247 run osmo-hlr_10.42.42.2(pid=4566): stderr: | 20221209121958908 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209121958908 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209121958908 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209121958908 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209121958908 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209121958908 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209121958920 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209121958929 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209121958929 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209121958929 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:02.522232 run osmo-msc_10.42.42.6(pid=4572): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4572)] 12:20:02.570215 run osmo-msc_10.42.42.6(pid=4572): stdout: | (launched: 2022-12-09_12:20:00.793849) 12:20:02.619569 run osmo-msc_10.42.42.6(pid=4572): stderr: | 20221209122001373 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122001373 DLGLOBAL DEBUG validating counter group 0x7fc2f9045c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122001373 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122001373 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122001373 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122001374 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122001375 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122001376 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122001376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122001376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:20:02.669322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4565): Terminating (SIGTERM) 12:20:02.709083 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4568): Terminating (SIGTERM) 12:20:02.749123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4571): Terminating (SIGTERM) 12:20:02.789154 --- ParallelTerminationStrategy: PID 4565 died... 12:20:02.807917 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4565): Terminated: ok {rc=0} 12:20:02.852135 --- ParallelTerminationStrategy: PID 4568 died... 12:20:02.870845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4568): Terminated: ok {rc=0} 12:20:02.914677 --- ParallelTerminationStrategy: PID 4571 died... 12:20:02.933270 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4571): Terminated: ok {rc=0} 12:20:03.020190 bus /sierra_3: Setting Powered False 12:20:04.121521 bus /sierra_3: Setting Powered False 12:20:05.238775 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:20:06.386055 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:20:06.398083 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:20:06.461963 tst mo_mt_call_osmux.py: using LAC 21420 12:20:06.583572 tst mo_mt_call_osmux.py: using RAC 255 12:20:06.704037 tst mo_mt_call_osmux.py: using CellId 21420 12:20:06.823578 tst mo_mt_call_osmux.py: using BVCI 21421 12:20:06.936492 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:20:06.947798 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:20:06.958788 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:20:06.969905 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:20:06.981644 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:20:06.992737 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:20:07.110770 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:20:07.233840 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:20:07.745233 run create_hlr_db(pid=4577): Launched 12:20:07.871114 bus /sierra_2: Setting Powered False 12:20:08.935297 run create_hlr_db(pid=4577): Terminated: ok {rc=0} 12:20:09.376294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4579): Launched 12:20:09.686006 run osmo-hlr_10.42.42.2(pid=4580): Launched 12:20:09.802283 run osmo-stp_10.42.42.5: Starting osmo-stp 12:20:10.345599 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4582): Launched 12:20:10.655307 run osmo-stp_10.42.42.5(pid=4583): Launched 12:20:10.771712 run osmo-msc_10.42.42.6: Starting osmo-msc 12:20:11.329870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4585): Launched 12:20:11.640455 run osmo-msc_10.42.42.6(pid=4586): Launched 12:20:11.812401 run osmo-stp_10.42.42.5(pid=4583): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4583)] 12:20:11.942970 run osmo-stp_10.42.42.5(pid=4583): stdout: | (launched: 2022-12-09_12:20:10.597953) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:12.072575 run osmo-stp_10.42.42.5(pid=4583): stderr: | 20221209122010768 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122010768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122010768 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122010769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122010770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122010770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122010770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:12.200393 run osmo-stp_10.42.42.5(pid=4583): stdout: | (launched: 2022-12-09_12:20:10.597953) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:12.322200 run osmo-stp_10.42.42.5(pid=4583): stderr: | 20221209122010768 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122010768 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122010768 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122010769 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122010770 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122010770 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122010770 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:12.468401 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4583): Process ended prematurely: osmo-stp_10.42.42.5(pid=4583) [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4583)] [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:20:12.477365 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:20:12.503676 run osmo-hlr_10.42.42.2(pid=4580): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4580)] 12:20:12.551547 run osmo-hlr_10.42.42.2(pid=4580): stdout: | (launched: 2022-12-09_12:20:09.628619) 12:20:12.600937 run osmo-hlr_10.42.42.2(pid=4580): stderr: | 20221209122009804 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122009804 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122009804 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122009804 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122009805 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122009805 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122009817 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122009825 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122009825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122009825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:12.670119 run osmo-msc_10.42.42.6(pid=4586): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4586)] 12:20:12.717776 run osmo-msc_10.42.42.6(pid=4586): stdout: | (launched: 2022-12-09_12:20:11.582663) 12:20:12.766918 run osmo-msc_10.42.42.6(pid=4586): stderr: | 20221209122011854 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122011854 DLGLOBAL DEBUG validating counter group 0x7fd8f0c60c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122011854 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122011854 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122011855 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122011855 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122011856 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122011857 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122011857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122011857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:20:12.816372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4579): Terminating (SIGTERM) 12:20:12.855789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4582): Terminating (SIGTERM) 12:20:12.895255 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4585): Terminating (SIGTERM) 12:20:12.935121 --- ParallelTerminationStrategy: PID 4579 died... 12:20:12.954233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4579): Terminated: ok {rc=0} 12:20:12.998156 --- ParallelTerminationStrategy: PID 4582 died... 12:20:13.016766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4582): Terminated: ok {rc=0} 12:20:13.060563 --- ParallelTerminationStrategy: PID 4585 died... 12:20:13.079159 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4585): Terminated: ok {rc=0} 12:20:13.164789 bus /sierra_3: Setting Powered False 12:20:14.263624 bus /sierra_3: Setting Powered False 12:20:15.375585 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:20:16.650481 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:20:16.659319 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:20:16.689678 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:20:16.724306 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:20:16.785785 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:20:16.821541 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:20:16.850954 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:20:17.391861 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:20:17.445646 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:17.457571 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:20:17.524164 tst mo_mt_call.py: using LAC 21421 12:20:17.653639 tst mo_mt_call.py: using RAC 1 12:20:17.774040 tst mo_mt_call.py: using CellId 21421 12:20:17.892776 tst mo_mt_call.py: using BVCI 21422 12:20:18.004929 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:18.016352 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:18.027604 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:18.038891 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:18.049979 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:18.061176 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:20:18.183289 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:20:18.300488 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:20:18.776787 run create_hlr_db(pid=4591): Launched 12:20:18.902864 bus /sierra_2: Setting Powered False 12:20:19.964237 run create_hlr_db(pid=4591): Terminated: ok {rc=0} 12:20:20.413974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4594): Launched 12:20:20.743814 run osmo-hlr_10.42.42.2(pid=4595): Launched 12:20:20.870758 run osmo-stp_10.42.42.5: Starting osmo-stp 12:20:21.437165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4597): Launched 12:20:21.768852 run osmo-stp_10.42.42.5(pid=4598): Launched 12:20:21.894157 run osmo-msc_10.42.42.6: Starting osmo-msc 12:20:22.487761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4600): Launched 12:20:22.819603 run osmo-msc_10.42.42.6(pid=4601): Launched 12:20:23.003523 run osmo-stp_10.42.42.5(pid=4598): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4598)] 12:20:23.142639 run osmo-stp_10.42.42.5(pid=4598): stdout: | (launched: 2022-12-09_12:20:21.707876) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:23.282147 run osmo-stp_10.42.42.5(pid=4598): stderr: | 20221209122021897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122021897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122021898 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122021898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122021899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122021899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122021899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:23.419546 run osmo-stp_10.42.42.5(pid=4598): stdout: | (launched: 2022-12-09_12:20:21.707876) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:23.550304 run osmo-stp_10.42.42.5(pid=4598): stderr: | 20221209122021897 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122021897 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122021898 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122021898 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122021899 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122021899 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122021899 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:23.707081 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4598): Process ended prematurely: osmo-stp_10.42.42.5(pid=4598) [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4598)] [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:20:23.716641 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:20:23.744890 run osmo-hlr_10.42.42.2(pid=4595): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4595)] 12:20:23.795724 run osmo-hlr_10.42.42.2(pid=4595): stdout: | (launched: 2022-12-09_12:20:20.683447) 12:20:23.847911 run osmo-hlr_10.42.42.2(pid=4595): stderr: | 20221209122020879 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122020879 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122020879 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122020879 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122020879 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122020879 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122020891 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122020900 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122020900 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122020900 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:23.920639 run osmo-msc_10.42.42.6(pid=4601): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4601)] 12:20:23.971268 run osmo-msc_10.42.42.6(pid=4601): stdout: | (launched: 2022-12-09_12:20:22.759055) 12:20:24.023596 run osmo-msc_10.42.42.6(pid=4601): stderr: | 20221209122023077 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122023078 DLGLOBAL DEBUG validating counter group 0x7fce2ed25c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122023078 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122023078 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122023078 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122023078 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122023080 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122023080 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122023080 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122023080 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:20:24.076258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4594): Terminating (SIGTERM) 12:20:24.118790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4597): Terminating (SIGTERM) 12:20:24.161404 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4600): Terminating (SIGTERM) 12:20:24.204139 --- ParallelTerminationStrategy: PID 4594 died... 12:20:24.224369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4594): Terminated: ok {rc=0} 12:20:24.272069 --- ParallelTerminationStrategy: PID 4597 died... 12:20:24.291999 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4597): Terminated: ok {rc=0} 12:20:24.339271 --- ParallelTerminationStrategy: PID 4600 died... 12:20:24.359115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4600): Terminated: ok {rc=0} 12:20:24.447889 bus /sierra_3: Setting Powered False 12:20:25.547253 bus /sierra_3: Setting Powered False 12:20:26.665640 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:20:27.814941 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:27.827436 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:20:27.889643 tst mo_mt_call_osmux.py: using LAC 21422 12:20:28.012656 tst mo_mt_call_osmux.py: using RAC 2 12:20:28.135826 tst mo_mt_call_osmux.py: using CellId 21422 12:20:28.258182 tst mo_mt_call_osmux.py: using BVCI 21423 12:20:28.371153 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:28.382726 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:28.394107 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:28.405340 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:28.416628 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:20:28.427915 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:20:28.550273 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:20:28.672844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:20:29.182815 run create_hlr_db(pid=4603): Launched 12:20:29.311122 bus /sierra_2: Setting Powered False 12:20:30.371912 run create_hlr_db(pid=4603): Terminated: ok {rc=0} 12:20:30.833773 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4605): Launched 12:20:31.169704 run osmo-hlr_10.42.42.2(pid=4606): Launched 12:20:31.372275 run osmo-stp_10.42.42.5: Starting osmo-stp 12:20:32.045238 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4608): Launched 12:20:32.392938 run osmo-stp_10.42.42.5(pid=4609): Launched 12:20:32.519223 run osmo-msc_10.42.42.6: Starting osmo-msc 12:20:33.120320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4611): Launched 12:20:33.453303 run osmo-msc_10.42.42.6(pid=4612): Launched 12:20:33.639808 run osmo-stp_10.42.42.5(pid=4609): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4609)] 12:20:33.780021 run osmo-stp_10.42.42.5(pid=4609): stdout: | (launched: 2022-12-09_12:20:32.331762) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:33.920055 run osmo-stp_10.42.42.5(pid=4609): stderr: | 20221209122032521 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122032521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122032521 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122032522 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122032522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122032522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122032522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:34.057789 run osmo-stp_10.42.42.5(pid=4609): stdout: | (launched: 2022-12-09_12:20:32.331762) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:34.189258 run osmo-stp_10.42.42.5(pid=4609): stderr: | 20221209122032521 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122032521 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122032521 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122032522 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122032522 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122032522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122032522 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:34.346820 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4609): Process ended prematurely: osmo-stp_10.42.42.5(pid=4609) [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4609)] [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:20:34.356719 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 12:20:34.385275 run osmo-hlr_10.42.42.2(pid=4606): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4606)] 12:20:34.436037 run osmo-hlr_10.42.42.2(pid=4606): stdout: | (launched: 2022-12-09_12:20:31.110055) 12:20:34.488218 run osmo-hlr_10.42.42.2(pid=4606): stderr: | 20221209122031454 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122031454 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122031454 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122031454 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122031454 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122031454 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122031471 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122031487 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122031488 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122031488 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:34.560850 run osmo-msc_10.42.42.6(pid=4612): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4612)] 12:20:34.611107 run osmo-msc_10.42.42.6(pid=4612): stdout: | (launched: 2022-12-09_12:20:33.391719) 12:20:34.663229 run osmo-msc_10.42.42.6(pid=4612): stderr: | 20221209122033713 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122033713 DLGLOBAL DEBUG validating counter group 0x7f9609bacc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122033714 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122033714 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122033714 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122033714 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122033716 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122033717 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122033717 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122033717 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:20:34.715790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4605): Terminating (SIGTERM) 12:20:34.758127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4608): Terminating (SIGTERM) 12:20:34.800292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4611): Terminating (SIGTERM) 12:20:34.842785 --- ParallelTerminationStrategy: PID 4605 died... 12:20:34.863009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4605): Terminated: ok {rc=0} 12:20:34.910194 --- ParallelTerminationStrategy: PID 4608 died... 12:20:34.930101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4608): Terminated: ok {rc=0} 12:20:34.976916 --- ParallelTerminationStrategy: PID 4611 died... 12:20:34.996695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4611): Terminated: ok {rc=0} 12:20:35.084922 bus /sierra_3: Setting Powered False 12:20:36.185238 bus /sierra_3: Setting Powered False 12:20:37.303365 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:20:38.555905 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:20:38.564817 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:20:38.588911 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:20:38.615558 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:20:38.674185 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:20:38.697620 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:20:38.724175 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:20:39.270010 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:20:39.325506 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:39.337248 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:20:39.398633 tst mo_mt_call.py: using LAC 21423 12:20:39.527495 tst mo_mt_call.py: using RAC 3 12:20:39.659318 tst mo_mt_call.py: using CellId 21423 12:20:39.790063 tst mo_mt_call.py: using BVCI 21424 12:20:39.911160 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:39.922931 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:39.934557 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:39.946325 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:39.958235 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:39.969960 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:20:40.089209 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:20:40.211608 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:20:40.720301 run create_hlr_db(pid=4617): Launched 12:20:40.845303 bus /sierra_2: Setting Powered False 12:20:41.909931 run create_hlr_db(pid=4617): Terminated: ok {rc=0} 12:20:42.348657 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4619): Launched 12:20:42.657668 run osmo-hlr_10.42.42.2(pid=4620): Launched 12:20:42.775954 run osmo-stp_10.42.42.5: Starting osmo-stp 12:20:43.307096 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4622): Launched 12:20:43.616583 run osmo-stp_10.42.42.5(pid=4623): Launched 12:20:43.734197 run osmo-msc_10.42.42.6: Starting osmo-msc 12:20:44.290160 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4625): Launched 12:20:44.600560 run osmo-msc_10.42.42.6(pid=4626): Launched 12:20:44.773137 run osmo-stp_10.42.42.5(pid=4623): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4623)] 12:20:44.903155 run osmo-stp_10.42.42.5(pid=4623): stdout: | (launched: 2022-12-09_12:20:43.559634) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:45.032695 run osmo-stp_10.42.42.5(pid=4623): stderr: | 20221209122043728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122043728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122043728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122043729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122043729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122043729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122043729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:45.160787 run osmo-stp_10.42.42.5(pid=4623): stdout: | (launched: 2022-12-09_12:20:43.559634) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:45.282596 run osmo-stp_10.42.42.5(pid=4623): stderr: | 20221209122043728 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122043728 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122043728 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122043729 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122043729 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122043729 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122043729 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:45.428583 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4623): Process ended prematurely: osmo-stp_10.42.42.5(pid=4623) [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4623)] [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:20:45.437589 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:20:45.464473 run osmo-hlr_10.42.42.2(pid=4620): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4620)] 12:20:45.512437 run osmo-hlr_10.42.42.2(pid=4620): stdout: | (launched: 2022-12-09_12:20:42.600230) 12:20:45.562129 run osmo-hlr_10.42.42.2(pid=4620): stderr: | 20221209122042774 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122042774 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122042774 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122042774 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122042774 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122042774 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122042789 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122042798 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122042798 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122042798 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:45.631711 run osmo-msc_10.42.42.6(pid=4626): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4626)] 12:20:45.679366 run osmo-msc_10.42.42.6(pid=4626): stdout: | (launched: 2022-12-09_12:20:44.542296) 12:20:45.729217 run osmo-msc_10.42.42.6(pid=4626): stderr: | 20221209122044813 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122044813 DLGLOBAL DEBUG validating counter group 0x7f10fd502c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122044813 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122044813 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122044813 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122044814 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122044816 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122044816 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122044816 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122044816 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:20:45.779033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4619): Terminating (SIGTERM) 12:20:45.819290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4622): Terminating (SIGTERM) 12:20:45.873991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4625): Terminating (SIGTERM) 12:20:45.931036 --- ParallelTerminationStrategy: PID 4619 died... 12:20:45.950126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4619): Terminated: ok {rc=0} 12:20:45.995740 --- ParallelTerminationStrategy: PID 4622 died... 12:20:46.015017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4622): Terminated: ok {rc=0} 12:20:46.060898 --- ParallelTerminationStrategy: PID 4625 died... 12:20:46.080283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4625): Terminated: ok {rc=0} 12:20:46.168188 bus /sierra_3: Setting Powered False 12:20:47.273625 bus /sierra_3: Setting Powered False 12:20:48.387727 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:20:49.538731 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:49.551292 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:20:49.613424 tst mo_mt_call_osmux.py: using LAC 21424 12:20:49.746514 tst mo_mt_call_osmux.py: using RAC 4 12:20:49.874216 tst mo_mt_call_osmux.py: using CellId 21424 12:20:50.002567 tst mo_mt_call_osmux.py: using BVCI 21425 12:20:50.121918 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:50.133844 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:50.145343 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:50.157559 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:50.169554 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:20:50.181298 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:20:50.300755 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:20:50.422285 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:20:50.934172 run create_hlr_db(pid=4628): Launched 12:20:51.060705 bus /sierra_2: Setting Powered False 12:20:52.126376 run create_hlr_db(pid=4628): Terminated: ok {rc=0} 12:20:52.568120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4630): Launched 12:20:52.879102 run osmo-hlr_10.42.42.2(pid=4631): Launched 12:20:52.998744 run osmo-stp_10.42.42.5: Starting osmo-stp 12:20:53.528672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4633): Launched 12:20:53.837575 run osmo-stp_10.42.42.5(pid=4634): Launched 12:20:53.956310 run osmo-msc_10.42.42.6: Starting osmo-msc 12:20:54.515026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4636): Launched 12:20:54.826739 run osmo-msc_10.42.42.6(pid=4637): Launched 12:20:54.998963 run osmo-stp_10.42.42.5(pid=4634): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4634)] 12:20:55.128920 run osmo-stp_10.42.42.5(pid=4634): stdout: | (launched: 2022-12-09_12:20:53.780203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:55.258894 run osmo-stp_10.42.42.5(pid=4634): stderr: | 20221209122053950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122053950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122053950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122053951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122053951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122053951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122053951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:55.386602 run osmo-stp_10.42.42.5(pid=4634): stdout: | (launched: 2022-12-09_12:20:53.780203) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:20:55.508258 run osmo-stp_10.42.42.5(pid=4634): stderr: | 20221209122053950 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122053950 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122053950 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122053951 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122053951 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122053951 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122053951 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:20:55.653939 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4634): Process ended prematurely: osmo-stp_10.42.42.5(pid=4634) [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4634)] [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:20:55.662961 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:20:55.689772 run osmo-hlr_10.42.42.2(pid=4631): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4631)] 12:20:55.738400 run osmo-hlr_10.42.42.2(pid=4631): stdout: | (launched: 2022-12-09_12:20:52.821742) 12:20:55.788144 run osmo-hlr_10.42.42.2(pid=4631): stderr: | 20221209122052995 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122052995 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122052995 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122052995 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122052995 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122052995 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122053008 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122053016 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122053016 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122053016 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:20:55.857661 run osmo-msc_10.42.42.6(pid=4637): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4637)] 12:20:55.905897 run osmo-msc_10.42.42.6(pid=4637): stdout: | (launched: 2022-12-09_12:20:54.768580) 12:20:55.955041 run osmo-msc_10.42.42.6(pid=4637): stderr: | 20221209122055040 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122055040 DLGLOBAL DEBUG validating counter group 0x7fe0192c6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122055040 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122055040 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122055040 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122055040 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122055042 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122055042 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122055043 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122055043 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:20:56.004585 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4630): Terminating (SIGTERM) 12:20:56.043897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4633): Terminating (SIGTERM) 12:20:56.083276 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4636): Terminating (SIGTERM) 12:20:56.122949 --- ParallelTerminationStrategy: PID 4630 died... 12:20:56.142207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4630): Terminated: ok {rc=0} 12:20:56.186231 --- ParallelTerminationStrategy: PID 4633 died... 12:20:56.205017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4633): Terminated: ok {rc=0} 12:20:56.249246 --- ParallelTerminationStrategy: PID 4636 died... 12:20:56.267725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4636): Terminated: ok {rc=0} 12:20:56.353440 bus /sierra_3: Setting Powered False 12:20:57.453906 bus /sierra_3: Setting Powered False 12:20:58.570363 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:20:59.812736 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:20:59.820836 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:20:59.846435 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:20:59.873646 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:20:59.927849 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:20:59.952022 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:20:59.978877 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:21:00.533415 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:21:00.586560 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:00.598594 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:21:00.665716 tst mo_mt_call.py: using LAC 21425 12:21:00.794780 tst mo_mt_call.py: using RAC 5 12:21:00.941194 tst mo_mt_call.py: using CellId 21425 12:21:01.065483 tst mo_mt_call.py: using BVCI 21426 12:21:01.209761 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:01.222512 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:01.234353 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:01.246814 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:01.258591 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:01.271068 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:21:01.391642 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:21:01.512420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:21:02.010430 run create_hlr_db(pid=4642): Launched 12:21:02.176488 bus /sierra_2: Setting Powered False 12:21:03.238216 run create_hlr_db(pid=4642): Terminated: ok {rc=0} 12:21:03.667336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4644): Launched 12:21:03.976139 run osmo-hlr_10.42.42.2(pid=4645): Launched 12:21:04.092747 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:04.634409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4647): Launched 12:21:04.943942 run osmo-stp_10.42.42.5(pid=4648): Launched 12:21:05.060106 run osmo-msc_10.42.42.6: Starting osmo-msc 12:21:05.618521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4650): Launched 12:21:05.928197 run osmo-msc_10.42.42.6(pid=4651): Launched 12:21:06.100019 run osmo-stp_10.42.42.5(pid=4648): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4648)] 12:21:06.228905 run osmo-stp_10.42.42.5(pid=4648): stdout: | (launched: 2022-12-09_12:21:04.886074) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:06.358118 run osmo-stp_10.42.42.5(pid=4648): stderr: | 20221209122105055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122105055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122105056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122105056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122105057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122105057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122105057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:06.485397 run osmo-stp_10.42.42.5(pid=4648): stdout: | (launched: 2022-12-09_12:21:04.886074) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:06.607125 run osmo-stp_10.42.42.5(pid=4648): stderr: | 20221209122105055 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122105055 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122105056 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122105056 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122105057 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122105057 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122105057 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:06.752228 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4648): Process ended prematurely: osmo-stp_10.42.42.5(pid=4648) [trial-2359↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4648)] [trial-2359↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:21:06.761386 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 12:21:06.788146 run osmo-hlr_10.42.42.2(pid=4645): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4645)] 12:21:06.835973 run osmo-hlr_10.42.42.2(pid=4645): stdout: | (launched: 2022-12-09_12:21:03.918552) 12:21:06.885497 run osmo-hlr_10.42.42.2(pid=4645): stderr: | 20221209122104094 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122104094 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122104094 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122104094 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122104094 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122104094 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122104106 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122104114 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122104115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122104115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:21:06.954556 run osmo-msc_10.42.42.6(pid=4651): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4651)] 12:21:07.001931 run osmo-msc_10.42.42.6(pid=4651): stdout: | (launched: 2022-12-09_12:21:05.871159) 12:21:07.051171 run osmo-msc_10.42.42.6(pid=4651): stderr: | 20221209122106142 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122106142 DLGLOBAL DEBUG validating counter group 0x7f86287adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122106142 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122106142 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122106142 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122106142 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122106144 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122106144 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122106145 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122106145 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:21:07.100879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4644): Terminating (SIGTERM) 12:21:07.140375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4647): Terminating (SIGTERM) 12:21:07.180091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4650): Terminating (SIGTERM) 12:21:07.220217 --- ParallelTerminationStrategy: PID 4644 died... 12:21:07.239629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4644): Terminated: ok {rc=0} 12:21:07.284047 --- ParallelTerminationStrategy: PID 4647 died... 12:21:07.302830 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4647): Terminated: ok {rc=0} 12:21:07.346840 --- ParallelTerminationStrategy: PID 4650 died... 12:21:07.365604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4650): Terminated: ok {rc=0} 12:21:07.452300 bus /sierra_3: Setting Powered False 12:21:08.552665 bus /sierra_3: Setting Powered False 12:21:09.668755 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:21:10.816891 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:10.829244 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:21:10.890556 tst mo_mt_call_osmux.py: using LAC 21426 12:21:11.012124 tst mo_mt_call_osmux.py: using RAC 6 12:21:11.134281 tst mo_mt_call_osmux.py: using CellId 21426 12:21:11.256798 tst mo_mt_call_osmux.py: using BVCI 21427 12:21:11.369450 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:11.380681 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:11.391705 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:11.402875 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:11.414140 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:21:11.425322 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:21:11.544453 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:21:11.668085 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:21:12.178118 run create_hlr_db(pid=4653): Launched 12:21:12.304455 bus /sierra_2: Setting Powered False 12:21:13.369376 run create_hlr_db(pid=4653): Terminated: ok {rc=0} 12:21:13.808145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4655): Launched 12:21:14.119762 run osmo-hlr_10.42.42.2(pid=4656): Launched 12:21:14.237346 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:14.782849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4658): Launched 12:21:15.092389 run osmo-stp_10.42.42.5(pid=4659): Launched 12:21:15.210535 run osmo-msc_10.42.42.6: Starting osmo-msc 12:21:15.767955 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4661): Launched 12:21:16.095207 run osmo-msc_10.42.42.6(pid=4662): Launched 12:21:16.384395 run osmo-stp_10.42.42.5(pid=4659): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4659)] 12:21:16.698806 run osmo-stp_10.42.42.5(pid=4659): stdout: | (launched: 2022-12-09_12:21:15.035144) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:16.907424 run osmo-stp_10.42.42.5(pid=4659): stderr: | 20221209122115203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122115203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122115204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122115204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122115204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122115205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122115205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:17.050215 run osmo-stp_10.42.42.5(pid=4659): stdout: | (launched: 2022-12-09_12:21:15.035144) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:17.182009 run osmo-stp_10.42.42.5(pid=4659): stderr: | 20221209122115203 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122115203 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122115204 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122115204 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122115204 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122115205 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122115205 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:17.332908 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4659): Process ended prematurely: osmo-stp_10.42.42.5(pid=4659) [trial-2359↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4659)] [trial-2359↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:21:17.342451 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 12:21:17.370395 run osmo-hlr_10.42.42.2(pid=4656): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4656)] 12:21:17.419313 run osmo-hlr_10.42.42.2(pid=4656): stdout: | (launched: 2022-12-09_12:21:14.062439) 12:21:17.469403 run osmo-hlr_10.42.42.2(pid=4656): stderr: | 20221209122114237 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122114237 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122114237 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122114237 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122114238 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122114238 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122114250 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122114258 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122114258 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122114258 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:21:17.539520 run osmo-msc_10.42.42.6(pid=4662): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4662)] 12:21:17.587592 run osmo-msc_10.42.42.6(pid=4662): stdout: | (launched: 2022-12-09_12:21:16.031815) 12:21:17.637479 run osmo-msc_10.42.42.6(pid=4662): stderr: | 20221209122116577 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122116577 DLGLOBAL DEBUG validating counter group 0x7f29eba17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122116577 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122116578 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122116578 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122116578 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122116579 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122116580 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122116580 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122116580 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:21:17.687963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4655): Terminating (SIGTERM) 12:21:17.728118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4658): Terminating (SIGTERM) 12:21:17.768429 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4661): Terminating (SIGTERM) 12:21:17.808880 --- ParallelTerminationStrategy: PID 4655 died... 12:21:17.828242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4655): Terminated: ok {rc=0} 12:21:17.872654 --- ParallelTerminationStrategy: PID 4658 died... 12:21:17.891659 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4658): Terminated: ok {rc=0} 12:21:17.935936 --- ParallelTerminationStrategy: PID 4661 died... 12:21:17.954767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4661): Terminated: ok {rc=0} 12:21:18.041368 bus /sierra_3: Setting Powered False 12:21:19.141430 bus /sierra_3: Setting Powered False 12:21:20.257482 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 emergency:nanobts+band-1900 --------------------------------------------------------------------- 12:21:21.499583 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:21:21.504713 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 12:21:21.528642 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 12:21:21.555630 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 12:21:21.640422 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 12:21:21.664162 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 12:21:21.690530 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 12:21:22.281393 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2359 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 12:21:22.287186 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:21:22.298771 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:21:22.344596 tst emergency_mo_mt_call.py: using LAC 21427 12:21:22.471067 tst emergency_mo_mt_call.py: using RAC 7 12:21:22.594186 tst emergency_mo_mt_call.py: using CellId 21427 12:21:22.711114 tst emergency_mo_mt_call.py: using BVCI 21428 12:21:22.821314 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:21:22.832201 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:21:22.842927 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:21:22.853658 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:21:22.864372 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:21:22.875044 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:21:22.993942 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:21:23.114163 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:21:23.612361 run create_hlr_db(pid=4669): Launched 12:21:23.735909 bus /sierra_2: Setting Powered False 12:21:24.800375 run create_hlr_db(pid=4669): Terminated: ok {rc=0} 12:21:25.233681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4671): Launched 12:21:25.537529 run osmo-hlr_10.42.42.2(pid=4672): Launched 12:21:25.654182 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:26.176490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4674): Launched 12:21:26.479018 run osmo-stp_10.42.42.5(pid=4675): Launched 12:21:26.603661 tst emergency_mo_mt_call.py: using MSISDN 7201 12:21:26.757092 run osmo-msc_10.42.42.6: Starting osmo-msc 12:21:27.302481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4677): Launched 12:21:27.605582 run osmo-msc_10.42.42.6(pid=4678): Launched 12:21:27.774354 run osmo-stp_10.42.42.5(pid=4675): ERR: Terminated: ERROR {rc=1} [trial-2359↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4675)] 12:21:27.902299 run osmo-stp_10.42.42.5(pid=4675): stdout: | (launched: 2022-12-09_12:21:26.422196) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:28.029588 run osmo-stp_10.42.42.5(pid=4675): stderr: | 20221209122126593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122126593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122126593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122126593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122126594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122126594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122126594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:28.156066 run osmo-stp_10.42.42.5(pid=4675): stdout: | (launched: 2022-12-09_12:21:26.422196) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:28.275921 run osmo-stp_10.42.42.5(pid=4675): stderr: | 20221209122126593 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122126593 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122126593 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122126593 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122126594 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122126594 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122126594 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:28.419715 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=4675): Process ended prematurely: osmo-stp_10.42.42.5(pid=4675) [trial-2359↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4675)] [trial-2359↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 12:21:28.427959 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 12:21:28.454115 run osmo-hlr_10.42.42.2(pid=4672): ERR: Terminated: ERROR {rc=237} [trial-2359↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4672)] 12:21:28.502051 run osmo-hlr_10.42.42.2(pid=4672): stdout: | (launched: 2022-12-09_12:21:25.481200) 12:21:28.551907 run osmo-hlr_10.42.42.2(pid=4672): stderr: | 20221209122125655 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122125655 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122125655 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122125655 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122125655 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122125655 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122125668 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122125676 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122125676 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122125677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:21:28.621419 run osmo-msc_10.42.42.6(pid=4678): ERR: Terminated: ERROR {rc=2} [trial-2359↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4678)] 12:21:28.669510 run osmo-msc_10.42.42.6(pid=4678): stdout: | (launched: 2022-12-09_12:21:27.548807) 12:21:28.719250 run osmo-msc_10.42.42.6(pid=4678): stderr: | 20221209122127820 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122127820 DLGLOBAL DEBUG validating counter group 0x7f72d6be5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122127820 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122127820 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122127821 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122127821 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122127823 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122127823 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122127824 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122127824 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:21:28.769378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4671): Terminating (SIGTERM) 12:21:28.809587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4674): Terminating (SIGTERM) 12:21:28.849705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4677): Terminating (SIGTERM) 12:21:28.890003 --- ParallelTerminationStrategy: PID 4671 died... 12:21:28.909370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4671): Terminated: ok {rc=0} 12:21:28.953915 --- ParallelTerminationStrategy: PID 4674 died... 12:21:28.972756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4674): Terminated: ok {rc=0} 12:21:29.017512 --- ParallelTerminationStrategy: PID 4677 died... 12:21:29.036323 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4677): Terminated: ok {rc=0} 12:21:29.123835 bus /sierra_3: Setting Powered False 12:21:30.224450 bus /sierra_3: Setting Powered False 12:21:31.350873 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 12:21:32.446897 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:21:32.459201 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:21:32.502235 tst emergency_preemptive_call.py: using LAC 21428 12:21:32.629137 tst emergency_preemptive_call.py: using RAC 8 12:21:32.754251 tst emergency_preemptive_call.py: using CellId 21428 12:21:32.880871 tst emergency_preemptive_call.py: using BVCI 21429 12:21:32.998241 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:21:33.009823 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:21:33.021243 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:21:33.033311 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:21:33.045166 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 12:21:33.057171 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:21:33.179176 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:21:33.298033 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:21:33.418065 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:21:33.536015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:21:34.005778 run create_hlr_db(pid=4680): Launched 12:21:34.130269 bus /sierra_2: Setting Powered False 12:21:35.192188 run create_hlr_db(pid=4680): Terminated: ok {rc=0} 12:21:35.637470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4682): Launched 12:21:35.965692 run osmo-hlr_10.42.42.2(pid=4683): Launched 12:21:36.090229 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:36.649334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4685): Launched 12:21:36.974400 run osmo-stp_10.42.42.5(pid=4686): Launched 12:21:37.106792 tst emergency_preemptive_call.py: using MSISDN 7202 12:21:37.274887 run osmo-msc_10.42.42.6: Starting osmo-msc 12:21:37.859605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4688): Launched 12:21:38.184927 run osmo-msc_10.42.42.6(pid=4689): Launched 12:21:38.367022 run osmo-stp_10.42.42.5(pid=4686): ERR: Terminated: ERROR {rc=1} [trial-2359↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4686)] 12:21:38.503308 run osmo-stp_10.42.42.5(pid=4686): stdout: | (launched: 2022-12-09_12:21:36.914774) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:38.640647 run osmo-stp_10.42.42.5(pid=4686): stderr: | 20221209122137102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122137102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122137102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122137103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122137103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122137103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122137103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:38.775636 run osmo-stp_10.42.42.5(pid=4686): stdout: | (launched: 2022-12-09_12:21:36.914774) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:38.904407 run osmo-stp_10.42.42.5(pid=4686): stderr: | 20221209122137102 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122137102 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122137102 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122137103 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122137103 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122137103 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122137103 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:39.058702 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=4686): Process ended prematurely: osmo-stp_10.42.42.5(pid=4686) [trial-2359↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4686)] [trial-2359↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 12:21:39.067721 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 12:21:39.096556 run osmo-hlr_10.42.42.2(pid=4683): ERR: Terminated: ERROR {rc=237} [trial-2359↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4683)] 12:21:39.147863 run osmo-hlr_10.42.42.2(pid=4683): stdout: | (launched: 2022-12-09_12:21:35.905293) 12:21:39.201383 run osmo-hlr_10.42.42.2(pid=4683): stderr: | 20221209122136099 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122136099 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122136099 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122136099 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122136099 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122136099 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122136110 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122136120 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122136120 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122136120 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:21:39.275611 run osmo-msc_10.42.42.6(pid=4689): ERR: Terminated: ERROR {rc=2} [trial-2359↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=4689)] 12:21:39.327205 run osmo-msc_10.42.42.6(pid=4689): stdout: | (launched: 2022-12-09_12:21:38.125250) 12:21:39.380283 run osmo-msc_10.42.42.6(pid=4689): stderr: | 20221209122138444 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122138444 DLGLOBAL DEBUG validating counter group 0x7f2324eb3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122138444 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122138444 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122138444 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122138444 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122138446 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122138447 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122138447 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122138447 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:21:39.433899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4682): Terminating (SIGTERM) 12:21:39.476879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4685): Terminating (SIGTERM) 12:21:39.520214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4688): Terminating (SIGTERM) 12:21:39.563365 --- ParallelTerminationStrategy: PID 4682 died... 12:21:39.583904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4682): Terminated: ok {rc=0} 12:21:39.631812 --- ParallelTerminationStrategy: PID 4685 died... 12:21:39.651968 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4685): Terminated: ok {rc=0} 12:21:39.699514 --- ParallelTerminationStrategy: PID 4688 died... 12:21:39.719656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=4688): Terminated: ok {rc=0} 12:21:39.809053 bus /sierra_9: Setting Powered False 12:21:40.908611 bus /sierra_9: Setting Powered False 12:21:42.030269 bus /sierra_8: Setting Powered False 12:21:43.129618 bus /sierra_8: Setting Powered False 12:21:44.243894 bus /sierra_3: Setting Powered False 12:21:45.343751 bus /sierra_3: Setting Powered False 12:21:46.470064 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:nanobts+band-1900 --------------------------------------------------------------------- 12:21:47.740509 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:21:47.745618 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 12:21:47.769319 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 12:21:47.809062 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 12:21:47.896128 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 12:21:47.919631 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 12:21:47.958019 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 12:21:48.550018 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 12:21:48.599994 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:21:48.610785 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:21:48.653851 tst cs_paging_gprs_active.py: using LAC 21429 12:21:48.775251 tst cs_paging_gprs_active.py: using RAC 9 12:21:48.899830 tst cs_paging_gprs_active.py: using CellId 21429 12:21:49.021892 tst cs_paging_gprs_active.py: using BVCI 21430 12:21:49.137123 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:21:49.147849 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:21:49.158350 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:21:49.168791 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:21:49.179324 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:21:49.189804 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:21:49.200402 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:21:49.210810 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:21:49.221433 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:21:49.343032 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:21:49.461657 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:21:49.669952 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:21:49.980482 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4697): Launched 12:21:50.250909 run iperf3-srv_10.42.42.10(pid=4698): Launched 12:21:50.370503 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:21:50.577768 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:21:50.887954 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4699): Launched 12:21:51.158784 run iperf3-srv_10.42.42.10(pid=4700): Launched 12:21:51.275389 tst cs_paging_gprs_active.py:38: start network... 12:21:51.482094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:21:51.962242 run create_hlr_db(pid=4701): Launched 12:21:52.088920 bus /sierra_2: Setting Powered False 12:21:53.151098 run create_hlr_db(pid=4701): Terminated: ok {rc=0} 12:21:53.602881 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4703): Launched 12:21:53.934793 run osmo-hlr_10.42.42.2(pid=4704): Launched 12:21:54.061570 run osmo-stp_10.42.42.5: Starting osmo-stp 12:21:54.636262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4706): Launched 12:21:54.968413 run osmo-stp_10.42.42.5(pid=4707): Launched 12:21:55.096340 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:21:55.667394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4709): Launched 12:21:55.796185 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:21:56.076705 run patchelf(pid=4710): Launched 12:21:56.263606 run osmo-stp_10.42.42.5(pid=4707): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4707)] 12:21:56.404415 run osmo-stp_10.42.42.5(pid=4707): stdout: | (launched: 2022-12-09_12:21:54.907200) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:56.545744 run osmo-stp_10.42.42.5(pid=4707): stderr: | 20221209122155096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122155096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122155096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122155096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122155097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122155097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122155097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:56.687299 run osmo-stp_10.42.42.5(pid=4707): stdout: | (launched: 2022-12-09_12:21:54.907200) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:21:56.823427 run osmo-stp_10.42.42.5(pid=4707): stderr: | 20221209122155096 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122155096 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122155096 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122155096 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122155097 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122155097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122155097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:21:56.984366 run patchelf(pid=4710): Terminating (SIGINT) 12:21:57.172213 run patchelf(pid=4710): Terminated: ok {rc=0} 12:21:57.307400 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4707): Process ended prematurely: osmo-stp_10.42.42.5(pid=4707) [trial-2359↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4707)] [trial-2359↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 12:21:57.317745 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 12:21:57.347337 run osmo-hlr_10.42.42.2(pid=4704): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4704)] 12:21:57.397910 run osmo-hlr_10.42.42.2(pid=4704): stdout: | (launched: 2022-12-09_12:21:53.873527) 12:21:57.450548 run osmo-hlr_10.42.42.2(pid=4704): stderr: | 20221209122154068 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122154068 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122154068 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122154068 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122154068 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122154068 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122154080 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122154088 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122154089 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122154089 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:21:57.503540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4697): Terminating (SIGTERM) 12:21:57.546152 run iperf3-srv_10.42.42.10(pid=4698): Terminating (SIGTERM) 12:21:57.588394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4699): Terminating (SIGTERM) 12:21:57.630741 run iperf3-srv_10.42.42.10(pid=4700): Terminating (SIGTERM) 12:21:57.673007 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4703): Terminating (SIGTERM) 12:21:57.715350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4706): Terminating (SIGTERM) 12:21:57.757674 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4709): Terminating (SIGTERM) 12:21:57.800304 --- ParallelTerminationStrategy: PID 4697 died... 12:21:57.820606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4697): Terminated: ok {rc=0} 12:21:57.867990 --- ParallelTerminationStrategy: PID 4698 died... 12:21:57.887692 run iperf3-srv_10.42.42.10(pid=4698): Terminated {rc=256} 12:21:57.934562 --- ParallelTerminationStrategy: PID 4699 died... 12:21:57.954305 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4699): Terminated: ok {rc=0} 12:21:58.001165 --- ParallelTerminationStrategy: PID 4700 died... 12:21:58.020729 run iperf3-srv_10.42.42.10(pid=4700): Terminated {rc=256} 12:21:58.067428 --- ParallelTerminationStrategy: PID 4703 died... 12:21:58.086938 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4703): Terminated: ok {rc=0} 12:21:58.133479 --- ParallelTerminationStrategy: PID 4706 died... 12:21:58.153055 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4706): Terminated: ok {rc=0} 12:21:58.199545 --- ParallelTerminationStrategy: PID 4709 died... 12:21:58.219161 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4709): Terminated: ok {rc=0} 12:21:58.307629 bus /gobi_0: Setting Powered False 12:21:59.407464 bus /gobi_0: Setting Powered False 12:22:00.523664 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 12:22:01.674388 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:01.687364 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:22:01.731922 tst iperf3.py: using LAC 21430 12:22:01.868807 tst iperf3.py: using RAC 10 12:22:02.001688 tst iperf3.py: using CellId 21430 12:22:02.134556 tst iperf3.py: using BVCI 21431 12:22:02.257598 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:02.269644 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:02.281526 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:02.295441 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:02.306738 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:02.318919 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:02.331683 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:02.342417 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:02.353204 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:22:02.475474 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:22:02.684246 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:22:02.995312 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4711): Launched 12:22:03.266670 run iperf3-srv_10.42.42.10(pid=4712): Launched 12:22:03.385589 tst iperf3.py:8: start network... 12:22:03.592676 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:22:04.072130 run create_hlr_db(pid=4713): Launched 12:22:04.198048 bus /gobi_6: Setting Powered False 12:22:05.260026 run create_hlr_db(pid=4713): Terminated: ok {rc=0} 12:22:05.691108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4715): Launched 12:22:06.002702 run osmo-hlr_10.42.42.2(pid=4716): Launched 12:22:06.121199 run osmo-stp_10.42.42.5: Starting osmo-stp 12:22:06.664870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4718): Launched 12:22:06.973926 run osmo-stp_10.42.42.5(pid=4719): Launched 12:22:07.090219 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:22:07.640367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4721): Launched 12:22:07.759018 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:22:08.020616 run patchelf(pid=4722): Launched 12:22:08.194667 run osmo-stp_10.42.42.5(pid=4719): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4719)] 12:22:08.325192 run osmo-stp_10.42.42.5(pid=4719): stdout: | (launched: 2022-12-09_12:22:06.916311) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:08.457164 run osmo-stp_10.42.42.5(pid=4719): stderr: | 20221209122207085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122207085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122207086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122207086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122207087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122207087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122207087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:08.589554 run osmo-stp_10.42.42.5(pid=4719): stdout: | (launched: 2022-12-09_12:22:06.916311) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:08.716298 run osmo-stp_10.42.42.5(pid=4719): stderr: | 20221209122207085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122207085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122207086 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122207086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122207087 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122207087 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122207087 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:08.866169 run patchelf(pid=4722): Terminating (SIGINT) 12:22:09.041218 run patchelf(pid=4722): Terminated: ok {rc=0} 12:22:09.167609 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4719): Process ended prematurely: osmo-stp_10.42.42.5(pid=4719) [trial-2359↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4719)] [trial-2359↪gprs:nanobts+band-1900↪iperf3.py:8] 12:22:09.177169 tst iperf3.py:8: Test FAILED (7.5 sec) 12:22:09.204527 run osmo-hlr_10.42.42.2(pid=4716): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4716)] 12:22:09.252279 run osmo-hlr_10.42.42.2(pid=4716): stdout: | (launched: 2022-12-09_12:22:05.945085) 12:22:09.301566 run osmo-hlr_10.42.42.2(pid=4716): stderr: | 20221209122206120 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122206120 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122206120 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122206120 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122206120 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122206121 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122206133 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122206143 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122206143 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122206143 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:22:09.351563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4711): Terminating (SIGTERM) 12:22:09.391586 run iperf3-srv_10.42.42.10(pid=4712): Terminating (SIGTERM) 12:22:09.431358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4715): Terminating (SIGTERM) 12:22:09.471310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4718): Terminating (SIGTERM) 12:22:09.511076 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4721): Terminating (SIGTERM) 12:22:09.551240 --- ParallelTerminationStrategy: PID 4711 died... 12:22:09.570456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4711): Terminated: ok {rc=0} 12:22:09.614480 --- ParallelTerminationStrategy: PID 4712 died... 12:22:09.633160 run iperf3-srv_10.42.42.10(pid=4712): Terminated {rc=256} 12:22:09.676851 --- ParallelTerminationStrategy: PID 4715 died... 12:22:09.695867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4715): Terminated: ok {rc=0} 12:22:09.739623 --- ParallelTerminationStrategy: PID 4718 died... 12:22:09.758307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4718): Terminated: ok {rc=0} 12:22:09.802131 --- ParallelTerminationStrategy: PID 4721 died... 12:22:09.820844 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4721): Terminated: ok {rc=0} 12:22:09.906714 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 12:22:11.056615 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:11.068117 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:22:11.108150 tst iperf3m4.py: using LAC 21431 12:22:11.231642 tst iperf3m4.py: using RAC 11 12:22:11.362948 tst iperf3m4.py: using CellId 21431 12:22:11.493391 tst iperf3m4.py: using BVCI 21432 12:22:11.613752 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:11.625307 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:11.636618 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:11.648146 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:11.659592 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:11.671036 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:11.682627 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:11.693936 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:11.705468 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:22:11.824100 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:22:11.947457 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:22:12.070953 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:22:12.188377 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:22:12.395546 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:22:12.708384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4723): Launched 12:22:12.978369 run iperf3-srv_10.42.42.10(pid=4724): Launched 12:22:13.096239 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:22:13.301748 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:22:13.611153 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4725): Launched 12:22:13.880585 run iperf3-srv_10.42.42.10(pid=4726): Launched 12:22:13.996785 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:22:14.201991 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:22:14.511785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4727): Launched 12:22:14.782705 run iperf3-srv_10.42.42.10(pid=4728): Launched 12:22:14.898783 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:22:15.104125 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:22:15.414681 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4729): Launched 12:22:15.686111 run iperf3-srv_10.42.42.10(pid=4730): Launched 12:22:15.803904 tst iperf3m4.py:8: start network... 12:22:16.025586 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:22:16.518393 run create_hlr_db(pid=4731): Launched 12:22:16.677783 bus /gobi_6: Setting Powered False 12:22:17.739129 run create_hlr_db(pid=4731): Terminated: ok {rc=0} 12:22:18.206287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4733): Launched 12:22:18.539769 run osmo-hlr_10.42.42.2(pid=4734): Launched 12:22:18.667741 run osmo-stp_10.42.42.5: Starting osmo-stp 12:22:19.239317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4736): Launched 12:22:19.573142 run osmo-stp_10.42.42.5(pid=4737): Launched 12:22:19.700415 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:22:20.270869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4739): Launched 12:22:20.398576 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:22:20.679074 run patchelf(pid=4740): Launched 12:22:20.867005 run osmo-stp_10.42.42.5(pid=4737): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4737)] 12:22:21.006876 run osmo-stp_10.42.42.5(pid=4737): stdout: | (launched: 2022-12-09_12:22:19.511512) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:21.147705 run osmo-stp_10.42.42.5(pid=4737): stderr: | 20221209122219699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122219699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122219699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122219700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122219700 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122219700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122219700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:21.288455 run osmo-stp_10.42.42.5(pid=4737): stdout: | (launched: 2022-12-09_12:22:19.511512) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:21.424251 run osmo-stp_10.42.42.5(pid=4737): stderr: | 20221209122219699 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122219699 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122219699 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122219700 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122219700 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122219700 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122219700 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:21.584532 run patchelf(pid=4740): Terminating (SIGINT) 12:22:21.770742 run patchelf(pid=4740): Terminated: ok {rc=0} 12:22:21.905345 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=4737): Process ended prematurely: osmo-stp_10.42.42.5(pid=4737) [trial-2359↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4737)] [trial-2359↪gprs:nanobts+band-1900↪iperf3m4.py:8] 12:22:21.915570 tst iperf3m4.py:8: Test FAILED (10.9 sec) 12:22:21.945258 run osmo-hlr_10.42.42.2(pid=4734): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4734)] 12:22:21.995882 run osmo-hlr_10.42.42.2(pid=4734): stdout: | (launched: 2022-12-09_12:22:18.478235) 12:22:22.048461 run osmo-hlr_10.42.42.2(pid=4734): stderr: | 20221209122218673 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122218673 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122218673 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122218673 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122218673 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122218673 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122218685 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122218694 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122218694 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122218694 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:22:22.101464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4723): Terminating (SIGTERM) 12:22:22.143936 run iperf3-srv_10.42.42.10(pid=4724): Terminating (SIGTERM) 12:22:22.186501 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4725): Terminating (SIGTERM) 12:22:22.229051 run iperf3-srv_10.42.42.10(pid=4726): Terminating (SIGTERM) 12:22:22.271438 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4727): Terminating (SIGTERM) 12:22:22.314337 run iperf3-srv_10.42.42.10(pid=4728): Terminating (SIGTERM) 12:22:22.356905 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4729): Terminating (SIGTERM) 12:22:22.399466 run iperf3-srv_10.42.42.10(pid=4730): Terminating (SIGTERM) 12:22:22.441818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4733): Terminating (SIGTERM) 12:22:22.484153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4736): Terminating (SIGTERM) 12:22:22.526636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4739): Terminating (SIGTERM) 12:22:22.569373 --- ParallelTerminationStrategy: PID 4723 died... 12:22:22.589660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4723): Terminated: ok {rc=0} 12:22:22.637088 --- ParallelTerminationStrategy: PID 4724 died... 12:22:22.656892 run iperf3-srv_10.42.42.10(pid=4724): Terminated {rc=256} 12:22:22.703976 --- ParallelTerminationStrategy: PID 4725 died... 12:22:22.723650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4725): Terminated: ok {rc=0} 12:22:22.770860 --- ParallelTerminationStrategy: PID 4726 died... 12:22:22.790606 run iperf3-srv_10.42.42.10(pid=4726): Terminated {rc=256} 12:22:22.837410 --- ParallelTerminationStrategy: PID 4727 died... 12:22:22.857304 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4727): Terminated: ok {rc=0} 12:22:22.904070 --- ParallelTerminationStrategy: PID 4728 died... 12:22:22.923790 run iperf3-srv_10.42.42.10(pid=4728): Terminated {rc=256} 12:22:22.970724 --- ParallelTerminationStrategy: PID 4729 died... 12:22:22.990680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4729): Terminated: ok {rc=0} 12:22:23.037847 --- ParallelTerminationStrategy: PID 4730 died... 12:22:23.057705 run iperf3-srv_10.42.42.10(pid=4730): Terminated {rc=256} 12:22:23.104664 --- ParallelTerminationStrategy: PID 4733 died... 12:22:23.124540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4733): Terminated: ok {rc=0} 12:22:23.171610 --- ParallelTerminationStrategy: PID 4736 died... 12:22:23.191450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4736): Terminated: ok {rc=0} 12:22:23.238613 --- ParallelTerminationStrategy: PID 4739 died... 12:22:23.258623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4739): Terminated: ok {rc=0} 12:22:23.348329 bus /gobi_4: Setting Powered False 12:22:24.448478 bus /gobi_4: Setting Powered False 12:22:25.565786 bus /gobi_1: Setting Powered False 12:22:26.667484 bus /gobi_1: Setting Powered False 12:22:27.786076 bus /gobi_0: Setting Powered False 12:22:28.884142 bus /gobi_0: Setting Powered False 12:22:30.002504 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 12:22:31.112675 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:31.128665 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:22:31.175102 tst ping.py: using LAC 21432 12:22:31.307923 tst ping.py: using RAC 12 12:22:31.440156 tst ping.py: using CellId 21432 12:22:31.574240 tst ping.py: using BVCI 21433 12:22:31.724093 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:31.738159 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:31.751283 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:31.765542 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:31.777815 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:31.791895 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:31.806361 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:31.817872 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:22:31.941817 tst ping.py:19: start network... 12:22:32.165441 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:22:32.670114 run create_hlr_db(pid=4741): Launched 12:22:32.794790 bus /gobi_6: Setting Powered False 12:22:33.858714 run create_hlr_db(pid=4741): Terminated: ok {rc=0} 12:22:34.311590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4743): Launched 12:22:34.638540 run osmo-hlr_10.42.42.2(pid=4744): Launched 12:22:34.763525 run osmo-stp_10.42.42.5: Starting osmo-stp 12:22:35.324068 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4746): Launched 12:22:35.651297 run osmo-stp_10.42.42.5(pid=4747): Launched 12:22:35.775219 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:22:36.343658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4749): Launched 12:22:36.471376 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:22:36.747495 run patchelf(pid=4750): Launched 12:22:36.929688 run osmo-stp_10.42.42.5(pid=4747): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4747)] 12:22:37.067638 run osmo-stp_10.42.42.5(pid=4747): stdout: | (launched: 2022-12-09_12:22:35.590958) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:37.207144 run osmo-stp_10.42.42.5(pid=4747): stderr: | 20221209122235779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122235779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122235780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122235780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122235780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122235781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122235781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:37.347313 run osmo-stp_10.42.42.5(pid=4747): stdout: | (launched: 2022-12-09_12:22:35.590958) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:37.480444 run osmo-stp_10.42.42.5(pid=4747): stderr: | 20221209122235779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122235779 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122235780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122235780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122235780 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122235781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122235781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:37.639236 run patchelf(pid=4750): Terminating (SIGINT) 12:22:37.823286 run patchelf(pid=4750): Terminated: ok {rc=0} 12:22:37.956112 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=4747): Process ended prematurely: osmo-stp_10.42.42.5(pid=4747) [trial-2359↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4747)] [trial-2359↪gprs:nanobts+band-1900↪ping.py:22] 12:22:37.965800 tst ping.py:22: Test FAILED (6.8 sec) 12:22:37.994721 run osmo-hlr_10.42.42.2(pid=4744): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4744)] 12:22:38.045825 run osmo-hlr_10.42.42.2(pid=4744): stdout: | (launched: 2022-12-09_12:22:34.578716) 12:22:38.098630 run osmo-hlr_10.42.42.2(pid=4744): stderr: | 20221209122234775 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122234775 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122234775 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122234775 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122234775 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122234775 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122234787 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122234795 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122234796 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122234796 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:22:38.151743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4743): Terminating (SIGTERM) 12:22:38.194409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4746): Terminating (SIGTERM) 12:22:38.237107 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4749): Terminating (SIGTERM) 12:22:38.280186 --- ParallelTerminationStrategy: PID 4743 died... 12:22:38.300524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4743): Terminated: ok {rc=0} 12:22:38.347918 --- ParallelTerminationStrategy: PID 4746 died... 12:22:38.368012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4746): Terminated: ok {rc=0} 12:22:38.415028 --- ParallelTerminationStrategy: PID 4749 died... 12:22:38.434900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4749): Terminated: ok {rc=0} 12:22:38.523802 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 12:22:39.612340 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:39.625107 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 12:22:39.671910 tst ping_idle_ping.py: using LAC 21433 12:22:39.799895 tst ping_idle_ping.py: using RAC 13 12:22:39.919334 tst ping_idle_ping.py: using CellId 21433 12:22:40.037386 tst ping_idle_ping.py: using BVCI 21434 12:22:40.148278 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:40.159278 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:40.170305 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:40.181442 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:40.192309 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:40.202982 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:40.214090 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 12:22:40.224807 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 12:22:40.344581 tst ping_idle_ping.py:24: start network... 12:22:40.564420 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:22:41.070579 run create_hlr_db(pid=4751): Launched 12:22:41.196378 bus /gobi_6: Setting Powered False 12:22:42.261201 run create_hlr_db(pid=4751): Terminated: ok {rc=0} 12:22:42.715549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4753): Launched 12:22:43.043652 run osmo-hlr_10.42.42.2(pid=4754): Launched 12:22:43.169588 run osmo-stp_10.42.42.5: Starting osmo-stp 12:22:43.733964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4756): Launched 12:22:44.060157 run osmo-stp_10.42.42.5(pid=4757): Launched 12:22:44.186279 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:22:44.748239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4759): Launched 12:22:44.875393 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:22:45.151074 run patchelf(pid=4760): Launched 12:22:45.334943 run osmo-stp_10.42.42.5(pid=4757): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4757)] 12:22:45.473946 run osmo-stp_10.42.42.5(pid=4757): stdout: | (launched: 2022-12-09_12:22:43.999997) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:45.613392 run osmo-stp_10.42.42.5(pid=4757): stderr: | 20221209122244189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122244189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122244189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122244190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122244190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122244190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122244190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:45.752650 run osmo-stp_10.42.42.5(pid=4757): stdout: | (launched: 2022-12-09_12:22:43.999997) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:45.889456 run osmo-stp_10.42.42.5(pid=4757): stderr: | 20221209122244189 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122244189 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122244189 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122244190 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122244190 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122244190 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122244190 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:46.051028 run patchelf(pid=4760): Terminating (SIGINT) 12:22:46.238712 run patchelf(pid=4760): Terminated: ok {rc=0} 12:22:46.375415 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=4757): Process ended prematurely: osmo-stp_10.42.42.5(pid=4757) [trial-2359↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4757)] [trial-2359↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 12:22:46.386093 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 12:22:46.416926 run osmo-hlr_10.42.42.2(pid=4754): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4754)] 12:22:46.469522 run osmo-hlr_10.42.42.2(pid=4754): stdout: | (launched: 2022-12-09_12:22:42.983764) 12:22:46.524004 run osmo-hlr_10.42.42.2(pid=4754): stderr: | 20221209122243178 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122243178 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122243178 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122243178 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122243178 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122243178 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122243191 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122243199 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122243199 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122243199 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:22:46.579151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4753): Terminating (SIGTERM) 12:22:46.624352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4756): Terminating (SIGTERM) 12:22:46.669974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4759): Terminating (SIGTERM) 12:22:46.715099 --- ParallelTerminationStrategy: PID 4753 died... 12:22:46.735918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4753): Terminated: ok {rc=0} 12:22:46.785850 --- ParallelTerminationStrategy: PID 4756 died... 12:22:46.806277 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4756): Terminated: ok {rc=0} 12:22:46.855951 --- ParallelTerminationStrategy: PID 4759 died... 12:22:46.876627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4759): Terminated: ok {rc=0} 12:22:46.968840 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 12:22:48.272711 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:22:48.279481 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:22:48.304784 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:22:48.344803 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:22:48.434405 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:22:48.458648 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:22:48.498366 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:22:49.095137 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:22:49.149071 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:49.160422 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:22:49.202441 tst cs_paging_gprs_active.py: using LAC 21434 12:22:49.332903 tst cs_paging_gprs_active.py: using RAC 14 12:22:49.464850 tst cs_paging_gprs_active.py: using CellId 21434 12:22:49.597269 tst cs_paging_gprs_active.py: using BVCI 21435 12:22:49.717609 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:49.729145 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:49.740369 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:49.751920 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:49.763146 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:49.774660 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:49.786675 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:49.798037 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:22:49.809702 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:22:49.929861 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:22:50.052259 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:22:50.276782 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:22:50.609978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4765): Launched 12:22:50.902388 run iperf3-srv_10.42.42.10(pid=4766): Launched 12:22:51.028840 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:22:51.252480 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:22:51.586020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4767): Launched 12:22:51.878084 run iperf3-srv_10.42.42.10(pid=4768): Launched 12:22:52.003051 tst cs_paging_gprs_active.py:38: start network... 12:22:52.226151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:22:52.739346 run create_hlr_db(pid=4769): Launched 12:22:52.866779 bus /gobi_6: Setting Powered False 12:22:53.931935 run create_hlr_db(pid=4769): Terminated: ok {rc=0} 12:22:54.374107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4771): Launched 12:22:54.684732 run osmo-hlr_10.42.42.2(pid=4772): Launched 12:22:54.802247 run osmo-stp_10.42.42.5: Starting osmo-stp 12:22:55.334781 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4774): Launched 12:22:55.645590 run osmo-stp_10.42.42.5(pid=4775): Launched 12:22:55.766169 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:22:56.303370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4777): Launched 12:22:56.422383 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:22:56.684772 run patchelf(pid=4778): Launched 12:22:56.858716 run osmo-stp_10.42.42.5(pid=4775): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4775)] 12:22:56.990009 run osmo-stp_10.42.42.5(pid=4775): stdout: | (launched: 2022-12-09_12:22:55.587853) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:57.122907 run osmo-stp_10.42.42.5(pid=4775): stderr: | 20221209122255757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122255757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122255757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122255758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122255758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122255758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122255758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:57.255416 run osmo-stp_10.42.42.5(pid=4775): stdout: | (launched: 2022-12-09_12:22:55.587853) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:22:57.382607 run osmo-stp_10.42.42.5(pid=4775): stderr: | 20221209122255757 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122255757 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122255757 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122255758 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122255758 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122255758 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122255758 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:22:57.533269 run patchelf(pid=4778): Terminating (SIGINT) 12:22:57.708717 run patchelf(pid=4778): Terminated: ok {rc=0} 12:22:57.834906 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=4775): Process ended prematurely: osmo-stp_10.42.42.5(pid=4775) [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4775)] [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:22:57.844408 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 12:22:57.871838 run osmo-hlr_10.42.42.2(pid=4772): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=4772)] 12:22:57.919856 run osmo-hlr_10.42.42.2(pid=4772): stdout: | (launched: 2022-12-09_12:22:54.626911) 12:22:57.969783 run osmo-hlr_10.42.42.2(pid=4772): stderr: | 20221209122254804 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122254804 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122254804 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122254804 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122254804 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122254804 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122254816 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122254825 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122254825 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122254825 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:22:58.020021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4765): Terminating (SIGTERM) 12:22:58.060145 run iperf3-srv_10.42.42.10(pid=4766): Terminating (SIGTERM) 12:22:58.100223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4767): Terminating (SIGTERM) 12:22:58.140267 run iperf3-srv_10.42.42.10(pid=4768): Terminating (SIGTERM) 12:22:58.180099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4771): Terminating (SIGTERM) 12:22:58.220119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4774): Terminating (SIGTERM) 12:22:58.259924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4777): Terminating (SIGTERM) 12:22:58.299977 --- ParallelTerminationStrategy: PID 4765 died... 12:22:58.319226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4765): Terminated: ok {rc=0} 12:22:58.363502 --- ParallelTerminationStrategy: PID 4766 died... 12:22:58.382292 run iperf3-srv_10.42.42.10(pid=4766): Terminated {rc=256} 12:22:58.426219 --- ParallelTerminationStrategy: PID 4767 died... 12:22:58.444795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4767): Terminated: ok {rc=0} 12:22:58.488772 --- ParallelTerminationStrategy: PID 4768 died... 12:22:58.507380 run iperf3-srv_10.42.42.10(pid=4768): Terminated {rc=256} 12:22:58.551394 --- ParallelTerminationStrategy: PID 4771 died... 12:22:58.570133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=4771): Terminated: ok {rc=0} 12:22:58.614840 --- ParallelTerminationStrategy: PID 4774 died... 12:22:58.633571 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=4774): Terminated: ok {rc=0} 12:22:58.677497 --- ParallelTerminationStrategy: PID 4777 died... 12:22:58.696194 run pcap-recorder_any(filters='host 10.42.42.6')(pid=4777): Terminated: ok {rc=0} 12:22:58.780538 bus /gobi_0: Setting Powered False 12:22:59.878754 bus /gobi_0: Setting Powered False 12:23:01.009435 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:23:02.213498 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:02.230860 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:23:02.288930 tst iperf3.py: using LAC 21435 12:23:02.451539 tst iperf3.py: using RAC 15 12:23:02.617253 tst iperf3.py: using CellId 21435 12:23:02.761811 tst iperf3.py: using BVCI 21436 12:23:02.888280 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:02.900109 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:02.916206 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:02.934168 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:02.945728 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:02.959447 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:02.972772 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:02.987841 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:03.003964 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:23:03.130691 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:23:03.369056 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:23:03.747745 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4929): Launched 12:23:04.107236 run iperf3-srv_10.42.42.10(pid=4970): Launched 12:23:04.268742 tst iperf3.py:8: start network... 12:23:04.536415 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:23:05.099896 run create_hlr_db(pid=5050): Launched 12:23:05.268072 bus /gobi_6: Setting Powered False 12:23:06.334848 run create_hlr_db(pid=5050): Terminated: ok {rc=0} 12:23:06.778306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5054): Launched 12:23:07.127273 run osmo-hlr_10.42.42.2(pid=5055): Launched 12:23:07.379156 run osmo-stp_10.42.42.5: Starting osmo-stp 12:23:08.062553 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5057): Launched 12:23:08.411382 run osmo-stp_10.42.42.5(pid=5058): Launched 12:23:08.661773 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:23:09.318692 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5060): Launched 12:23:09.460123 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:23:09.748640 run patchelf(pid=5061): Launched 12:23:09.950520 run osmo-stp_10.42.42.5(pid=5058): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5058)] 12:23:10.095185 run osmo-stp_10.42.42.5(pid=5058): stdout: | (launched: 2022-12-09_12:23:08.350129) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:10.241467 run osmo-stp_10.42.42.5(pid=5058): stderr: | 20221209122308643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122308643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122308643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122308644 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122308644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122308644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122308644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:10.388742 run osmo-stp_10.42.42.5(pid=5058): stdout: | (launched: 2022-12-09_12:23:08.350129) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:10.529278 run osmo-stp_10.42.42.5(pid=5058): stderr: | 20221209122308643 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122308643 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122308643 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122308644 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122308644 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122308644 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122308644 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:10.696521 run patchelf(pid=5061): Terminating (SIGINT) 12:23:10.890059 run patchelf(pid=5061): Terminated: ok {rc=0} 12:23:11.032185 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5058): Process ended prematurely: osmo-stp_10.42.42.5(pid=5058) [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5058)] [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 12:23:11.043797 tst iperf3.py:8: Test FAILED (8.9 sec) 12:23:11.076930 run osmo-hlr_10.42.42.2(pid=5055): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5055)] 12:23:11.130596 run osmo-hlr_10.42.42.2(pid=5055): stdout: | (launched: 2022-12-09_12:23:07.065166) 12:23:11.185852 run osmo-hlr_10.42.42.2(pid=5055): stderr: | 20221209122307371 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122307371 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122307371 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122307371 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122307371 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122307371 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122307391 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122307400 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122307400 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122307400 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:23:11.242355 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4929): Terminating (SIGTERM) 12:23:11.287707 run iperf3-srv_10.42.42.10(pid=4970): Terminating (SIGTERM) 12:23:11.335862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5054): Terminating (SIGTERM) 12:23:11.382333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5057): Terminating (SIGTERM) 12:23:11.429354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5060): Terminating (SIGTERM) 12:23:11.476715 --- ParallelTerminationStrategy: PID 4929 died... 12:23:11.497971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=4929): Terminated: ok {rc=0} 12:23:11.549919 --- ParallelTerminationStrategy: PID 4970 died... 12:23:11.571062 run iperf3-srv_10.42.42.10(pid=4970): Terminated {rc=256} 12:23:11.621756 --- ParallelTerminationStrategy: PID 5054 died... 12:23:11.642754 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5054): Terminated: ok {rc=0} 12:23:11.694363 --- ParallelTerminationStrategy: PID 5057 died... 12:23:11.715384 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5057): Terminated: ok {rc=0} 12:23:11.766743 --- ParallelTerminationStrategy: PID 5060 died... 12:23:11.787715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5060): Terminated: ok {rc=0} 12:23:11.882196 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:23:13.042778 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:13.056064 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:23:13.101628 tst iperf3m4.py: using LAC 21436 12:23:13.237951 tst iperf3m4.py: using RAC 16 12:23:13.373425 tst iperf3m4.py: using CellId 21436 12:23:13.508465 tst iperf3m4.py: using BVCI 21437 12:23:13.635714 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:13.648390 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:13.661810 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:13.676882 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:13.690495 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:13.703381 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:13.717210 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:13.733151 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:13.747066 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:23:13.876223 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:23:14.010171 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:23:14.141535 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:23:14.272027 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:23:14.506793 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:23:14.858206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5062): Launched 12:23:15.169685 run iperf3-srv_10.42.42.10(pid=5063): Launched 12:23:15.313606 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:23:15.548891 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:23:15.935167 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5064): Launched 12:23:16.300221 run iperf3-srv_10.42.42.10(pid=5065): Launched 12:23:16.469579 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:23:16.752869 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:23:17.169551 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5066): Launched 12:23:17.543137 run iperf3-srv_10.42.42.10(pid=5067): Launched 12:23:17.724670 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:23:18.014481 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:23:18.417709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5068): Launched 12:23:18.718946 run iperf3-srv_10.42.42.10(pid=5069): Launched 12:23:18.853683 tst iperf3m4.py:8: start network... 12:23:19.068362 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:23:19.570340 run create_hlr_db(pid=5070): Launched 12:23:19.734348 bus /gobi_6: Setting Powered False 12:23:20.798616 run create_hlr_db(pid=5070): Terminated: ok {rc=0} 12:23:21.250747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5072): Launched 12:23:21.588941 run osmo-hlr_10.42.42.2(pid=5073): Launched 12:23:21.835995 run osmo-stp_10.42.42.5: Starting osmo-stp 12:23:22.558567 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5075): Launched 12:23:22.898930 run osmo-stp_10.42.42.5(pid=5076): Launched 12:23:23.150501 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:23:23.849289 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5078): Launched 12:23:23.985550 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:23:24.285729 run patchelf(pid=5079): Launched 12:23:24.482871 run osmo-stp_10.42.42.5(pid=5076): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5076)] 12:23:24.627908 run osmo-stp_10.42.42.5(pid=5076): stdout: | (launched: 2022-12-09_12:23:22.838012) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:24.773695 run osmo-stp_10.42.42.5(pid=5076): stderr: | 20221209122323163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122323163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122323163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122323164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122323164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122323164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122323164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:24.919796 run osmo-stp_10.42.42.5(pid=5076): stdout: | (launched: 2022-12-09_12:23:22.838012) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:25.060075 run osmo-stp_10.42.42.5(pid=5076): stderr: | 20221209122323163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122323163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122323163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122323164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122323164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122323164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122323164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:25.226049 run patchelf(pid=5079): Terminating (SIGINT) 12:23:25.419207 run patchelf(pid=5079): Terminated: ok {rc=0} 12:23:25.558866 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5076): Process ended prematurely: osmo-stp_10.42.42.5(pid=5076) [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5076)] [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 12:23:25.570397 tst iperf3m4.py:8: Test FAILED (12.6 sec) 12:23:25.603747 run osmo-hlr_10.42.42.2(pid=5073): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5073)] 12:23:25.657183 run osmo-hlr_10.42.42.2(pid=5073): stdout: | (launched: 2022-12-09_12:23:21.528144) 12:23:25.712201 run osmo-hlr_10.42.42.2(pid=5073): stderr: | 20221209122321866 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122321866 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122321866 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122321866 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122321866 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122321866 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122321885 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122321894 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122321894 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122321894 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:23:25.767834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5062): Terminating (SIGTERM) 12:23:25.813209 run iperf3-srv_10.42.42.10(pid=5063): Terminating (SIGTERM) 12:23:25.861130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5064): Terminating (SIGTERM) 12:23:25.906737 run iperf3-srv_10.42.42.10(pid=5065): Terminating (SIGTERM) 12:23:25.954668 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5066): Terminating (SIGTERM) 12:23:26.000422 run iperf3-srv_10.42.42.10(pid=5067): Terminating (SIGTERM) 12:23:26.048397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5068): Terminating (SIGTERM) 12:23:26.094100 run iperf3-srv_10.42.42.10(pid=5069): Terminating (SIGTERM) 12:23:26.142033 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5072): Terminating (SIGTERM) 12:23:26.187618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5075): Terminating (SIGTERM) 12:23:26.234752 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5078): Terminating (SIGTERM) 12:23:26.281639 --- ParallelTerminationStrategy: PID 5062 died... 12:23:26.302770 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5062): Terminated: ok {rc=0} 12:23:26.354178 --- ParallelTerminationStrategy: PID 5063 died... 12:23:26.375182 run iperf3-srv_10.42.42.10(pid=5063): Terminated {rc=256} 12:23:26.425695 --- ParallelTerminationStrategy: PID 5064 died... 12:23:26.446747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5064): Terminated: ok {rc=0} 12:23:26.497364 --- ParallelTerminationStrategy: PID 5065 died... 12:23:26.518474 run iperf3-srv_10.42.42.10(pid=5065): Terminated {rc=256} 12:23:26.568625 --- ParallelTerminationStrategy: PID 5066 died... 12:23:26.590044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5066): Terminated: ok {rc=0} 12:23:26.640897 --- ParallelTerminationStrategy: PID 5067 died... 12:23:26.661767 run iperf3-srv_10.42.42.10(pid=5067): Terminated {rc=256} 12:23:26.710143 --- ParallelTerminationStrategy: PID 5068 died... 12:23:26.730115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5068): Terminated: ok {rc=0} 12:23:26.778061 --- ParallelTerminationStrategy: PID 5069 died... 12:23:26.798107 run iperf3-srv_10.42.42.10(pid=5069): Terminated {rc=256} 12:23:26.845904 --- ParallelTerminationStrategy: PID 5072 died... 12:23:26.865916 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5072): Terminated: ok {rc=0} 12:23:26.914017 --- ParallelTerminationStrategy: PID 5075 died... 12:23:26.934177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5075): Terminated: ok {rc=0} 12:23:26.982064 --- ParallelTerminationStrategy: PID 5078 died... 12:23:27.002201 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5078): Terminated: ok {rc=0} 12:23:27.093547 bus /gobi_4: Setting Powered False 12:23:28.193170 bus /gobi_4: Setting Powered False 12:23:29.310785 bus /gobi_1: Setting Powered False 12:23:30.410232 bus /gobi_1: Setting Powered False 12:23:31.529565 bus /gobi_0: Setting Powered False 12:23:32.629406 bus /gobi_0: Setting Powered False 12:23:33.747679 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 12:23:34.852605 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:34.864922 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:23:34.908059 tst ping.py: using LAC 21437 12:23:35.037313 tst ping.py: using RAC 17 12:23:35.165587 tst ping.py: using CellId 21437 12:23:35.286389 tst ping.py: using BVCI 21438 12:23:35.399774 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:35.410997 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:35.422250 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:35.433528 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:35.444574 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:35.455717 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:35.466861 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:35.478061 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:23:35.600740 tst ping.py:19: start network... 12:23:35.820239 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:23:36.324152 run create_hlr_db(pid=5081): Launched 12:23:36.451684 bus /gobi_6: Setting Powered False 12:23:37.516442 run create_hlr_db(pid=5081): Terminated: ok {rc=0} 12:23:37.972897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5083): Launched 12:23:38.299508 run osmo-hlr_10.42.42.2(pid=5084): Launched 12:23:38.426669 run osmo-stp_10.42.42.5: Starting osmo-stp 12:23:38.995725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5086): Launched 12:23:39.324149 run osmo-stp_10.42.42.5(pid=5087): Launched 12:23:39.450301 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:23:40.014903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5089): Launched 12:23:40.140876 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:23:40.418794 run patchelf(pid=5090): Launched 12:23:40.603331 run osmo-stp_10.42.42.5(pid=5087): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5087)] 12:23:40.742625 run osmo-stp_10.42.42.5(pid=5087): stdout: | (launched: 2022-12-09_12:23:39.263211) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:40.882853 run osmo-stp_10.42.42.5(pid=5087): stderr: | 20221209122339451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122339451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122339451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122339452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122339452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122339452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122339452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:41.023092 run osmo-stp_10.42.42.5(pid=5087): stdout: | (launched: 2022-12-09_12:23:39.263211) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:41.157309 run osmo-stp_10.42.42.5(pid=5087): stderr: | 20221209122339451 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122339451 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122339451 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122339452 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122339452 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122339452 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122339452 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:41.316386 run patchelf(pid=5090): Terminating (SIGINT) 12:23:41.502144 run patchelf(pid=5090): Terminated: ok {rc=0} 12:23:41.635648 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5087): Process ended prematurely: osmo-stp_10.42.42.5(pid=5087) [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5087)] [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 12:23:41.645524 tst ping.py:22: Test FAILED (6.8 sec) 12:23:41.674745 run osmo-hlr_10.42.42.2(pid=5084): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5084)] 12:23:41.725876 run osmo-hlr_10.42.42.2(pid=5084): stdout: | (launched: 2022-12-09_12:23:38.239482) 12:23:41.778768 run osmo-hlr_10.42.42.2(pid=5084): stderr: | 20221209122338433 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122338433 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122338433 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122338434 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122338434 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122338434 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122338450 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122338459 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122338460 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122338460 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:23:41.832090 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5083): Terminating (SIGTERM) 12:23:41.874751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5086): Terminating (SIGTERM) 12:23:41.917282 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5089): Terminating (SIGTERM) 12:23:41.960180 --- ParallelTerminationStrategy: PID 5083 died... 12:23:41.980485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5083): Terminated: ok {rc=0} 12:23:42.027847 --- ParallelTerminationStrategy: PID 5086 died... 12:23:42.047692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5086): Terminated: ok {rc=0} 12:23:42.094961 --- ParallelTerminationStrategy: PID 5089 died... 12:23:42.114874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5089): Terminated: ok {rc=0} 12:23:42.204242 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:23:43.293805 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:43.306786 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:23:43.352382 tst ping_idle_ping.py: using LAC 21438 12:23:43.480826 tst ping_idle_ping.py: using RAC 18 12:23:43.609184 tst ping_idle_ping.py: using CellId 21438 12:23:43.737121 tst ping_idle_ping.py: using BVCI 21439 12:23:43.857202 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:43.868811 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:43.880184 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:43.891839 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:43.903316 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:43.915028 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:43.926871 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:23:43.938469 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:23:44.058213 tst ping_idle_ping.py:24: start network... 12:23:44.265263 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:23:44.747511 run create_hlr_db(pid=5091): Launched 12:23:44.874167 bus /gobi_6: Setting Powered False 12:23:45.956742 run create_hlr_db(pid=5091): Terminated: ok {rc=0} 12:23:46.425889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5093): Launched 12:23:46.775847 run osmo-hlr_10.42.42.2(pid=5094): Launched 12:23:46.932529 run osmo-stp_10.42.42.5: Starting osmo-stp 12:23:47.600424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5096): Launched 12:23:47.931297 run osmo-stp_10.42.42.5(pid=5097): Launched 12:23:48.057328 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:23:48.624579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5099): Launched 12:23:48.751637 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:23:49.029745 run patchelf(pid=5100): Launched 12:23:49.213193 run osmo-stp_10.42.42.5(pid=5097): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5097)] 12:23:49.353288 run osmo-stp_10.42.42.5(pid=5097): stdout: | (launched: 2022-12-09_12:23:47.870291) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:49.493837 run osmo-stp_10.42.42.5(pid=5097): stderr: | 20221209122348059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122348059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122348059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122348060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122348060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122348060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122348061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:49.634091 run osmo-stp_10.42.42.5(pid=5097): stdout: | (launched: 2022-12-09_12:23:47.870291) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:23:49.768592 run osmo-stp_10.42.42.5(pid=5097): stderr: | 20221209122348059 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122348059 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122348059 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122348060 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122348060 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122348060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122348061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:23:49.927832 run patchelf(pid=5100): Terminating (SIGINT) 12:23:50.113503 run patchelf(pid=5100): Terminated: ok {rc=0} 12:23:50.247382 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5097): Process ended prematurely: osmo-stp_10.42.42.5(pid=5097) [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5097)] [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 12:23:50.257113 tst ping_idle_ping.py:27: Test FAILED (7.0 sec) 12:23:50.286273 run osmo-hlr_10.42.42.2(pid=5094): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5094)] 12:23:50.337406 run osmo-hlr_10.42.42.2(pid=5094): stdout: | (launched: 2022-12-09_12:23:46.714032) 12:23:50.390601 run osmo-hlr_10.42.42.2(pid=5094): stderr: | 20221209122347116 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122347116 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122347116 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122347116 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122347116 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122347116 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122347175 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122347191 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122347192 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122347192 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:23:50.443862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5093): Terminating (SIGTERM) 12:23:50.486893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5096): Terminating (SIGTERM) 12:23:50.529561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5099): Terminating (SIGTERM) 12:23:50.572275 --- ParallelTerminationStrategy: PID 5093 died... 12:23:50.592568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5093): Terminated: ok {rc=0} 12:23:50.640026 --- ParallelTerminationStrategy: PID 5096 died... 12:23:50.659919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5096): Terminated: ok {rc=0} 12:23:50.707070 --- ParallelTerminationStrategy: PID 5099 died... 12:23:50.726965 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5099): Terminated: ok {rc=0} 12:23:50.816477 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:23:52.119395 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:23:52.127478 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:23:52.152907 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:23:52.192856 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:23:52.281998 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:23:52.306540 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:23:52.346722 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:23:52.945140 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:23:52.999265 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:23:53.011199 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:23:53.073323 tst cs_paging_gprs_active.py: using LAC 21439 12:23:53.204687 tst cs_paging_gprs_active.py: using RAC 19 12:23:53.337245 tst cs_paging_gprs_active.py: using CellId 21439 12:23:53.468910 tst cs_paging_gprs_active.py: using BVCI 21440 12:23:53.591844 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:23:53.603648 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:23:53.615250 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:23:53.627123 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:23:53.639394 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:23:53.651194 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:23:53.663041 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:23:53.674539 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:23:53.686282 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:23:53.808489 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:23:53.929861 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:23:54.155032 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:23:54.490322 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5104): Launched 12:23:54.781875 run iperf3-srv_10.42.42.10(pid=5105): Launched 12:23:54.909632 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:23:55.135304 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:23:55.472764 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5106): Launched 12:23:55.764758 run iperf3-srv_10.42.42.10(pid=5107): Launched 12:23:55.890254 tst cs_paging_gprs_active.py:38: start network... 12:23:56.114617 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:23:56.631441 run create_hlr_db(pid=5108): Launched 12:23:56.760234 bus /gobi_6: Setting Powered False 12:23:57.826251 run create_hlr_db(pid=5108): Terminated: ok {rc=0} 12:23:58.288690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5110): Launched 12:23:58.624873 run osmo-hlr_10.42.42.2(pid=5111): Launched 12:23:58.753950 run osmo-stp_10.42.42.5: Starting osmo-stp 12:23:59.329679 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5113): Launched 12:23:59.662722 run osmo-stp_10.42.42.5(pid=5114): Launched 12:23:59.791205 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:24:00.363822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5116): Launched 12:24:00.492862 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:24:00.774869 run patchelf(pid=5117): Launched 12:24:00.978297 run osmo-stp_10.42.42.5(pid=5114): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5114)] 12:24:01.122930 run osmo-stp_10.42.42.5(pid=5114): stdout: | (launched: 2022-12-09_12:23:59.601409) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:01.269055 run osmo-stp_10.42.42.5(pid=5114): stderr: | 20221209122359793 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122359793 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122359793 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122359794 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122359794 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122359794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122359794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:01.415974 run osmo-stp_10.42.42.5(pid=5114): stdout: | (launched: 2022-12-09_12:23:59.601409) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:01.563395 run osmo-stp_10.42.42.5(pid=5114): stderr: | 20221209122359793 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122359793 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122359793 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122359794 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122359794 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122359794 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122359794 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:01.765636 run patchelf(pid=5117): Terminating (SIGINT) 12:24:01.958167 run patchelf(pid=5117): Terminated: ok {rc=0} 12:24:02.097554 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5114): Process ended prematurely: osmo-stp_10.42.42.5(pid=5114) [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5114)] [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:24:02.108836 tst cs_paging_gprs_active.py:38: Test FAILED (9.1 sec) 12:24:02.141395 run osmo-hlr_10.42.42.2(pid=5111): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5111)] 12:24:02.194611 run osmo-hlr_10.42.42.2(pid=5111): stdout: | (launched: 2022-12-09_12:23:58.563142) 12:24:02.249490 run osmo-hlr_10.42.42.2(pid=5111): stderr: | 20221209122358761 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122358761 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122358761 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122358761 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122358761 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122358761 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122358772 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122358781 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122358781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122358781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:24:02.303092 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5104): Terminating (SIGTERM) 12:24:02.345991 run iperf3-srv_10.42.42.10(pid=5105): Terminating (SIGTERM) 12:24:02.389298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5106): Terminating (SIGTERM) 12:24:02.432284 run iperf3-srv_10.42.42.10(pid=5107): Terminating (SIGTERM) 12:24:02.475218 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5110): Terminating (SIGTERM) 12:24:02.518041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5113): Terminating (SIGTERM) 12:24:02.561016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5116): Terminating (SIGTERM) 12:24:02.604052 --- ParallelTerminationStrategy: PID 5104 died... 12:24:02.624588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5104): Terminated: ok {rc=0} 12:24:02.672180 --- ParallelTerminationStrategy: PID 5105 died... 12:24:02.692186 run iperf3-srv_10.42.42.10(pid=5105): Terminated {rc=256} 12:24:02.739415 --- ParallelTerminationStrategy: PID 5106 died... 12:24:02.759323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5106): Terminated: ok {rc=0} 12:24:02.806726 --- ParallelTerminationStrategy: PID 5107 died... 12:24:02.826655 run iperf3-srv_10.42.42.10(pid=5107): Terminated {rc=256} 12:24:02.874217 --- ParallelTerminationStrategy: PID 5110 died... 12:24:02.894221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5110): Terminated: ok {rc=0} 12:24:02.942108 --- ParallelTerminationStrategy: PID 5113 died... 12:24:02.962399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5113): Terminated: ok {rc=0} 12:24:03.010174 --- ParallelTerminationStrategy: PID 5116 died... 12:24:03.030369 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5116): Terminated: ok {rc=0} 12:24:03.121573 bus /gobi_0: Setting Powered False 12:24:04.219399 bus /gobi_0: Setting Powered False 12:24:05.332683 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:24:06.484344 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:06.496798 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:24:06.564689 tst iperf3.py: using LAC 21440 12:24:06.688644 tst iperf3.py: using RAC 20 12:24:06.811286 tst iperf3.py: using CellId 21440 12:24:06.935074 tst iperf3.py: using BVCI 21441 12:24:07.050095 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:07.061437 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:07.072340 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:07.083554 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:07.094680 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:07.105770 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:07.116913 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:07.127854 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:07.138958 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:24:07.259466 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:24:07.484841 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:07.819356 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5118): Launched 12:24:08.110165 run iperf3-srv_10.42.42.10(pid=5119): Launched 12:24:08.237589 tst iperf3.py:8: start network... 12:24:08.461810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:24:08.975937 run create_hlr_db(pid=5120): Launched 12:24:09.104778 bus /gobi_6: Setting Powered False 12:24:10.170130 run create_hlr_db(pid=5120): Terminated: ok {rc=0} 12:24:10.614383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5122): Launched 12:24:10.930080 run osmo-hlr_10.42.42.2(pid=5123): Launched 12:24:11.051566 run osmo-stp_10.42.42.5: Starting osmo-stp 12:24:11.604742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5125): Launched 12:24:11.917382 run osmo-stp_10.42.42.5(pid=5126): Launched 12:24:12.037248 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:24:12.572748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5128): Launched 12:24:12.693571 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:24:12.956666 run patchelf(pid=5129): Launched 12:24:13.131688 run osmo-stp_10.42.42.5(pid=5126): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5126)] 12:24:13.262996 run osmo-stp_10.42.42.5(pid=5126): stdout: | (launched: 2022-12-09_12:24:11.859023) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:13.395622 run osmo-stp_10.42.42.5(pid=5126): stderr: | 20221209122412029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122412029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122412030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122412030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122412030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122412031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122412031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:13.528891 run osmo-stp_10.42.42.5(pid=5126): stdout: | (launched: 2022-12-09_12:24:11.859023) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:13.655960 run osmo-stp_10.42.42.5(pid=5126): stderr: | 20221209122412029 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122412029 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122412030 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122412030 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122412030 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122412031 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122412031 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:13.806551 run patchelf(pid=5129): Terminating (SIGINT) 12:24:13.982958 run patchelf(pid=5129): Terminated: ok {rc=0} 12:24:14.110186 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5126): Process ended prematurely: osmo-stp_10.42.42.5(pid=5126) [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5126)] [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 12:24:14.119752 tst iperf3.py:8: Test FAILED (7.7 sec) 12:24:14.147284 run osmo-hlr_10.42.42.2(pid=5123): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5123)] 12:24:14.195262 run osmo-hlr_10.42.42.2(pid=5123): stdout: | (launched: 2022-12-09_12:24:10.871026) 12:24:14.245300 run osmo-hlr_10.42.42.2(pid=5123): stderr: | 20221209122411047 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122411047 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122411047 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122411047 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122411047 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122411047 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122411059 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122411067 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122411068 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122411068 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:24:14.295564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5118): Terminating (SIGTERM) 12:24:14.336024 run iperf3-srv_10.42.42.10(pid=5119): Terminating (SIGTERM) 12:24:14.376174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5122): Terminating (SIGTERM) 12:24:14.416673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5125): Terminating (SIGTERM) 12:24:14.457046 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5128): Terminating (SIGTERM) 12:24:14.497611 --- ParallelTerminationStrategy: PID 5118 died... 12:24:14.517082 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5118): Terminated: ok {rc=0} 12:24:14.561646 --- ParallelTerminationStrategy: PID 5119 died... 12:24:14.580339 run iperf3-srv_10.42.42.10(pid=5119): Terminated {rc=256} 12:24:14.624750 --- ParallelTerminationStrategy: PID 5122 died... 12:24:14.643687 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5122): Terminated: ok {rc=0} 12:24:14.688180 --- ParallelTerminationStrategy: PID 5125 died... 12:24:14.707413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5125): Terminated: ok {rc=0} 12:24:14.752001 --- ParallelTerminationStrategy: PID 5128 died... 12:24:14.770926 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5128): Terminated: ok {rc=0} 12:24:14.858855 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:24:16.015281 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:16.028707 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:24:16.100110 tst iperf3m4.py: using LAC 21441 12:24:16.248318 tst iperf3m4.py: using RAC 21 12:24:16.385263 tst iperf3m4.py: using CellId 21441 12:24:16.549024 tst iperf3m4.py: using BVCI 21442 12:24:16.673412 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:16.686161 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:16.698670 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:16.713335 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:16.727571 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:16.740015 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:16.753633 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:16.767002 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:16.780297 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:24:16.910523 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:24:17.071615 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:24:17.211669 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:24:17.340541 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:24:17.551906 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:17.865880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5130): Launched 12:24:18.141316 run iperf3-srv_10.42.42.10(pid=5131): Launched 12:24:18.260519 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:24:18.469256 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:18.782921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5132): Launched 12:24:19.057672 run iperf3-srv_10.42.42.10(pid=5133): Launched 12:24:19.175572 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:24:19.384776 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:19.699622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5134): Launched 12:24:19.973800 run iperf3-srv_10.42.42.10(pid=5135): Launched 12:24:20.093186 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:24:20.302346 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:24:20.616620 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5136): Launched 12:24:20.891025 run iperf3-srv_10.42.42.10(pid=5137): Launched 12:24:21.010317 tst iperf3m4.py:8: start network... 12:24:21.217728 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:24:21.700718 run create_hlr_db(pid=5138): Launched 12:24:21.829126 bus /gobi_6: Setting Powered False 12:24:22.889983 run create_hlr_db(pid=5138): Terminated: ok {rc=0} 12:24:23.345224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5140): Launched 12:24:23.682189 run osmo-hlr_10.42.42.2(pid=5141): Launched 12:24:23.808724 run osmo-stp_10.42.42.5: Starting osmo-stp 12:24:24.383011 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5143): Launched 12:24:24.715540 run osmo-stp_10.42.42.5(pid=5144): Launched 12:24:24.843709 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:24:25.416924 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5146): Launched 12:24:25.545917 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:24:25.827612 run patchelf(pid=5147): Launched 12:24:26.013373 run osmo-stp_10.42.42.5(pid=5144): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5144)] 12:24:26.153687 run osmo-stp_10.42.42.5(pid=5144): stdout: | (launched: 2022-12-09_12:24:24.654185) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:26.295424 run osmo-stp_10.42.42.5(pid=5144): stderr: | 20221209122424843 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122424843 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122424844 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122424844 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122424844 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122424845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122424845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:26.437733 run osmo-stp_10.42.42.5(pid=5144): stdout: | (launched: 2022-12-09_12:24:24.654185) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:26.573655 run osmo-stp_10.42.42.5(pid=5144): stderr: | 20221209122424843 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122424843 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122424844 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122424844 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122424844 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122424845 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122424845 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:26.734782 run patchelf(pid=5147): Terminating (SIGINT) 12:24:26.921799 run patchelf(pid=5147): Terminated: ok {rc=0} 12:24:27.057440 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5144): Process ended prematurely: osmo-stp_10.42.42.5(pid=5144) [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5144)] [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:24:27.068109 tst iperf3m4.py:8: Test FAILED (11.1 sec) 12:24:27.098053 run osmo-hlr_10.42.42.2(pid=5141): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5141)] 12:24:27.149358 run osmo-hlr_10.42.42.2(pid=5141): stdout: | (launched: 2022-12-09_12:24:23.620329) 12:24:27.202158 run osmo-hlr_10.42.42.2(pid=5141): stderr: | 20221209122423819 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122423819 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122423819 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122423819 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122423819 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122423819 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122423831 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122423842 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122423842 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122423843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:24:27.255678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5130): Terminating (SIGTERM) 12:24:27.298690 run iperf3-srv_10.42.42.10(pid=5131): Terminating (SIGTERM) 12:24:27.341339 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5132): Terminating (SIGTERM) 12:24:27.384537 run iperf3-srv_10.42.42.10(pid=5133): Terminating (SIGTERM) 12:24:27.427419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5134): Terminating (SIGTERM) 12:24:27.470472 run iperf3-srv_10.42.42.10(pid=5135): Terminating (SIGTERM) 12:24:27.513481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5136): Terminating (SIGTERM) 12:24:27.557032 run iperf3-srv_10.42.42.10(pid=5137): Terminating (SIGTERM) 12:24:27.599779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5140): Terminating (SIGTERM) 12:24:27.642696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5143): Terminating (SIGTERM) 12:24:27.685599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5146): Terminating (SIGTERM) 12:24:27.728819 --- ParallelTerminationStrategy: PID 5130 died... 12:24:27.749279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5130): Terminated: ok {rc=0} 12:24:27.796851 --- ParallelTerminationStrategy: PID 5131 died... 12:24:27.816839 run iperf3-srv_10.42.42.10(pid=5131): Terminated {rc=256} 12:24:27.864438 --- ParallelTerminationStrategy: PID 5132 died... 12:24:27.884315 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5132): Terminated: ok {rc=0} 12:24:27.931468 --- ParallelTerminationStrategy: PID 5133 died... 12:24:27.951397 run iperf3-srv_10.42.42.10(pid=5133): Terminated {rc=256} 12:24:27.998424 --- ParallelTerminationStrategy: PID 5134 died... 12:24:28.018243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5134): Terminated: ok {rc=0} 12:24:28.065412 --- ParallelTerminationStrategy: PID 5135 died... 12:24:28.085330 run iperf3-srv_10.42.42.10(pid=5135): Terminated {rc=256} 12:24:28.132257 --- ParallelTerminationStrategy: PID 5136 died... 12:24:28.152210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5136): Terminated: ok {rc=0} 12:24:28.199389 --- ParallelTerminationStrategy: PID 5137 died... 12:24:28.219145 run iperf3-srv_10.42.42.10(pid=5137): Terminated {rc=256} 12:24:28.266219 --- ParallelTerminationStrategy: PID 5140 died... 12:24:28.286061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5140): Terminated: ok {rc=0} 12:24:28.333341 --- ParallelTerminationStrategy: PID 5143 died... 12:24:28.353290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5143): Terminated: ok {rc=0} 12:24:28.400726 --- ParallelTerminationStrategy: PID 5146 died... 12:24:28.420820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5146): Terminated: ok {rc=0} 12:24:28.510700 bus /gobi_4: Setting Powered False 12:24:29.612643 bus /gobi_4: Setting Powered False 12:24:30.730340 bus /gobi_1: Setting Powered False 12:24:31.833094 bus /gobi_1: Setting Powered False 12:24:32.959772 bus /gobi_0: Setting Powered False 12:24:34.059270 bus /gobi_0: Setting Powered False 12:24:35.177503 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:24:36.280773 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:36.293123 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:24:36.356568 tst ping.py: using LAC 21442 12:24:36.481932 tst ping.py: using RAC 22 12:24:36.607103 tst ping.py: using CellId 21442 12:24:36.732185 tst ping.py: using BVCI 21443 12:24:36.848441 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:36.860071 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:36.871407 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:36.882931 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:36.894394 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:36.906005 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:36.917652 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:36.929104 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:24:37.049098 tst ping.py:19: start network... 12:24:37.265060 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:24:37.761183 run create_hlr_db(pid=5149): Launched 12:24:37.884242 bus /gobi_6: Setting Powered False 12:24:38.948881 run create_hlr_db(pid=5149): Terminated: ok {rc=0} 12:24:39.384608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5151): Launched 12:24:39.691112 run osmo-hlr_10.42.42.2(pid=5152): Launched 12:24:39.808738 run osmo-stp_10.42.42.5: Starting osmo-stp 12:24:40.339672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5154): Launched 12:24:40.646831 run osmo-stp_10.42.42.5(pid=5155): Launched 12:24:40.761935 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:24:41.285435 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5157): Launched 12:24:41.402225 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:24:41.659342 run patchelf(pid=5158): Launched 12:24:41.829391 run osmo-stp_10.42.42.5(pid=5155): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5155)] 12:24:41.958091 run osmo-stp_10.42.42.5(pid=5155): stdout: | (launched: 2022-12-09_12:24:40.589687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:42.087719 run osmo-stp_10.42.42.5(pid=5155): stderr: | 20221209122440760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122440760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122440760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122440761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122440761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122440761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122440761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:42.217385 run osmo-stp_10.42.42.5(pid=5155): stdout: | (launched: 2022-12-09_12:24:40.589687) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:42.340859 run osmo-stp_10.42.42.5(pid=5155): stderr: | 20221209122440760 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122440760 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122440760 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122440761 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122440761 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122440761 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122440761 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:42.487389 run patchelf(pid=5158): Terminating (SIGINT) 12:24:42.659075 run patchelf(pid=5158): Terminated: ok {rc=0} 12:24:42.782784 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5155): Process ended prematurely: osmo-stp_10.42.42.5(pid=5155) [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5155)] [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 12:24:42.791618 tst ping.py:22: Test FAILED (6.5 sec) 12:24:42.818702 run osmo-hlr_10.42.42.2(pid=5152): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5152)] 12:24:42.866346 run osmo-hlr_10.42.42.2(pid=5152): stdout: | (launched: 2022-12-09_12:24:39.633796) 12:24:42.915805 run osmo-hlr_10.42.42.2(pid=5152): stderr: | 20221209122439810 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122439810 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122439810 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122439810 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122439810 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122439810 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122439825 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122439836 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122439836 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122439836 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:24:42.965708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5151): Terminating (SIGTERM) 12:24:43.005501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5154): Terminating (SIGTERM) 12:24:43.045360 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5157): Terminating (SIGTERM) 12:24:43.085488 --- ParallelTerminationStrategy: PID 5151 died... 12:24:43.104290 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5151): Terminated: ok {rc=0} 12:24:43.148345 --- ParallelTerminationStrategy: PID 5154 died... 12:24:43.167213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5154): Terminated: ok {rc=0} 12:24:43.211298 --- ParallelTerminationStrategy: PID 5157 died... 12:24:43.229925 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5157): Terminated: ok {rc=0} 12:24:43.313670 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:24:44.402081 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:44.415104 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:24:44.478828 tst ping_idle_ping.py: using LAC 21443 12:24:44.605789 tst ping_idle_ping.py: using RAC 23 12:24:44.734824 tst ping_idle_ping.py: using CellId 21443 12:24:44.863085 tst ping_idle_ping.py: using BVCI 21444 12:24:44.981024 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:44.992578 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:45.003903 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:45.015637 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:45.027137 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:45.038708 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:45.050354 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:24:45.061997 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:24:45.187735 tst ping_idle_ping.py:24: start network... 12:24:45.406605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:24:45.921270 run create_hlr_db(pid=5159): Launched 12:24:46.078199 bus /gobi_6: Setting Powered False 12:24:47.140775 run create_hlr_db(pid=5159): Terminated: ok {rc=0} 12:24:47.600042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5161): Launched 12:24:47.928431 run osmo-hlr_10.42.42.2(pid=5162): Launched 12:24:48.052839 run osmo-stp_10.42.42.5: Starting osmo-stp 12:24:48.615387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5164): Launched 12:24:48.942639 run osmo-stp_10.42.42.5(pid=5165): Launched 12:24:49.066225 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:24:49.626701 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5167): Launched 12:24:49.751458 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:24:50.026432 run patchelf(pid=5168): Launched 12:24:50.207889 run osmo-stp_10.42.42.5(pid=5165): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5165)] 12:24:50.345599 run osmo-stp_10.42.42.5(pid=5165): stdout: | (launched: 2022-12-09_12:24:48.882319) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:50.484527 run osmo-stp_10.42.42.5(pid=5165): stderr: | 20221209122449070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122449070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122449070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122449070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122449071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122449071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122449071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:50.623555 run osmo-stp_10.42.42.5(pid=5165): stdout: | (launched: 2022-12-09_12:24:48.882319) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:50.755942 run osmo-stp_10.42.42.5(pid=5165): stderr: | 20221209122449070 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122449070 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122449070 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122449070 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122449071 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122449071 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122449071 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:50.912630 run patchelf(pid=5168): Terminating (SIGINT) 12:24:51.095804 run patchelf(pid=5168): Terminated: ok {rc=0} 12:24:51.228025 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5165): Process ended prematurely: osmo-stp_10.42.42.5(pid=5165) [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5165)] [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:24:51.237876 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 12:24:51.266625 run osmo-hlr_10.42.42.2(pid=5162): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5162)] 12:24:51.317266 run osmo-hlr_10.42.42.2(pid=5162): stdout: | (launched: 2022-12-09_12:24:47.868502) 12:24:51.370201 run osmo-hlr_10.42.42.2(pid=5162): stderr: | 20221209122448061 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122448061 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122448061 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122448061 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122448061 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122448061 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122448074 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122448082 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122448083 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122448083 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:24:51.422963 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5161): Terminating (SIGTERM) 12:24:51.465279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5164): Terminating (SIGTERM) 12:24:51.507748 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5167): Terminating (SIGTERM) 12:24:51.550381 --- ParallelTerminationStrategy: PID 5161 died... 12:24:51.570597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5161): Terminated: ok {rc=0} 12:24:51.617670 --- ParallelTerminationStrategy: PID 5164 died... 12:24:51.637509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5164): Terminated: ok {rc=0} 12:24:51.684844 --- ParallelTerminationStrategy: PID 5167 died... 12:24:51.704810 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5167): Terminated: ok {rc=0} 12:24:51.792942 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 12:24:53.089943 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:24:53.097464 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:24:53.121252 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:24:53.156393 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:24:53.209525 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:24:53.233326 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:24:53.267977 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:24:53.830796 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2359 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:24:53.836273 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:24:53.847990 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:24:53.909209 tst switch_tch_pdch.py: using LAC 21444 12:24:54.030324 tst switch_tch_pdch.py: using RAC 24 12:24:54.152278 tst switch_tch_pdch.py: using CellId 21444 12:24:54.272766 tst switch_tch_pdch.py: using BVCI 21445 12:24:54.383779 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:24:54.395540 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:24:54.406920 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:24:54.418605 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:24:54.430059 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:24:54.441593 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:24:54.453386 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:24:54.464736 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:24:54.587646 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:24:54.710027 tst switch_tch_pdch.py:51: start network... 12:24:54.928388 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:24:55.430522 run create_hlr_db(pid=5173): Launched 12:24:55.554446 bus /gobi_6: Setting Powered False 12:24:56.618371 run create_hlr_db(pid=5173): Terminated: ok {rc=0} 12:24:57.053818 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5175): Launched 12:24:57.358878 run osmo-hlr_10.42.42.2(pid=5176): Launched 12:24:57.476063 run osmo-stp_10.42.42.5: Starting osmo-stp 12:24:57.999508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5178): Launched 12:24:58.304387 run osmo-stp_10.42.42.5(pid=5179): Launched 12:24:58.419461 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:24:58.942905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5181): Launched 12:24:59.059302 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:24:59.316178 run patchelf(pid=5182): Launched 12:24:59.486245 run osmo-stp_10.42.42.5(pid=5179): ERR: Terminated: ERROR {rc=1} [trial-2359↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5179)] 12:24:59.614925 run osmo-stp_10.42.42.5(pid=5179): stdout: | (launched: 2022-12-09_12:24:58.247488) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:24:59.744440 run osmo-stp_10.42.42.5(pid=5179): stderr: | 20221209122458416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122458416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122458417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122458417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122458418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122458418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122458418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:24:59.875029 run osmo-stp_10.42.42.5(pid=5179): stdout: | (launched: 2022-12-09_12:24:58.247488) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:00.000065 run osmo-stp_10.42.42.5(pid=5179): stderr: | 20221209122458416 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122458416 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122458417 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122458417 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122458418 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122458418 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122458418 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:00.146642 run patchelf(pid=5182): Terminating (SIGINT) 12:25:00.317837 run patchelf(pid=5182): Terminated: ok {rc=0} 12:25:00.441230 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=5179): Process ended prematurely: osmo-stp_10.42.42.5(pid=5179) [trial-2359↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5179)] [trial-2359↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:25:00.450209 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 12:25:00.476698 run osmo-hlr_10.42.42.2(pid=5176): ERR: Terminated: ERROR {rc=237} [trial-2359↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5176)] 12:25:00.524721 run osmo-hlr_10.42.42.2(pid=5176): stdout: | (launched: 2022-12-09_12:24:57.302028) 12:25:00.574447 run osmo-hlr_10.42.42.2(pid=5176): stderr: | 20221209122457475 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122457475 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122457475 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122457475 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122457475 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122457475 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122457487 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122457496 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122457496 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122457496 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:25:00.624646 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5175): Terminating (SIGTERM) 12:25:00.664898 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5178): Terminating (SIGTERM) 12:25:00.705218 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5181): Terminating (SIGTERM) 12:25:00.746239 --- ParallelTerminationStrategy: PID 5175 died... 12:25:00.765533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5175): Terminated: ok {rc=0} 12:25:00.809948 --- ParallelTerminationStrategy: PID 5178 died... 12:25:00.828552 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5178): Terminated: ok {rc=0} 12:25:00.896413 --- ParallelTerminationStrategy: PID 5181 died... 12:25:00.916478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5181): Terminated: ok {rc=0} 12:25:01.010595 bus /gobi_0: Setting Powered False 12:25:02.112852 bus /gobi_0: Setting Powered False 12:25:03.233992 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 sms:nanobts+band-900 --------------------------------------------------------------------- 12:25:04.484457 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:25:04.489393 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 12:25:04.521659 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 12:25:04.551815 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 12:25:04.604377 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 12:25:04.636663 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 12:25:04.663175 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 12:25:05.211832 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 12:25:05.217042 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:25:05.227904 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 12:25:05.273971 tst mo_mt_sms.py: using LAC 21445 12:25:05.390390 tst mo_mt_sms.py: using RAC 25 12:25:05.509336 tst mo_mt_sms.py: using CellId 21445 12:25:05.627283 tst mo_mt_sms.py: using BVCI 21446 12:25:05.738566 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:25:05.749280 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:25:05.759727 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:25:05.770179 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:25:05.780690 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:25:05.791175 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 12:25:05.912374 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 12:25:06.031139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:25:06.502567 run create_hlr_db(pid=5189): Launched 12:25:06.628586 bus /gobi_6: Setting Powered False 12:25:07.690005 run create_hlr_db(pid=5189): Terminated: ok {rc=0} 12:25:08.135223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5191): Launched 12:25:08.461685 run osmo-hlr_10.42.42.2(pid=5192): Launched 12:25:08.587170 run osmo-stp_10.42.42.5: Starting osmo-stp 12:25:09.141992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5194): Launched 12:25:09.467500 run osmo-stp_10.42.42.5(pid=5195): Launched 12:25:09.591358 run osmo-msc_10.42.42.6: Starting osmo-msc 12:25:10.178039 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5197): Launched 12:25:10.505284 run osmo-msc_10.42.42.6(pid=5198): Launched 12:25:10.685584 run osmo-stp_10.42.42.5(pid=5195): ERR: Terminated: ERROR {rc=1} [trial-2359↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5195)] 12:25:10.821662 run osmo-stp_10.42.42.5(pid=5195): stdout: | (launched: 2022-12-09_12:25:09.407656) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:10.958456 run osmo-stp_10.42.42.5(pid=5195): stderr: | 20221209122509594 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122509594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122509595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122509595 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122509596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122509596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122509596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:11.094821 run osmo-stp_10.42.42.5(pid=5195): stdout: | (launched: 2022-12-09_12:25:09.407656) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:11.223285 run osmo-stp_10.42.42.5(pid=5195): stderr: | 20221209122509594 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122509594 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122509595 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122509595 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122509596 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122509596 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122509596 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:11.377174 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=5195): Process ended prematurely: osmo-stp_10.42.42.5(pid=5195) [trial-2359↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5195)] [trial-2359↪sms:nanobts+band-900↪mo_mt_sms.py:16] 12:25:11.386623 tst mo_mt_sms.py:16: Test FAILED (6.2 sec) 12:25:11.414952 run osmo-hlr_10.42.42.2(pid=5192): ERR: Terminated: ERROR {rc=237} [trial-2359↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5192)] 12:25:11.465948 run osmo-hlr_10.42.42.2(pid=5192): stdout: | (launched: 2022-12-09_12:25:08.401789) 12:25:11.518628 run osmo-hlr_10.42.42.2(pid=5192): stderr: | 20221209122508596 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122508596 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122508597 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122508597 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122508597 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122508597 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122508609 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122508620 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122508620 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122508620 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:25:11.592166 run osmo-msc_10.42.42.6(pid=5198): ERR: Terminated: ERROR {rc=2} [trial-2359↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5198)] 12:25:11.642681 run osmo-msc_10.42.42.6(pid=5198): stdout: | (launched: 2022-12-09_12:25:10.444803) 12:25:11.695021 run osmo-msc_10.42.42.6(pid=5198): stderr: | 20221209122510765 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122510765 DLGLOBAL DEBUG validating counter group 0x7f30f135ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122510765 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122510766 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122510766 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122510766 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122510768 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122510768 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122510768 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122510768 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:25:11.747760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5191): Terminating (SIGTERM) 12:25:11.789787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5194): Terminating (SIGTERM) 12:25:11.831951 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5197): Terminating (SIGTERM) 12:25:11.874495 --- ParallelTerminationStrategy: PID 5191 died... 12:25:11.894769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5191): Terminated: ok {rc=0} 12:25:11.942333 --- ParallelTerminationStrategy: PID 5194 died... 12:25:11.962033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5194): Terminated: ok {rc=0} 12:25:12.008639 --- ParallelTerminationStrategy: PID 5197 died... 12:25:12.028354 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5197): Terminated: ok {rc=0} 12:25:12.117037 bus /sierra_3: Setting Powered False 12:25:13.218836 bus /sierra_3: Setting Powered False 12:25:14.335740 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 12:25:15.570535 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:25:15.575346 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 12:25:15.607759 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 12:25:15.614632 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 12:25:15.649812 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 12:25:15.682922 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 12:25:15.689982 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 12:25:16.223338 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2359 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 12:25:16.232248 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 12:25:16.248896 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 12:25:16.303242 tst assert_extension.py: using LAC 21446 12:25:16.423304 tst assert_extension.py: using RAC 26 12:25:16.542720 tst assert_extension.py: using CellId 21446 12:25:16.695906 tst assert_extension.py: using BVCI 21447 12:25:16.810538 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 12:25:16.933441 tst assert_extension.py:10: start nitb and bts... 12:25:17.178448 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:25:17.838993 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5203): Launched 12:25:18.164266 run osmo-nitb_10.42.42.2(pid=5204): Launched 12:25:18.343249 run osmo-nitb_10.42.42.2(pid=5204): ERR: Terminated: ERROR {rc=2} [trial-2359↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5204)] 12:25:18.488445 run osmo-nitb_10.42.42.2(pid=5204): stdout: | (launched: 2022-12-09_12:25:18.105412) 12:25:18.635071 run osmo-nitb_10.42.42.2(pid=5204): stderr: | (launched: 2022-12-09_12:25:18.153338) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:25:18.781525 run osmo-nitb_10.42.42.2(pid=5204): stdout: | (launched: 2022-12-09_12:25:18.105412) 12:25:18.921681 run osmo-nitb_10.42.42.2(pid=5204): stderr: | (launched: 2022-12-09_12:25:18.153338) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5204): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5204) [trial-2359↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5204)] 12:25:19.286786 tst osmo-nitb_10.42.42.2(pid=5204): stdout: | (launched: 2022-12-09_12:25:18.105412) 12:25:19.418464 tst osmo-nitb_10.42.42.2(pid=5204): stderr: | (launched: 2022-12-09_12:25:18.153338) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:25:19.572759 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=5204): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5204) [trial-2359↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5204)] [trial-2359↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 12:25:19.581824 tst assert_extension.py:12: Test FAILED (3.3 sec) 12:25:19.588831 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5203): Terminating (SIGTERM) 12:25:19.800602 --- ParallelTerminationStrategy: PID 5203 died... 12:25:19.822003 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5203): Terminated: ok {rc=0} 12:25:19.911064 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 ussd:nanobts+band-900 --------------------------------------------------------------------- 12:25:21.088858 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:25:21.094390 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 12:25:21.130220 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 12:25:21.158106 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 12:25:21.194313 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 12:25:21.228054 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 12:25:21.256094 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 12:25:21.785290 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2359 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 12:25:21.790751 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:25:21.802243 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 12:25:21.852625 tst assert_extension.py: using LAC 21447 12:25:21.981882 tst assert_extension.py: using RAC 27 12:25:22.112834 tst assert_extension.py: using CellId 21447 12:25:22.240191 tst assert_extension.py: using BVCI 21448 12:25:22.358368 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:25:22.369747 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:25:22.380859 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:25:22.393318 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:25:22.405142 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:25:22.417147 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 12:25:22.535809 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:25:23.002892 run create_hlr_db(pid=5208): Launched 12:25:23.128112 bus /sierra_2: Setting Powered False 12:25:24.189711 run create_hlr_db(pid=5208): Terminated: ok {rc=0} 12:25:24.633699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5210): Launched 12:25:24.961223 run osmo-hlr_10.42.42.2(pid=5211): Launched 12:25:25.084511 run osmo-stp_10.42.42.5: Starting osmo-stp 12:25:25.641760 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5213): Launched 12:25:25.964148 run osmo-stp_10.42.42.5(pid=5214): Launched 12:25:26.087186 run osmo-msc_10.42.42.6: Starting osmo-msc 12:25:26.669394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5216): Launched 12:25:26.991876 run osmo-msc_10.42.42.6(pid=5217): Launched 12:25:27.171335 run osmo-stp_10.42.42.5(pid=5214): ERR: Terminated: ERROR {rc=1} [trial-2359↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5214)] 12:25:27.307351 run osmo-stp_10.42.42.5(pid=5214): stdout: | (launched: 2022-12-09_12:25:25.905346) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:27.444091 run osmo-stp_10.42.42.5(pid=5214): stderr: | 20221209122526091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122526091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122526091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122526091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122526092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122526092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122526092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:27.578968 run osmo-stp_10.42.42.5(pid=5214): stdout: | (launched: 2022-12-09_12:25:25.905346) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:27.707118 run osmo-stp_10.42.42.5(pid=5214): stderr: | 20221209122526091 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122526091 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122526091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122526091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122526092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122526092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122526092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:27.860617 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=5214): Process ended prematurely: osmo-stp_10.42.42.5(pid=5214) [trial-2359↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5214)] [trial-2359↪ussd:nanobts+band-900↪assert_extension.py:17] 12:25:27.869507 tst assert_extension.py:17: Test FAILED (6.1 sec) 12:25:27.897544 run osmo-hlr_10.42.42.2(pid=5211): ERR: Terminated: ERROR {rc=237} [trial-2359↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5211)] 12:25:27.948177 run osmo-hlr_10.42.42.2(pid=5211): stdout: | (launched: 2022-12-09_12:25:24.901972) 12:25:28.000895 run osmo-hlr_10.42.42.2(pid=5211): stderr: | 20221209122525094 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122525094 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122525095 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122525095 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122525095 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122525095 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122525107 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122525115 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122525115 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122525115 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:25:28.074316 run osmo-msc_10.42.42.6(pid=5217): ERR: Terminated: ERROR {rc=2} [trial-2359↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5217)] 12:25:28.125053 run osmo-msc_10.42.42.6(pid=5217): stdout: | (launched: 2022-12-09_12:25:26.933058) 12:25:28.177427 run osmo-msc_10.42.42.6(pid=5217): stderr: | 20221209122527249 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122527249 DLGLOBAL DEBUG validating counter group 0x7f00f4999c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122527249 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122527249 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122527249 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122527250 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122527251 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122527252 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122527252 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122527252 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:25:28.230477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5210): Terminating (SIGTERM) 12:25:28.272824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5213): Terminating (SIGTERM) 12:25:28.315253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5216): Terminating (SIGTERM) 12:25:28.358314 --- ParallelTerminationStrategy: PID 5210 died... 12:25:28.378498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5210): Terminated: ok {rc=0} 12:25:28.425875 --- ParallelTerminationStrategy: PID 5213 died... 12:25:28.445720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5213): Terminated: ok {rc=0} 12:25:28.492444 --- ParallelTerminationStrategy: PID 5216 died... 12:25:28.512060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5216): Terminated: ok {rc=0} 12:25:28.600171 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 12:25:29.814083 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:25:29.822091 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 12:25:29.855681 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 12:25:29.883245 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 12:25:29.937375 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 12:25:29.970611 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 12:25:29.997831 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 12:25:30.550918 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 12:25:30.604224 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:25:30.615969 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:25:30.684175 tst mo_mt_call.py: using LAC 21448 12:25:30.813080 tst mo_mt_call.py: using RAC 28 12:25:30.973589 tst mo_mt_call.py: using CellId 21448 12:25:31.104854 tst mo_mt_call.py: using BVCI 21449 12:25:31.227762 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:25:31.240801 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:25:31.255030 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:25:31.267638 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:25:31.282871 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:25:31.296480 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:25:31.424882 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:25:31.553391 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:25:32.076097 run create_hlr_db(pid=5223): Launched 12:25:32.239477 bus /sierra_2: Setting Powered False 12:25:33.303873 run create_hlr_db(pid=5223): Terminated: ok {rc=0} 12:25:33.763521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5225): Launched 12:25:34.093383 run osmo-hlr_10.42.42.2(pid=5226): Launched 12:25:34.218867 run osmo-stp_10.42.42.5: Starting osmo-stp 12:25:34.789810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5228): Launched 12:25:35.121676 run osmo-stp_10.42.42.5(pid=5229): Launched 12:25:35.250290 run osmo-msc_10.42.42.6: Starting osmo-msc 12:25:35.848933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5231): Launched 12:25:36.181306 run osmo-msc_10.42.42.6(pid=5232): Launched 12:25:36.365768 run osmo-stp_10.42.42.5(pid=5229): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5229)] 12:25:36.504378 run osmo-stp_10.42.42.5(pid=5229): stdout: | (launched: 2022-12-09_12:25:35.060565) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:36.643571 run osmo-stp_10.42.42.5(pid=5229): stderr: | 20221209122535250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122535250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122535250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122535250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122535251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122535251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122535251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:36.781332 run osmo-stp_10.42.42.5(pid=5229): stdout: | (launched: 2022-12-09_12:25:35.060565) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:36.912064 run osmo-stp_10.42.42.5(pid=5229): stderr: | 20221209122535250 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122535250 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122535250 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122535250 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122535251 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122535251 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122535251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:37.068556 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5229): Process ended prematurely: osmo-stp_10.42.42.5(pid=5229) [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5229)] [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 12:25:37.078491 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 12:25:37.107278 run osmo-hlr_10.42.42.2(pid=5226): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5226)] 12:25:37.158045 run osmo-hlr_10.42.42.2(pid=5226): stdout: | (launched: 2022-12-09_12:25:34.032820) 12:25:37.210332 run osmo-hlr_10.42.42.2(pid=5226): stderr: | 20221209122534228 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122534228 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122534228 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122534228 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122534228 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122534229 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122534240 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122534249 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122534249 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122534249 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:25:37.283355 run osmo-msc_10.42.42.6(pid=5232): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5232)] 12:25:37.333950 run osmo-msc_10.42.42.6(pid=5232): stdout: | (launched: 2022-12-09_12:25:36.120253) 12:25:37.386079 run osmo-msc_10.42.42.6(pid=5232): stderr: | 20221209122536439 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122536440 DLGLOBAL DEBUG validating counter group 0x7fe8fa0b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122536440 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122536440 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122536440 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122536440 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122536442 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122536442 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122536442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122536443 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:25:37.439087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5225): Terminating (SIGTERM) 12:25:37.481888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5228): Terminating (SIGTERM) 12:25:37.524428 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5231): Terminating (SIGTERM) 12:25:37.567433 --- ParallelTerminationStrategy: PID 5225 died... 12:25:37.587798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5225): Terminated: ok {rc=0} 12:25:37.635139 --- ParallelTerminationStrategy: PID 5228 died... 12:25:37.655093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5228): Terminated: ok {rc=0} 12:25:37.702489 --- ParallelTerminationStrategy: PID 5231 died... 12:25:37.722432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5231): Terminated: ok {rc=0} 12:25:37.811759 bus /sierra_3: Setting Powered False 12:25:38.912061 bus /sierra_3: Setting Powered False 12:25:40.031781 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 12:25:41.186393 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:25:41.199112 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 12:25:41.268332 tst mo_mt_call_osmux.py: using LAC 21449 12:25:41.398011 tst mo_mt_call_osmux.py: using RAC 29 12:25:41.528328 tst mo_mt_call_osmux.py: using CellId 21449 12:25:41.657244 tst mo_mt_call_osmux.py: using BVCI 21450 12:25:41.778390 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:25:41.790468 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:25:41.802625 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:25:41.814704 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:25:41.826913 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 12:25:41.838518 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:25:41.961833 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 12:25:42.078953 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:25:42.559029 run create_hlr_db(pid=5234): Launched 12:25:42.688897 bus /sierra_2: Setting Powered False 12:25:43.751034 run create_hlr_db(pid=5234): Terminated: ok {rc=0} 12:25:44.203408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5236): Launched 12:25:44.539948 run osmo-hlr_10.42.42.2(pid=5237): Launched 12:25:44.667661 run osmo-stp_10.42.42.5: Starting osmo-stp 12:25:45.240756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5239): Launched 12:25:45.572560 run osmo-stp_10.42.42.5(pid=5240): Launched 12:25:45.697911 run osmo-msc_10.42.42.6: Starting osmo-msc 12:25:46.311577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5242): Launched 12:25:46.649703 run osmo-msc_10.42.42.6(pid=5243): Launched 12:25:47.065575 run osmo-stp_10.42.42.5(pid=5240): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5240)] 12:25:47.278293 run osmo-stp_10.42.42.5(pid=5240): stdout: | (launched: 2022-12-09_12:25:45.511429) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:47.419455 run osmo-stp_10.42.42.5(pid=5240): stderr: | 20221209122545700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122545700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122545701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122545701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122545702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122545702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122545702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:47.557865 run osmo-stp_10.42.42.5(pid=5240): stdout: | (launched: 2022-12-09_12:25:45.511429) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:47.689081 run osmo-stp_10.42.42.5(pid=5240): stderr: | 20221209122545700 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122545700 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122545701 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122545701 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122545702 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122545702 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122545702 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:47.845878 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5240): Process ended prematurely: osmo-stp_10.42.42.5(pid=5240) [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5240)] [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 12:25:47.855498 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 12:25:47.884236 run osmo-hlr_10.42.42.2(pid=5237): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5237)] 12:25:47.935326 run osmo-hlr_10.42.42.2(pid=5237): stdout: | (launched: 2022-12-09_12:25:44.478895) 12:25:47.988250 run osmo-hlr_10.42.42.2(pid=5237): stderr: | 20221209122544672 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122544672 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122544672 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122544672 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122544672 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122544672 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122544685 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122544693 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122544693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122544693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:25:48.061894 run osmo-msc_10.42.42.6(pid=5243): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5243)] 12:25:48.112861 run osmo-msc_10.42.42.6(pid=5243): stdout: | (launched: 2022-12-09_12:25:46.587621) 12:25:48.165582 run osmo-msc_10.42.42.6(pid=5243): stderr: | 20221209122546937 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122546937 DLGLOBAL DEBUG validating counter group 0x7f437a2d9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122546938 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122546938 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122546938 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122546939 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122546942 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122546944 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122546944 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122546944 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:25:48.218821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5236): Terminating (SIGTERM) 12:25:48.261889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5239): Terminating (SIGTERM) 12:25:48.304862 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5242): Terminating (SIGTERM) 12:25:48.348046 --- ParallelTerminationStrategy: PID 5236 died... 12:25:48.368395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5236): Terminated: ok {rc=0} 12:25:48.416031 --- ParallelTerminationStrategy: PID 5239 died... 12:25:48.435743 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5239): Terminated: ok {rc=0} 12:25:48.483414 --- ParallelTerminationStrategy: PID 5242 died... 12:25:48.503307 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5242): Terminated: ok {rc=0} 12:25:48.593433 bus /sierra_3: Setting Powered False 12:25:49.693101 bus /sierra_3: Setting Powered False 12:25:50.809007 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 12:25:52.066594 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:25:52.074680 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 12:25:52.108314 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 12:25:52.135819 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 12:25:52.188863 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 12:25:52.221968 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 12:25:52.248938 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 12:25:52.802875 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 12:25:52.855818 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:25:52.867432 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:25:52.935764 tst mo_mt_call.py: using LAC 21450 12:25:53.065345 tst mo_mt_call.py: using RAC 30 12:25:53.193448 tst mo_mt_call.py: using CellId 21450 12:25:53.315289 tst mo_mt_call.py: using BVCI 21451 12:25:53.428498 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:25:53.439899 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:25:53.451099 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:25:53.462805 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:25:53.474436 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:25:53.486019 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:25:53.602963 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:25:53.725399 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:25:54.235845 run create_hlr_db(pid=5248): Launched 12:25:54.362636 bus /sierra_2: Setting Powered False 12:25:55.427953 run create_hlr_db(pid=5248): Terminated: ok {rc=0} 12:25:55.886769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5250): Launched 12:25:56.219012 run osmo-hlr_10.42.42.2(pid=5251): Launched 12:25:56.346566 run osmo-stp_10.42.42.5: Starting osmo-stp 12:25:56.913641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5253): Launched 12:25:57.247589 run osmo-stp_10.42.42.5(pid=5254): Launched 12:25:57.376459 run osmo-msc_10.42.42.6: Starting osmo-msc 12:25:57.974347 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5256): Launched 12:25:58.305725 run osmo-msc_10.42.42.6(pid=5257): Launched 12:25:58.492321 run osmo-stp_10.42.42.5(pid=5254): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5254)] 12:25:58.632468 run osmo-stp_10.42.42.5(pid=5254): stdout: | (launched: 2022-12-09_12:25:57.186182) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:58.773362 run osmo-stp_10.42.42.5(pid=5254): stderr: | 20221209122557375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122557375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122557375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122557376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122557376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122557376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122557376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:58.910865 run osmo-stp_10.42.42.5(pid=5254): stdout: | (launched: 2022-12-09_12:25:57.186182) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:25:59.041985 run osmo-stp_10.42.42.5(pid=5254): stderr: | 20221209122557375 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122557375 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122557375 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122557376 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122557376 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122557376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122557376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:25:59.199184 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5254): Process ended prematurely: osmo-stp_10.42.42.5(pid=5254) [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5254)] [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 12:25:59.208713 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:25:59.237235 run osmo-hlr_10.42.42.2(pid=5251): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5251)] 12:25:59.287633 run osmo-hlr_10.42.42.2(pid=5251): stdout: | (launched: 2022-12-09_12:25:56.158718) 12:25:59.339672 run osmo-hlr_10.42.42.2(pid=5251): stderr: | 20221209122556355 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122556355 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122556355 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122556355 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122556355 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122556355 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122556367 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122556376 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122556376 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122556376 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:25:59.412747 run osmo-msc_10.42.42.6(pid=5257): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5257)] 12:25:59.463065 run osmo-msc_10.42.42.6(pid=5257): stdout: | (launched: 2022-12-09_12:25:58.244740) 12:25:59.515115 run osmo-msc_10.42.42.6(pid=5257): stderr: | 20221209122558564 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122558564 DLGLOBAL DEBUG validating counter group 0x7f999a6a9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122558564 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122558564 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122558564 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122558565 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122558566 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122558567 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122558567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122558567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:25:59.567462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5250): Terminating (SIGTERM) 12:25:59.609601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5253): Terminating (SIGTERM) 12:25:59.651697 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5256): Terminating (SIGTERM) 12:25:59.694172 --- ParallelTerminationStrategy: PID 5250 died... 12:25:59.714397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5250): Terminated: ok {rc=0} 12:25:59.761408 --- ParallelTerminationStrategy: PID 5253 died... 12:25:59.781095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5253): Terminated: ok {rc=0} 12:25:59.827931 --- ParallelTerminationStrategy: PID 5256 died... 12:25:59.847522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5256): Terminated: ok {rc=0} 12:25:59.936397 bus /sierra_3: Setting Powered False 12:26:01.032139 bus /sierra_3: Setting Powered False 12:26:02.160224 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 12:26:03.312828 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:26:03.325420 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 12:26:03.395505 tst mo_mt_call_osmux.py: using LAC 21451 12:26:03.526483 tst mo_mt_call_osmux.py: using RAC 31 12:26:03.656658 tst mo_mt_call_osmux.py: using CellId 21451 12:26:03.786790 tst mo_mt_call_osmux.py: using BVCI 21452 12:26:03.906538 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:26:03.918307 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:26:03.929867 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:26:03.941742 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:26:03.953616 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 12:26:03.965415 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:26:04.083829 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 12:26:04.206432 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:26:04.718862 run create_hlr_db(pid=5259): Launched 12:26:04.846589 bus /sierra_2: Setting Powered False 12:26:05.911591 run create_hlr_db(pid=5259): Terminated: ok {rc=0} 12:26:06.353148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5261): Launched 12:26:06.665599 run osmo-hlr_10.42.42.2(pid=5262): Launched 12:26:06.786638 run osmo-stp_10.42.42.5: Starting osmo-stp 12:26:07.319210 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5264): Launched 12:26:07.629312 run osmo-stp_10.42.42.5(pid=5265): Launched 12:26:07.747272 run osmo-msc_10.42.42.6: Starting osmo-msc 12:26:08.306665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5267): Launched 12:26:08.616858 run osmo-msc_10.42.42.6(pid=5268): Launched 12:26:08.791539 run osmo-stp_10.42.42.5(pid=5265): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5265)] 12:26:08.921509 run osmo-stp_10.42.42.5(pid=5265): stdout: | (launched: 2022-12-09_12:26:07.572179) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:09.051043 run osmo-stp_10.42.42.5(pid=5265): stderr: | 20221209122607742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122607742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122607742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122607743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122607743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122607743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122607743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:09.178879 run osmo-stp_10.42.42.5(pid=5265): stdout: | (launched: 2022-12-09_12:26:07.572179) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:09.300743 run osmo-stp_10.42.42.5(pid=5265): stderr: | 20221209122607742 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122607742 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122607742 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122607743 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122607743 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122607743 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122607743 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:09.447151 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5265): Process ended prematurely: osmo-stp_10.42.42.5(pid=5265) [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5265)] [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 12:26:09.455857 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:26:09.482633 run osmo-hlr_10.42.42.2(pid=5262): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5262)] 12:26:09.530542 run osmo-hlr_10.42.42.2(pid=5262): stdout: | (launched: 2022-12-09_12:26:06.608302) 12:26:09.580541 run osmo-hlr_10.42.42.2(pid=5262): stderr: | 20221209122606782 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122606783 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122606783 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122606783 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122606783 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122606783 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122606795 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122606805 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122606805 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122606805 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:26:09.649817 run osmo-msc_10.42.42.6(pid=5268): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5268)] 12:26:09.697573 run osmo-msc_10.42.42.6(pid=5268): stdout: | (launched: 2022-12-09_12:26:08.559469) 12:26:09.746995 run osmo-msc_10.42.42.6(pid=5268): stderr: | 20221209122608828 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122608828 DLGLOBAL DEBUG validating counter group 0x7f05c1509c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122608828 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122608828 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122608828 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122608828 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122608830 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122608831 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122608831 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122608831 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:26:09.797134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5261): Terminating (SIGTERM) 12:26:09.837051 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5264): Terminating (SIGTERM) 12:26:09.876855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5267): Terminating (SIGTERM) 12:26:09.917022 --- ParallelTerminationStrategy: PID 5261 died... 12:26:09.936278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5261): Terminated: ok {rc=0} 12:26:09.980892 --- ParallelTerminationStrategy: PID 5264 died... 12:26:10.000054 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5264): Terminated: ok {rc=0} 12:26:10.044011 --- ParallelTerminationStrategy: PID 5267 died... 12:26:10.062865 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5267): Terminated: ok {rc=0} 12:26:10.147462 bus /sierra_3: Setting Powered False 12:26:11.246353 bus /sierra_3: Setting Powered False 12:26:12.363117 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 12:26:13.617150 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:26:13.625361 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 12:26:13.659493 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 12:26:13.687195 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 12:26:13.740162 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 12:26:13.773802 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 12:26:13.801096 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 12:26:14.354522 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 12:26:14.407475 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:26:14.419593 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:26:14.487874 tst mo_mt_call.py: using LAC 21452 12:26:14.618661 tst mo_mt_call.py: using RAC 32 12:26:14.747896 tst mo_mt_call.py: using CellId 21452 12:26:14.874848 tst mo_mt_call.py: using BVCI 21453 12:26:14.987978 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:26:14.999411 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:26:15.010537 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:26:15.021573 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:26:15.032846 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:26:15.044022 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:26:15.161300 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:26:15.283470 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:26:15.796657 run create_hlr_db(pid=5273): Launched 12:26:15.972448 bus /sierra_2: Setting Powered False 12:26:17.048147 run create_hlr_db(pid=5273): Terminated: ok {rc=0} 12:26:17.515117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5275): Launched 12:26:17.828570 run osmo-hlr_10.42.42.2(pid=5276): Launched 12:26:17.945564 run osmo-stp_10.42.42.5: Starting osmo-stp 12:26:18.481424 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5278): Launched 12:26:18.792269 run osmo-stp_10.42.42.5(pid=5279): Launched 12:26:18.911028 run osmo-msc_10.42.42.6: Starting osmo-msc 12:26:19.467348 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5281): Launched 12:26:19.778802 run osmo-msc_10.42.42.6(pid=5282): Launched 12:26:19.954802 run osmo-stp_10.42.42.5(pid=5279): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5279)] 12:26:20.084744 run osmo-stp_10.42.42.5(pid=5279): stdout: | (launched: 2022-12-09_12:26:18.733420) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:20.214694 run osmo-stp_10.42.42.5(pid=5279): stderr: | 20221209122618901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122618902 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122618902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122618902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122618903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122618903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122618903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:20.343206 run osmo-stp_10.42.42.5(pid=5279): stdout: | (launched: 2022-12-09_12:26:18.733420) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:20.466174 run osmo-stp_10.42.42.5(pid=5279): stderr: | 20221209122618901 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122618902 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122618902 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122618902 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122618903 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122618903 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122618903 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:20.613880 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5279): Process ended prematurely: osmo-stp_10.42.42.5(pid=5279) [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5279)] [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 12:26:20.622862 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 12:26:20.649658 run osmo-hlr_10.42.42.2(pid=5276): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5276)] 12:26:20.697321 run osmo-hlr_10.42.42.2(pid=5276): stdout: | (launched: 2022-12-09_12:26:17.770268) 12:26:20.746752 run osmo-hlr_10.42.42.2(pid=5276): stderr: | 20221209122617945 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122617945 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122617945 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122617946 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122617946 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122617946 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122617958 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122617966 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122617966 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122617966 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:26:20.815672 run osmo-msc_10.42.42.6(pid=5282): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5282)] 12:26:20.863251 run osmo-msc_10.42.42.6(pid=5282): stdout: | (launched: 2022-12-09_12:26:19.720790) 12:26:20.913238 run osmo-msc_10.42.42.6(pid=5282): stderr: | 20221209122619990 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122619990 DLGLOBAL DEBUG validating counter group 0x7f7479d01c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122619990 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122619990 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122619990 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122619990 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122619992 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122619992 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122619993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122619993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:26:20.962907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5275): Terminating (SIGTERM) 12:26:21.002746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5278): Terminating (SIGTERM) 12:26:21.042423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5281): Terminating (SIGTERM) 12:26:21.082553 --- ParallelTerminationStrategy: PID 5275 died... 12:26:21.101857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5275): Terminated: ok {rc=0} 12:26:21.146055 --- ParallelTerminationStrategy: PID 5278 died... 12:26:21.164835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5278): Terminated: ok {rc=0} 12:26:21.208794 --- ParallelTerminationStrategy: PID 5281 died... 12:26:21.227960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5281): Terminated: ok {rc=0} 12:26:21.311509 bus /sierra_3: Setting Powered False 12:26:22.410527 bus /sierra_3: Setting Powered False 12:26:23.528146 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 12:26:24.676382 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:26:24.688554 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 12:26:24.755806 tst mo_mt_call_osmux.py: using LAC 21453 12:26:24.876610 tst mo_mt_call_osmux.py: using RAC 33 12:26:25.000445 tst mo_mt_call_osmux.py: using CellId 21453 12:26:25.123431 tst mo_mt_call_osmux.py: using BVCI 21454 12:26:25.237141 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:26:25.248390 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:26:25.259610 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:26:25.270724 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:26:25.281944 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 12:26:25.293026 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:26:25.410543 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 12:26:25.536384 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:26:26.049777 run create_hlr_db(pid=5284): Launched 12:26:26.178041 bus /sierra_2: Setting Powered False 12:26:27.243897 run create_hlr_db(pid=5284): Terminated: ok {rc=0} 12:26:27.688299 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5286): Launched 12:26:27.999904 run osmo-hlr_10.42.42.2(pid=5287): Launched 12:26:28.118076 run osmo-stp_10.42.42.5: Starting osmo-stp 12:26:28.649377 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5289): Launched 12:26:28.959457 run osmo-stp_10.42.42.5(pid=5290): Launched 12:26:29.076832 run osmo-msc_10.42.42.6: Starting osmo-msc 12:26:29.634893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5292): Launched 12:26:29.947524 run osmo-msc_10.42.42.6(pid=5293): Launched 12:26:30.120121 run osmo-stp_10.42.42.5(pid=5290): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5290)] 12:26:30.250192 run osmo-stp_10.42.42.5(pid=5290): stdout: | (launched: 2022-12-09_12:26:28.901791) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:30.380402 run osmo-stp_10.42.42.5(pid=5290): stderr: | 20221209122629071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122629072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122629072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122629072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122629073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122629073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122629073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:30.508939 run osmo-stp_10.42.42.5(pid=5290): stdout: | (launched: 2022-12-09_12:26:28.901791) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:30.632091 run osmo-stp_10.42.42.5(pid=5290): stderr: | 20221209122629071 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122629072 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122629072 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122629072 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122629073 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122629073 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122629073 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:30.778719 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5290): Process ended prematurely: osmo-stp_10.42.42.5(pid=5290) [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5290)] [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 12:26:30.787731 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 12:26:30.814438 run osmo-hlr_10.42.42.2(pid=5287): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5287)] 12:26:30.878618 run osmo-hlr_10.42.42.2(pid=5287): stdout: | (launched: 2022-12-09_12:26:27.941649) 12:26:30.929246 run osmo-hlr_10.42.42.2(pid=5287): stderr: | 20221209122628115 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122628116 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122628116 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122628116 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122628116 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122628116 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122628128 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122628136 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122628136 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122628137 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:26:30.999388 run osmo-msc_10.42.42.6(pid=5293): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5293)] 12:26:31.048136 run osmo-msc_10.42.42.6(pid=5293): stdout: | (launched: 2022-12-09_12:26:29.889815) 12:26:31.098585 run osmo-msc_10.42.42.6(pid=5293): stderr: | 20221209122630161 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122630162 DLGLOBAL DEBUG validating counter group 0x7fc5f57ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122630162 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122630162 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122630162 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122630162 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122630164 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122630164 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122630164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122630164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:26:31.149431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5286): Terminating (SIGTERM) 12:26:31.190814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5289): Terminating (SIGTERM) 12:26:31.233312 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5292): Terminating (SIGTERM) 12:26:31.274965 --- ParallelTerminationStrategy: PID 5286 died... 12:26:31.294330 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5286): Terminated: ok {rc=0} 12:26:31.339640 --- ParallelTerminationStrategy: PID 5289 died... 12:26:31.359266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5289): Terminated: ok {rc=0} 12:26:31.404798 --- ParallelTerminationStrategy: PID 5292 died... 12:26:31.424244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5292): Terminated: ok {rc=0} 12:26:31.517592 bus /sierra_3: Setting Powered False 12:26:32.613552 bus /sierra_3: Setting Powered False 12:26:33.728439 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 12:26:34.984865 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:26:34.992889 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 12:26:35.026982 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 12:26:35.054408 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 12:26:35.112612 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 12:26:35.145874 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 12:26:35.173378 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 12:26:35.727415 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 12:26:35.782155 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:26:35.793930 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:26:35.869063 tst mo_mt_call.py: using LAC 21454 12:26:35.998434 tst mo_mt_call.py: using RAC 34 12:26:36.129221 tst mo_mt_call.py: using CellId 21454 12:26:36.251835 tst mo_mt_call.py: using BVCI 21455 12:26:36.365588 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:26:36.376888 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:26:36.388196 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:26:36.399685 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:26:36.411080 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:26:36.422560 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:26:36.543986 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:26:36.663084 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:26:37.143191 run create_hlr_db(pid=5298): Launched 12:26:37.272396 bus /sierra_2: Setting Powered False 12:26:38.334685 run create_hlr_db(pid=5298): Terminated: ok {rc=0} 12:26:38.786846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5300): Launched 12:26:39.118982 run osmo-hlr_10.42.42.2(pid=5301): Launched 12:26:39.244127 run osmo-stp_10.42.42.5: Starting osmo-stp 12:26:39.814445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5303): Launched 12:26:40.147739 run osmo-stp_10.42.42.5(pid=5304): Launched 12:26:40.274946 run osmo-msc_10.42.42.6: Starting osmo-msc 12:26:40.874302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5306): Launched 12:26:41.206409 run osmo-msc_10.42.42.6(pid=5307): Launched 12:26:41.392030 run osmo-stp_10.42.42.5(pid=5304): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5304)] 12:26:41.531616 run osmo-stp_10.42.42.5(pid=5304): stdout: | (launched: 2022-12-09_12:26:40.086635) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:41.671343 run osmo-stp_10.42.42.5(pid=5304): stderr: | 20221209122640275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122640275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122640275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122640276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122640276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122640276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122640277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:41.809572 run osmo-stp_10.42.42.5(pid=5304): stdout: | (launched: 2022-12-09_12:26:40.086635) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:41.940728 run osmo-stp_10.42.42.5(pid=5304): stderr: | 20221209122640275 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122640275 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122640275 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122640276 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122640276 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122640276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122640277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:42.097431 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5304): Process ended prematurely: osmo-stp_10.42.42.5(pid=5304) [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5304)] [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 12:26:42.106985 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:26:42.135658 run osmo-hlr_10.42.42.2(pid=5301): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5301)] 12:26:42.186040 run osmo-hlr_10.42.42.2(pid=5301): stdout: | (launched: 2022-12-09_12:26:39.057589) 12:26:42.238313 run osmo-hlr_10.42.42.2(pid=5301): stderr: | 20221209122639254 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122639254 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122639254 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122639254 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122639254 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122639254 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122639267 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122639275 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122639276 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122639276 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:26:42.311110 run osmo-msc_10.42.42.6(pid=5307): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5307)] 12:26:42.361586 run osmo-msc_10.42.42.6(pid=5307): stdout: | (launched: 2022-12-09_12:26:41.145397) 12:26:42.413852 run osmo-msc_10.42.42.6(pid=5307): stderr: | 20221209122641464 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122641464 DLGLOBAL DEBUG validating counter group 0x7f6ce2af1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122641464 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122641464 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122641464 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122641465 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122641466 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122641467 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122641467 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122641467 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:26:42.466741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5300): Terminating (SIGTERM) 12:26:42.509091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5303): Terminating (SIGTERM) 12:26:42.551320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5306): Terminating (SIGTERM) 12:26:42.593755 --- ParallelTerminationStrategy: PID 5300 died... 12:26:42.613919 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5300): Terminated: ok {rc=0} 12:26:42.660906 --- ParallelTerminationStrategy: PID 5303 died... 12:26:42.680625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5303): Terminated: ok {rc=0} 12:26:42.727328 --- ParallelTerminationStrategy: PID 5306 died... 12:26:42.746996 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5306): Terminated: ok {rc=0} 12:26:42.835843 bus /sierra_3: Setting Powered False 12:26:43.935679 bus /sierra_3: Setting Powered False 12:26:45.054517 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 12:26:46.205595 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:26:46.218172 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 12:26:46.287483 tst mo_mt_call_osmux.py: using LAC 21455 12:26:46.425420 tst mo_mt_call_osmux.py: using RAC 35 12:26:46.582561 tst mo_mt_call_osmux.py: using CellId 21455 12:26:46.715367 tst mo_mt_call_osmux.py: using BVCI 21456 12:26:46.833531 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:26:46.845428 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:26:46.857182 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:26:46.869063 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:26:46.880651 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 12:26:46.892405 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:26:47.019097 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 12:26:47.148014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:26:47.668035 run create_hlr_db(pid=5309): Launched 12:26:47.796700 bus /sierra_2: Setting Powered False 12:26:48.861953 run create_hlr_db(pid=5309): Terminated: ok {rc=0} 12:26:49.304799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5311): Launched 12:26:49.615241 run osmo-hlr_10.42.42.2(pid=5312): Launched 12:26:49.732635 run osmo-stp_10.42.42.5: Starting osmo-stp 12:26:50.266845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5314): Launched 12:26:50.577928 run osmo-stp_10.42.42.5(pid=5315): Launched 12:26:50.695398 run osmo-msc_10.42.42.6: Starting osmo-msc 12:26:51.253607 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5317): Launched 12:26:51.564846 run osmo-msc_10.42.42.6(pid=5318): Launched 12:26:51.739139 run osmo-stp_10.42.42.5(pid=5315): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5315)] 12:26:51.869319 run osmo-stp_10.42.42.5(pid=5315): stdout: | (launched: 2022-12-09_12:26:50.520412) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:52.000070 run osmo-stp_10.42.42.5(pid=5315): stderr: | 20221209122650689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122650689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122650689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122650690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122650690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122650690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122650690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:52.128372 run osmo-stp_10.42.42.5(pid=5315): stdout: | (launched: 2022-12-09_12:26:50.520412) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:26:52.250514 run osmo-stp_10.42.42.5(pid=5315): stderr: | 20221209122650689 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122650689 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122650689 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122650690 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122650690 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122650690 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122650690 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:26:52.396475 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5315): Process ended prematurely: osmo-stp_10.42.42.5(pid=5315) [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5315)] [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 12:26:52.405628 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 12:26:52.432453 run osmo-hlr_10.42.42.2(pid=5312): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5312)] 12:26:52.480325 run osmo-hlr_10.42.42.2(pid=5312): stdout: | (launched: 2022-12-09_12:26:49.557926) 12:26:52.530006 run osmo-hlr_10.42.42.2(pid=5312): stderr: | 20221209122649733 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122649733 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122649733 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122649733 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122649733 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122649733 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122649745 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122649755 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122649755 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122649755 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:26:52.599716 run osmo-msc_10.42.42.6(pid=5318): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5318)] 12:26:52.647369 run osmo-msc_10.42.42.6(pid=5318): stdout: | (launched: 2022-12-09_12:26:51.506924) 12:26:52.696507 run osmo-msc_10.42.42.6(pid=5318): stderr: | 20221209122651778 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122651778 DLGLOBAL DEBUG validating counter group 0x7fa6bb69cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122651778 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122651778 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122651779 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122651779 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122651781 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122651781 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122651781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122651782 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:26:52.746295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5311): Terminating (SIGTERM) 12:26:52.786072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5314): Terminating (SIGTERM) 12:26:52.825978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5317): Terminating (SIGTERM) 12:26:52.866077 --- ParallelTerminationStrategy: PID 5311 died... 12:26:52.885095 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5311): Terminated: ok {rc=0} 12:26:52.929910 --- ParallelTerminationStrategy: PID 5314 died... 12:26:52.948536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5314): Terminated: ok {rc=0} 12:26:52.992726 --- ParallelTerminationStrategy: PID 5317 died... 12:26:53.011674 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5317): Terminated: ok {rc=0} 12:26:53.097598 bus /sierra_3: Setting Powered False 12:26:54.197991 bus /sierra_3: Setting Powered False 12:26:55.315082 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 12:26:56.578554 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:26:56.588562 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:26:56.622938 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 12:26:56.650259 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:26:56.703516 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:26:56.736053 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 12:26:56.762873 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:26:57.320116 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 12:26:57.374361 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:26:57.386249 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:26:57.455117 tst mo_mt_call.py: using LAC 21456 12:26:57.582932 tst mo_mt_call.py: using RAC 36 12:26:57.712854 tst mo_mt_call.py: using CellId 21456 12:26:57.841112 tst mo_mt_call.py: using BVCI 21457 12:26:57.961286 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:26:57.973130 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:26:57.984647 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:26:57.996439 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:26:58.008291 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:26:58.020177 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:26:58.141397 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:26:58.263023 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:26:58.744893 run create_hlr_db(pid=5324): Launched 12:26:58.871503 bus /sierra_2: Setting Powered False 12:26:59.933865 run create_hlr_db(pid=5324): Terminated: ok {rc=0} 12:27:00.386196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5326): Launched 12:27:00.718364 run osmo-hlr_10.42.42.2(pid=5327): Launched 12:27:00.851098 run osmo-stp_10.42.42.5: Starting osmo-stp 12:27:01.533771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5329): Launched 12:27:01.882151 run osmo-stp_10.42.42.5(pid=5330): Launched 12:27:02.197416 run osmo-msc_10.42.42.6: Starting osmo-msc 12:27:02.785078 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5332): Launched 12:27:03.094859 run osmo-msc_10.42.42.6(pid=5333): Launched 12:27:03.266507 run osmo-stp_10.42.42.5(pid=5330): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5330)] 12:27:03.395898 run osmo-stp_10.42.42.5(pid=5330): stdout: | (launched: 2022-12-09_12:27:01.818989) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:03.525950 run osmo-stp_10.42.42.5(pid=5330): stderr: | 20221209122702037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122702037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122702037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122702037 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122702038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122702038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122702038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:03.654269 run osmo-stp_10.42.42.5(pid=5330): stdout: | (launched: 2022-12-09_12:27:01.818989) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:03.776068 run osmo-stp_10.42.42.5(pid=5330): stderr: | 20221209122702037 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122702037 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122702037 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122702037 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122702038 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122702038 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122702038 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:03.922451 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5330): Process ended prematurely: osmo-stp_10.42.42.5(pid=5330) [trial-2359↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5330)] [trial-2359↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 12:27:03.931477 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 12:27:03.958043 run osmo-hlr_10.42.42.2(pid=5327): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5327)] 12:27:04.005672 run osmo-hlr_10.42.42.2(pid=5327): stdout: | (launched: 2022-12-09_12:27:00.657679) 12:27:04.055098 run osmo-hlr_10.42.42.2(pid=5327): stderr: | 20221209122700886 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122700886 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122700886 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122700886 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122700886 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122700887 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122700912 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122700937 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122700938 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122700938 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:04.124298 run osmo-msc_10.42.42.6(pid=5333): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5333)] 12:27:04.171713 run osmo-msc_10.42.42.6(pid=5333): stdout: | (launched: 2022-12-09_12:27:03.037599) 12:27:04.220674 run osmo-msc_10.42.42.6(pid=5333): stderr: | 20221209122703307 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122703307 DLGLOBAL DEBUG validating counter group 0x7fabb14c5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122703307 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122703307 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122703307 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122703308 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122703309 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122703310 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122703310 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122703310 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:27:04.270008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5326): Terminating (SIGTERM) 12:27:04.309722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5329): Terminating (SIGTERM) 12:27:04.349397 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5332): Terminating (SIGTERM) 12:27:04.389382 --- ParallelTerminationStrategy: PID 5326 died... 12:27:04.408612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5326): Terminated: ok {rc=0} 12:27:04.452690 --- ParallelTerminationStrategy: PID 5329 died... 12:27:04.471494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5329): Terminated: ok {rc=0} 12:27:04.515518 --- ParallelTerminationStrategy: PID 5332 died... 12:27:04.534373 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5332): Terminated: ok {rc=0} 12:27:04.620108 bus /sierra_3: Setting Powered False 12:27:05.720604 bus /sierra_3: Setting Powered False 12:27:06.836908 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 12:27:07.989659 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:27:08.002217 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:27:08.072609 tst mo_mt_call_osmux.py: using LAC 21457 12:27:08.204690 tst mo_mt_call_osmux.py: using RAC 37 12:27:08.330147 tst mo_mt_call_osmux.py: using CellId 21457 12:27:08.455623 tst mo_mt_call_osmux.py: using BVCI 21458 12:27:08.568294 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:27:08.579778 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:27:08.591086 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:27:08.602407 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:27:08.613617 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 12:27:08.624658 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:27:08.746571 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:27:08.870561 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:27:09.385227 run create_hlr_db(pid=5335): Launched 12:27:09.513536 bus /sierra_2: Setting Powered False 12:27:10.578510 run create_hlr_db(pid=5335): Terminated: ok {rc=0} 12:27:11.039257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5337): Launched 12:27:11.368599 run osmo-hlr_10.42.42.2(pid=5338): Launched 12:27:11.496536 run osmo-stp_10.42.42.5: Starting osmo-stp 12:27:12.063759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5340): Launched 12:27:12.396683 run osmo-stp_10.42.42.5(pid=5341): Launched 12:27:12.524629 run osmo-msc_10.42.42.6: Starting osmo-msc 12:27:13.122069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5343): Launched 12:27:13.453254 run osmo-msc_10.42.42.6(pid=5344): Launched 12:27:13.639262 run osmo-stp_10.42.42.5(pid=5341): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5341)] 12:27:13.778182 run osmo-stp_10.42.42.5(pid=5341): stdout: | (launched: 2022-12-09_12:27:12.335657) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:13.918219 run osmo-stp_10.42.42.5(pid=5341): stderr: | 20221209122712525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122712525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122712527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122712527 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122712528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122712528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122712528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:14.055976 run osmo-stp_10.42.42.5(pid=5341): stdout: | (launched: 2022-12-09_12:27:12.335657) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:14.186959 run osmo-stp_10.42.42.5(pid=5341): stderr: | 20221209122712525 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122712525 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122712527 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122712527 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122712528 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122712528 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122712528 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:14.343598 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5341): Process ended prematurely: osmo-stp_10.42.42.5(pid=5341) [trial-2359↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5341)] [trial-2359↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 12:27:14.353415 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:27:14.382020 run osmo-hlr_10.42.42.2(pid=5338): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5338)] 12:27:14.432816 run osmo-hlr_10.42.42.2(pid=5338): stdout: | (launched: 2022-12-09_12:27:11.307729) 12:27:14.485831 run osmo-hlr_10.42.42.2(pid=5338): stderr: | 20221209122711504 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122711504 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122711504 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122711504 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122711504 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122711504 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122711516 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122711525 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122711525 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122711525 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:14.558819 run osmo-msc_10.42.42.6(pid=5344): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5344)] 12:27:14.609468 run osmo-msc_10.42.42.6(pid=5344): stdout: | (launched: 2022-12-09_12:27:13.391729) 12:27:14.662022 run osmo-msc_10.42.42.6(pid=5344): stderr: | 20221209122713712 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122713712 DLGLOBAL DEBUG validating counter group 0x7f07aeb91c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122713712 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122713712 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122713713 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122713713 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122713714 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122713715 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122713715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122713715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:27:14.714966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5337): Terminating (SIGTERM) 12:27:14.757157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5340): Terminating (SIGTERM) 12:27:14.799242 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5343): Terminating (SIGTERM) 12:27:14.841768 --- ParallelTerminationStrategy: PID 5337 died... 12:27:14.862020 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5337): Terminated: ok {rc=0} 12:27:14.909289 --- ParallelTerminationStrategy: PID 5340 died... 12:27:14.929341 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5340): Terminated: ok {rc=0} 12:27:14.976463 --- ParallelTerminationStrategy: PID 5343 died... 12:27:14.996297 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5343): Terminated: ok {rc=0} 12:27:15.085454 bus /sierra_3: Setting Powered False 12:27:16.181380 bus /sierra_3: Setting Powered False 12:27:17.298905 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 12:27:18.556871 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:27:18.564519 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 12:27:18.598878 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 12:27:18.626361 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 12:27:18.678314 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 12:27:18.712103 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 12:27:18.739952 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 12:27:19.296169 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 12:27:19.349995 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:27:19.362043 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:27:19.416268 tst mo_mt_call.py: using LAC 21458 12:27:19.545689 tst mo_mt_call.py: using RAC 38 12:27:19.675443 tst mo_mt_call.py: using CellId 21458 12:27:19.804731 tst mo_mt_call.py: using BVCI 21459 12:27:19.924859 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:27:19.937018 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:27:19.949208 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:27:19.961530 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:27:19.973623 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:27:19.985744 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:27:20.104867 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:27:20.228808 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:27:20.739730 run create_hlr_db(pid=5349): Launched 12:27:20.867885 bus /sierra_2: Setting Powered False 12:27:21.932694 run create_hlr_db(pid=5349): Terminated: ok {rc=0} 12:27:22.393732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5351): Launched 12:27:22.727872 run osmo-hlr_10.42.42.2(pid=5352): Launched 12:27:22.855645 run osmo-stp_10.42.42.5: Starting osmo-stp 12:27:23.424581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5354): Launched 12:27:23.756332 run osmo-stp_10.42.42.5(pid=5355): Launched 12:27:23.883629 run osmo-msc_10.42.42.6: Starting osmo-msc 12:27:24.479497 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5357): Launched 12:27:24.811697 run osmo-msc_10.42.42.6(pid=5358): Launched 12:27:24.997793 run osmo-stp_10.42.42.5(pid=5355): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5355)] 12:27:25.136913 run osmo-stp_10.42.42.5(pid=5355): stdout: | (launched: 2022-12-09_12:27:23.695726) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:25.276675 run osmo-stp_10.42.42.5(pid=5355): stderr: | 20221209122723885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122723885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122723885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122723886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122723886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122723886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122723886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:25.414544 run osmo-stp_10.42.42.5(pid=5355): stdout: | (launched: 2022-12-09_12:27:23.695726) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:25.546297 run osmo-stp_10.42.42.5(pid=5355): stderr: | 20221209122723885 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122723885 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122723885 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122723886 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122723886 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122723886 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122723886 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:25.703529 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5355): Process ended prematurely: osmo-stp_10.42.42.5(pid=5355) [trial-2359↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5355)] [trial-2359↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 12:27:25.713380 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 12:27:25.742313 run osmo-hlr_10.42.42.2(pid=5352): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5352)] 12:27:25.793184 run osmo-hlr_10.42.42.2(pid=5352): stdout: | (launched: 2022-12-09_12:27:22.665955) 12:27:25.845828 run osmo-hlr_10.42.42.2(pid=5352): stderr: | 20221209122722861 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122722861 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122722861 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122722861 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122722862 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122722862 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122722874 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122722884 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122722884 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122722884 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:25.919076 run osmo-msc_10.42.42.6(pid=5358): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5358)] 12:27:25.970157 run osmo-msc_10.42.42.6(pid=5358): stdout: | (launched: 2022-12-09_12:27:24.751027) 12:27:26.022583 run osmo-msc_10.42.42.6(pid=5358): stderr: | 20221209122725071 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122725071 DLGLOBAL DEBUG validating counter group 0x7fd949c61c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122725071 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122725071 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122725071 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122725071 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122725073 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122725073 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122725074 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122725074 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:27:26.075379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5351): Terminating (SIGTERM) 12:27:26.117919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5354): Terminating (SIGTERM) 12:27:26.160843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5357): Terminating (SIGTERM) 12:27:26.203841 --- ParallelTerminationStrategy: PID 5351 died... 12:27:26.224327 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5351): Terminated: ok {rc=0} 12:27:26.272019 --- ParallelTerminationStrategy: PID 5354 died... 12:27:26.291956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5354): Terminated: ok {rc=0} 12:27:26.339097 --- ParallelTerminationStrategy: PID 5357 died... 12:27:26.359058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5357): Terminated: ok {rc=0} 12:27:26.448646 bus /sierra_3: Setting Powered False 12:27:27.548757 bus /sierra_3: Setting Powered False 12:27:28.666605 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 12:27:29.818066 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:27:29.830900 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:27:29.882932 tst mo_mt_call_osmux.py: using LAC 21459 12:27:30.013139 tst mo_mt_call_osmux.py: using RAC 39 12:27:30.141996 tst mo_mt_call_osmux.py: using CellId 21459 12:27:30.262899 tst mo_mt_call_osmux.py: using BVCI 21460 12:27:30.373936 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:27:30.385401 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:27:30.396556 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:27:30.407823 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:27:30.419149 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 12:27:30.430354 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:27:30.553028 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 12:27:30.675271 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:27:31.204303 run create_hlr_db(pid=5360): Launched 12:27:31.373055 bus /sierra_2: Setting Powered False 12:27:32.438437 run create_hlr_db(pid=5360): Terminated: ok {rc=0} 12:27:32.899467 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5362): Launched 12:27:33.231642 run osmo-hlr_10.42.42.2(pid=5363): Launched 12:27:33.357446 run osmo-stp_10.42.42.5: Starting osmo-stp 12:27:33.925680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5365): Launched 12:27:34.260234 run osmo-stp_10.42.42.5(pid=5366): Launched 12:27:34.387686 run osmo-msc_10.42.42.6: Starting osmo-msc 12:27:34.983987 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5368): Launched 12:27:35.318829 run osmo-msc_10.42.42.6(pid=5369): Launched 12:27:35.505242 run osmo-stp_10.42.42.5(pid=5366): ERR: Terminated: ERROR {rc=1} [trial-2359↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5366)] 12:27:35.644458 run osmo-stp_10.42.42.5(pid=5366): stdout: | (launched: 2022-12-09_12:27:34.199029) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:35.785140 run osmo-stp_10.42.42.5(pid=5366): stderr: | 20221209122734390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122734390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122734391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122734391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122734391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122734392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122734392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:35.923099 run osmo-stp_10.42.42.5(pid=5366): stdout: | (launched: 2022-12-09_12:27:34.199029) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:36.044846 run osmo-stp_10.42.42.5(pid=5366): stderr: | 20221209122734390 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122734390 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122734391 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122734391 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122734391 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122734392 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122734392 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:36.191582 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5366): Process ended prematurely: osmo-stp_10.42.42.5(pid=5366) [trial-2359↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5366)] [trial-2359↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 12:27:36.200473 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 12:27:36.227211 run osmo-hlr_10.42.42.2(pid=5363): ERR: Terminated: ERROR {rc=237} [trial-2359↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5363)] 12:27:36.275292 run osmo-hlr_10.42.42.2(pid=5363): stdout: | (launched: 2022-12-09_12:27:33.170501) 12:27:36.325276 run osmo-hlr_10.42.42.2(pid=5363): stderr: | 20221209122733366 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122733367 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122733367 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122733367 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122733367 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122733367 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122733379 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122733387 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122733387 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122733388 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:36.394687 run osmo-msc_10.42.42.6(pid=5369): ERR: Terminated: ERROR {rc=2} [trial-2359↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5369)] 12:27:36.442665 run osmo-msc_10.42.42.6(pid=5369): stdout: | (launched: 2022-12-09_12:27:35.257487) 12:27:36.492177 run osmo-msc_10.42.42.6(pid=5369): stderr: | 20221209122735579 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122735579 DLGLOBAL DEBUG validating counter group 0x7f354abedc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122735579 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122735579 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122735579 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122735579 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122735581 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122735582 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122735582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122735582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:27:36.542155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5362): Terminating (SIGTERM) 12:27:36.582248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5365): Terminating (SIGTERM) 12:27:36.621943 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5368): Terminating (SIGTERM) 12:27:36.661961 --- ParallelTerminationStrategy: PID 5362 died... 12:27:36.681262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5362): Terminated: ok {rc=0} 12:27:36.725496 --- ParallelTerminationStrategy: PID 5365 died... 12:27:36.744043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5365): Terminated: ok {rc=0} 12:27:36.788328 --- ParallelTerminationStrategy: PID 5368 died... 12:27:36.807126 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5368): Terminated: ok {rc=0} 12:27:36.894200 bus /sierra_3: Setting Powered False 12:27:37.994789 bus /sierra_3: Setting Powered False 12:27:39.107817 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 emergency:nanobts+band-900 --------------------------------------------------------------------- 12:27:40.369077 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:27:40.374938 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 12:27:40.408802 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 12:27:40.436362 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 12:27:40.523269 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 12:27:40.556319 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 12:27:40.583354 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 12:27:41.169327 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2359 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 12:27:41.174586 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:27:41.185952 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 12:27:41.240643 tst emergency_mo_mt_call.py: using LAC 21460 12:27:41.366959 tst emergency_mo_mt_call.py: using RAC 40 12:27:41.493195 tst emergency_mo_mt_call.py: using CellId 21460 12:27:41.617356 tst emergency_mo_mt_call.py: using BVCI 21461 12:27:41.734374 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:27:41.745741 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:27:41.756689 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:27:41.768042 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:27:41.780004 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:27:41.791576 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:27:41.911324 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:27:42.027202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:27:42.498306 run create_hlr_db(pid=5377): Launched 12:27:42.624804 bus /sierra_2: Setting Powered False 12:27:43.685673 run create_hlr_db(pid=5377): Terminated: ok {rc=0} 12:27:44.134896 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5379): Launched 12:27:44.461419 run osmo-hlr_10.42.42.2(pid=5380): Launched 12:27:44.587678 run osmo-stp_10.42.42.5: Starting osmo-stp 12:27:45.150523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5382): Launched 12:27:45.475927 run osmo-stp_10.42.42.5(pid=5383): Launched 12:27:45.613516 tst emergency_mo_mt_call.py: using MSISDN 7203 12:27:45.782472 run osmo-msc_10.42.42.6: Starting osmo-msc 12:27:46.393731 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5385): Launched 12:27:46.711322 run osmo-msc_10.42.42.6(pid=5386): Launched 12:27:46.926082 run osmo-stp_10.42.42.5(pid=5383): ERR: Terminated: ERROR {rc=1} [trial-2359↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5383)] 12:27:47.074116 run osmo-stp_10.42.42.5(pid=5383): stdout: | (launched: 2022-12-09_12:27:45.415649) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:47.313842 run osmo-stp_10.42.42.5(pid=5383): stderr: | 20221209122745604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122745604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122745604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122745605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122745606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122745606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122745606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:47.451939 run osmo-stp_10.42.42.5(pid=5383): stdout: | (launched: 2022-12-09_12:27:45.415649) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:47.584128 run osmo-stp_10.42.42.5(pid=5383): stderr: | 20221209122745604 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122745604 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122745604 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122745605 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122745606 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122745606 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122745606 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:47.739132 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=5383): Process ended prematurely: osmo-stp_10.42.42.5(pid=5383) [trial-2359↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5383)] [trial-2359↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 12:27:47.748244 tst emergency_mo_mt_call.py:19: Test FAILED (6.6 sec) 12:27:47.776882 run osmo-hlr_10.42.42.2(pid=5380): ERR: Terminated: ERROR {rc=237} [trial-2359↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5380)] 12:27:47.827871 run osmo-hlr_10.42.42.2(pid=5380): stdout: | (launched: 2022-12-09_12:27:44.401289) 12:27:47.880580 run osmo-hlr_10.42.42.2(pid=5380): stderr: | 20221209122744596 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122744596 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122744596 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122744596 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122744596 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122744596 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122744609 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122744618 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122744618 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122744618 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:47.953917 run osmo-msc_10.42.42.6(pid=5386): ERR: Terminated: ERROR {rc=2} [trial-2359↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5386)] 12:27:48.004680 run osmo-msc_10.42.42.6(pid=5386): stdout: | (launched: 2022-12-09_12:27:46.652337) 12:27:48.057143 run osmo-msc_10.42.42.6(pid=5386): stderr: | 20221209122747284 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122747285 DLGLOBAL DEBUG validating counter group 0x7fbb710eac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122747285 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122747285 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122747285 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122747285 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122747287 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122747287 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122747288 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122747288 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:27:48.109992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5379): Terminating (SIGTERM) 12:27:48.152690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5382): Terminating (SIGTERM) 12:27:48.195737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5385): Terminating (SIGTERM) 12:27:48.238547 --- ParallelTerminationStrategy: PID 5379 died... 12:27:48.258720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5379): Terminated: ok {rc=0} 12:27:48.306039 --- ParallelTerminationStrategy: PID 5382 died... 12:27:48.325957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5382): Terminated: ok {rc=0} 12:27:48.373378 --- ParallelTerminationStrategy: PID 5385 died... 12:27:48.393521 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5385): Terminated: ok {rc=0} 12:27:48.483543 bus /sierra_3: Setting Powered False 12:27:49.583754 bus /sierra_3: Setting Powered False 12:27:50.704138 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 12:27:51.793399 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:27:51.805564 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 12:27:51.857566 tst emergency_preemptive_call.py: using LAC 21461 12:27:51.988109 tst emergency_preemptive_call.py: using RAC 41 12:27:52.115029 tst emergency_preemptive_call.py: using CellId 21461 12:27:52.243027 tst emergency_preemptive_call.py: using BVCI 21462 12:27:52.361023 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:27:52.372536 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:27:52.383861 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:27:52.395437 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:27:52.406749 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 12:27:52.418394 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:27:52.537023 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:27:52.659115 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:27:52.777139 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 12:27:52.894433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:27:53.367544 run create_hlr_db(pid=5388): Launched 12:27:53.491680 bus /sierra_2: Setting Powered False 12:27:54.552865 run create_hlr_db(pid=5388): Terminated: ok {rc=0} 12:27:55.000339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5390): Launched 12:27:55.329731 run osmo-hlr_10.42.42.2(pid=5391): Launched 12:27:55.453846 run osmo-stp_10.42.42.5: Starting osmo-stp 12:27:56.019085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5393): Launched 12:27:56.344284 run osmo-stp_10.42.42.5(pid=5394): Launched 12:27:56.482576 tst emergency_preemptive_call.py: using MSISDN 7204 12:27:56.648836 run osmo-msc_10.42.42.6: Starting osmo-msc 12:27:57.232067 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5396): Launched 12:27:57.560743 run osmo-msc_10.42.42.6(pid=5397): Launched 12:27:57.742589 run osmo-stp_10.42.42.5(pid=5394): ERR: Terminated: ERROR {rc=1} [trial-2359↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5394)] 12:27:57.879627 run osmo-stp_10.42.42.5(pid=5394): stdout: | (launched: 2022-12-09_12:27:56.284051) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:58.017651 run osmo-stp_10.42.42.5(pid=5394): stderr: | 20221209122756470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122756470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122756471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122756471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122756472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122756472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122756472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:58.153205 run osmo-stp_10.42.42.5(pid=5394): stdout: | (launched: 2022-12-09_12:27:56.284051) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:27:58.282322 run osmo-stp_10.42.42.5(pid=5394): stderr: | 20221209122756470 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122756470 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122756471 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122756471 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122756472 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122756472 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122756472 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:27:58.436797 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=5394): Process ended prematurely: osmo-stp_10.42.42.5(pid=5394) [trial-2359↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5394)] [trial-2359↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 12:27:58.446101 tst emergency_preemptive_call.py:32: Test FAILED (6.6 sec) 12:27:58.474936 run osmo-hlr_10.42.42.2(pid=5391): ERR: Terminated: ERROR {rc=237} [trial-2359↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5391)] 12:27:58.525710 run osmo-hlr_10.42.42.2(pid=5391): stdout: | (launched: 2022-12-09_12:27:55.269385) 12:27:58.578270 run osmo-hlr_10.42.42.2(pid=5391): stderr: | 20221209122755463 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122755463 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122755463 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122755463 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122755463 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122755463 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122755476 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122755486 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122755487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122755487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:27:58.651633 run osmo-msc_10.42.42.6(pid=5397): ERR: Terminated: ERROR {rc=2} [trial-2359↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5397)] 12:27:58.702045 run osmo-msc_10.42.42.6(pid=5397): stdout: | (launched: 2022-12-09_12:27:57.500492) 12:27:58.754431 run osmo-msc_10.42.42.6(pid=5397): stderr: | 20221209122757819 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209122757819 DLGLOBAL DEBUG validating counter group 0x7f180155ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209122757820 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209122757820 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209122757820 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209122757820 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209122757822 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209122757822 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209122757822 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209122757822 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:27:58.807431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5390): Terminating (SIGTERM) 12:27:58.849889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5393): Terminating (SIGTERM) 12:27:58.893069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5396): Terminating (SIGTERM) 12:27:58.936049 --- ParallelTerminationStrategy: PID 5390 died... 12:27:58.956315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5390): Terminated: ok {rc=0} 12:27:59.003682 --- ParallelTerminationStrategy: PID 5393 died... 12:27:59.023618 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5393): Terminated: ok {rc=0} 12:27:59.070743 --- ParallelTerminationStrategy: PID 5396 died... 12:27:59.090718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5396): Terminated: ok {rc=0} 12:27:59.179162 bus /sierra_9: Setting Powered False 12:28:00.279766 bus /sierra_9: Setting Powered False 12:28:01.397773 bus /sierra_8: Setting Powered False 12:28:02.499505 bus /sierra_8: Setting Powered False 12:28:03.617308 bus /sierra_3: Setting Powered False 12:28:04.714830 bus /sierra_3: Setting Powered False 12:28:05.834121 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:nanobts+band-900 --------------------------------------------------------------------- 12:28:07.114786 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:28:07.120084 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 12:28:07.152649 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 12:28:07.191044 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 12:28:07.283918 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 12:28:07.317432 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 12:28:07.356017 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 12:28:07.940284 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 12:28:07.991162 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:08.002305 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 12:28:08.048780 tst cs_paging_gprs_active.py: using LAC 21462 12:28:08.168733 tst cs_paging_gprs_active.py: using RAC 42 12:28:08.289423 tst cs_paging_gprs_active.py: using CellId 21462 12:28:08.411533 tst cs_paging_gprs_active.py: using BVCI 21463 12:28:08.523831 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:08.534709 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:08.545376 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:08.556085 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:08.566766 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:08.577394 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:08.588225 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:08.599133 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:08.610197 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:28:08.732229 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:28:08.856918 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:28:09.081438 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:28:09.415447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5402): Launched 12:28:09.705682 run iperf3-srv_10.42.42.10(pid=5403): Launched 12:28:09.831603 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:28:10.056294 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:28:10.391227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5404): Launched 12:28:10.681210 run iperf3-srv_10.42.42.10(pid=5405): Launched 12:28:10.805727 tst cs_paging_gprs_active.py:38: start network... 12:28:11.028593 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:28:11.542812 run create_hlr_db(pid=5406): Launched 12:28:11.669818 bus /sierra_2: Setting Powered False 12:28:12.734603 run create_hlr_db(pid=5406): Terminated: ok {rc=0} 12:28:13.177441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5408): Launched 12:28:13.491853 run osmo-hlr_10.42.42.2(pid=5409): Launched 12:28:13.612376 run osmo-stp_10.42.42.5: Starting osmo-stp 12:28:14.159522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5411): Launched 12:28:14.471290 run osmo-stp_10.42.42.5(pid=5412): Launched 12:28:14.592076 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:28:15.124820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5414): Launched 12:28:15.243225 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:28:15.505396 run patchelf(pid=5415): Launched 12:28:15.679876 run osmo-stp_10.42.42.5(pid=5412): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5412)] 12:28:15.810797 run osmo-stp_10.42.42.5(pid=5412): stdout: | (launched: 2022-12-09_12:28:14.413483) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:15.984224 run osmo-stp_10.42.42.5(pid=5412): stderr: | 20221209122814582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122814583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122814583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122814583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122814584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122814584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122814584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:16.133527 run osmo-stp_10.42.42.5(pid=5412): stdout: | (launched: 2022-12-09_12:28:14.413483) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:16.274796 run osmo-stp_10.42.42.5(pid=5412): stderr: | 20221209122814582 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122814583 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122814583 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122814583 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122814584 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122814584 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122814584 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:16.444102 run patchelf(pid=5415): Terminating (SIGINT) 12:28:16.641058 run patchelf(pid=5415): Terminated: ok {rc=0} 12:28:16.781535 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5412): Process ended prematurely: osmo-stp_10.42.42.5(pid=5412) [trial-2359↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5412)] [trial-2359↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 12:28:16.794080 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 12:28:16.826793 run osmo-hlr_10.42.42.2(pid=5409): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5409)] 12:28:16.881501 run osmo-hlr_10.42.42.2(pid=5409): stdout: | (launched: 2022-12-09_12:28:13.433429) 12:28:16.937989 run osmo-hlr_10.42.42.2(pid=5409): stderr: | 20221209122813608 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122813608 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122813608 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122813608 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122813608 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122813608 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122813623 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122813632 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122813633 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122813633 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:28:16.993784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5402): Terminating (SIGTERM) 12:28:17.038668 run iperf3-srv_10.42.42.10(pid=5403): Terminating (SIGTERM) 12:28:17.083651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5404): Terminating (SIGTERM) 12:28:17.128738 run iperf3-srv_10.42.42.10(pid=5405): Terminating (SIGTERM) 12:28:17.171288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5408): Terminating (SIGTERM) 12:28:17.213747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5411): Terminating (SIGTERM) 12:28:17.256750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5414): Terminating (SIGTERM) 12:28:17.299665 --- ParallelTerminationStrategy: PID 5402 died... 12:28:17.319855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5402): Terminated: ok {rc=0} 12:28:17.367531 --- ParallelTerminationStrategy: PID 5403 died... 12:28:17.387414 run iperf3-srv_10.42.42.10(pid=5403): Terminated {rc=256} 12:28:17.434385 --- ParallelTerminationStrategy: PID 5404 died... 12:28:17.454265 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5404): Terminated: ok {rc=0} 12:28:17.501840 --- ParallelTerminationStrategy: PID 5405 died... 12:28:17.521662 run iperf3-srv_10.42.42.10(pid=5405): Terminated {rc=256} 12:28:17.568821 --- ParallelTerminationStrategy: PID 5408 died... 12:28:17.588699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5408): Terminated: ok {rc=0} 12:28:17.635840 --- ParallelTerminationStrategy: PID 5411 died... 12:28:17.655680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5411): Terminated: ok {rc=0} 12:28:17.702761 --- ParallelTerminationStrategy: PID 5414 died... 12:28:17.722681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5414): Terminated: ok {rc=0} 12:28:17.812124 bus /gobi_0: Setting Powered False 12:28:18.913305 bus /gobi_0: Setting Powered False 12:28:20.030722 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 12:28:21.180840 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:21.193047 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 12:28:21.245725 tst iperf3.py: using LAC 21463 12:28:21.368118 tst iperf3.py: using RAC 43 12:28:21.491865 tst iperf3.py: using CellId 21463 12:28:21.615212 tst iperf3.py: using BVCI 21464 12:28:21.729573 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:21.740491 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:21.751201 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:21.761903 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:21.772365 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:21.782822 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:21.793799 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:21.804445 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:21.815023 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:28:21.934112 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:28:22.141125 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:28:22.451929 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5416): Launched 12:28:22.723356 run iperf3-srv_10.42.42.10(pid=5417): Launched 12:28:22.840203 tst iperf3.py:8: start network... 12:28:23.046895 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:28:23.527482 run create_hlr_db(pid=5418): Launched 12:28:23.654819 bus /gobi_6: Setting Powered False 12:28:24.717059 run create_hlr_db(pid=5418): Terminated: ok {rc=0} 12:28:25.149436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5420): Launched 12:28:25.460868 run osmo-hlr_10.42.42.2(pid=5421): Launched 12:28:25.579304 run osmo-stp_10.42.42.5: Starting osmo-stp 12:28:26.131180 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5423): Launched 12:28:26.441697 run osmo-stp_10.42.42.5(pid=5424): Launched 12:28:26.559019 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:28:27.091260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5426): Launched 12:28:27.211064 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:28:27.471799 run patchelf(pid=5427): Launched 12:28:27.645974 run osmo-stp_10.42.42.5(pid=5424): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5424)] 12:28:27.776653 run osmo-stp_10.42.42.5(pid=5424): stdout: | (launched: 2022-12-09_12:28:26.384098) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:27.908682 run osmo-stp_10.42.42.5(pid=5424): stderr: | 20221209122826555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122826555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122826556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122826556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122826556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122826557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122826557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:28.040595 run osmo-stp_10.42.42.5(pid=5424): stdout: | (launched: 2022-12-09_12:28:26.384098) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:28.167105 run osmo-stp_10.42.42.5(pid=5424): stderr: | 20221209122826555 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122826555 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122826556 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122826556 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122826556 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122826557 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122826557 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:28.316788 run patchelf(pid=5427): Terminating (SIGINT) 12:28:28.491874 run patchelf(pid=5427): Terminated: ok {rc=0} 12:28:28.618498 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5424): Process ended prematurely: osmo-stp_10.42.42.5(pid=5424) [trial-2359↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5424)] [trial-2359↪gprs:nanobts+band-900↪iperf3.py:8] 12:28:28.628007 tst iperf3.py:8: Test FAILED (7.5 sec) 12:28:28.655361 run osmo-hlr_10.42.42.2(pid=5421): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5421)] 12:28:28.702761 run osmo-hlr_10.42.42.2(pid=5421): stdout: | (launched: 2022-12-09_12:28:25.402909) 12:28:28.752069 run osmo-hlr_10.42.42.2(pid=5421): stderr: | 20221209122825580 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122825580 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122825581 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122825581 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122825581 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122825581 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122825593 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122825601 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122825601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122825601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:28:28.801909 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5416): Terminating (SIGTERM) 12:28:28.841939 run iperf3-srv_10.42.42.10(pid=5417): Terminating (SIGTERM) 12:28:28.881678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5420): Terminating (SIGTERM) 12:28:28.921590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5423): Terminating (SIGTERM) 12:28:28.961459 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5426): Terminating (SIGTERM) 12:28:29.001508 --- ParallelTerminationStrategy: PID 5416 died... 12:28:29.020746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5416): Terminated: ok {rc=0} 12:28:29.064818 --- ParallelTerminationStrategy: PID 5417 died... 12:28:29.084104 run iperf3-srv_10.42.42.10(pid=5417): Terminated {rc=256} 12:28:29.128040 --- ParallelTerminationStrategy: PID 5420 died... 12:28:29.146895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5420): Terminated: ok {rc=0} 12:28:29.190746 --- ParallelTerminationStrategy: PID 5423 died... 12:28:29.209492 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5423): Terminated: ok {rc=0} 12:28:29.253513 --- ParallelTerminationStrategy: PID 5426 died... 12:28:29.272277 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5426): Terminated: ok {rc=0} 12:28:29.356382 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 12:28:30.499462 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:30.511358 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 12:28:30.559645 tst iperf3m4.py: using LAC 21464 12:28:30.683314 tst iperf3m4.py: using RAC 44 12:28:30.808931 tst iperf3m4.py: using CellId 21464 12:28:30.949006 tst iperf3m4.py: using BVCI 21465 12:28:31.073426 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:31.085903 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:31.099121 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:31.111195 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:31.125102 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:31.139115 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:31.151305 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:31.164089 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:31.177334 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:28:31.305781 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:28:31.445105 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:28:31.564384 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:28:31.705148 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:28:31.950693 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:28:32.266775 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5429): Launched 12:28:32.568661 run iperf3-srv_10.42.42.10(pid=5430): Launched 12:28:32.695314 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:28:32.918273 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:28:33.251314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5431): Launched 12:28:33.544140 run iperf3-srv_10.42.42.10(pid=5432): Launched 12:28:33.671346 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:28:33.894727 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:28:34.227665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5433): Launched 12:28:34.519454 run iperf3-srv_10.42.42.10(pid=5434): Launched 12:28:34.646142 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:28:34.868764 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:28:35.201306 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5435): Launched 12:28:35.492573 run iperf3-srv_10.42.42.10(pid=5436): Launched 12:28:35.619824 tst iperf3m4.py:8: start network... 12:28:35.843183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:28:36.358077 run create_hlr_db(pid=5437): Launched 12:28:36.485539 bus /gobi_6: Setting Powered False 12:28:37.550518 run create_hlr_db(pid=5437): Terminated: ok {rc=0} 12:28:38.013693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5439): Launched 12:28:38.349630 run osmo-hlr_10.42.42.2(pid=5440): Launched 12:28:38.477597 run osmo-stp_10.42.42.5: Starting osmo-stp 12:28:39.054357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5442): Launched 12:28:39.390008 run osmo-stp_10.42.42.5(pid=5443): Launched 12:28:39.517477 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:28:40.089726 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5445): Launched 12:28:40.218706 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:28:40.499533 run patchelf(pid=5446): Launched 12:28:40.685202 run osmo-stp_10.42.42.5(pid=5443): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5443)] 12:28:40.825290 run osmo-stp_10.42.42.5(pid=5443): stdout: | (launched: 2022-12-09_12:28:39.328019) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:40.966952 run osmo-stp_10.42.42.5(pid=5443): stderr: | 20221209122839517 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122839517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122839518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122839518 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122839519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122839519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122839519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:41.108243 run osmo-stp_10.42.42.5(pid=5443): stdout: | (launched: 2022-12-09_12:28:39.328019) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:41.244227 run osmo-stp_10.42.42.5(pid=5443): stderr: | 20221209122839517 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122839517 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122839518 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122839518 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122839519 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122839519 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122839519 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:41.405335 run patchelf(pid=5446): Terminating (SIGINT) 12:28:41.593636 run patchelf(pid=5446): Terminated: ok {rc=0} 12:28:41.729457 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5443): Process ended prematurely: osmo-stp_10.42.42.5(pid=5443) [trial-2359↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5443)] [trial-2359↪gprs:nanobts+band-900↪iperf3m4.py:8] 12:28:41.739716 tst iperf3m4.py:8: Test FAILED (11.3 sec) 12:28:41.769595 run osmo-hlr_10.42.42.2(pid=5440): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5440)] 12:28:41.820330 run osmo-hlr_10.42.42.2(pid=5440): stdout: | (launched: 2022-12-09_12:28:38.287595) 12:28:41.872597 run osmo-hlr_10.42.42.2(pid=5440): stderr: | 20221209122838483 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122838483 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122838483 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122838483 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122838483 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122838483 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122838495 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122838504 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122838504 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122838504 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:28:41.925986 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5429): Terminating (SIGTERM) 12:28:41.968227 run iperf3-srv_10.42.42.10(pid=5430): Terminating (SIGTERM) 12:28:42.010652 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5431): Terminating (SIGTERM) 12:28:42.053060 run iperf3-srv_10.42.42.10(pid=5432): Terminating (SIGTERM) 12:28:42.095149 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5433): Terminating (SIGTERM) 12:28:42.137224 run iperf3-srv_10.42.42.10(pid=5434): Terminating (SIGTERM) 12:28:42.179171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5435): Terminating (SIGTERM) 12:28:42.221159 run iperf3-srv_10.42.42.10(pid=5436): Terminating (SIGTERM) 12:28:42.263100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5439): Terminating (SIGTERM) 12:28:42.305321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5442): Terminating (SIGTERM) 12:28:42.347500 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5445): Terminating (SIGTERM) 12:28:42.389997 --- ParallelTerminationStrategy: PID 5429 died... 12:28:42.410239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5429): Terminated: ok {rc=0} 12:28:42.457344 --- ParallelTerminationStrategy: PID 5430 died... 12:28:42.476995 run iperf3-srv_10.42.42.10(pid=5430): Terminated {rc=256} 12:28:42.524044 --- ParallelTerminationStrategy: PID 5431 died... 12:28:42.543865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5431): Terminated: ok {rc=0} 12:28:42.590581 --- ParallelTerminationStrategy: PID 5432 died... 12:28:42.610230 run iperf3-srv_10.42.42.10(pid=5432): Terminated {rc=256} 12:28:42.656751 --- ParallelTerminationStrategy: PID 5433 died... 12:28:42.676463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5433): Terminated: ok {rc=0} 12:28:42.723197 --- ParallelTerminationStrategy: PID 5434 died... 12:28:42.742848 run iperf3-srv_10.42.42.10(pid=5434): Terminated {rc=256} 12:28:42.789387 --- ParallelTerminationStrategy: PID 5435 died... 12:28:42.809080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5435): Terminated: ok {rc=0} 12:28:42.856193 --- ParallelTerminationStrategy: PID 5436 died... 12:28:42.875899 run iperf3-srv_10.42.42.10(pid=5436): Terminated {rc=256} 12:28:42.922524 --- ParallelTerminationStrategy: PID 5439 died... 12:28:42.942208 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5439): Terminated: ok {rc=0} 12:28:42.988734 --- ParallelTerminationStrategy: PID 5442 died... 12:28:43.008408 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5442): Terminated: ok {rc=0} 12:28:43.055166 --- ParallelTerminationStrategy: PID 5445 died... 12:28:43.074961 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5445): Terminated: ok {rc=0} 12:28:43.163764 bus /gobi_4: Setting Powered False 12:28:44.262574 bus /gobi_4: Setting Powered False 12:28:45.379113 bus /gobi_1: Setting Powered False 12:28:46.484761 bus /gobi_1: Setting Powered False 12:28:47.604728 bus /gobi_0: Setting Powered False 12:28:48.703585 bus /gobi_0: Setting Powered False 12:28:49.822088 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-900 ping.py ---------------------------------------------- 12:28:50.925798 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:50.937787 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 12:28:50.991118 tst ping.py: using LAC 21465 12:28:51.118675 tst ping.py: using RAC 45 12:28:51.243639 tst ping.py: using CellId 21465 12:28:51.370990 tst ping.py: using BVCI 21466 12:28:51.490264 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:51.501864 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:51.512867 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:51.524126 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:51.535317 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:51.546753 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:51.557901 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:51.569886 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:28:51.686586 tst ping.py:19: start network... 12:28:51.904889 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:28:52.406008 run create_hlr_db(pid=5447): Launched 12:28:52.531210 bus /gobi_6: Setting Powered False 12:28:53.595603 run create_hlr_db(pid=5447): Terminated: ok {rc=0} 12:28:54.032422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5449): Launched 12:28:54.337668 run osmo-hlr_10.42.42.2(pid=5450): Launched 12:28:54.454294 run osmo-stp_10.42.42.5: Starting osmo-stp 12:28:54.983869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5452): Launched 12:28:55.289471 run osmo-stp_10.42.42.5(pid=5453): Launched 12:28:55.406955 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:28:55.935859 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5455): Launched 12:28:56.054492 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:28:56.311861 run patchelf(pid=5456): Launched 12:28:56.484285 run osmo-stp_10.42.42.5(pid=5453): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5453)] 12:28:56.614325 run osmo-stp_10.42.42.5(pid=5453): stdout: | (launched: 2022-12-09_12:28:55.232773) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:56.744437 run osmo-stp_10.42.42.5(pid=5453): stderr: | 20221209122855402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122855402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122855403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122855403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122855404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122855404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122855404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:56.875020 run osmo-stp_10.42.42.5(pid=5453): stdout: | (launched: 2022-12-09_12:28:55.232773) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:28:56.999600 run osmo-stp_10.42.42.5(pid=5453): stderr: | 20221209122855402 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122855402 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122855403 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122855403 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122855404 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122855404 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122855404 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:28:57.146991 run patchelf(pid=5456): Terminating (SIGINT) 12:28:57.319758 run patchelf(pid=5456): Terminated: ok {rc=0} 12:28:57.444219 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5453): Process ended prematurely: osmo-stp_10.42.42.5(pid=5453) [trial-2359↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5453)] [trial-2359↪gprs:nanobts+band-900↪ping.py:22] 12:28:57.453396 tst ping.py:22: Test FAILED (6.5 sec) 12:28:57.480756 run osmo-hlr_10.42.42.2(pid=5450): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5450)] 12:28:57.528835 run osmo-hlr_10.42.42.2(pid=5450): stdout: | (launched: 2022-12-09_12:28:54.280401) 12:28:57.578635 run osmo-hlr_10.42.42.2(pid=5450): stderr: | 20221209122854453 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122854453 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122854453 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122854453 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122854453 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122854453 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122854466 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122854474 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122854474 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122854474 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:28:57.629084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5449): Terminating (SIGTERM) 12:28:57.669257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5452): Terminating (SIGTERM) 12:28:57.709947 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5455): Terminating (SIGTERM) 12:28:57.750784 --- ParallelTerminationStrategy: PID 5449 died... 12:28:57.769812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5449): Terminated: ok {rc=0} 12:28:57.814484 --- ParallelTerminationStrategy: PID 5452 died... 12:28:57.833371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5452): Terminated: ok {rc=0} 12:28:57.878459 --- ParallelTerminationStrategy: PID 5455 died... 12:28:57.897452 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5455): Terminated: ok {rc=0} 12:28:57.984200 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 12:28:59.073035 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:59.084601 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 12:28:59.138916 tst ping_idle_ping.py: using LAC 21466 12:28:59.258690 tst ping_idle_ping.py: using RAC 46 12:28:59.378359 tst ping_idle_ping.py: using CellId 21466 12:28:59.497812 tst ping_idle_ping.py: using BVCI 21467 12:28:59.619377 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:59.630739 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:59.641911 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:59.653108 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:59.664346 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:59.675690 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:59.687220 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 12:28:59.698686 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 12:28:59.816879 tst ping_idle_ping.py:24: start network... 12:29:00.021183 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:00.495584 run create_hlr_db(pid=5457): Launched 12:29:00.622518 bus /gobi_6: Setting Powered False 12:29:01.691443 run create_hlr_db(pid=5457): Terminated: ok {rc=0} 12:29:02.175305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5459): Launched 12:29:02.495496 run osmo-hlr_10.42.42.2(pid=5460): Launched 12:29:02.613445 run osmo-stp_10.42.42.5: Starting osmo-stp 12:29:03.138257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5462): Launched 12:29:03.443993 run osmo-stp_10.42.42.5(pid=5463): Launched 12:29:03.561274 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:29:04.086227 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5465): Launched 12:29:04.205429 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:29:04.463412 run patchelf(pid=5466): Launched 12:29:04.634234 run osmo-stp_10.42.42.5(pid=5463): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5463)] 12:29:04.763548 run osmo-stp_10.42.42.5(pid=5463): stdout: | (launched: 2022-12-09_12:29:03.387060) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:04.893689 run osmo-stp_10.42.42.5(pid=5463): stderr: | 20221209122903556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122903556 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122903557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122903557 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122903558 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122903558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122903558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:05.023736 run osmo-stp_10.42.42.5(pid=5463): stdout: | (launched: 2022-12-09_12:29:03.387060) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:05.148205 run osmo-stp_10.42.42.5(pid=5463): stderr: | 20221209122903556 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122903556 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122903557 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122903557 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122903558 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122903558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122903558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:05.295429 run patchelf(pid=5466): Terminating (SIGINT) 12:29:05.468477 run patchelf(pid=5466): Terminated: ok {rc=0} 12:29:05.593571 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5463): Process ended prematurely: osmo-stp_10.42.42.5(pid=5463) [trial-2359↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5463)] [trial-2359↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 12:29:05.602436 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 12:29:05.629683 run osmo-hlr_10.42.42.2(pid=5460): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5460)] 12:29:05.677701 run osmo-hlr_10.42.42.2(pid=5460): stdout: | (launched: 2022-12-09_12:29:02.438506) 12:29:05.728263 run osmo-hlr_10.42.42.2(pid=5460): stderr: | 20221209122902615 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122902615 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122902615 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122902615 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122902615 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122902615 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122902628 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122902638 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122902638 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122902638 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:05.778703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5459): Terminating (SIGTERM) 12:29:05.818957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5462): Terminating (SIGTERM) 12:29:05.858798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5465): Terminating (SIGTERM) 12:29:05.898987 --- ParallelTerminationStrategy: PID 5459 died... 12:29:05.918287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5459): Terminated: ok {rc=0} 12:29:05.962865 --- ParallelTerminationStrategy: PID 5462 died... 12:29:05.981911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5462): Terminated: ok {rc=0} 12:29:06.026561 --- ParallelTerminationStrategy: PID 5465 died... 12:29:06.045557 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5465): Terminated: ok {rc=0} 12:29:06.132258 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 12:29:07.434183 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:29:07.442309 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 12:29:07.478138 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 12:29:07.518929 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 12:29:07.609301 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 12:29:07.643142 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 12:29:07.683580 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 12:29:08.285254 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 12:29:08.339819 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:08.351444 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:29:08.402687 tst cs_paging_gprs_active.py: using LAC 21467 12:29:08.533194 tst cs_paging_gprs_active.py: using RAC 47 12:29:08.665828 tst cs_paging_gprs_active.py: using CellId 21467 12:29:08.787964 tst cs_paging_gprs_active.py: using BVCI 21468 12:29:08.901833 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:08.913085 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:08.923906 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:08.934970 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:08.945906 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:08.956702 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:08.967611 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:08.978367 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:08.989650 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:29:09.111069 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:29:09.230604 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:29:09.440312 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:29:09.753210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5471): Launched 12:29:10.024890 run iperf3-srv_10.42.42.10(pid=5472): Launched 12:29:10.141924 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:29:10.349505 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:29:10.660545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5473): Launched 12:29:10.931605 run iperf3-srv_10.42.42.10(pid=5474): Launched 12:29:11.048287 tst cs_paging_gprs_active.py:38: start network... 12:29:11.254876 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:11.735521 run create_hlr_db(pid=5475): Launched 12:29:11.863601 bus /gobi_6: Setting Powered False 12:29:12.926054 run create_hlr_db(pid=5475): Terminated: ok {rc=0} 12:29:13.379303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5477): Launched 12:29:13.712690 run osmo-hlr_10.42.42.2(pid=5478): Launched 12:29:13.841591 run osmo-stp_10.42.42.5: Starting osmo-stp 12:29:14.413015 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5480): Launched 12:29:14.748070 run osmo-stp_10.42.42.5(pid=5481): Launched 12:29:14.877351 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:29:15.450902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5483): Launched 12:29:15.580174 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:29:15.877537 run patchelf(pid=5484): Launched 12:29:16.079036 run osmo-stp_10.42.42.5(pid=5481): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5481)] 12:29:16.214816 run osmo-stp_10.42.42.5(pid=5481): stdout: | (launched: 2022-12-09_12:29:14.686669) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:16.352340 run osmo-stp_10.42.42.5(pid=5481): stderr: | 20221209122914877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122914877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122914877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122914878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122914878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122914878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122914878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:16.488509 run osmo-stp_10.42.42.5(pid=5481): stdout: | (launched: 2022-12-09_12:29:14.686669) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:16.620801 run osmo-stp_10.42.42.5(pid=5481): stderr: | 20221209122914877 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122914877 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122914877 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122914878 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122914878 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122914878 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122914878 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:16.777581 run patchelf(pid=5484): Terminating (SIGINT) 12:29:16.960356 run patchelf(pid=5484): Terminated: ok {rc=0} 12:29:17.091064 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5481): Process ended prematurely: osmo-stp_10.42.42.5(pid=5481) [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5481)] [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 12:29:17.101518 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 12:29:17.131308 run osmo-hlr_10.42.42.2(pid=5478): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5478)] 12:29:17.180313 run osmo-hlr_10.42.42.2(pid=5478): stdout: | (launched: 2022-12-09_12:29:13.651265) 12:29:17.230837 run osmo-hlr_10.42.42.2(pid=5478): stderr: | 20221209122913849 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122913849 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122913850 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122913850 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122913850 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122913850 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122913861 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122913870 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122913870 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122913870 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:17.281224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5471): Terminating (SIGTERM) 12:29:17.321889 run iperf3-srv_10.42.42.10(pid=5472): Terminating (SIGTERM) 12:29:17.362344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5473): Terminating (SIGTERM) 12:29:17.402729 run iperf3-srv_10.42.42.10(pid=5474): Terminating (SIGTERM) 12:29:17.443136 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5477): Terminating (SIGTERM) 12:29:17.483495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5480): Terminating (SIGTERM) 12:29:17.524043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5483): Terminating (SIGTERM) 12:29:17.565073 --- ParallelTerminationStrategy: PID 5471 died... 12:29:17.584257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5471): Terminated: ok {rc=0} 12:29:17.629089 --- ParallelTerminationStrategy: PID 5472 died... 12:29:17.648012 run iperf3-srv_10.42.42.10(pid=5472): Terminated {rc=256} 12:29:17.692568 --- ParallelTerminationStrategy: PID 5473 died... 12:29:17.711637 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5473): Terminated: ok {rc=0} 12:29:17.756124 --- ParallelTerminationStrategy: PID 5474 died... 12:29:17.775095 run iperf3-srv_10.42.42.10(pid=5474): Terminated {rc=256} 12:29:17.819566 --- ParallelTerminationStrategy: PID 5477 died... 12:29:17.838626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5477): Terminated: ok {rc=0} 12:29:17.883658 --- ParallelTerminationStrategy: PID 5480 died... 12:29:17.902928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5480): Terminated: ok {rc=0} 12:29:17.948153 --- ParallelTerminationStrategy: PID 5483 died... 12:29:17.967237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5483): Terminated: ok {rc=0} 12:29:18.052312 bus /gobi_0: Setting Powered False 12:29:19.151504 bus /gobi_0: Setting Powered False 12:29:20.267529 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 12:29:21.418328 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:21.430493 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:29:21.484427 tst iperf3.py: using LAC 21468 12:29:21.616691 tst iperf3.py: using RAC 48 12:29:21.748551 tst iperf3.py: using CellId 21468 12:29:21.878442 tst iperf3.py: using BVCI 21469 12:29:21.999716 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:22.011315 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:22.022596 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:22.034173 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:22.045600 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:22.057004 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:22.068728 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:22.080379 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:22.092231 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:29:22.213752 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:29:22.437933 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:29:22.772546 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5485): Launched 12:29:23.065233 run iperf3-srv_10.42.42.10(pid=5486): Launched 12:29:23.192025 tst iperf3.py:8: start network... 12:29:23.416494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:23.932625 run create_hlr_db(pid=5487): Launched 12:29:24.059587 bus /gobi_6: Setting Powered False 12:29:25.124731 run create_hlr_db(pid=5487): Terminated: ok {rc=0} 12:29:25.570329 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5489): Launched 12:29:25.883606 run osmo-hlr_10.42.42.2(pid=5490): Launched 12:29:26.002248 run osmo-stp_10.42.42.5: Starting osmo-stp 12:29:26.540931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5492): Launched 12:29:26.853714 run osmo-stp_10.42.42.5(pid=5493): Launched 12:29:26.971347 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:29:27.508765 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5495): Launched 12:29:27.628802 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:29:27.890781 run patchelf(pid=5496): Launched 12:29:28.066129 run osmo-stp_10.42.42.5(pid=5493): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5493)] 12:29:28.197239 run osmo-stp_10.42.42.5(pid=5493): stdout: | (launched: 2022-12-09_12:29:26.795847) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:28.329330 run osmo-stp_10.42.42.5(pid=5493): stderr: | 20221209122926967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122926968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122926968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122926968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122926969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122926969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122926969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:28.461376 run osmo-stp_10.42.42.5(pid=5493): stdout: | (launched: 2022-12-09_12:29:26.795847) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:28.587764 run osmo-stp_10.42.42.5(pid=5493): stderr: | 20221209122926967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122926968 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122926968 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122926968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122926969 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122926969 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122926969 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:28.737835 run patchelf(pid=5496): Terminating (SIGINT) 12:29:28.912869 run patchelf(pid=5496): Terminated: ok {rc=0} 12:29:29.039283 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5493): Process ended prematurely: osmo-stp_10.42.42.5(pid=5493) [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5493)] [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 12:29:29.048661 tst iperf3.py:8: Test FAILED (7.7 sec) 12:29:29.076121 run osmo-hlr_10.42.42.2(pid=5490): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5490)] 12:29:29.124070 run osmo-hlr_10.42.42.2(pid=5490): stdout: | (launched: 2022-12-09_12:29:25.825491) 12:29:29.173441 run osmo-hlr_10.42.42.2(pid=5490): stderr: | 20221209122926001 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122926001 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122926001 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122926001 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122926001 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122926001 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122926014 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122926024 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122926024 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122926024 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:29.223103 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5485): Terminating (SIGTERM) 12:29:29.263031 run iperf3-srv_10.42.42.10(pid=5486): Terminating (SIGTERM) 12:29:29.304452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5489): Terminating (SIGTERM) 12:29:29.345225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5492): Terminating (SIGTERM) 12:29:29.385607 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5495): Terminating (SIGTERM) 12:29:29.426223 --- ParallelTerminationStrategy: PID 5485 died... 12:29:29.445521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5485): Terminated: ok {rc=0} 12:29:29.489909 --- ParallelTerminationStrategy: PID 5486 died... 12:29:29.508540 run iperf3-srv_10.42.42.10(pid=5486): Terminated {rc=256} 12:29:29.552310 --- ParallelTerminationStrategy: PID 5489 died... 12:29:29.571215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5489): Terminated: ok {rc=0} 12:29:29.615017 --- ParallelTerminationStrategy: PID 5492 died... 12:29:29.633668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5492): Terminated: ok {rc=0} 12:29:29.677495 --- ParallelTerminationStrategy: PID 5495 died... 12:29:29.696340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5495): Terminated: ok {rc=0} 12:29:29.782293 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 12:29:30.955461 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:30.968567 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:29:31.027119 tst iperf3m4.py: using LAC 21469 12:29:31.152909 tst iperf3m4.py: using RAC 49 12:29:31.277888 tst iperf3m4.py: using CellId 21469 12:29:31.413496 tst iperf3m4.py: using BVCI 21470 12:29:31.544591 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:31.557394 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:31.570002 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:31.584653 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:31.598109 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:31.610895 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:31.623996 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:31.638449 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:31.652044 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:29:31.781525 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:29:31.916816 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:29:32.059037 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:29:32.203470 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:29:32.415901 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:29:32.728390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5497): Launched 12:29:33.000806 run iperf3-srv_10.42.42.10(pid=5498): Launched 12:29:33.117857 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:29:33.325217 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:29:33.637212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5499): Launched 12:29:33.909719 run iperf3-srv_10.42.42.10(pid=5500): Launched 12:29:34.027934 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:29:34.235451 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:29:34.547181 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5501): Launched 12:29:34.821313 run iperf3-srv_10.42.42.10(pid=5502): Launched 12:29:34.940307 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:29:35.147356 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:29:35.458944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5503): Launched 12:29:35.731027 run iperf3-srv_10.42.42.10(pid=5504): Launched 12:29:35.848404 tst iperf3m4.py:8: start network... 12:29:36.056457 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:36.540276 run create_hlr_db(pid=5505): Launched 12:29:36.668686 bus /gobi_6: Setting Powered False 12:29:37.730778 run create_hlr_db(pid=5505): Terminated: ok {rc=0} 12:29:38.184434 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5507): Launched 12:29:38.518880 run osmo-hlr_10.42.42.2(pid=5508): Launched 12:29:38.647897 run osmo-stp_10.42.42.5: Starting osmo-stp 12:29:39.225375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5510): Launched 12:29:39.563810 run osmo-stp_10.42.42.5(pid=5511): Launched 12:29:39.691296 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:29:40.247490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5513): Launched 12:29:40.368383 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:29:40.630808 run patchelf(pid=5514): Launched 12:29:40.804910 run osmo-stp_10.42.42.5(pid=5511): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5511)] 12:29:40.936131 run osmo-stp_10.42.42.5(pid=5511): stdout: | (launched: 2022-12-09_12:29:39.500893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:41.068071 run osmo-stp_10.42.42.5(pid=5511): stderr: | 20221209122939691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122939691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122939692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122939692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122939693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122939693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122939693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:41.200386 run osmo-stp_10.42.42.5(pid=5511): stdout: | (launched: 2022-12-09_12:29:39.500893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:41.326976 run osmo-stp_10.42.42.5(pid=5511): stderr: | 20221209122939691 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122939691 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122939692 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122939692 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122939693 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122939693 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122939693 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:41.477172 run patchelf(pid=5514): Terminating (SIGINT) 12:29:41.653192 run patchelf(pid=5514): Terminated: ok {rc=0} 12:29:41.779550 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5511): Process ended prematurely: osmo-stp_10.42.42.5(pid=5511) [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5511)] [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 12:29:41.789174 tst iperf3m4.py:8: Test FAILED (10.9 sec) 12:29:41.817010 run osmo-hlr_10.42.42.2(pid=5508): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5508)] 12:29:41.864911 run osmo-hlr_10.42.42.2(pid=5508): stdout: | (launched: 2022-12-09_12:29:38.457517) 12:29:41.914653 run osmo-hlr_10.42.42.2(pid=5508): stderr: | 20221209122938653 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122938653 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122938653 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122938653 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122938653 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122938653 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122938666 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122938677 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122938677 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122938677 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:41.964494 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5497): Terminating (SIGTERM) 12:29:42.004488 run iperf3-srv_10.42.42.10(pid=5498): Terminating (SIGTERM) 12:29:42.044396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5499): Terminating (SIGTERM) 12:29:42.084877 run iperf3-srv_10.42.42.10(pid=5500): Terminating (SIGTERM) 12:29:42.124640 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5501): Terminating (SIGTERM) 12:29:42.164429 run iperf3-srv_10.42.42.10(pid=5502): Terminating (SIGTERM) 12:29:42.203821 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5503): Terminating (SIGTERM) 12:29:42.243455 run iperf3-srv_10.42.42.10(pid=5504): Terminating (SIGTERM) 12:29:42.283038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5507): Terminating (SIGTERM) 12:29:42.322795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5510): Terminating (SIGTERM) 12:29:42.362529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5513): Terminating (SIGTERM) 12:29:42.402748 --- ParallelTerminationStrategy: PID 5497 died... 12:29:42.422247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5497): Terminated: ok {rc=0} 12:29:42.467056 --- ParallelTerminationStrategy: PID 5498 died... 12:29:42.486024 run iperf3-srv_10.42.42.10(pid=5498): Terminated {rc=256} 12:29:42.530076 --- ParallelTerminationStrategy: PID 5499 died... 12:29:42.549007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5499): Terminated: ok {rc=0} 12:29:42.593243 --- ParallelTerminationStrategy: PID 5500 died... 12:29:42.611982 run iperf3-srv_10.42.42.10(pid=5500): Terminated {rc=256} 12:29:42.656096 --- ParallelTerminationStrategy: PID 5501 died... 12:29:42.675069 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5501): Terminated: ok {rc=0} 12:29:42.719605 --- ParallelTerminationStrategy: PID 5502 died... 12:29:42.738471 run iperf3-srv_10.42.42.10(pid=5502): Terminated {rc=256} 12:29:42.782571 --- ParallelTerminationStrategy: PID 5503 died... 12:29:42.801507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5503): Terminated: ok {rc=0} 12:29:42.845571 --- ParallelTerminationStrategy: PID 5504 died... 12:29:42.864390 run iperf3-srv_10.42.42.10(pid=5504): Terminated {rc=256} 12:29:42.908379 --- ParallelTerminationStrategy: PID 5507 died... 12:29:42.927379 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5507): Terminated: ok {rc=0} 12:29:42.971628 --- ParallelTerminationStrategy: PID 5510 died... 12:29:42.990595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5510): Terminated: ok {rc=0} 12:29:43.034823 --- ParallelTerminationStrategy: PID 5513 died... 12:29:43.053804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5513): Terminated: ok {rc=0} 12:29:43.140244 bus /gobi_4: Setting Powered False 12:29:44.241352 bus /gobi_4: Setting Powered False 12:29:45.358592 bus /gobi_1: Setting Powered False 12:29:46.461324 bus /gobi_1: Setting Powered False 12:29:47.581453 bus /gobi_0: Setting Powered False 12:29:48.681595 bus /gobi_0: Setting Powered False 12:29:49.799409 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 12:29:50.906395 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:50.918840 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:29:50.970462 tst ping.py: using LAC 21470 12:29:51.100216 tst ping.py: using RAC 50 12:29:51.229884 tst ping.py: using CellId 21470 12:29:51.358063 tst ping.py: using BVCI 21471 12:29:51.477043 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:51.488637 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:51.500007 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:51.511573 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:51.523513 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:51.535202 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:51.546984 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:51.558589 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:29:51.676118 tst ping.py:19: start network... 12:29:51.882308 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:29:52.355642 run create_hlr_db(pid=5515): Launched 12:29:52.480367 bus /gobi_6: Setting Powered False 12:29:53.542069 run create_hlr_db(pid=5515): Terminated: ok {rc=0} 12:29:53.969554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5517): Launched 12:29:54.277650 run osmo-hlr_10.42.42.2(pid=5518): Launched 12:29:54.394866 run osmo-stp_10.42.42.5: Starting osmo-stp 12:29:54.934317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5520): Launched 12:29:55.238847 run osmo-stp_10.42.42.5(pid=5521): Launched 12:29:55.355607 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:29:55.880285 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5523): Launched 12:29:55.999532 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:29:56.258865 run patchelf(pid=5524): Launched 12:29:56.431271 run osmo-stp_10.42.42.5(pid=5521): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5521)] 12:29:56.560817 run osmo-stp_10.42.42.5(pid=5521): stdout: | (launched: 2022-12-09_12:29:55.182039) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:56.691297 run osmo-stp_10.42.42.5(pid=5521): stderr: | 20221209122955351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122955351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122955351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122955351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122955352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122955352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122955352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:56.822609 run osmo-stp_10.42.42.5(pid=5521): stdout: | (launched: 2022-12-09_12:29:55.182039) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:29:56.948056 run osmo-stp_10.42.42.5(pid=5521): stderr: | 20221209122955351 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209122955351 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209122955351 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209122955351 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209122955352 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209122955352 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209122955352 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:29:57.096308 run patchelf(pid=5524): Terminating (SIGINT) 12:29:57.269295 run patchelf(pid=5524): Terminated: ok {rc=0} 12:29:57.393382 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5521): Process ended prematurely: osmo-stp_10.42.42.5(pid=5521) [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5521)] [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 12:29:57.402236 tst ping.py:22: Test FAILED (6.5 sec) 12:29:57.429392 run osmo-hlr_10.42.42.2(pid=5518): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5518)] 12:29:57.477165 run osmo-hlr_10.42.42.2(pid=5518): stdout: | (launched: 2022-12-09_12:29:54.220093) 12:29:57.526617 run osmo-hlr_10.42.42.2(pid=5518): stderr: | 20221209122954394 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209122954394 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209122954394 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209122954394 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209122954394 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209122954394 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209122954407 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209122954415 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209122954415 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209122954415 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:29:57.576677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5517): Terminating (SIGTERM) 12:29:57.616616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5520): Terminating (SIGTERM) 12:29:57.656447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5523): Terminating (SIGTERM) 12:29:57.697048 --- ParallelTerminationStrategy: PID 5517 died... 12:29:57.716269 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5517): Terminated: ok {rc=0} 12:29:57.760540 --- ParallelTerminationStrategy: PID 5520 died... 12:29:57.779417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5520): Terminated: ok {rc=0} 12:29:57.823797 --- ParallelTerminationStrategy: PID 5523 died... 12:29:57.842720 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5523): Terminated: ok {rc=0} 12:29:57.929390 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 12:29:59.018075 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:59.029813 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 12:29:59.079912 tst ping_idle_ping.py: using LAC 21471 12:29:59.202129 tst ping_idle_ping.py: using RAC 51 12:29:59.321865 tst ping_idle_ping.py: using CellId 21471 12:29:59.442075 tst ping_idle_ping.py: using BVCI 21472 12:29:59.553732 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:59.564742 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:59.575571 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:59.586391 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:59.597344 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:59.608068 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:59.619122 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 12:29:59.629994 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 12:29:59.745709 tst ping_idle_ping.py:24: start network... 12:29:59.951067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:30:00.427965 run create_hlr_db(pid=5525): Launched 12:30:00.554270 bus /gobi_6: Setting Powered False 12:30:01.641686 run create_hlr_db(pid=5525): Terminated: ok {rc=0} 12:30:02.149273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5530): Launched 12:30:02.482769 run osmo-hlr_10.42.42.2(pid=5531): Launched 12:30:02.609595 run osmo-stp_10.42.42.5: Starting osmo-stp 12:30:03.179234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5533): Launched 12:30:03.509471 run osmo-stp_10.42.42.5(pid=5534): Launched 12:30:03.637440 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:30:04.206722 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5536): Launched 12:30:04.333406 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:30:04.611272 run patchelf(pid=5537): Launched 12:30:04.794856 run osmo-stp_10.42.42.5(pid=5534): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5534)] 12:30:04.934148 run osmo-stp_10.42.42.5(pid=5534): stdout: | (launched: 2022-12-09_12:30:03.448681) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:05.074771 run osmo-stp_10.42.42.5(pid=5534): stderr: | 20221209123003638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123003638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123003638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123003639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123003639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123003639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123003639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:05.215505 run osmo-stp_10.42.42.5(pid=5534): stdout: | (launched: 2022-12-09_12:30:03.448681) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:05.349699 run osmo-stp_10.42.42.5(pid=5534): stderr: | 20221209123003638 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123003638 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123003638 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123003639 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123003639 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123003639 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123003639 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:05.508556 run patchelf(pid=5537): Terminating (SIGINT) 12:30:05.694990 run patchelf(pid=5537): Terminated: ok {rc=0} 12:30:05.828596 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5534): Process ended prematurely: osmo-stp_10.42.42.5(pid=5534) [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5534)] [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 12:30:05.838381 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 12:30:05.867896 run osmo-hlr_10.42.42.2(pid=5531): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5531)] 12:30:05.919115 run osmo-hlr_10.42.42.2(pid=5531): stdout: | (launched: 2022-12-09_12:30:02.421795) 12:30:05.972485 run osmo-hlr_10.42.42.2(pid=5531): stderr: | 20221209123002616 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123002616 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123002616 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123002616 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123002616 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123002616 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123002627 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123002635 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123002636 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123002636 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:30:06.025988 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5530): Terminating (SIGTERM) 12:30:06.068790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5533): Terminating (SIGTERM) 12:30:06.112272 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5536): Terminating (SIGTERM) 12:30:06.155711 --- ParallelTerminationStrategy: PID 5530 died... 12:30:06.176254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5530): Terminated: ok {rc=0} 12:30:06.224408 --- ParallelTerminationStrategy: PID 5533 died... 12:30:06.244472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5533): Terminated: ok {rc=0} 12:30:06.292489 --- ParallelTerminationStrategy: PID 5536 died... 12:30:06.312492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5536): Terminated: ok {rc=0} 12:30:06.402480 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 12:30:07.712784 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:30:07.720481 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 12:30:07.755274 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 12:30:07.795480 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 12:30:07.885448 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 12:30:07.919036 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 12:30:07.959282 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 12:30:08.557247 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 12:30:08.611509 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:08.623294 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:30:08.693894 tst cs_paging_gprs_active.py: using LAC 21472 12:30:08.824830 tst cs_paging_gprs_active.py: using RAC 52 12:30:08.957063 tst cs_paging_gprs_active.py: using CellId 21472 12:30:09.079469 tst cs_paging_gprs_active.py: using BVCI 21473 12:30:09.194774 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:09.205916 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:09.216782 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:09.227684 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:09.238478 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:09.249349 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:09.260260 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:09.271040 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:09.282007 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:30:09.404378 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:30:09.523978 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:30:09.734167 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:30:10.046635 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5541): Launched 12:30:10.321337 run iperf3-srv_10.42.42.10(pid=5542): Launched 12:30:10.438953 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:30:10.647235 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:30:10.961083 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5543): Launched 12:30:11.232707 run iperf3-srv_10.42.42.10(pid=5544): Launched 12:30:11.350396 tst cs_paging_gprs_active.py:38: start network... 12:30:11.558249 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:30:12.041145 run create_hlr_db(pid=5545): Launched 12:30:12.168622 bus /gobi_6: Setting Powered False 12:30:13.231094 run create_hlr_db(pid=5545): Terminated: ok {rc=0} 12:30:13.665112 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5547): Launched 12:30:13.977420 run osmo-hlr_10.42.42.2(pid=5548): Launched 12:30:14.096729 run osmo-stp_10.42.42.5: Starting osmo-stp 12:30:14.634860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5550): Launched 12:30:14.948447 run osmo-stp_10.42.42.5(pid=5551): Launched 12:30:15.067703 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:30:15.604682 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5553): Launched 12:30:15.725153 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:30:16.007183 run patchelf(pid=5554): Launched 12:30:16.202015 run osmo-stp_10.42.42.5(pid=5551): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5551)] 12:30:16.337626 run osmo-stp_10.42.42.5(pid=5551): stdout: | (launched: 2022-12-09_12:30:14.890729) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:16.473851 run osmo-stp_10.42.42.5(pid=5551): stderr: | 20221209123015060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123015060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123015060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123015061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123015061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123015061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123015061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:16.609743 run osmo-stp_10.42.42.5(pid=5551): stdout: | (launched: 2022-12-09_12:30:14.890729) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:16.740164 run osmo-stp_10.42.42.5(pid=5551): stderr: | 20221209123015060 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123015060 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123015060 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123015061 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123015061 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123015061 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123015061 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:16.895269 run patchelf(pid=5554): Terminating (SIGINT) 12:30:17.076385 run patchelf(pid=5554): Terminated: ok {rc=0} 12:30:17.205931 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5551): Process ended prematurely: osmo-stp_10.42.42.5(pid=5551) [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5551)] [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 12:30:17.215754 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 12:30:17.243872 run osmo-hlr_10.42.42.2(pid=5548): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5548)] 12:30:17.292643 run osmo-hlr_10.42.42.2(pid=5548): stdout: | (launched: 2022-12-09_12:30:13.919213) 12:30:17.343211 run osmo-hlr_10.42.42.2(pid=5548): stderr: | 20221209123014093 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123014093 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123014093 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123014093 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123014093 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123014093 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123014105 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123014114 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123014114 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123014114 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:30:17.394250 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5541): Terminating (SIGTERM) 12:30:17.435170 run iperf3-srv_10.42.42.10(pid=5542): Terminating (SIGTERM) 12:30:17.476012 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5543): Terminating (SIGTERM) 12:30:17.516754 run iperf3-srv_10.42.42.10(pid=5544): Terminating (SIGTERM) 12:30:17.557471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5547): Terminating (SIGTERM) 12:30:17.598181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5550): Terminating (SIGTERM) 12:30:17.638811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5553): Terminating (SIGTERM) 12:30:17.679909 --- ParallelTerminationStrategy: PID 5541 died... 12:30:17.699690 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5541): Terminated: ok {rc=0} 12:30:17.745130 --- ParallelTerminationStrategy: PID 5542 died... 12:30:17.764190 run iperf3-srv_10.42.42.10(pid=5542): Terminated {rc=256} 12:30:17.809346 --- ParallelTerminationStrategy: PID 5543 died... 12:30:17.828500 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5543): Terminated: ok {rc=0} 12:30:17.873424 --- ParallelTerminationStrategy: PID 5544 died... 12:30:17.892640 run iperf3-srv_10.42.42.10(pid=5544): Terminated {rc=256} 12:30:17.938291 --- ParallelTerminationStrategy: PID 5547 died... 12:30:17.957184 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5547): Terminated: ok {rc=0} 12:30:18.001713 --- ParallelTerminationStrategy: PID 5550 died... 12:30:18.020684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5550): Terminated: ok {rc=0} 12:30:18.065072 --- ParallelTerminationStrategy: PID 5553 died... 12:30:18.084051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5553): Terminated: ok {rc=0} 12:30:18.169186 bus /gobi_0: Setting Powered False 12:30:19.268510 bus /gobi_0: Setting Powered False 12:30:20.388333 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 12:30:21.536180 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:21.548152 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:30:21.618136 tst iperf3.py: using LAC 21473 12:30:21.740929 tst iperf3.py: using RAC 53 12:30:21.863253 tst iperf3.py: using CellId 21473 12:30:21.986651 tst iperf3.py: using BVCI 21474 12:30:22.100634 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:22.111665 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:22.122557 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:22.133503 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:22.144235 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:22.155291 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:22.166168 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:22.176871 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:22.187741 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:30:22.310617 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:30:22.536156 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:30:22.872003 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5557): Launched 12:30:23.165910 run iperf3-srv_10.42.42.10(pid=5558): Launched 12:30:23.294355 tst iperf3.py:8: start network... 12:30:23.519902 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:30:24.040097 run create_hlr_db(pid=5559): Launched 12:30:24.167971 bus /gobi_6: Setting Powered False 12:30:25.233333 run create_hlr_db(pid=5559): Terminated: ok {rc=0} 12:30:25.679603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5561): Launched 12:30:25.992016 run osmo-hlr_10.42.42.2(pid=5562): Launched 12:30:26.110958 run osmo-stp_10.42.42.5: Starting osmo-stp 12:30:26.647558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5564): Launched 12:30:26.962280 run osmo-stp_10.42.42.5(pid=5565): Launched 12:30:27.082700 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:30:27.618948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5567): Launched 12:30:27.750278 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:30:28.032295 run patchelf(pid=5568): Launched 12:30:28.219848 run osmo-stp_10.42.42.5(pid=5565): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5565)] 12:30:28.360731 run osmo-stp_10.42.42.5(pid=5565): stdout: | (launched: 2022-12-09_12:30:26.904168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:28.503559 run osmo-stp_10.42.42.5(pid=5565): stderr: | 20221209123027076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123027076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123027076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123027077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123027077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123027077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123027077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:28.646732 run osmo-stp_10.42.42.5(pid=5565): stdout: | (launched: 2022-12-09_12:30:26.904168) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:28.783366 run osmo-stp_10.42.42.5(pid=5565): stderr: | 20221209123027076 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123027076 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123027076 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123027077 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123027077 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123027077 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123027077 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:28.945115 run patchelf(pid=5568): Terminating (SIGINT) 12:30:29.133561 run patchelf(pid=5568): Terminated: ok {rc=0} 12:30:29.269537 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5565): Process ended prematurely: osmo-stp_10.42.42.5(pid=5565) [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5565)] [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 12:30:29.279811 tst iperf3.py:8: Test FAILED (7.8 sec) 12:30:29.309382 run osmo-hlr_10.42.42.2(pid=5562): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5562)] 12:30:29.360293 run osmo-hlr_10.42.42.2(pid=5562): stdout: | (launched: 2022-12-09_12:30:25.934147) 12:30:29.412938 run osmo-hlr_10.42.42.2(pid=5562): stderr: | 20221209123026110 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123026110 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123026110 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123026110 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123026110 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123026111 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123026123 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123026134 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123026134 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123026134 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:30:29.466123 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5557): Terminating (SIGTERM) 12:30:29.509132 run iperf3-srv_10.42.42.10(pid=5558): Terminating (SIGTERM) 12:30:29.552405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5561): Terminating (SIGTERM) 12:30:29.595328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5564): Terminating (SIGTERM) 12:30:29.638050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5567): Terminating (SIGTERM) 12:30:29.681363 --- ParallelTerminationStrategy: PID 5557 died... 12:30:29.701840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5557): Terminated: ok {rc=0} 12:30:29.749877 --- ParallelTerminationStrategy: PID 5558 died... 12:30:29.769802 run iperf3-srv_10.42.42.10(pid=5558): Terminated {rc=256} 12:30:29.817113 --- ParallelTerminationStrategy: PID 5561 died... 12:30:29.836942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5561): Terminated: ok {rc=0} 12:30:29.883963 --- ParallelTerminationStrategy: PID 5564 died... 12:30:29.903965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5564): Terminated: ok {rc=0} 12:30:29.951468 --- ParallelTerminationStrategy: PID 5567 died... 12:30:29.971592 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5567): Terminated: ok {rc=0} 12:30:30.062082 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 12:30:31.208763 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:31.222071 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:30:31.294482 tst iperf3m4.py: using LAC 21474 12:30:31.427382 tst iperf3m4.py: using RAC 54 12:30:31.561280 tst iperf3m4.py: using CellId 21474 12:30:31.684757 tst iperf3m4.py: using BVCI 21475 12:30:31.832692 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:31.844852 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:31.856918 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:31.870726 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:31.882899 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:31.894613 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:31.906739 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:31.919967 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:31.931941 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:30:32.087503 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:30:32.240005 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:30:32.366051 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:30:32.487130 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:30:32.714285 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:30:33.051845 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5569): Launched 12:30:33.344132 run iperf3-srv_10.42.42.10(pid=5570): Launched 12:30:33.471818 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:30:33.697776 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:30:34.033722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5571): Launched 12:30:34.327527 run iperf3-srv_10.42.42.10(pid=5572): Launched 12:30:34.453358 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:30:34.678948 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:30:35.014344 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5573): Launched 12:30:35.307901 run iperf3-srv_10.42.42.10(pid=5574): Launched 12:30:35.435807 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:30:35.660763 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:30:35.995816 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5575): Launched 12:30:36.287989 run iperf3-srv_10.42.42.10(pid=5576): Launched 12:30:36.415938 tst iperf3m4.py:8: start network... 12:30:36.641571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:30:37.161725 run create_hlr_db(pid=5577): Launched 12:30:37.291145 bus /gobi_6: Setting Powered False 12:30:38.356456 run create_hlr_db(pid=5577): Terminated: ok {rc=0} 12:30:38.802521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5579): Launched 12:30:39.115413 run osmo-hlr_10.42.42.2(pid=5580): Launched 12:30:39.237363 run osmo-stp_10.42.42.5: Starting osmo-stp 12:30:39.782070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5582): Launched 12:30:40.096498 run osmo-stp_10.42.42.5(pid=5583): Launched 12:30:40.217814 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:30:40.756098 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5585): Launched 12:30:40.877835 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:30:41.140530 run patchelf(pid=5586): Launched 12:30:41.316590 run osmo-stp_10.42.42.5(pid=5583): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5583)] 12:30:41.448455 run osmo-stp_10.42.42.5(pid=5583): stdout: | (launched: 2022-12-09_12:30:40.038233) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:41.581796 run osmo-stp_10.42.42.5(pid=5583): stderr: | 20221209123040211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123040212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123040212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123040212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123040213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123040213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123040213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:41.714540 run osmo-stp_10.42.42.5(pid=5583): stdout: | (launched: 2022-12-09_12:30:40.038233) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:41.841730 run osmo-stp_10.42.42.5(pid=5583): stderr: | 20221209123040211 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123040212 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123040212 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123040212 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123040213 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123040213 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123040213 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:41.992601 run patchelf(pid=5586): Terminating (SIGINT) 12:30:42.168694 run patchelf(pid=5586): Terminated: ok {rc=0} 12:30:42.296512 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5583): Process ended prematurely: osmo-stp_10.42.42.5(pid=5583) [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5583)] [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 12:30:42.306154 tst iperf3m4.py:8: Test FAILED (11.1 sec) 12:30:42.333726 run osmo-hlr_10.42.42.2(pid=5580): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5580)] 12:30:42.381969 run osmo-hlr_10.42.42.2(pid=5580): stdout: | (launched: 2022-12-09_12:30:39.056896) 12:30:42.431575 run osmo-hlr_10.42.42.2(pid=5580): stderr: | 20221209123039234 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123039234 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123039234 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123039234 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123039234 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123039234 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123039246 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123039254 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123039254 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123039254 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:30:42.481431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5569): Terminating (SIGTERM) 12:30:42.521347 run iperf3-srv_10.42.42.10(pid=5570): Terminating (SIGTERM) 12:30:42.561541 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5571): Terminating (SIGTERM) 12:30:42.601453 run iperf3-srv_10.42.42.10(pid=5572): Terminating (SIGTERM) 12:30:42.641197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5573): Terminating (SIGTERM) 12:30:42.681124 run iperf3-srv_10.42.42.10(pid=5574): Terminating (SIGTERM) 12:30:42.720776 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5575): Terminating (SIGTERM) 12:30:42.760798 run iperf3-srv_10.42.42.10(pid=5576): Terminating (SIGTERM) 12:30:42.800528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5579): Terminating (SIGTERM) 12:30:42.840518 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5582): Terminating (SIGTERM) 12:30:42.880309 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5585): Terminating (SIGTERM) 12:30:42.920485 --- ParallelTerminationStrategy: PID 5569 died... 12:30:42.939872 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5569): Terminated: ok {rc=0} 12:30:42.984757 --- ParallelTerminationStrategy: PID 5570 died... 12:30:43.004044 run iperf3-srv_10.42.42.10(pid=5570): Terminated {rc=256} 12:30:43.048099 --- ParallelTerminationStrategy: PID 5571 died... 12:30:43.066865 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5571): Terminated: ok {rc=0} 12:30:43.110831 --- ParallelTerminationStrategy: PID 5572 died... 12:30:43.129590 run iperf3-srv_10.42.42.10(pid=5572): Terminated {rc=256} 12:30:43.174397 --- ParallelTerminationStrategy: PID 5573 died... 12:30:43.193239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5573): Terminated: ok {rc=0} 12:30:43.237240 --- ParallelTerminationStrategy: PID 5574 died... 12:30:43.255808 run iperf3-srv_10.42.42.10(pid=5574): Terminated {rc=256} 12:30:43.299928 --- ParallelTerminationStrategy: PID 5575 died... 12:30:43.318768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5575): Terminated: ok {rc=0} 12:30:43.362792 --- ParallelTerminationStrategy: PID 5576 died... 12:30:43.381501 run iperf3-srv_10.42.42.10(pid=5576): Terminated {rc=256} 12:30:43.425449 --- ParallelTerminationStrategy: PID 5579 died... 12:30:43.444294 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5579): Terminated: ok {rc=0} 12:30:43.488336 --- ParallelTerminationStrategy: PID 5582 died... 12:30:43.507342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5582): Terminated: ok {rc=0} 12:30:43.551587 --- ParallelTerminationStrategy: PID 5585 died... 12:30:43.570549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5585): Terminated: ok {rc=0} 12:30:43.656688 bus /gobi_4: Setting Powered False 12:30:44.757938 bus /gobi_4: Setting Powered False 12:30:45.894767 bus /gobi_1: Setting Powered False 12:30:47.000273 bus /gobi_1: Setting Powered False 12:30:48.121584 bus /gobi_0: Setting Powered False 12:30:49.219577 bus /gobi_0: Setting Powered False 12:30:50.337705 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 12:30:51.441218 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:51.453779 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:30:51.527328 tst ping.py: using LAC 21475 12:30:51.655104 tst ping.py: using RAC 55 12:30:51.782895 tst ping.py: using CellId 21475 12:30:51.910072 tst ping.py: using BVCI 21476 12:30:52.030518 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:52.042229 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:52.053580 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:52.065379 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:52.076884 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:52.088677 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:52.100457 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:52.112068 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:30:52.231348 tst ping.py:19: start network... 12:30:52.435365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:30:52.908302 run create_hlr_db(pid=5587): Launched 12:30:53.035094 bus /gobi_6: Setting Powered False 12:30:54.095976 run create_hlr_db(pid=5587): Terminated: ok {rc=0} 12:30:54.524185 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5589): Launched 12:30:54.832234 run osmo-hlr_10.42.42.2(pid=5590): Launched 12:30:54.947255 run osmo-stp_10.42.42.5: Starting osmo-stp 12:30:55.491847 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5592): Launched 12:30:55.800381 run osmo-stp_10.42.42.5(pid=5593): Launched 12:30:55.916057 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:30:56.443058 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5595): Launched 12:30:56.561900 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:30:56.820809 run patchelf(pid=5596): Launched 12:30:56.992564 run osmo-stp_10.42.42.5(pid=5593): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5593)] 12:30:57.122370 run osmo-stp_10.42.42.5(pid=5593): stdout: | (launched: 2022-12-09_12:30:55.743456) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:57.252933 run osmo-stp_10.42.42.5(pid=5593): stderr: | 20221209123055915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123055915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123055915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123055916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123055916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123055916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123055916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:57.383768 run osmo-stp_10.42.42.5(pid=5593): stdout: | (launched: 2022-12-09_12:30:55.743456) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:30:57.508539 run osmo-stp_10.42.42.5(pid=5593): stderr: | 20221209123055915 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123055915 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123055915 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123055916 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123055916 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123055916 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123055916 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:30:57.656297 run patchelf(pid=5596): Terminating (SIGINT) 12:30:57.829679 run patchelf(pid=5596): Terminated: ok {rc=0} 12:30:57.954418 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5593): Process ended prematurely: osmo-stp_10.42.42.5(pid=5593) [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5593)] [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 12:30:57.963342 tst ping.py:22: Test FAILED (6.5 sec) 12:30:57.990523 run osmo-hlr_10.42.42.2(pid=5590): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5590)] 12:30:58.038532 run osmo-hlr_10.42.42.2(pid=5590): stdout: | (launched: 2022-12-09_12:30:54.775331) 12:30:58.088441 run osmo-hlr_10.42.42.2(pid=5590): stderr: | 20221209123054952 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123054952 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123054952 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123054952 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123054952 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123054952 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123054965 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123054974 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123054974 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123054974 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:30:58.138609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5589): Terminating (SIGTERM) 12:30:58.178742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5592): Terminating (SIGTERM) 12:30:58.218804 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5595): Terminating (SIGTERM) 12:30:58.259083 --- ParallelTerminationStrategy: PID 5589 died... 12:30:58.278465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5589): Terminated: ok {rc=0} 12:30:58.322825 --- ParallelTerminationStrategy: PID 5592 died... 12:30:58.341680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5592): Terminated: ok {rc=0} 12:30:58.386384 --- ParallelTerminationStrategy: PID 5595 died... 12:30:58.405330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5595): Terminated: ok {rc=0} 12:30:58.492394 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 12:30:59.582571 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:30:59.594781 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 12:30:59.663200 tst ping_idle_ping.py: using LAC 21476 12:30:59.783997 tst ping_idle_ping.py: using RAC 56 12:30:59.905298 tst ping_idle_ping.py: using CellId 21476 12:31:00.027228 tst ping_idle_ping.py: using BVCI 21477 12:31:00.138475 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:00.149671 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:00.160472 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:00.171318 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:00.182110 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:00.193010 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:00.203986 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 12:31:00.214880 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 12:31:00.330729 tst ping_idle_ping.py:24: start network... 12:31:00.536202 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:31:01.049258 run create_hlr_db(pid=5597): Launched 12:31:01.216054 bus /gobi_6: Setting Powered False 12:31:02.286821 run create_hlr_db(pid=5597): Terminated: ok {rc=0} 12:31:02.747155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5599): Launched 12:31:03.077922 run osmo-hlr_10.42.42.2(pid=5600): Launched 12:31:03.204690 run osmo-stp_10.42.42.5: Starting osmo-stp 12:31:03.770009 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5602): Launched 12:31:04.100238 run osmo-stp_10.42.42.5(pid=5603): Launched 12:31:04.224817 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:31:04.790995 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5605): Launched 12:31:04.918538 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:31:05.195683 run patchelf(pid=5606): Launched 12:31:05.380302 run osmo-stp_10.42.42.5(pid=5603): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5603)] 12:31:05.519117 run osmo-stp_10.42.42.5(pid=5603): stdout: | (launched: 2022-12-09_12:31:04.039519) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:05.659982 run osmo-stp_10.42.42.5(pid=5603): stderr: | 20221209123104230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123104231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123104231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123104231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123104232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123104232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123104232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:05.800069 run osmo-stp_10.42.42.5(pid=5603): stdout: | (launched: 2022-12-09_12:31:04.039519) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:05.934171 run osmo-stp_10.42.42.5(pid=5603): stderr: | 20221209123104230 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123104231 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123104231 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123104231 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123104232 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123104232 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123104232 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:06.092848 run patchelf(pid=5606): Terminating (SIGINT) 12:31:06.278530 run patchelf(pid=5606): Terminated: ok {rc=0} 12:31:06.412171 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5603): Process ended prematurely: osmo-stp_10.42.42.5(pid=5603) [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5603)] [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 12:31:06.421976 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 12:31:06.451198 run osmo-hlr_10.42.42.2(pid=5600): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5600)] 12:31:06.501745 run osmo-hlr_10.42.42.2(pid=5600): stdout: | (launched: 2022-12-09_12:31:03.017391) 12:31:06.554023 run osmo-hlr_10.42.42.2(pid=5600): stderr: | 20221209123103214 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123103214 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123103214 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123103215 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123103215 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123103215 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123103227 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123103235 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123103236 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123103236 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:31:06.606923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5599): Terminating (SIGTERM) 12:31:06.649409 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5602): Terminating (SIGTERM) 12:31:06.691833 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5605): Terminating (SIGTERM) 12:31:06.734636 --- ParallelTerminationStrategy: PID 5599 died... 12:31:06.754703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5599): Terminated: ok {rc=0} 12:31:06.801915 --- ParallelTerminationStrategy: PID 5602 died... 12:31:06.821609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5602): Terminated: ok {rc=0} 12:31:06.868547 --- ParallelTerminationStrategy: PID 5605 died... 12:31:06.888348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5605): Terminated: ok {rc=0} 12:31:06.977274 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 12:31:08.288858 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:31:08.296441 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 12:31:08.329448 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 12:31:08.367669 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 12:31:08.454582 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 12:31:08.486275 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 12:31:08.523866 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 12:31:09.124314 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2359 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 12:31:09.181551 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:09.193641 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:31:09.245117 tst cs_paging_gprs_active.py: using LAC 21477 12:31:09.375428 tst cs_paging_gprs_active.py: using RAC 57 12:31:09.504355 tst cs_paging_gprs_active.py: using CellId 21477 12:31:09.634024 tst cs_paging_gprs_active.py: using BVCI 21478 12:31:09.754487 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:09.766374 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:09.777995 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:09.790279 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:09.802628 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:09.815057 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:09.827461 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:09.840080 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:09.853641 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:31:09.973934 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:31:10.095947 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 12:31:10.303150 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:31:10.611639 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5610): Launched 12:31:10.881536 run iperf3-srv_10.42.42.10(pid=5611): Launched 12:31:10.998480 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 12:31:11.205342 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:31:11.515011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5612): Launched 12:31:11.784005 run iperf3-srv_10.42.42.10(pid=5613): Launched 12:31:11.899806 tst cs_paging_gprs_active.py:38: start network... 12:31:12.104573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:31:12.582108 run create_hlr_db(pid=5614): Launched 12:31:12.709291 bus /gobi_6: Setting Powered False 12:31:13.770476 run create_hlr_db(pid=5614): Terminated: ok {rc=0} 12:31:14.200172 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5616): Launched 12:31:14.509529 run osmo-hlr_10.42.42.2(pid=5617): Launched 12:31:14.628225 run osmo-stp_10.42.42.5: Starting osmo-stp 12:31:15.161477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5619): Launched 12:31:15.472787 run osmo-stp_10.42.42.5(pid=5620): Launched 12:31:15.591425 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:31:16.187060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5622): Launched 12:31:16.315798 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:31:16.591302 run patchelf(pid=5623): Launched 12:31:16.793635 run osmo-stp_10.42.42.5(pid=5620): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5620)] 12:31:16.940940 run osmo-stp_10.42.42.5(pid=5620): stdout: | (launched: 2022-12-09_12:31:15.414454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:17.088528 run osmo-stp_10.42.42.5(pid=5620): stderr: | 20221209123115586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123115587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123115587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123115587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123115588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123115588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123115588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:17.234970 run osmo-stp_10.42.42.5(pid=5620): stdout: | (launched: 2022-12-09_12:31:15.414454) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:17.372101 run osmo-stp_10.42.42.5(pid=5620): stderr: | 20221209123115586 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123115587 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123115587 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123115587 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123115588 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123115588 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123115588 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:17.534034 run patchelf(pid=5623): Terminating (SIGINT) 12:31:17.722756 run patchelf(pid=5623): Terminated: ok {rc=0} 12:31:17.857796 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=5620): Process ended prematurely: osmo-stp_10.42.42.5(pid=5620) [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5620)] [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 12:31:17.868410 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 12:31:17.897980 run osmo-hlr_10.42.42.2(pid=5617): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5617)] 12:31:17.948846 run osmo-hlr_10.42.42.2(pid=5617): stdout: | (launched: 2022-12-09_12:31:14.451952) 12:31:18.001271 run osmo-hlr_10.42.42.2(pid=5617): stderr: | 20221209123114629 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123114629 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123114629 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123114629 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123114629 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123114629 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123114641 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123114649 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123114649 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123114649 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:31:18.054172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5610): Terminating (SIGTERM) 12:31:18.096702 run iperf3-srv_10.42.42.10(pid=5611): Terminating (SIGTERM) 12:31:18.139680 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5612): Terminating (SIGTERM) 12:31:18.182501 run iperf3-srv_10.42.42.10(pid=5613): Terminating (SIGTERM) 12:31:18.225015 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5616): Terminating (SIGTERM) 12:31:18.268013 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5619): Terminating (SIGTERM) 12:31:18.310976 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5622): Terminating (SIGTERM) 12:31:18.354021 --- ParallelTerminationStrategy: PID 5610 died... 12:31:18.374068 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5610): Terminated: ok {rc=0} 12:31:18.421564 --- ParallelTerminationStrategy: PID 5611 died... 12:31:18.441117 run iperf3-srv_10.42.42.10(pid=5611): Terminated {rc=256} 12:31:18.488115 --- ParallelTerminationStrategy: PID 5612 died... 12:31:18.507869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5612): Terminated: ok {rc=0} 12:31:18.555248 --- ParallelTerminationStrategy: PID 5613 died... 12:31:18.575463 run iperf3-srv_10.42.42.10(pid=5613): Terminated {rc=256} 12:31:18.622761 --- ParallelTerminationStrategy: PID 5616 died... 12:31:18.642566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5616): Terminated: ok {rc=0} 12:31:18.689875 --- ParallelTerminationStrategy: PID 5619 died... 12:31:18.709677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5619): Terminated: ok {rc=0} 12:31:18.757076 --- ParallelTerminationStrategy: PID 5622 died... 12:31:18.777007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5622): Terminated: ok {rc=0} 12:31:18.867571 bus /gobi_0: Setting Powered False 12:31:19.967927 bus /gobi_0: Setting Powered False 12:31:21.085643 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 12:31:22.231079 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:22.243430 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:31:22.294307 tst iperf3.py: using LAC 21478 12:31:22.416769 tst iperf3.py: using RAC 58 12:31:22.544176 tst iperf3.py: using CellId 21478 12:31:22.664552 tst iperf3.py: using BVCI 21479 12:31:22.776423 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:22.787879 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:22.799028 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:22.811145 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:22.822332 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:22.833622 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:22.844770 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:22.855943 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:22.867721 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:31:22.985943 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 12:31:23.190457 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:31:23.496858 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5624): Launched 12:31:23.765194 run iperf3-srv_10.42.42.10(pid=5625): Launched 12:31:23.880859 tst iperf3.py:8: start network... 12:31:24.085952 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:31:24.561529 run create_hlr_db(pid=5626): Launched 12:31:24.688182 bus /gobi_6: Setting Powered False 12:31:25.749640 run create_hlr_db(pid=5626): Terminated: ok {rc=0} 12:31:26.199152 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5628): Launched 12:31:26.530896 run osmo-hlr_10.42.42.2(pid=5629): Launched 12:31:26.658431 run osmo-stp_10.42.42.5: Starting osmo-stp 12:31:27.221591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5631): Launched 12:31:27.552893 run osmo-stp_10.42.42.5(pid=5632): Launched 12:31:27.678697 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:31:28.245124 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5634): Launched 12:31:28.371840 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:31:28.651336 run patchelf(pid=5635): Launched 12:31:28.835422 run osmo-stp_10.42.42.5(pid=5632): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5632)] 12:31:28.975765 run osmo-stp_10.42.42.5(pid=5632): stdout: | (launched: 2022-12-09_12:31:27.491478) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:29.116503 run osmo-stp_10.42.42.5(pid=5632): stderr: | 20221209123127684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123127684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123127684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123127685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123127685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123127685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123127685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:29.257849 run osmo-stp_10.42.42.5(pid=5632): stdout: | (launched: 2022-12-09_12:31:27.491478) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:29.393492 run osmo-stp_10.42.42.5(pid=5632): stderr: | 20221209123127684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123127684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123127684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123127685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123127685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123127685 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123127685 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:29.553920 run patchelf(pid=5635): Terminating (SIGINT) 12:31:29.741056 run patchelf(pid=5635): Terminated: ok {rc=0} 12:31:29.876160 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5632): Process ended prematurely: osmo-stp_10.42.42.5(pid=5632) [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5632)] [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 12:31:29.886651 tst iperf3.py:8: Test FAILED (7.7 sec) 12:31:29.916061 run osmo-hlr_10.42.42.2(pid=5629): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5629)] 12:31:29.966919 run osmo-hlr_10.42.42.2(pid=5629): stdout: | (launched: 2022-12-09_12:31:26.470790) 12:31:30.019604 run osmo-hlr_10.42.42.2(pid=5629): stderr: | 20221209123126668 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123126668 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123126668 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123126668 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123126668 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123126668 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123126680 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123126689 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123126689 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123126689 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:31:30.072662 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5624): Terminating (SIGTERM) 12:31:30.115160 run iperf3-srv_10.42.42.10(pid=5625): Terminating (SIGTERM) 12:31:30.157478 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5628): Terminating (SIGTERM) 12:31:30.199964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5631): Terminating (SIGTERM) 12:31:30.242345 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5634): Terminating (SIGTERM) 12:31:30.284910 --- ParallelTerminationStrategy: PID 5624 died... 12:31:30.305064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5624): Terminated: ok {rc=0} 12:31:30.352333 --- ParallelTerminationStrategy: PID 5625 died... 12:31:30.371884 run iperf3-srv_10.42.42.10(pid=5625): Terminated {rc=256} 12:31:30.418649 --- ParallelTerminationStrategy: PID 5628 died... 12:31:30.438445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5628): Terminated: ok {rc=0} 12:31:30.485512 --- ParallelTerminationStrategy: PID 5631 died... 12:31:30.505182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5631): Terminated: ok {rc=0} 12:31:30.552292 --- ParallelTerminationStrategy: PID 5634 died... 12:31:30.572211 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5634): Terminated: ok {rc=0} 12:31:30.661171 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 12:31:31.843880 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:31.858493 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:31:31.911129 tst iperf3m4.py: using LAC 21479 12:31:32.038203 tst iperf3m4.py: using RAC 59 12:31:32.172764 tst iperf3m4.py: using CellId 21479 12:31:32.306266 tst iperf3m4.py: using BVCI 21480 12:31:32.427855 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:32.439911 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:32.451667 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:32.463639 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:32.476226 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:32.488511 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:32.500718 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:32.512719 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:32.524879 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:31:32.644295 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:31:32.764930 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:31:32.885129 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:31:33.008368 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 12:31:33.231631 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:31:33.562078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5636): Launched 12:31:33.849718 run iperf3-srv_10.42.42.10(pid=5637): Launched 12:31:33.966370 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 12:31:34.172176 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:31:34.482485 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5638): Launched 12:31:34.753186 run iperf3-srv_10.42.42.10(pid=5639): Launched 12:31:34.869325 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 12:31:35.075200 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:31:35.383523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5640): Launched 12:31:35.652290 run iperf3-srv_10.42.42.10(pid=5641): Launched 12:31:35.768118 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 12:31:35.973073 run iperf3-srv_10.42.42.10: Starting iperf3-srv 12:31:36.281594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5642): Launched 12:31:36.551652 run iperf3-srv_10.42.42.10(pid=5643): Launched 12:31:36.667386 tst iperf3m4.py:8: start network... 12:31:36.872456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:31:37.350109 run create_hlr_db(pid=5644): Launched 12:31:37.477266 bus /gobi_6: Setting Powered False 12:31:38.537201 run create_hlr_db(pid=5644): Terminated: ok {rc=0} 12:31:38.967386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5646): Launched 12:31:39.277544 run osmo-hlr_10.42.42.2(pid=5647): Launched 12:31:39.395360 run osmo-stp_10.42.42.5: Starting osmo-stp 12:31:39.941088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5649): Launched 12:31:40.252143 run osmo-stp_10.42.42.5(pid=5650): Launched 12:31:40.370063 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:31:40.902876 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5652): Launched 12:31:41.024019 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:31:41.285114 run patchelf(pid=5653): Launched 12:31:41.457232 run osmo-stp_10.42.42.5(pid=5650): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5650)] 12:31:41.587304 run osmo-stp_10.42.42.5(pid=5650): stdout: | (launched: 2022-12-09_12:31:40.194956) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:41.718733 run osmo-stp_10.42.42.5(pid=5650): stderr: | 20221209123140366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123140366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123140366 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123140366 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123140367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123140367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123140367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:41.850347 run osmo-stp_10.42.42.5(pid=5650): stdout: | (launched: 2022-12-09_12:31:40.194956) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:41.976346 run osmo-stp_10.42.42.5(pid=5650): stderr: | 20221209123140366 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123140366 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123140366 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123140366 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123140367 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123140367 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123140367 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:42.125772 run patchelf(pid=5653): Terminating (SIGINT) 12:31:42.299747 run patchelf(pid=5653): Terminated: ok {rc=0} 12:31:42.425685 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5650): Process ended prematurely: osmo-stp_10.42.42.5(pid=5650) [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5650)] [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 12:31:42.435266 tst iperf3m4.py:8: Test FAILED (10.6 sec) 12:31:42.462980 run osmo-hlr_10.42.42.2(pid=5647): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5647)] 12:31:42.510933 run osmo-hlr_10.42.42.2(pid=5647): stdout: | (launched: 2022-12-09_12:31:39.219673) 12:31:42.560501 run osmo-hlr_10.42.42.2(pid=5647): stderr: | 20221209123139400 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123139400 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123139400 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123139400 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123139400 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123139400 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123139413 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123139422 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123139422 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123139422 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:31:42.610453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5636): Terminating (SIGTERM) 12:31:42.650442 run iperf3-srv_10.42.42.10(pid=5637): Terminating (SIGTERM) 12:31:42.690252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5638): Terminating (SIGTERM) 12:31:42.730125 run iperf3-srv_10.42.42.10(pid=5639): Terminating (SIGTERM) 12:31:42.769792 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5640): Terminating (SIGTERM) 12:31:42.809396 run iperf3-srv_10.42.42.10(pid=5641): Terminating (SIGTERM) 12:31:42.849170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5642): Terminating (SIGTERM) 12:31:42.888772 run iperf3-srv_10.42.42.10(pid=5643): Terminating (SIGTERM) 12:31:42.928426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5646): Terminating (SIGTERM) 12:31:42.968323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5649): Terminating (SIGTERM) 12:31:43.008110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5652): Terminating (SIGTERM) 12:31:43.048788 --- ParallelTerminationStrategy: PID 5636 died... 12:31:43.068132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5636): Terminated: ok {rc=0} 12:31:43.112289 --- ParallelTerminationStrategy: PID 5637 died... 12:31:43.131013 run iperf3-srv_10.42.42.10(pid=5637): Terminated {rc=256} 12:31:43.174837 --- ParallelTerminationStrategy: PID 5638 died... 12:31:43.193451 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5638): Terminated: ok {rc=0} 12:31:43.237272 --- ParallelTerminationStrategy: PID 5639 died... 12:31:43.255882 run iperf3-srv_10.42.42.10(pid=5639): Terminated {rc=256} 12:31:43.299399 --- ParallelTerminationStrategy: PID 5640 died... 12:31:43.318093 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5640): Terminated: ok {rc=0} 12:31:43.361792 --- ParallelTerminationStrategy: PID 5641 died... 12:31:43.380405 run iperf3-srv_10.42.42.10(pid=5641): Terminated {rc=256} 12:31:43.424573 --- ParallelTerminationStrategy: PID 5642 died... 12:31:43.443299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=5642): Terminated: ok {rc=0} 12:31:43.486949 --- ParallelTerminationStrategy: PID 5643 died... 12:31:43.505507 run iperf3-srv_10.42.42.10(pid=5643): Terminated {rc=256} 12:31:43.549896 --- ParallelTerminationStrategy: PID 5646 died... 12:31:43.568571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5646): Terminated: ok {rc=0} 12:31:43.612916 --- ParallelTerminationStrategy: PID 5649 died... 12:31:43.631956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5649): Terminated: ok {rc=0} 12:31:43.676280 --- ParallelTerminationStrategy: PID 5652 died... 12:31:43.695044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5652): Terminated: ok {rc=0} 12:31:43.782056 bus /gobi_4: Setting Powered False 12:31:44.883596 bus /gobi_4: Setting Powered False 12:31:45.997454 bus /gobi_1: Setting Powered False 12:31:47.095547 bus /gobi_1: Setting Powered False 12:31:48.214912 bus /gobi_0: Setting Powered False 12:31:49.314269 bus /gobi_0: Setting Powered False 12:31:50.431314 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 12:31:51.536279 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:51.548690 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:31:51.599728 tst ping.py: using LAC 21480 12:31:51.719689 tst ping.py: using RAC 60 12:31:51.838675 tst ping.py: using CellId 21480 12:31:51.958618 tst ping.py: using BVCI 21481 12:31:52.069440 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:52.080865 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:52.092179 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:52.103437 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:52.114795 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:52.126052 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:52.138010 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:52.149429 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:31:52.269989 tst ping.py:19: start network... 12:31:52.488377 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:31:52.989205 run create_hlr_db(pid=5654): Launched 12:31:53.114430 bus /gobi_6: Setting Powered False 12:31:54.178595 run create_hlr_db(pid=5654): Terminated: ok {rc=0} 12:31:54.631412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5656): Launched 12:31:54.956899 run osmo-hlr_10.42.42.2(pid=5657): Launched 12:31:55.082300 run osmo-stp_10.42.42.5: Starting osmo-stp 12:31:55.648352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5659): Launched 12:31:55.972348 run osmo-stp_10.42.42.5(pid=5660): Launched 12:31:56.097311 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:31:56.655815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5662): Launched 12:31:56.781837 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:31:57.055775 run patchelf(pid=5663): Launched 12:31:57.236412 run osmo-stp_10.42.42.5(pid=5660): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5660)] 12:31:57.373859 run osmo-stp_10.42.42.5(pid=5660): stdout: | (launched: 2022-12-09_12:31:55.912617) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:57.512174 run osmo-stp_10.42.42.5(pid=5660): stderr: | 20221209123156103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123156103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123156103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123156104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123156104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123156104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123156104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:57.651623 run osmo-stp_10.42.42.5(pid=5660): stdout: | (launched: 2022-12-09_12:31:55.912617) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:31:57.784061 run osmo-stp_10.42.42.5(pid=5660): stderr: | 20221209123156103 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123156103 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123156103 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123156104 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123156104 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123156104 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123156104 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:31:57.940722 run patchelf(pid=5663): Terminating (SIGINT) 12:31:58.123572 run patchelf(pid=5663): Terminated: ok {rc=0} 12:31:58.255639 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=5660): Process ended prematurely: osmo-stp_10.42.42.5(pid=5660) [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5660)] [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 12:31:58.265406 tst ping.py:22: Test FAILED (6.7 sec) 12:31:58.294353 run osmo-hlr_10.42.42.2(pid=5657): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5657)] 12:31:58.345426 run osmo-hlr_10.42.42.2(pid=5657): stdout: | (launched: 2022-12-09_12:31:54.897392) 12:31:58.398497 run osmo-hlr_10.42.42.2(pid=5657): stderr: | 20221209123155096 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123155096 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123155096 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123155096 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123155096 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123155096 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123155109 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123155118 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123155118 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123155118 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:31:58.451882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5656): Terminating (SIGTERM) 12:31:58.494533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5659): Terminating (SIGTERM) 12:31:58.537149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5662): Terminating (SIGTERM) 12:31:58.580027 --- ParallelTerminationStrategy: PID 5656 died... 12:31:58.600619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5656): Terminated: ok {rc=0} 12:31:58.648765 --- ParallelTerminationStrategy: PID 5659 died... 12:31:58.668685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5659): Terminated: ok {rc=0} 12:31:58.715802 --- ParallelTerminationStrategy: PID 5662 died... 12:31:58.735546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5662): Terminated: ok {rc=0} 12:31:58.825319 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2359 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 12:31:59.911827 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:31:59.924198 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 12:31:59.978387 tst ping_idle_ping.py: using LAC 21481 12:32:00.098641 tst ping_idle_ping.py: using RAC 61 12:32:00.217881 tst ping_idle_ping.py: using CellId 21481 12:32:00.335612 tst ping_idle_ping.py: using BVCI 21482 12:32:00.446335 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:32:00.457969 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:32:00.469380 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:32:00.480641 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:32:00.491918 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:32:00.503260 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:32:00.515346 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 12:32:00.526925 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 12:32:00.645950 tst ping_idle_ping.py:24: start network... 12:32:00.887574 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:32:01.385610 run create_hlr_db(pid=5664): Launched 12:32:01.550648 bus /gobi_6: Setting Powered False 12:32:02.615898 run create_hlr_db(pid=5664): Terminated: ok {rc=0} 12:32:03.072800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5666): Launched 12:32:03.399238 run osmo-hlr_10.42.42.2(pid=5667): Launched 12:32:03.525179 run osmo-stp_10.42.42.5: Starting osmo-stp 12:32:04.085495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5669): Launched 12:32:04.413234 run osmo-stp_10.42.42.5(pid=5670): Launched 12:32:04.537033 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:32:05.098776 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5672): Launched 12:32:05.224237 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:32:05.499595 run patchelf(pid=5673): Launched 12:32:05.683564 run osmo-stp_10.42.42.5(pid=5670): ERR: Terminated: ERROR {rc=1} [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5670)] 12:32:05.821988 run osmo-stp_10.42.42.5(pid=5670): stdout: | (launched: 2022-12-09_12:32:04.352457) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:05.961430 run osmo-stp_10.42.42.5(pid=5670): stderr: | 20221209123204545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123204546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123204546 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123204546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123204547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123204547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123204547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:06.100690 run osmo-stp_10.42.42.5(pid=5670): stdout: | (launched: 2022-12-09_12:32:04.352457) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:06.233878 run osmo-stp_10.42.42.5(pid=5670): stderr: | 20221209123204545 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123204546 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123204546 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123204546 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123204547 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123204547 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123204547 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:06.391750 run patchelf(pid=5673): Terminating (SIGINT) 12:32:06.576257 run patchelf(pid=5673): Terminated: ok {rc=0} 12:32:06.709962 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=5670): Process ended prematurely: osmo-stp_10.42.42.5(pid=5670) [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5670)] [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 12:32:06.719665 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 12:32:06.748906 run osmo-hlr_10.42.42.2(pid=5667): ERR: Terminated: ERROR {rc=237} [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5667)] 12:32:06.800429 run osmo-hlr_10.42.42.2(pid=5667): stdout: | (launched: 2022-12-09_12:32:03.339221) 12:32:06.853822 run osmo-hlr_10.42.42.2(pid=5667): stderr: | 20221209123203536 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123203536 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123203536 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123203537 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123203537 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123203537 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123203549 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123203557 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123203558 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123203558 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:32:06.907403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5666): Terminating (SIGTERM) 12:32:06.950434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5669): Terminating (SIGTERM) 12:32:06.993611 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5672): Terminating (SIGTERM) 12:32:07.036872 --- ParallelTerminationStrategy: PID 5666 died... 12:32:07.057436 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5666): Terminated: ok {rc=0} 12:32:07.105301 --- ParallelTerminationStrategy: PID 5669 died... 12:32:07.125118 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5669): Terminated: ok {rc=0} 12:32:07.172740 --- ParallelTerminationStrategy: PID 5672 died... 12:32:07.192689 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5672): Terminated: ok {rc=0} 12:32:07.282598 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 12:32:08.600642 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:32:08.608455 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 12:32:08.641196 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 12:32:08.675519 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 12:32:08.730105 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 12:32:08.763296 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 12:32:08.797209 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 12:32:09.358000 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2359 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 12:32:09.363040 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:32:09.374705 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 12:32:09.441627 tst switch_tch_pdch.py: using LAC 21482 12:32:09.561538 tst switch_tch_pdch.py: using RAC 62 12:32:09.679747 tst switch_tch_pdch.py: using CellId 21482 12:32:09.803597 tst switch_tch_pdch.py: using BVCI 21483 12:32:09.913890 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:32:09.925502 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:32:09.936763 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:32:09.948165 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:32:09.959467 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:32:09.970789 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:32:09.982286 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 12:32:09.993730 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:32:10.114552 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 12:32:10.234310 tst switch_tch_pdch.py:51: start network... 12:32:10.437163 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:32:10.905098 run create_hlr_db(pid=5677): Launched 12:32:11.028611 bus /gobi_6: Setting Powered False 12:32:12.089899 run create_hlr_db(pid=5677): Terminated: ok {rc=0} 12:32:12.534418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5679): Launched 12:32:12.859303 run osmo-hlr_10.42.42.2(pid=5680): Launched 12:32:12.984410 run osmo-stp_10.42.42.5: Starting osmo-stp 12:32:13.540501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5682): Launched 12:32:13.866507 run osmo-stp_10.42.42.5(pid=5683): Launched 12:32:13.991437 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 12:32:14.553351 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5685): Launched 12:32:14.679328 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 12:32:14.955256 run patchelf(pid=5686): Launched 12:32:15.138786 run osmo-stp_10.42.42.5(pid=5683): ERR: Terminated: ERROR {rc=1} [trial-2359↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5683)] 12:32:15.278052 run osmo-stp_10.42.42.5(pid=5683): stdout: | (launched: 2022-12-09_12:32:13.806873) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:15.418433 run osmo-stp_10.42.42.5(pid=5683): stderr: | 20221209123213998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123213998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123213998 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123213998 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123213999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123213999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123213999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:15.558535 run osmo-stp_10.42.42.5(pid=5683): stdout: | (launched: 2022-12-09_12:32:13.806873) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:15.692814 run osmo-stp_10.42.42.5(pid=5683): stderr: | 20221209123213998 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123213998 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123213998 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123213998 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123213999 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123213999 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123213999 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:15.855299 run patchelf(pid=5686): Terminating (SIGINT) 12:32:16.052302 run patchelf(pid=5686): Terminated: ok {rc=0} 12:32:16.189391 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=5683): Process ended prematurely: osmo-stp_10.42.42.5(pid=5683) [trial-2359↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5683)] [trial-2359↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 12:32:16.200225 tst switch_tch_pdch.py:54: Test FAILED (6.8 sec) 12:32:16.232537 run osmo-hlr_10.42.42.2(pid=5680): ERR: Terminated: ERROR {rc=237} [trial-2359↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5680)] 12:32:16.286299 run osmo-hlr_10.42.42.2(pid=5680): stdout: | (launched: 2022-12-09_12:32:12.800066) 12:32:16.341280 run osmo-hlr_10.42.42.2(pid=5680): stderr: | 20221209123212997 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123212997 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123212997 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123212997 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123212997 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123212997 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123213009 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123213018 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123213018 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123213018 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:32:16.396662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5679): Terminating (SIGTERM) 12:32:16.441585 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5682): Terminating (SIGTERM) 12:32:16.486531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5685): Terminating (SIGTERM) 12:32:16.531184 --- ParallelTerminationStrategy: PID 5679 died... 12:32:16.552055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5679): Terminated: ok {rc=0} 12:32:16.602386 --- ParallelTerminationStrategy: PID 5682 died... 12:32:16.623093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5682): Terminated: ok {rc=0} 12:32:16.672759 --- ParallelTerminationStrategy: PID 5685 died... 12:32:16.693568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=5685): Terminated: ok {rc=0} 12:32:16.786455 bus /gobi_0: Setting Powered False 12:32:17.891920 bus /gobi_0: Setting Powered False 12:32:19.010713 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2359 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 nitb_smpp --------------------------------------------------------------------- 12:32:20.272367 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:32:20.275059 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 12:32:20.295562 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 12:32:20.302547 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 12:32:20.336641 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 12:32:20.357162 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 12:32:20.363761 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 12:32:20.884257 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2359 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 12:32:20.889298 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 12:32:20.908194 tst esme_connect_policy_acceptall.py: using MSISDN 7205 12:32:21.054518 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:32:21.676469 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5691): Launched 12:32:22.009828 run osmo-nitb_10.42.42.2(pid=5692): Launched 12:32:22.194895 run osmo-nitb_10.42.42.2(pid=5692): ERR: Terminated: ERROR {rc=2} [trial-2359↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5692)] 12:32:22.342543 run osmo-nitb_10.42.42.2(pid=5692): stdout: | (launched: 2022-12-09_12:32:21.949260) 12:32:22.491865 run osmo-nitb_10.42.42.2(pid=5692): stderr: | (launched: 2022-12-09_12:32:21.998349) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:32:22.641988 run osmo-nitb_10.42.42.2(pid=5692): stdout: | (launched: 2022-12-09_12:32:21.949260) 12:32:22.785183 run osmo-nitb_10.42.42.2(pid=5692): stderr: | (launched: 2022-12-09_12:32:21.998349) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5692): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5692) [trial-2359↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5692)] 12:32:23.136852 tst osmo-nitb_10.42.42.2(pid=5692): stdout: | (launched: 2022-12-09_12:32:21.949260) 12:32:23.271101 tst osmo-nitb_10.42.42.2(pid=5692): stderr: | (launched: 2022-12-09_12:32:21.998349) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:32:23.430061 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=5692): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5692) [trial-2359↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5692)] [trial-2359↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 12:32:23.439146 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.5 sec) 12:32:23.446505 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5691): Terminating (SIGTERM) 12:32:23.658457 --- ParallelTerminationStrategy: PID 5691 died... 12:32:23.680615 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5691): Terminated: ok {rc=0} ---------------------------------------------- trial-2359 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 12:32:23.732545 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 12:32:23.753638 tst esme_connect_policy_closed.py: using MSISDN 7206 12:32:23.885370 tst esme_connect_policy_closed.py: using MSISDN 7207 12:32:24.005157 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:32:24.623214 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5693): Launched 12:32:24.956850 run osmo-nitb_10.42.42.2(pid=5694): Launched 12:32:25.137915 run osmo-nitb_10.42.42.2(pid=5694): ERR: Terminated: ERROR {rc=2} [trial-2359↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5694)] 12:32:25.274691 run osmo-nitb_10.42.42.2(pid=5694): stdout: | (launched: 2022-12-09_12:32:24.895718) 12:32:25.412847 run osmo-nitb_10.42.42.2(pid=5694): stderr: | (launched: 2022-12-09_12:32:24.945449) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:32:25.551077 run osmo-nitb_10.42.42.2(pid=5694): stdout: | (launched: 2022-12-09_12:32:24.895718) 12:32:25.683480 run osmo-nitb_10.42.42.2(pid=5694): stderr: | (launched: 2022-12-09_12:32:24.945449) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:32:25.841716 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=5694): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5694) [trial-2359↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5694)] [trial-2359↪nitb_smpp↪esme_connect_policy_closed.py:24] 12:32:25.850787 tst esme_connect_policy_closed.py:24: Test FAILED (2.1 sec) 12:32:25.857820 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5693): Terminating (SIGTERM) 12:32:26.070175 --- ParallelTerminationStrategy: PID 5693 died... 12:32:26.092169 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5693): Terminated: ok {rc=0} ---------------------------------------------- trial-2359 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 12:32:26.143916 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 12:32:26.155601 tst nitb_smpp: Using 1 x bts (candidates: 1) 12:32:26.195745 tst esme_ms_sms_storeforward.py: using LAC 21483 12:32:26.318663 tst esme_ms_sms_storeforward.py: using RAC 63 12:32:26.441010 tst esme_ms_sms_storeforward.py: using CellId 21483 12:32:26.564569 tst esme_ms_sms_storeforward.py: using BVCI 21484 12:32:26.678662 tst nitb_smpp: Using 1 x modem (candidates: 1) 12:32:26.808490 tst esme_ms_sms_storeforward.py: using MSISDN 7208 12:32:26.930664 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 12:32:27.158383 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:32:27.841366 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5695): Launched 12:32:28.175934 run osmo-nitb_10.42.42.2(pid=5696): Launched 12:32:28.356193 run osmo-nitb_10.42.42.2(pid=5696): ERR: Terminated: ERROR {rc=2} [trial-2359↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5696)] 12:32:28.493692 run osmo-nitb_10.42.42.2(pid=5696): stdout: | (launched: 2022-12-09_12:32:28.114915) 12:32:28.632371 run osmo-nitb_10.42.42.2(pid=5696): stderr: | (launched: 2022-12-09_12:32:28.164533) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:32:28.771112 run osmo-nitb_10.42.42.2(pid=5696): stdout: | (launched: 2022-12-09_12:32:28.114915) 12:32:28.903246 run osmo-nitb_10.42.42.2(pid=5696): stderr: | (launched: 2022-12-09_12:32:28.164533) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:32:29.061561 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=5696): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5696) [trial-2359↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5696)] [trial-2359↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 12:32:29.070511 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.9 sec) 12:32:29.077620 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5695): Terminating (SIGTERM) 12:32:29.288882 --- ParallelTerminationStrategy: PID 5695 died... 12:32:29.310090 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5695): Terminated: ok {rc=0} 12:32:29.400015 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 12:32:30.487952 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 12:32:30.499871 tst nitb_smpp: Using 1 x bts (candidates: 1) 12:32:30.535866 tst esme_ms_sms_transaction.py: using LAC 21484 12:32:30.666777 tst esme_ms_sms_transaction.py: using RAC 64 12:32:30.798715 tst esme_ms_sms_transaction.py: using CellId 21484 12:32:30.946799 tst esme_ms_sms_transaction.py: using BVCI 21485 12:32:31.074117 tst nitb_smpp: Using 1 x modem (candidates: 1) 12:32:31.205817 tst esme_ms_sms_transaction.py: using MSISDN 7209 12:32:31.322987 tst esme_ms_sms_transaction.py:18: start nitb and bts... 12:32:31.543254 run osmo-nitb_10.42.42.2: Starting osmo-nitb 12:32:32.197039 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5697): Launched 12:32:32.532068 run osmo-nitb_10.42.42.2(pid=5698): Launched 12:32:32.716932 run osmo-nitb_10.42.42.2(pid=5698): ERR: Terminated: ERROR {rc=2} [trial-2359↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5698)] 12:32:32.865538 run osmo-nitb_10.42.42.2(pid=5698): stdout: | (launched: 2022-12-09_12:32:32.471167) 12:32:33.015538 run osmo-nitb_10.42.42.2(pid=5698): stderr: | (launched: 2022-12-09_12:32:32.520714) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:32:33.165563 run osmo-nitb_10.42.42.2(pid=5698): stdout: | (launched: 2022-12-09_12:32:32.471167) 12:32:33.309218 run osmo-nitb_10.42.42.2(pid=5698): stderr: | (launched: 2022-12-09_12:32:32.520714) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=5698): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5698) [trial-2359↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5698)] 12:32:33.657980 tst osmo-nitb_10.42.42.2(pid=5698): stdout: | (launched: 2022-12-09_12:32:32.471167) 12:32:33.792680 tst osmo-nitb_10.42.42.2(pid=5698): stderr: | (launched: 2022-12-09_12:32:32.520714) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 12:32:33.951581 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=5698): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5698) [trial-2359↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5698)] [trial-2359↪nitb_smpp↪esme_ms_sms_transaction.py:21] 12:32:33.960903 tst esme_ms_sms_transaction.py:21: Test FAILED (3.5 sec) 12:32:33.968279 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5697): Terminating (SIGTERM) 12:32:34.180051 --- ParallelTerminationStrategy: PID 5697 died... 12:32:34.201917 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=5697): Terminated: ok {rc=0} 12:32:34.291544 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 smpp --------------------------------------------------------------------- 12:32:35.461188 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:32:35.464227 tst smpp: Verifying 1 x bts (candidates: 11) 12:32:35.486703 tst smpp: Verifying 6 x ip_address (candidates: 9) 12:32:35.516413 tst smpp: Verifying 1 x modem (candidates: 12) 12:32:35.553678 tst smpp: Reserving 1 x bts (candidates: 11) 12:32:35.575407 tst smpp: Reserving 6 x ip_address (candidates: 9) 12:32:35.604493 tst smpp: Reserving 1 x modem (candidates: 12) 12:32:36.127530 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2359 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 12:32:36.133543 tst smpp: Using 1 x ip_address (candidates: 6) 12:32:36.144535 tst smpp: Using 1 x ip_address (candidates: 6) 12:32:36.155438 tst smpp: Using 1 x ip_address (candidates: 6) 12:32:36.166095 tst smpp: Using 1 x ip_address (candidates: 6) 12:32:36.187616 tst esme_connect_policy_acceptall.py: using MSISDN 7210 12:32:36.310560 run osmo-stp_10.42.42.4: Starting osmo-stp 12:32:36.881616 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5705): Launched 12:32:37.217735 run osmo-stp_10.42.42.4(pid=5706): Launched 12:32:37.345642 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:32:37.862133 run create_hlr_db(pid=5707): Launched 12:32:37.988671 bus /sierra_2: Setting Powered False 12:32:39.054490 run create_hlr_db(pid=5707): Terminated: ok {rc=0} 12:32:39.518475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5709): Launched 12:32:39.851795 run osmo-hlr_10.42.42.2(pid=5710): Launched 12:32:39.979743 run osmo-msc_10.42.42.5: Starting osmo-msc 12:32:40.581133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5712): Launched 12:32:40.914927 run osmo-msc_10.42.42.5(pid=5713): Launched 12:32:41.101956 run osmo-hlr_10.42.42.2(pid=5710): ERR: Terminated: ERROR {rc=237} [trial-2359↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5710)] 12:32:41.241873 run osmo-hlr_10.42.42.2(pid=5710): stdout: | (launched: 2022-12-09_12:32:39.790938) 12:32:41.386649 run osmo-hlr_10.42.42.2(pid=5710): stderr: | 20221209123239985 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123239985 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123239985 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123239985 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123239985 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123239985 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123240000 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123240009 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123240009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123240009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:32:41.526959 run osmo-hlr_10.42.42.2(pid=5710): stdout: | (launched: 2022-12-09_12:32:39.790938) 12:32:41.659666 run osmo-hlr_10.42.42.2(pid=5710): stderr: | 20221209123239985 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123239985 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123239985 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123239985 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123239985 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123239985 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123240000 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123240009 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123240009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123240009 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:32:41.817900 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=5710): Process ended prematurely: osmo-hlr_10.42.42.2(pid=5710) [trial-2359↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5710)] [trial-2359↪smpp↪esme_connect_policy_acceptall.py:23] 12:32:41.826670 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.7 sec) 12:32:41.854776 run osmo-msc_10.42.42.5(pid=5713): ERR: Terminated: ERROR {rc=9} [trial-2359↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=5713)] 12:32:41.905753 run osmo-msc_10.42.42.5(pid=5713): stdout: | (launched: 2022-12-09_12:32:40.853802) 12:32:41.958539 run osmo-msc_10.42.42.5(pid=5713): stderr: | 20221209123241216 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209123241216 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209123241217 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123241217 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209123241217 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209123241217 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209123241217 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209123241217 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209123241217 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 12:32:42.011564 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5705): Terminating (SIGTERM) 12:32:42.054271 run osmo-stp_10.42.42.4(pid=5706): Terminating (SIGTERM) 12:32:42.097011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5709): Terminating (SIGTERM) 12:32:42.141177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5712): Terminating (SIGTERM) 12:32:42.186760 --- ParallelTerminationStrategy: PID 5705 died... 12:32:42.207237 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5705): Terminated: ok {rc=0} 12:32:42.256500 --- ParallelTerminationStrategy: PID 5706 died... 12:32:42.276251 run osmo-stp_10.42.42.4(pid=5706): Terminated: ok {rc=0} 12:32:42.323428 --- ParallelTerminationStrategy: PID 5709 died... 12:32:42.343130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5709): Terminated: ok {rc=0} 12:32:42.390284 --- ParallelTerminationStrategy: PID 5712 died... 12:32:42.409938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5712): Terminated: ok {rc=0} ---------------------------------------------- trial-2359 smpp esme_connect_policy_closed.py ---------------------------------------------- 12:32:42.461918 tst smpp: Using 1 x ip_address (candidates: 6) 12:32:42.473741 tst smpp: Using 1 x bts (candidates: 1) 12:32:42.510596 tst esme_connect_policy_closed.py: using LAC 21485 12:32:42.641295 tst esme_connect_policy_closed.py: using RAC 65 12:32:42.770982 tst esme_connect_policy_closed.py: using CellId 21485 12:32:42.902203 tst esme_connect_policy_closed.py: using BVCI 21486 12:32:43.024547 tst smpp: Using 1 x ip_address (candidates: 6) 12:32:43.035578 tst smpp: Using 1 x ip_address (candidates: 6) 12:32:43.046546 tst smpp: Using 1 x ip_address (candidates: 6) 12:32:43.066375 tst esme_connect_policy_closed.py: using MSISDN 7211 12:32:43.199449 tst esme_connect_policy_closed.py: using MSISDN 7212 12:32:43.314454 run osmo-stp_10.42.42.4: Starting osmo-stp 12:32:43.848792 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5716): Launched 12:32:44.162262 run osmo-stp_10.42.42.4(pid=5717): Launched 12:32:44.284433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:32:44.768129 run create_hlr_db(pid=5718): Launched 12:32:45.951002 run create_hlr_db(pid=5718): Terminated: ok {rc=0} 12:32:46.286695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5720): Launched 12:32:46.616332 run osmo-hlr_10.42.42.2(pid=5721): Launched 12:32:46.857968 run osmo-msc_10.42.42.5: Starting osmo-msc 12:32:47.531359 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5723): Launched 12:32:47.846516 run osmo-msc_10.42.42.5(pid=5724): Launched 12:32:48.021744 run osmo-hlr_10.42.42.2(pid=5721): ERR: Terminated: ERROR {rc=237} [trial-2359↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5721)] 12:32:48.155099 run osmo-hlr_10.42.42.2(pid=5721): stdout: | (launched: 2022-12-09_12:32:46.557145) 12:32:48.288033 run osmo-hlr_10.42.42.2(pid=5721): stderr: | 20221209123246900 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123246900 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123246900 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123246915 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123246915 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123246915 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123246933 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123246950 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123246950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123246950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:32:48.418644 run osmo-hlr_10.42.42.2(pid=5721): stdout: | (launched: 2022-12-09_12:32:46.557145) 12:32:48.543107 run osmo-hlr_10.42.42.2(pid=5721): stderr: | 20221209123246900 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123246900 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123246900 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123246915 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123246915 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123246915 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123246933 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123246950 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123246950 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123246950 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:32:48.692332 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=5721): Process ended prematurely: osmo-hlr_10.42.42.2(pid=5721) [trial-2359↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5721)] [trial-2359↪smpp↪esme_connect_policy_closed.py:31] 12:32:48.700623 tst esme_connect_policy_closed.py:31: Test FAILED (6.2 sec) 12:32:48.726837 run osmo-msc_10.42.42.5(pid=5724): ERR: Terminated: ERROR {rc=9} [trial-2359↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=5724)] 12:32:48.775055 run osmo-msc_10.42.42.5(pid=5724): stdout: | (launched: 2022-12-09_12:32:47.787903) 12:32:48.824824 run osmo-msc_10.42.42.5(pid=5724): stderr: | 20221209123248103 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | 20221209123248103 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | 20221209123248103 DLSS7 DEBUG XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123248103 DLSCCP NOTICE OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | 20221209123248104 DLSS7 NOTICE 0: Creating SCCP instance (osmo_ss7.c:458) | 20221209123248104 DLSCCP INFO Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | 20221209123248104 DLSS7 DEBUG registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | 20221209123248104 DLGLOBAL NOTICE unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221209123248104 DSGS ERROR SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 12:32:48.875550 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5716): Terminating (SIGTERM) 12:32:48.915292 run osmo-stp_10.42.42.4(pid=5717): Terminating (SIGTERM) 12:32:48.955094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5720): Terminating (SIGTERM) 12:32:48.997072 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5723): Terminating (SIGTERM) 12:32:49.040387 --- ParallelTerminationStrategy: PID 5716 died... 12:32:49.059781 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=5716): Terminated: ok {rc=0} 12:32:49.104000 --- ParallelTerminationStrategy: PID 5717 died... 12:32:49.122630 run osmo-stp_10.42.42.4(pid=5717): Terminated: ok {rc=0} 12:32:49.166616 --- ParallelTerminationStrategy: PID 5720 died... 12:32:49.185451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5720): Terminated: ok {rc=0} 12:32:49.229843 --- ParallelTerminationStrategy: PID 5723 died... 12:32:49.248503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5723): Terminated: ok {rc=0} ---------------------------------------------- trial-2359 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 12:32:49.297244 tst smpp: Using 1 x ip_address (candidates: 6) 12:32:49.308223 tst smpp: Using 1 x bts (candidates: 1) 12:32:49.343575 tst esme_ms_sms_storeforward.py: using LAC 21486 12:32:49.468360 tst esme_ms_sms_storeforward.py: using RAC 66 12:32:49.592894 tst esme_ms_sms_storeforward.py: using CellId 21486 12:32:49.718991 tst esme_ms_sms_storeforward.py: using BVCI 21487 12:32:49.834841 tst smpp: Using 1 x ip_address (candidates: 6) 12:32:49.845445 tst smpp: Using 1 x ip_address (candidates: 6) 12:32:49.855747 tst smpp: Using 1 x ip_address (candidates: 6) 12:32:49.866040 tst smpp: Using 1 x ip_address (candidates: 6) 12:32:49.876302 tst smpp: Using 1 x ip_address (candidates: 6) 12:32:49.886605 tst smpp: Using 1 x modem (candidates: 1) 12:32:50.018458 tst esme_ms_sms_storeforward.py: using MSISDN 7213 12:32:50.134468 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:32:50.621774 run create_hlr_db(pid=5727): Launched 12:32:51.807170 run create_hlr_db(pid=5727): Terminated: ok {rc=0} 12:32:52.140765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5729): Launched 12:32:52.455180 run osmo-hlr_10.42.42.2(pid=5730): Launched 12:32:52.576320 run osmo-stp_10.42.42.5: Starting osmo-stp 12:32:53.133970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5732): Launched 12:32:53.451685 run osmo-stp_10.42.42.5(pid=5733): Launched 12:32:53.573856 run osmo-msc_10.42.42.6: Starting osmo-msc 12:32:54.141401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5735): Launched 12:32:54.459181 run osmo-msc_10.42.42.6(pid=5736): Launched 12:32:54.637662 run osmo-stp_10.42.42.5(pid=5733): ERR: Terminated: ERROR {rc=1} [trial-2359↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5733)] 12:32:54.770755 run osmo-stp_10.42.42.5(pid=5733): stdout: | (launched: 2022-12-09_12:32:53.393163) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:54.903086 run osmo-stp_10.42.42.5(pid=5733): stderr: | 20221209123253566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123253567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123253567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123253567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123253568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123253568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123253568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:55.033489 run osmo-stp_10.42.42.5(pid=5733): stdout: | (launched: 2022-12-09_12:32:53.393163) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:32:55.158596 run osmo-stp_10.42.42.5(pid=5733): stderr: | 20221209123253566 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123253567 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123253567 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123253567 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123253568 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123253568 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123253568 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:32:55.307622 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=5733): Process ended prematurely: osmo-stp_10.42.42.5(pid=5733) [trial-2359↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5733)] [trial-2359↪smpp↪esme_ms_sms_storeforward.py:30] 12:32:55.316065 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.0 sec) 12:32:55.342525 run osmo-hlr_10.42.42.2(pid=5730): ERR: Terminated: ERROR {rc=237} [trial-2359↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5730)] 12:32:55.390874 run osmo-hlr_10.42.42.2(pid=5730): stdout: | (launched: 2022-12-09_12:32:52.396547) 12:32:55.440707 run osmo-hlr_10.42.42.2(pid=5730): stderr: | 20221209123252578 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123252578 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123252579 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123252579 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123252579 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123252579 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123252591 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123252601 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123252601 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123252601 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:32:55.510562 run osmo-msc_10.42.42.6(pid=5736): ERR: Terminated: ERROR {rc=2} [trial-2359↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5736)] 12:32:55.558892 run osmo-msc_10.42.42.6(pid=5736): stdout: | (launched: 2022-12-09_12:32:54.399917) 12:32:55.609187 run osmo-msc_10.42.42.6(pid=5736): stderr: | 20221209123254676 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123254676 DLGLOBAL DEBUG validating counter group 0x7f33be257c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123254676 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123254676 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123254676 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123254677 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123254679 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123254679 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123254679 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123254679 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:32:55.659418 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5729): Terminating (SIGTERM) 12:32:55.699650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5732): Terminating (SIGTERM) 12:32:55.740004 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5735): Terminating (SIGTERM) 12:32:55.780376 --- ParallelTerminationStrategy: PID 5729 died... 12:32:55.799862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5729): Terminated: ok {rc=0} 12:32:55.844589 --- ParallelTerminationStrategy: PID 5732 died... 12:32:55.863565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5732): Terminated: ok {rc=0} 12:32:55.908182 --- ParallelTerminationStrategy: PID 5735 died... 12:32:55.926968 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5735): Terminated: ok {rc=0} 12:32:56.013891 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 smpp esme_ms_sms_transaction.py ---------------------------------------------- 12:32:57.104202 tst smpp: Using 1 x ip_address (candidates: 6) 12:32:57.115986 tst smpp: Using 1 x bts (candidates: 1) 12:32:57.157541 tst esme_ms_sms_transaction.py: using LAC 21487 12:32:57.290284 tst esme_ms_sms_transaction.py: using RAC 67 12:32:57.421875 tst esme_ms_sms_transaction.py: using CellId 21487 12:32:57.554404 tst esme_ms_sms_transaction.py: using BVCI 21488 12:32:57.679572 tst smpp: Using 1 x ip_address (candidates: 6) 12:32:57.690563 tst smpp: Using 1 x ip_address (candidates: 6) 12:32:57.701451 tst smpp: Using 1 x ip_address (candidates: 6) 12:32:57.712405 tst smpp: Using 1 x ip_address (candidates: 6) 12:32:57.723470 tst smpp: Using 1 x ip_address (candidates: 6) 12:32:57.734470 tst smpp: Using 1 x modem (candidates: 1) 12:32:57.862726 tst esme_ms_sms_transaction.py: using MSISDN 7214 12:32:57.985039 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:32:58.507155 run create_hlr_db(pid=5738): Launched 12:32:58.635132 bus /sierra_2: Setting Powered False 12:32:59.697317 run create_hlr_db(pid=5738): Terminated: ok {rc=0} 12:33:00.168544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5740): Launched 12:33:00.507279 run osmo-hlr_10.42.42.2(pid=5741): Launched 12:33:00.637686 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:01.272243 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5744): Launched 12:33:01.657725 run osmo-stp_10.42.42.5(pid=5745): Launched 12:33:01.874340 run osmo-msc_10.42.42.6: Starting osmo-msc 12:33:02.554976 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5747): Launched 12:33:02.873578 run osmo-msc_10.42.42.6(pid=5748): Launched 12:33:03.050572 run osmo-stp_10.42.42.5(pid=5745): ERR: Terminated: ERROR {rc=1} [trial-2359↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5745)] 12:33:03.183606 run osmo-stp_10.42.42.5(pid=5745): stdout: | (launched: 2022-12-09_12:33:01.592059) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:03.317441 run osmo-stp_10.42.42.5(pid=5745): stderr: | 20221209123301956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123301956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123301956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123301956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123301963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123301963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123301963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:03.448934 run osmo-stp_10.42.42.5(pid=5745): stdout: | (launched: 2022-12-09_12:33:01.592059) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:03.574679 run osmo-stp_10.42.42.5(pid=5745): stderr: | 20221209123301956 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123301956 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123301956 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123301956 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123301963 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123301963 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123301963 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:03.725586 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=5745): Process ended prematurely: osmo-stp_10.42.42.5(pid=5745) [trial-2359↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5745)] [trial-2359↪smpp↪esme_ms_sms_transaction.py:28] 12:33:03.734117 tst esme_ms_sms_transaction.py:28: Test FAILED (6.6 sec) 12:33:03.760255 run osmo-hlr_10.42.42.2(pid=5741): ERR: Terminated: ERROR {rc=237} [trial-2359↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5741)] 12:33:03.808362 run osmo-hlr_10.42.42.2(pid=5741): stdout: | (launched: 2022-12-09_12:33:00.445361) 12:33:03.858464 run osmo-hlr_10.42.42.2(pid=5741): stderr: | 20221209123300648 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123300648 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123300648 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123300648 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123300648 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123300648 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123300661 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123300670 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123300670 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123300670 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:03.928345 run osmo-msc_10.42.42.6(pid=5748): ERR: Terminated: ERROR {rc=2} [trial-2359↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5748)] 12:33:03.976654 run osmo-msc_10.42.42.6(pid=5748): stdout: | (launched: 2022-12-09_12:33:02.814995) 12:33:04.026636 run osmo-msc_10.42.42.6(pid=5748): stderr: | 20221209123303091 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123303092 DLGLOBAL DEBUG validating counter group 0x7f86db236c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123303092 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123303092 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123303092 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123303092 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123303094 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123303095 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123303095 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123303095 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:33:04.076816 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5740): Terminating (SIGTERM) 12:33:04.117389 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5744): Terminating (SIGTERM) 12:33:04.157985 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5747): Terminating (SIGTERM) 12:33:04.198735 --- ParallelTerminationStrategy: PID 5740 died... 12:33:04.218233 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5740): Terminated: ok {rc=0} 12:33:04.263010 --- ParallelTerminationStrategy: PID 5744 died... 12:33:04.281998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5744): Terminated: ok {rc=0} 12:33:04.326522 --- ParallelTerminationStrategy: PID 5747 died... 12:33:04.345568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5747): Terminated: ok {rc=0} 12:33:04.432716 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 encryption --------------------------------------------------------------------- 12:33:05.626318 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:33:05.629216 tst encryption: Verifying 1 x bts (candidates: 11) 12:33:05.650087 tst encryption: Verifying 6 x ip_address (candidates: 9) 12:33:05.677471 tst encryption: Verifying 1 x modem (candidates: 12) 12:33:05.714286 tst encryption: Reserving 1 x bts (candidates: 11) 12:33:05.735531 tst encryption: Reserving 6 x ip_address (candidates: 9) 12:33:05.762238 tst encryption: Reserving 1 x modem (candidates: 12) 12:33:06.292074 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2359 encryption register_a5_0_authopt.py ---------------------------------------------- 12:33:06.349467 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:06.360728 tst encryption: Using 1 x bts (candidates: 1) 12:33:06.397251 tst register_a5_0_authopt.py: using LAC 21488 12:33:06.529352 tst register_a5_0_authopt.py: using RAC 68 12:33:06.662307 tst register_a5_0_authopt.py: using CellId 21488 12:33:06.795618 tst register_a5_0_authopt.py: using BVCI 21489 12:33:06.921258 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:06.932433 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:06.943382 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:06.954677 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:06.965917 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:06.977156 tst encryption: Using 1 x modem (candidates: 1) 12:33:07.095547 tst register_a5_0_authopt.py:8: start network... 12:33:07.310317 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:33:07.802732 run create_hlr_db(pid=5753): Launched 12:33:07.934009 bus /sierra_2: Setting Powered False 12:33:08.996803 run create_hlr_db(pid=5753): Terminated: ok {rc=0} 12:33:09.439727 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5755): Launched 12:33:09.761413 run osmo-hlr_10.42.42.2(pid=5756): Launched 12:33:09.882590 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:10.432002 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5758): Launched 12:33:10.752377 run osmo-stp_10.42.42.5(pid=5759): Launched 12:33:10.876791 run osmo-msc_10.42.42.6: Starting osmo-msc 12:33:11.447750 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5761): Launched 12:33:11.769395 run osmo-msc_10.42.42.6(pid=5762): Launched 12:33:11.947231 run osmo-stp_10.42.42.5(pid=5759): ERR: Terminated: ERROR {rc=1} [trial-2359↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5759)] 12:33:12.080021 run osmo-stp_10.42.42.5(pid=5759): stdout: | (launched: 2022-12-09_12:33:10.693461) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:12.213287 run osmo-stp_10.42.42.5(pid=5759): stderr: | 20221209123310867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123310867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123310867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123310868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123310868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123310868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123310868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:12.344748 run osmo-stp_10.42.42.5(pid=5759): stdout: | (launched: 2022-12-09_12:33:10.693461) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:12.470153 run osmo-stp_10.42.42.5(pid=5759): stderr: | 20221209123310867 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123310867 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123310867 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123310868 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123310868 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123310868 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123310868 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:12.620065 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5759): Process ended prematurely: osmo-stp_10.42.42.5(pid=5759) [trial-2359↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5759)] [trial-2359↪encryption↪register_a5_0_authopt.py:8] 12:33:12.629056 tst register_a5_0_authopt.py:8: Test FAILED (6.3 sec) 12:33:12.655568 run osmo-hlr_10.42.42.2(pid=5756): ERR: Terminated: ERROR {rc=237} [trial-2359↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5756)] 12:33:12.703749 run osmo-hlr_10.42.42.2(pid=5756): stdout: | (launched: 2022-12-09_12:33:09.701682) 12:33:12.753617 run osmo-hlr_10.42.42.2(pid=5756): stderr: | 20221209123309885 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123309885 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123309885 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123309885 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123309885 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123309885 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123309898 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123309906 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123309906 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123309907 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:12.823296 run osmo-msc_10.42.42.6(pid=5762): ERR: Terminated: ERROR {rc=2} [trial-2359↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5762)] 12:33:12.871331 run osmo-msc_10.42.42.6(pid=5762): stdout: | (launched: 2022-12-09_12:33:11.709535) 12:33:12.921309 run osmo-msc_10.42.42.6(pid=5762): stderr: | 20221209123311985 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123311985 DLGLOBAL DEBUG validating counter group 0x7f93cd58fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123311985 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123311986 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123311986 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123311986 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123311988 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123311988 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123311988 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123311988 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:33:12.971481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5755): Terminating (SIGTERM) 12:33:13.011545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5758): Terminating (SIGTERM) 12:33:13.051836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5761): Terminating (SIGTERM) 12:33:13.092259 --- ParallelTerminationStrategy: PID 5755 died... 12:33:13.111241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5755): Terminated: ok {rc=0} 12:33:13.155714 --- ParallelTerminationStrategy: PID 5758 died... 12:33:13.174526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5758): Terminated: ok {rc=0} 12:33:13.218725 --- ParallelTerminationStrategy: PID 5761 died... 12:33:13.237453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5761): Terminated: ok {rc=0} 12:33:13.324410 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 encryption register_a5_0_authreq.py ---------------------------------------------- 12:33:14.480189 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:14.492238 tst encryption: Using 1 x bts (candidates: 1) 12:33:14.531381 tst register_a5_0_authreq.py: using LAC 21489 12:33:14.656941 tst register_a5_0_authreq.py: using RAC 69 12:33:14.782252 tst register_a5_0_authreq.py: using CellId 21489 12:33:14.907682 tst register_a5_0_authreq.py: using BVCI 21490 12:33:15.024157 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:15.034745 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:15.045168 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:15.055437 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:15.065773 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:15.076019 tst encryption: Using 1 x modem (candidates: 1) 12:33:15.198559 tst register_a5_0_authreq.py:8: start network... 12:33:15.429358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:33:15.981732 run create_hlr_db(pid=5764): Launched 12:33:16.165796 bus /sierra_2: Setting Powered False 12:33:17.235505 run create_hlr_db(pid=5764): Terminated: ok {rc=0} 12:33:17.711659 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5766): Launched 12:33:18.052558 run osmo-hlr_10.42.42.2(pid=5767): Launched 12:33:18.183913 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:18.766986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5769): Launched 12:33:19.107485 run osmo-stp_10.42.42.5(pid=5770): Launched 12:33:19.239326 run osmo-msc_10.42.42.6: Starting osmo-msc 12:33:19.853283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5772): Launched 12:33:20.196540 run osmo-msc_10.42.42.6(pid=5773): Launched 12:33:20.388003 run osmo-stp_10.42.42.5(pid=5770): ERR: Terminated: ERROR {rc=1} [trial-2359↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5770)] 12:33:20.530326 run osmo-stp_10.42.42.5(pid=5770): stdout: | (launched: 2022-12-09_12:33:19.045163) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:20.674714 run osmo-stp_10.42.42.5(pid=5770): stderr: | 20221209123319239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123319239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123319239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123319240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123319240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123319240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123319240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:20.816077 run osmo-stp_10.42.42.5(pid=5770): stdout: | (launched: 2022-12-09_12:33:19.045163) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:20.950694 run osmo-stp_10.42.42.5(pid=5770): stderr: | 20221209123319239 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123319239 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123319239 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123319240 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123319240 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123319240 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123319240 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:21.111604 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5770): Process ended prematurely: osmo-stp_10.42.42.5(pid=5770) [trial-2359↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5770)] [trial-2359↪encryption↪register_a5_0_authreq.py:8] 12:33:21.121333 tst register_a5_0_authreq.py:8: Test FAILED (6.7 sec) 12:33:21.150154 run osmo-hlr_10.42.42.2(pid=5767): ERR: Terminated: ERROR {rc=237} [trial-2359↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5767)] 12:33:21.201186 run osmo-hlr_10.42.42.2(pid=5767): stdout: | (launched: 2022-12-09_12:33:17.990080) 12:33:21.254057 run osmo-hlr_10.42.42.2(pid=5767): stderr: | 20221209123318195 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123318196 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123318196 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123318196 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123318196 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123318196 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123318208 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123318216 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123318216 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123318216 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:21.327583 run osmo-msc_10.42.42.6(pid=5773): ERR: Terminated: ERROR {rc=2} [trial-2359↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5773)] 12:33:21.378767 run osmo-msc_10.42.42.6(pid=5773): stdout: | (launched: 2022-12-09_12:33:20.133684) 12:33:21.431850 run osmo-msc_10.42.42.6(pid=5773): stderr: | 20221209123320460 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123320460 DLGLOBAL DEBUG validating counter group 0x7fa60e925c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123320460 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123320460 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123320461 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123320461 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123320462 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123320463 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123320463 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123320463 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:33:21.485080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5766): Terminating (SIGTERM) 12:33:21.527958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5769): Terminating (SIGTERM) 12:33:21.571115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5772): Terminating (SIGTERM) 12:33:21.614513 --- ParallelTerminationStrategy: PID 5766 died... 12:33:21.635237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5766): Terminated: ok {rc=0} 12:33:21.683089 --- ParallelTerminationStrategy: PID 5769 died... 12:33:21.702918 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5769): Terminated: ok {rc=0} 12:33:21.750422 --- ParallelTerminationStrategy: PID 5772 died... 12:33:21.770460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5772): Terminated: ok {rc=0} 12:33:21.860543 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 encryption register_a5_1_authreq.py ---------------------------------------------- 12:33:23.016815 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:23.028849 tst encryption: Using 1 x bts (candidates: 1) 12:33:23.066930 tst register_a5_1_authreq.py: using LAC 21490 12:33:23.201799 tst register_a5_1_authreq.py: using RAC 70 12:33:23.327273 tst register_a5_1_authreq.py: using CellId 21490 12:33:23.453433 tst register_a5_1_authreq.py: using BVCI 21491 12:33:23.570672 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:23.581648 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:23.592220 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:23.602838 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:23.613250 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:23.623562 tst encryption: Using 1 x modem (candidates: 1) 12:33:23.745713 tst register_a5_1_authreq.py:8: start network... 12:33:23.975664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:33:24.502330 run create_hlr_db(pid=5775): Launched 12:33:24.633462 bus /sierra_2: Setting Powered False 12:33:25.700260 run create_hlr_db(pid=5775): Terminated: ok {rc=0} 12:33:26.174698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5777): Launched 12:33:26.516691 run osmo-hlr_10.42.42.2(pid=5778): Launched 12:33:26.649419 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:27.249677 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5780): Launched 12:33:27.570811 run osmo-stp_10.42.42.5(pid=5781): Launched 12:33:27.694335 run osmo-msc_10.42.42.6: Starting osmo-msc 12:33:28.266130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5783): Launched 12:33:28.584514 run osmo-msc_10.42.42.6(pid=5784): Launched 12:33:28.762522 run osmo-stp_10.42.42.5(pid=5781): ERR: Terminated: ERROR {rc=1} [trial-2359↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5781)] 12:33:28.896719 run osmo-stp_10.42.42.5(pid=5781): stdout: | (launched: 2022-12-09_12:33:27.511522) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:29.030337 run osmo-stp_10.42.42.5(pid=5781): stderr: | 20221209123327684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123327684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123327684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123327685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123327685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123327686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123327686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:29.162448 run osmo-stp_10.42.42.5(pid=5781): stdout: | (launched: 2022-12-09_12:33:27.511522) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:29.287910 run osmo-stp_10.42.42.5(pid=5781): stderr: | 20221209123327684 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123327684 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123327684 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123327685 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123327685 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123327686 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123327686 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:29.438132 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5781): Process ended prematurely: osmo-stp_10.42.42.5(pid=5781) [trial-2359↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5781)] [trial-2359↪encryption↪register_a5_1_authreq.py:8] 12:33:29.446910 tst register_a5_1_authreq.py:8: Test FAILED (6.5 sec) 12:33:29.473743 run osmo-hlr_10.42.42.2(pid=5778): ERR: Terminated: ERROR {rc=237} [trial-2359↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5778)] 12:33:29.522349 run osmo-hlr_10.42.42.2(pid=5778): stdout: | (launched: 2022-12-09_12:33:26.454089) 12:33:29.572599 run osmo-hlr_10.42.42.2(pid=5778): stderr: | 20221209123326655 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123326655 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123326655 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123326655 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123326655 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123326655 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123326667 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123326675 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123326675 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123326675 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:29.642582 run osmo-msc_10.42.42.6(pid=5784): ERR: Terminated: ERROR {rc=2} [trial-2359↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5784)] 12:33:29.690869 run osmo-msc_10.42.42.6(pid=5784): stdout: | (launched: 2022-12-09_12:33:28.525616) 12:33:29.740787 run osmo-msc_10.42.42.6(pid=5784): stderr: | 20221209123328800 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123328800 DLGLOBAL DEBUG validating counter group 0x7ff479ae7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123328800 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123328800 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123328801 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123328801 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123328803 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123328803 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123328803 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123328803 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:33:29.791258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5777): Terminating (SIGTERM) 12:33:29.831632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5780): Terminating (SIGTERM) 12:33:29.872645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5783): Terminating (SIGTERM) 12:33:29.913455 --- ParallelTerminationStrategy: PID 5777 died... 12:33:29.932793 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5777): Terminated: ok {rc=0} 12:33:29.977897 --- ParallelTerminationStrategy: PID 5780 died... 12:33:29.996848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5780): Terminated: ok {rc=0} 12:33:30.041342 --- ParallelTerminationStrategy: PID 5783 died... 12:33:30.060190 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5783): Terminated: ok {rc=0} 12:33:30.147360 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2359 encryption register_a5_3_authreq.py ---------------------------------------------- 12:33:31.305556 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:31.318047 tst encryption: Using 1 x bts (candidates: 1) 12:33:31.357470 tst register_a5_3_authreq.py: using LAC 21491 12:33:31.518610 tst register_a5_3_authreq.py: using RAC 71 12:33:31.689150 tst register_a5_3_authreq.py: using CellId 21491 12:33:31.851596 tst register_a5_3_authreq.py: using BVCI 21492 12:33:31.996301 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:32.008045 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:32.020328 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:32.031866 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:32.044136 tst encryption: Using 1 x ip_address (candidates: 6) 12:33:32.056214 tst encryption: Using 1 x modem (candidates: 1) 12:33:32.188716 tst register_a5_3_authreq.py:8: start network... 12:33:32.408521 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:33:32.902898 run create_hlr_db(pid=5786): Launched 12:33:33.033544 bus /sierra_2: Setting Powered False 12:33:34.096392 run create_hlr_db(pid=5786): Terminated: ok {rc=0} 12:33:34.539572 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5788): Launched 12:33:34.862000 run osmo-hlr_10.42.42.2(pid=5789): Launched 12:33:34.983971 run osmo-stp_10.42.42.5: Starting osmo-stp 12:33:35.530913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5791): Launched 12:33:35.852370 run osmo-stp_10.42.42.5(pid=5792): Launched 12:33:35.975893 run osmo-msc_10.42.42.6: Starting osmo-msc 12:33:36.552188 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5794): Launched 12:33:36.872460 run osmo-msc_10.42.42.6(pid=5795): Launched 12:33:37.050479 run osmo-stp_10.42.42.5(pid=5792): ERR: Terminated: ERROR {rc=1} [trial-2359↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5792)] 12:33:37.186570 run osmo-stp_10.42.42.5(pid=5792): stdout: | (launched: 2022-12-09_12:33:35.793270) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:37.321224 run osmo-stp_10.42.42.5(pid=5792): stderr: | 20221209123335967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123335967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123335967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123335968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123335968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123335968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123335968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:37.454138 run osmo-stp_10.42.42.5(pid=5792): stdout: | (launched: 2022-12-09_12:33:35.793270) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:33:37.580444 run osmo-stp_10.42.42.5(pid=5792): stderr: | 20221209123335967 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123335967 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123335967 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123335968 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123335968 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123335968 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123335968 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:33:37.731883 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=5792): Process ended prematurely: osmo-stp_10.42.42.5(pid=5792) [trial-2359↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5792)] [trial-2359↪encryption↪register_a5_3_authreq.py:8] 12:33:37.741030 tst register_a5_3_authreq.py:8: Test FAILED (6.5 sec) 12:33:37.767597 run osmo-hlr_10.42.42.2(pid=5789): ERR: Terminated: ERROR {rc=237} [trial-2359↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5789)] 12:33:37.815735 run osmo-hlr_10.42.42.2(pid=5789): stdout: | (launched: 2022-12-09_12:33:34.802877) 12:33:37.865598 run osmo-hlr_10.42.42.2(pid=5789): stderr: | 20221209123334986 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123334986 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123334986 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123334986 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123334986 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123334986 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123334998 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123335006 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123335006 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123335006 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:33:37.935082 run osmo-msc_10.42.42.6(pid=5795): ERR: Terminated: ERROR {rc=2} [trial-2359↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5795)] 12:33:37.983797 run osmo-msc_10.42.42.6(pid=5795): stdout: | (launched: 2022-12-09_12:33:36.813493) 12:33:38.033647 run osmo-msc_10.42.42.6(pid=5795): stderr: | 20221209123337090 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123337090 DLGLOBAL DEBUG validating counter group 0x7f86ac934c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123337090 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123337090 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123337090 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123337090 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123337092 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123337092 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123337093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123337093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:33:38.083809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5788): Terminating (SIGTERM) 12:33:38.124411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5791): Terminating (SIGTERM) 12:33:38.164890 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5794): Terminating (SIGTERM) 12:33:38.205249 --- ParallelTerminationStrategy: PID 5788 died... 12:33:38.224495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5788): Terminated: ok {rc=0} 12:33:38.269436 --- ParallelTerminationStrategy: PID 5791 died... 12:33:38.288120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5791): Terminated: ok {rc=0} 12:33:38.332682 --- ParallelTerminationStrategy: PID 5794 died... 12:33:38.351628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5794): Terminated: ok {rc=0} 12:33:38.439184 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 12:33:39.650346 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:33:39.656219 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 12:33:39.675554 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 12:33:39.704842 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 12:33:39.734348 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 12:33:39.753753 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 12:33:39.781678 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 12:33:40.291166 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2359 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 12:33:40.296371 tst handover.py:11: TEST_CONFIG: {} 12:33:40.527203 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:33:40.543857 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:33:40.568128 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:33:40.617717 tst handover.py: using MSISDN 7215 12:33:40.744800 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7215', subscriber_id=0} 12:33:40.863913 run srsepc_10.42.42.118: Starting srsepc 12:33:42.803507 run rm-remote-dir(pid=5801): Launched 12:33:42.939717 bus /sierra_2: Setting Powered False 12:33:44.011143 run rm-remote-dir(pid=5801): Terminated: ok {rc=0} 12:33:44.482300 run mk-remote-dir(pid=5802): Launched 12:33:45.670639 run mk-remote-dir(pid=5802): Terminated: ok {rc=0} 12:33:45.994838 run scp-inst-to-remote(pid=5803): Launched 12:33:48.248261 run scp-inst-to-remote(pid=5803): Terminated: ok {rc=0} 12:33:48.594346 run rm-remote-dir(pid=5805): Launched 12:33:49.786512 run rm-remote-dir(pid=5805): Terminated: ok {rc=0} 12:33:50.135193 run mk-remote-dir(pid=5806): Launched 12:33:51.322551 run mk-remote-dir(pid=5806): Terminated: ok {rc=0} 12:33:51.619161 run scp-cfg-to-remote(pid=5807): Launched 12:33:52.804418 run scp-cfg-to-remote(pid=5807): Terminated: ok {rc=0} 12:33:53.099276 run scp-db-to-remote(pid=5809): Launched 12:33:54.285483 run scp-db-to-remote(pid=5809): Terminated: ok {rc=0} 12:33:54.421381 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:33:54.742568 run patchelf(pid=5811): Launched 12:33:55.929584 run patchelf(pid=5811): Terminated: ok {rc=0} 12:33:56.068267 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:33:56.389964 run setcap-netadm(pid=5812): Launched 12:33:57.575616 run setcap-netadm(pid=5812): Terminated: ok {rc=0} 12:33:57.910857 run srsepc(pid=5813): Launched 12:33:58.031961 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:33:59.243696 run rm-remote-dir(pid=5814): Launched 12:33:59.438740 run srsepc(pid=5813): ERR: Terminated: ERROR {rc=127} [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=5813)] 12:33:59.586407 run srsepc(pid=5813): stdout: | (launched: 2022-12-09_12:33:57.851304) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:33:59.734824 run srsepc(pid=5813): stderr: | (launched: 2022-12-09_12:33:57.898682) | Connection to 10.42.42.116 closed. 12:33:59.882670 run srsepc(pid=5813): stdout: | (launched: 2022-12-09_12:33:57.851304) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:34:00.025622 run srsepc(pid=5813): stderr: | (launched: 2022-12-09_12:33:57.898682) | Connection to 10.42.42.116 closed. 12:34:00.195477 run rm-remote-dir(pid=5814): Terminating (SIGINT) 12:34:00.391760 run rm-remote-dir(pid=5814): Terminated: ok {rc=0} 12:34:00.533512 tst handover.py:37: ERR: Error: srsepc(pid=5813): Process ended prematurely: srsepc(pid=5813) [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=5813)] [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 12:34:00.544493 tst handover.py:37: Test FAILED (20.2 sec) 12:34:00.627879 run scp-back-log(pid=5815): Launched 12:34:01.709090 run scp-back-log(pid=5815): ERR: Terminated: ERROR {rc=1} [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=5815)] 12:34:01.772583 run scp-back-log(pid=5815): stdout: | (launched: 2022-12-09_12:34:00.594552) 12:34:01.837790 run scp-back-log(pid=5815): stderr: | (launched: 2022-12-09_12:34:00.615501) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:34:01.911332 tst srsepc_10.42.42.118: Error('scp-back-log(pid=5815): launch_sync(): local process exited with status 1 [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=5815)]') ---------------------------------------------- trial-2359 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 12:34:01.960198 tst iperf3_bidir.py:13: Number of physical ue: 1 12:34:02.181711 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:34:02.224235 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 12:34:02.434903 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:34:02.450914 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:34:02.481910 tst iperf3_bidir.py: using MSISDN 7216 12:34:02.596941 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7216', subscriber_id=0} 12:34:02.708293 run srsepc_10.42.42.118: Starting srsepc 12:34:03.359499 run rm-remote-dir(pid=5817): Launched 12:34:04.565080 run rm-remote-dir(pid=5817): Terminated: ok {rc=0} 12:34:04.936091 run mk-remote-dir(pid=5818): Launched 12:34:06.133162 run mk-remote-dir(pid=5818): Terminated: ok {rc=0} 12:34:06.450183 run scp-inst-to-remote(pid=5819): Launched 12:34:08.646733 run scp-inst-to-remote(pid=5819): Terminated: ok {rc=0} 12:34:09.016144 run rm-remote-dir(pid=5823): Launched 12:34:10.213712 run rm-remote-dir(pid=5823): Terminated: ok {rc=0} 12:34:10.584152 run mk-remote-dir(pid=5824): Launched 12:34:11.781990 run mk-remote-dir(pid=5824): Terminated: ok {rc=0} 12:34:12.098676 run scp-cfg-to-remote(pid=5825): Launched 12:34:13.294086 run scp-cfg-to-remote(pid=5825): Terminated: ok {rc=0} 12:34:13.608530 run scp-db-to-remote(pid=5827): Launched 12:34:14.804931 run scp-db-to-remote(pid=5827): Terminated: ok {rc=0} 12:34:14.949568 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:34:15.291389 run patchelf(pid=5829): Launched 12:34:16.497426 run patchelf(pid=5829): Terminated: ok {rc=0} 12:34:16.679417 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:34:17.107890 run setcap-netadm(pid=5830): Launched 12:34:18.366753 run setcap-netadm(pid=5830): Terminated: ok {rc=0} 12:34:18.701287 run srsepc(pid=5831): Launched 12:34:18.820294 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:34:20.034318 run rm-remote-dir(pid=5832): Launched 12:34:20.229498 run srsepc(pid=5831): ERR: Terminated: ERROR {rc=127} [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=5831)] 12:34:20.377288 run srsepc(pid=5831): stdout: | (launched: 2022-12-09_12:34:18.642091) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:34:20.525514 run srsepc(pid=5831): stderr: | (launched: 2022-12-09_12:34:18.689292) | Connection to 10.42.42.116 closed. 12:34:20.673998 run srsepc(pid=5831): stdout: | (launched: 2022-12-09_12:34:18.642091) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:34:20.816705 run srsepc(pid=5831): stderr: | (launched: 2022-12-09_12:34:18.689292) | Connection to 10.42.42.116 closed. 12:34:20.985458 run rm-remote-dir(pid=5832): Terminating (SIGINT) 12:34:21.181346 run rm-remote-dir(pid=5832): Terminated: ok {rc=0} 12:34:21.322697 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=5831): Process ended prematurely: srsepc(pid=5831) [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=5831)] [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 12:34:21.333578 tst iperf3_bidir.py:42: Test FAILED (19.4 sec) 12:34:21.416713 run scp-back-log(pid=5833): Launched 12:34:22.498584 run scp-back-log(pid=5833): ERR: Terminated: ERROR {rc=1} [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=5833)] 12:34:22.563367 run scp-back-log(pid=5833): stdout: | (launched: 2022-12-09_12:34:21.383561) 12:34:22.629785 run scp-back-log(pid=5833): stderr: | (launched: 2022-12-09_12:34:21.404519) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:34:22.705312 tst srsepc_10.42.42.118: Error('scp-back-log(pid=5833): launch_sync(): local process exited with status 1 [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=5833)]') ---------------------------------------------- trial-2359 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 12:34:22.753976 tst iperf3_dl.py:13: Number of physical ue: 1 12:34:22.982208 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:34:23.028816 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 12:34:23.257534 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:34:23.274244 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:34:23.306136 tst iperf3_dl.py: using MSISDN 7217 12:34:23.429586 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7217', subscriber_id=0} 12:34:23.547840 run srsepc_10.42.42.118: Starting srsepc 12:34:24.239389 run rm-remote-dir(pid=5835): Launched 12:34:25.434770 run rm-remote-dir(pid=5835): Terminated: ok {rc=0} 12:34:25.781476 run mk-remote-dir(pid=5836): Launched 12:34:26.969135 run mk-remote-dir(pid=5836): Terminated: ok {rc=0} 12:34:27.265067 run scp-inst-to-remote(pid=5837): Launched 12:34:29.454551 run scp-inst-to-remote(pid=5837): Terminated: ok {rc=0} 12:34:29.822867 run rm-remote-dir(pid=5839): Launched 12:34:31.034516 run rm-remote-dir(pid=5839): Terminated: ok {rc=0} 12:34:31.463766 run mk-remote-dir(pid=5840): Launched 12:34:32.715606 run mk-remote-dir(pid=5840): Terminated: ok {rc=0} 12:34:33.010175 run scp-cfg-to-remote(pid=5841): Launched 12:34:34.192441 run scp-cfg-to-remote(pid=5841): Terminated: ok {rc=0} 12:34:34.485690 run scp-db-to-remote(pid=5843): Launched 12:34:35.670473 run scp-db-to-remote(pid=5843): Terminated: ok {rc=0} 12:34:35.804925 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:34:36.123909 run patchelf(pid=5845): Launched 12:34:37.307987 run patchelf(pid=5845): Terminated: ok {rc=0} 12:34:37.443385 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:34:37.763258 run setcap-netadm(pid=5846): Launched 12:34:38.962826 run setcap-netadm(pid=5846): Terminated: ok {rc=0} 12:34:39.319689 run srsepc(pid=5847): Launched 12:34:39.447017 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:34:40.671370 run rm-remote-dir(pid=5848): Launched 12:34:40.868726 run srsepc(pid=5847): ERR: Terminated: ERROR {rc=127} [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=5847)] 12:34:41.016439 run srsepc(pid=5847): stdout: | (launched: 2022-12-09_12:34:39.257262) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:34:41.164283 run srsepc(pid=5847): stderr: | (launched: 2022-12-09_12:34:39.307442) | Connection to 10.42.42.116 closed. 12:34:41.312018 run srsepc(pid=5847): stdout: | (launched: 2022-12-09_12:34:39.257262) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:34:41.454986 run srsepc(pid=5847): stderr: | (launched: 2022-12-09_12:34:39.307442) | Connection to 10.42.42.116 closed. 12:34:41.624024 run rm-remote-dir(pid=5848): Terminating (SIGINT) 12:34:41.820914 run rm-remote-dir(pid=5848): Terminated: ok {rc=0} 12:34:41.962932 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=5847): Process ended prematurely: srsepc(pid=5847) [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=5847)] [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 12:34:41.973810 tst iperf3_dl.py:42: Test FAILED (19.2 sec) 12:34:42.057300 run scp-back-log(pid=5849): Launched 12:34:43.140918 run scp-back-log(pid=5849): ERR: Terminated: ERROR {rc=1} [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=5849)] 12:34:43.206529 run scp-back-log(pid=5849): stdout: | (launched: 2022-12-09_12:34:42.023897) 12:34:43.273130 run scp-back-log(pid=5849): stderr: | (launched: 2022-12-09_12:34:42.044866) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:34:43.347942 tst srsepc_10.42.42.118: Error('scp-back-log(pid=5849): launch_sync(): local process exited with status 1 [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=5849)]') ---------------------------------------------- trial-2359 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 12:34:43.396385 tst iperf3_ul.py:13: Number of physical ue: 1 12:34:43.625636 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:34:43.668355 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 12:34:43.897590 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:34:43.914349 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:34:43.946674 tst iperf3_ul.py: using MSISDN 7218 12:34:44.069920 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7218', subscriber_id=0} 12:34:44.188478 run srsepc_10.42.42.118: Starting srsepc 12:34:44.883116 run rm-remote-dir(pid=5851): Launched 12:34:46.078139 run rm-remote-dir(pid=5851): Terminated: ok {rc=0} 12:34:46.456161 run mk-remote-dir(pid=5852): Launched 12:34:47.763538 run mk-remote-dir(pid=5852): Terminated: ok {rc=0} 12:34:48.059350 run scp-inst-to-remote(pid=5853): Launched 12:34:50.245291 run scp-inst-to-remote(pid=5853): Terminated: ok {rc=0} 12:34:50.591125 run rm-remote-dir(pid=5855): Launched 12:34:51.793615 run rm-remote-dir(pid=5855): Terminated: ok {rc=0} 12:34:52.163247 run mk-remote-dir(pid=5856): Launched 12:34:53.361499 run mk-remote-dir(pid=5856): Terminated: ok {rc=0} 12:34:53.676374 run scp-cfg-to-remote(pid=5857): Launched 12:34:54.870002 run scp-cfg-to-remote(pid=5857): Terminated: ok {rc=0} 12:34:55.183441 run scp-db-to-remote(pid=5859): Launched 12:34:56.378350 run scp-db-to-remote(pid=5859): Terminated: ok {rc=0} 12:34:56.522492 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:34:56.865396 run patchelf(pid=5861): Launched 12:34:58.060269 run patchelf(pid=5861): Terminated: ok {rc=0} 12:34:58.204912 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:34:58.546767 run setcap-netadm(pid=5862): Launched 12:34:59.742353 run setcap-netadm(pid=5862): Terminated: ok {rc=0} 12:35:00.098861 run srsepc(pid=5863): Launched 12:35:00.224517 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:35:01.506585 run rm-remote-dir(pid=5864): Launched 12:35:01.862110 run srsepc(pid=5863): ERR: Terminated: ERROR {rc=127} [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=5863)] 12:35:02.015559 run srsepc(pid=5863): stdout: | (launched: 2022-12-09_12:35:00.036486) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:35:02.170365 run srsepc(pid=5863): stderr: | (launched: 2022-12-09_12:35:00.086656) | Connection to 10.42.42.116 closed. 12:35:02.320650 run srsepc(pid=5863): stdout: | (launched: 2022-12-09_12:35:00.036486) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:35:02.464070 run srsepc(pid=5863): stderr: | (launched: 2022-12-09_12:35:00.086656) | Connection to 10.42.42.116 closed. 12:35:02.634086 run rm-remote-dir(pid=5864): Terminating (SIGINT) 12:35:02.831822 run rm-remote-dir(pid=5864): Terminated: ok {rc=0} 12:35:02.973967 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=5863): Process ended prematurely: srsepc(pid=5863) [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=5863)] [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 12:35:02.985110 tst iperf3_ul.py:42: Test FAILED (19.6 sec) 12:35:03.068840 run scp-back-log(pid=5868): Launched 12:35:04.151732 run scp-back-log(pid=5868): ERR: Terminated: ERROR {rc=1} [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=5868)] 12:35:04.216558 run scp-back-log(pid=5868): stdout: | (launched: 2022-12-09_12:35:03.035471) 12:35:04.282696 run scp-back-log(pid=5868): stderr: | (launched: 2022-12-09_12:35:03.056534) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:35:04.357392 tst srsepc_10.42.42.118: Error('scp-back-log(pid=5868): launch_sync(): local process exited with status 1 [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=5868)]') ---------------------------------------------- trial-2359 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 12:35:04.406570 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:35:04.424132 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:35:04.448942 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:35:04.501523 tst ping.py: using MSISDN 7219 12:35:04.627923 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7219', subscriber_id=0} 12:35:04.747093 run srsepc_10.42.42.118: Starting srsepc 12:35:05.441537 run rm-remote-dir(pid=5870): Launched 12:35:06.639608 run rm-remote-dir(pid=5870): Terminated: ok {rc=0} 12:35:07.010237 run mk-remote-dir(pid=5871): Launched 12:35:08.203217 run mk-remote-dir(pid=5871): Terminated: ok {rc=0} 12:35:08.499853 run scp-inst-to-remote(pid=5872): Launched 12:35:10.690013 run scp-inst-to-remote(pid=5872): Terminated: ok {rc=0} 12:35:11.059478 run rm-remote-dir(pid=5874): Launched 12:35:12.252097 run rm-remote-dir(pid=5874): Terminated: ok {rc=0} 12:35:12.599928 run mk-remote-dir(pid=5875): Launched 12:35:13.786237 run mk-remote-dir(pid=5875): Terminated: ok {rc=0} 12:35:14.081631 run scp-cfg-to-remote(pid=5876): Launched 12:35:15.264921 run scp-cfg-to-remote(pid=5876): Terminated: ok {rc=0} 12:35:15.559177 run scp-db-to-remote(pid=5878): Launched 12:35:16.745247 run scp-db-to-remote(pid=5878): Terminated: ok {rc=0} 12:35:16.884328 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:35:17.209694 run patchelf(pid=5880): Launched 12:35:18.396168 run patchelf(pid=5880): Terminated: ok {rc=0} 12:35:18.530967 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:35:18.850895 run setcap-netadm(pid=5881): Launched 12:35:20.036090 run setcap-netadm(pid=5881): Terminated: ok {rc=0} 12:35:20.369542 run srsepc(pid=5882): Launched 12:35:20.490445 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:35:21.705061 run rm-remote-dir(pid=5883): Launched 12:35:21.902694 run srsepc(pid=5882): ERR: Terminated: ERROR {rc=127} [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=5882)] 12:35:22.051444 run srsepc(pid=5882): stdout: | (launched: 2022-12-09_12:35:20.310178) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:35:22.200712 run srsepc(pid=5882): stderr: | (launched: 2022-12-09_12:35:20.357252) | Connection to 10.42.42.116 closed. 12:35:22.349885 run srsepc(pid=5882): stdout: | (launched: 2022-12-09_12:35:20.310178) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:35:22.493929 run srsepc(pid=5882): stderr: | (launched: 2022-12-09_12:35:20.357252) | Connection to 10.42.42.116 closed. 12:35:22.664493 run rm-remote-dir(pid=5883): Terminating (SIGINT) 12:35:22.863473 run rm-remote-dir(pid=5883): Terminated: ok {rc=0} 12:35:23.005980 tst ping.py:16: ERR: Error: srsepc(pid=5882): Process ended prematurely: srsepc(pid=5882) [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=5882)] [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 12:35:23.017165 tst ping.py:16: Test FAILED (18.6 sec) 12:35:23.101155 run scp-back-log(pid=5884): Launched 12:35:24.184242 run scp-back-log(pid=5884): ERR: Terminated: ERROR {rc=1} [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=5884)] 12:35:24.249806 run scp-back-log(pid=5884): stdout: | (launched: 2022-12-09_12:35:23.067858) 12:35:24.316762 run scp-back-log(pid=5884): stderr: | (launched: 2022-12-09_12:35:23.088853) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:35:24.392100 tst srsepc_10.42.42.118: Error('scp-back-log(pid=5884): launch_sync(): local process exited with status 1 [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=5884)]') ---------------------------------------------- trial-2359 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 12:35:24.441574 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:35:24.459188 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:35:24.483783 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:35:24.536793 tst rrc_idle_mo_ping.py: using MSISDN 7220 12:35:24.655478 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7220', subscriber_id=0} 12:35:24.766490 run srsepc_10.42.42.118: Starting srsepc 12:35:25.414567 run rm-remote-dir(pid=5886): Launched 12:35:26.603558 run rm-remote-dir(pid=5886): Terminated: ok {rc=0} 12:35:26.950230 run mk-remote-dir(pid=5887): Launched 12:35:28.136113 run mk-remote-dir(pid=5887): Terminated: ok {rc=0} 12:35:28.431803 run scp-inst-to-remote(pid=5888): Launched 12:35:30.618952 run scp-inst-to-remote(pid=5888): Terminated: ok {rc=0} 12:35:30.972653 run rm-remote-dir(pid=5890): Launched 12:35:32.270562 run rm-remote-dir(pid=5890): Terminated: ok {rc=0} 12:35:32.644467 run mk-remote-dir(pid=5891): Launched 12:35:33.844408 run mk-remote-dir(pid=5891): Terminated: ok {rc=0} 12:35:34.159843 run scp-cfg-to-remote(pid=5892): Launched 12:35:35.353994 run scp-cfg-to-remote(pid=5892): Terminated: ok {rc=0} 12:35:35.670605 run scp-db-to-remote(pid=5894): Launched 12:35:36.864904 run scp-db-to-remote(pid=5894): Terminated: ok {rc=0} 12:35:37.009671 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:35:37.352054 run patchelf(pid=5896): Launched 12:35:38.549258 run patchelf(pid=5896): Terminated: ok {rc=0} 12:35:38.693698 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:35:39.035615 run setcap-netadm(pid=5897): Launched 12:35:40.230575 run setcap-netadm(pid=5897): Terminated: ok {rc=0} 12:35:40.587691 run srsepc(pid=5898): Launched 12:35:40.714272 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:35:41.938226 run rm-remote-dir(pid=5899): Launched 12:35:42.134542 run srsepc(pid=5898): ERR: Terminated: ERROR {rc=127} [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=5898)] 12:35:42.282154 run srsepc(pid=5898): stdout: | (launched: 2022-12-09_12:35:40.525066) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:35:42.430517 run srsepc(pid=5898): stderr: | (launched: 2022-12-09_12:35:40.575286) | Connection to 10.42.42.116 closed. 12:35:42.578802 run srsepc(pid=5898): stdout: | (launched: 2022-12-09_12:35:40.525066) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:35:42.721711 run srsepc(pid=5898): stderr: | (launched: 2022-12-09_12:35:40.575286) | Connection to 10.42.42.116 closed. 12:35:42.891170 run rm-remote-dir(pid=5899): Terminating (SIGINT) 12:35:43.088364 run rm-remote-dir(pid=5899): Terminated: ok {rc=0} 12:35:43.230482 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=5898): Process ended prematurely: srsepc(pid=5898) [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=5898)] [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 12:35:43.241508 tst rrc_idle_mo_ping.py:16: Test FAILED (18.8 sec) 12:35:43.325567 run scp-back-log(pid=5900): Launched 12:35:44.409318 run scp-back-log(pid=5900): ERR: Terminated: ERROR {rc=1} [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=5900)] 12:35:44.474796 run scp-back-log(pid=5900): stdout: | (launched: 2022-12-09_12:35:43.291965) 12:35:44.541652 run scp-back-log(pid=5900): stderr: | (launched: 2022-12-09_12:35:43.313145) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:35:44.617262 tst srsepc_10.42.42.118: Error('scp-back-log(pid=5900): launch_sync(): local process exited with status 1 [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=5900)]') ---------------------------------------------- trial-2359 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 12:35:44.667119 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 12:35:44.684718 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 12:35:44.709941 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 12:35:44.759390 tst rrc_idle_mt_ping.py: using MSISDN 7221 12:35:44.885594 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7221', subscriber_id=0} 12:35:45.005258 run srsepc_10.42.42.118: Starting srsepc 12:35:45.701648 run rm-remote-dir(pid=5902): Launched 12:35:46.957825 run rm-remote-dir(pid=5902): Terminated: ok {rc=0} 12:35:47.334043 run mk-remote-dir(pid=5903): Launched 12:35:48.524118 run mk-remote-dir(pid=5903): Terminated: ok {rc=0} 12:35:48.822708 run scp-inst-to-remote(pid=5904): Launched 12:35:51.011468 run scp-inst-to-remote(pid=5904): Terminated: ok {rc=0} 12:35:51.360522 run rm-remote-dir(pid=5906): Launched 12:35:52.547572 run rm-remote-dir(pid=5906): Terminated: ok {rc=0} 12:35:52.896896 run mk-remote-dir(pid=5907): Launched 12:35:54.085672 run mk-remote-dir(pid=5907): Terminated: ok {rc=0} 12:35:54.383205 run scp-cfg-to-remote(pid=5908): Launched 12:35:55.568558 run scp-cfg-to-remote(pid=5908): Terminated: ok {rc=0} 12:35:55.864491 run scp-db-to-remote(pid=5910): Launched 12:35:57.049930 run scp-db-to-remote(pid=5910): Terminated: ok {rc=0} 12:35:57.185896 run srsepc_10.42.42.118: Setting RPATH for srsepc 12:35:57.507284 run patchelf(pid=5912): Launched 12:35:58.693883 run patchelf(pid=5912): Terminated: ok {rc=0} 12:35:58.830751 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 12:35:59.153772 run setcap-netadm(pid=5913): Launched 12:36:00.339346 run setcap-netadm(pid=5913): Terminated: ok {rc=0} 12:36:00.676071 run srsepc(pid=5914): Launched 12:36:00.795712 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 12:36:02.106130 run rm-remote-dir(pid=5915): Launched 12:36:02.323649 run srsepc(pid=5914): ERR: Terminated: ERROR {rc=127} [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=5914)] 12:36:02.472943 run srsepc(pid=5914): stdout: | (launched: 2022-12-09_12:36:00.616839) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:36:02.621900 run srsepc(pid=5914): stderr: | (launched: 2022-12-09_12:36:00.664158) | Connection to 10.42.42.116 closed. 12:36:02.770897 run srsepc(pid=5914): stdout: | (launched: 2022-12-09_12:36:00.616839) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 12:36:02.914277 run srsepc(pid=5914): stderr: | (launched: 2022-12-09_12:36:00.664158) | Connection to 10.42.42.116 closed. 12:36:03.083931 run rm-remote-dir(pid=5915): Terminating (SIGINT) 12:36:03.281569 run rm-remote-dir(pid=5915): Terminated: ok {rc=0} 12:36:03.424555 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=5914): Process ended prematurely: srsepc(pid=5914) [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=5914)] [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 12:36:03.435758 tst rrc_idle_mt_ping.py:16: Test FAILED (18.8 sec) 12:36:03.520320 run scp-back-log(pid=5916): Launched 12:36:04.604923 run scp-back-log(pid=5916): ERR: Terminated: ERROR {rc=1} [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=5916)] 12:36:04.670793 run scp-back-log(pid=5916): stdout: | (launched: 2022-12-09_12:36:03.486678) 12:36:04.738462 run scp-back-log(pid=5916): stderr: | (launched: 2022-12-09_12:36:03.507931) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 12:36:04.814073 tst srsepc_10.42.42.118: Error('scp-back-log(pid=5916): launch_sync(): local process exited with status 1 [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=5916)]') --------------------------------------------------------------------- trial-2359 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 12:36:04.948387 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:36:04.955091 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 12:36:04.998890 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 12:36:05.026940 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 12:36:05.080924 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 12:36:05.125365 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 12:36:05.152630 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 12:36:05.703068 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 12:36:05.709092 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:36:05.720449 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 12:36:05.760112 tst handover.py: using LAC 21492 12:36:05.886324 tst handover.py: using RAC 72 12:36:06.010130 tst handover.py: using CellId 21492 12:36:06.133662 tst handover.py: using BVCI 21493 12:36:06.249055 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 12:36:06.283835 tst handover.py: using LAC 21493 12:36:06.405106 tst handover.py: using RAC 73 12:36:06.526089 tst handover.py: using CellId 21493 12:36:06.649870 tst handover.py: using BVCI 21494 12:36:06.765135 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:36:06.775836 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:36:06.786389 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:36:06.796889 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:36:06.807653 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 12:36:06.818338 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 12:36:06.937551 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 12:36:07.059943 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:36:07.577639 run create_hlr_db(pid=5922): Launched 12:36:08.766061 run create_hlr_db(pid=5922): Terminated: ok {rc=0} 12:36:09.118807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5924): Launched 12:36:09.453092 run osmo-hlr_10.42.42.2(pid=5925): Launched 12:36:09.582509 run osmo-stp_10.42.42.5: Starting osmo-stp 12:36:10.154886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5927): Launched 12:36:10.490549 run osmo-stp_10.42.42.5(pid=5928): Launched 12:36:10.618913 run osmo-msc_10.42.42.6: Starting osmo-msc 12:36:11.222196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5930): Launched 12:36:11.557130 run osmo-msc_10.42.42.6(pid=5931): Launched 12:36:11.745273 run osmo-stp_10.42.42.5(pid=5928): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5928)] 12:36:11.885595 run osmo-stp_10.42.42.5(pid=5928): stdout: | (launched: 2022-12-09_12:36:10.428760) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:12.026799 run osmo-stp_10.42.42.5(pid=5928): stderr: | 20221209123610622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123610622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123610623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123610623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123610624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123610624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123610624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:12.165557 run osmo-stp_10.42.42.5(pid=5928): stdout: | (launched: 2022-12-09_12:36:10.428760) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:12.297567 run osmo-stp_10.42.42.5(pid=5928): stderr: | 20221209123610622 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123610622 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123610623 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123610623 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123610624 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123610624 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123610624 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:12.455596 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=5928): Process ended prematurely: osmo-stp_10.42.42.5(pid=5928) [trial-2359↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5928)] [trial-2359↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 12:36:12.464530 tst handover.py:18: Test FAILED (6.7 sec) 12:36:12.492812 run osmo-hlr_10.42.42.2(pid=5925): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5925)] 12:36:12.543788 run osmo-hlr_10.42.42.2(pid=5925): stdout: | (launched: 2022-12-09_12:36:09.391675) 12:36:12.596783 run osmo-hlr_10.42.42.2(pid=5925): stderr: | 20221209123609592 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123609592 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123609592 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123609592 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123609592 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123609592 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123609604 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123609612 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123609613 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123609613 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:36:12.669968 run osmo-msc_10.42.42.6(pid=5931): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5931)] 12:36:12.720941 run osmo-msc_10.42.42.6(pid=5931): stdout: | (launched: 2022-12-09_12:36:11.495480) 12:36:12.773513 run osmo-msc_10.42.42.6(pid=5931): stderr: | 20221209123611817 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123611817 DLGLOBAL DEBUG validating counter group 0x7fbcff7a7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123611817 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123611818 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123611818 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123611818 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123611819 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123611820 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123611820 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123611820 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:36:12.826226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5924): Terminating (SIGTERM) 12:36:12.868526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5927): Terminating (SIGTERM) 12:36:12.910899 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5930): Terminating (SIGTERM) 12:36:12.953421 --- ParallelTerminationStrategy: PID 5924 died... 12:36:12.973512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5924): Terminated: ok {rc=0} 12:36:13.020814 --- ParallelTerminationStrategy: PID 5927 died... 12:36:13.040475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5927): Terminated: ok {rc=0} 12:36:13.087076 --- ParallelTerminationStrategy: PID 5930 died... 12:36:13.106758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5930): Terminated: ok {rc=0} 12:36:13.195936 bus /sierra_3: Setting Powered False 12:36:14.295265 bus /sierra_3: Setting Powered False 12:36:15.412230 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 12:36:16.706946 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:36:16.715336 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 12:36:16.759912 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 12:36:16.789771 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 12:36:16.843452 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 12:36:16.886733 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 12:36:16.916187 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 12:36:17.468625 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 12:36:17.474104 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:36:17.485532 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 12:36:17.524720 tst handover.py: using LAC 21494 12:36:17.654461 tst handover.py: using RAC 74 12:36:17.785738 tst handover.py: using CellId 21494 12:36:17.907931 tst handover.py: using BVCI 21495 12:36:18.022976 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 12:36:18.056779 tst handover.py: using LAC 21495 12:36:18.177192 tst handover.py: using RAC 75 12:36:18.297612 tst handover.py: using CellId 21495 12:36:18.418155 tst handover.py: using BVCI 21496 12:36:18.530713 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:36:18.541680 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:36:18.552274 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:36:18.563149 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:36:18.573883 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:36:18.584837 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 12:36:18.704576 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 12:36:18.822205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:36:19.281062 run create_hlr_db(pid=5936): Launched 12:36:19.407999 bus /sierra_2: Setting Powered False 12:36:20.470596 run create_hlr_db(pid=5936): Terminated: ok {rc=0} 12:36:20.902397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5938): Launched 12:36:21.239640 run osmo-hlr_10.42.42.2(pid=5939): Launched 12:36:21.370786 run osmo-stp_10.42.42.5: Starting osmo-stp 12:36:21.919304 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5941): Launched 12:36:22.245947 run osmo-stp_10.42.42.5(pid=5942): Launched 12:36:22.366637 run osmo-msc_10.42.42.6: Starting osmo-msc 12:36:22.906685 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5944): Launched 12:36:23.222808 run osmo-msc_10.42.42.6(pid=5945): Launched 12:36:23.399963 run osmo-stp_10.42.42.5(pid=5942): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5942)] 12:36:23.532618 run osmo-stp_10.42.42.5(pid=5942): stdout: | (launched: 2022-12-09_12:36:22.187893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:23.664165 run osmo-stp_10.42.42.5(pid=5942): stderr: | 20221209123622360 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123622360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123622360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123622360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123622361 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123622361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123622361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:23.794402 run osmo-stp_10.42.42.5(pid=5942): stdout: | (launched: 2022-12-09_12:36:22.187893) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:23.918372 run osmo-stp_10.42.42.5(pid=5942): stderr: | 20221209123622360 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123622360 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123622360 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123622360 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123622361 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123622361 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123622361 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:24.067012 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=5942): Process ended prematurely: osmo-stp_10.42.42.5(pid=5942) [trial-2359↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5942)] [trial-2359↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 12:36:24.075658 tst handover.py:18: Test FAILED (6.6 sec) 12:36:24.101833 run osmo-hlr_10.42.42.2(pid=5939): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5939)] 12:36:24.149952 run osmo-hlr_10.42.42.2(pid=5939): stdout: | (launched: 2022-12-09_12:36:21.177668) 12:36:24.199639 run osmo-hlr_10.42.42.2(pid=5939): stderr: | 20221209123621378 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123621378 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123621378 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123621378 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123621378 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123621378 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123621394 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123621402 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123621402 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123621402 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:36:24.269189 run osmo-msc_10.42.42.6(pid=5945): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5945)] 12:36:24.317064 run osmo-msc_10.42.42.6(pid=5945): stdout: | (launched: 2022-12-09_12:36:23.164248) 12:36:24.366723 run osmo-msc_10.42.42.6(pid=5945): stderr: | 20221209123623435 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123623435 DLGLOBAL DEBUG validating counter group 0x7faac01d6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123623436 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123623436 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123623436 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123623436 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123623438 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123623438 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123623438 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123623439 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:36:24.416705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5938): Terminating (SIGTERM) 12:36:24.456584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5941): Terminating (SIGTERM) 12:36:24.496520 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5944): Terminating (SIGTERM) 12:36:24.536818 --- ParallelTerminationStrategy: PID 5938 died... 12:36:24.556024 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5938): Terminated: ok {rc=0} 12:36:24.600121 --- ParallelTerminationStrategy: PID 5941 died... 12:36:24.618650 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5941): Terminated: ok {rc=0} 12:36:24.663161 --- ParallelTerminationStrategy: PID 5944 died... 12:36:24.681913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5944): Terminated: ok {rc=0} 12:36:24.769327 bus /sierra_3: Setting Powered False 12:36:25.869126 bus /sierra_3: Setting Powered False 12:36:26.986042 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 12:36:28.238248 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:36:28.243941 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 12:36:28.297553 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 12:36:28.324175 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 12:36:28.376632 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 12:36:28.429803 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 12:36:28.456366 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 12:36:29.008588 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 12:36:29.013816 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:36:29.024665 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:36:29.062204 tst handover.py: using LAC 21496 12:36:29.184896 tst handover.py: using RAC 76 12:36:29.308470 tst handover.py: using CellId 21496 12:36:29.432228 tst handover.py: using BVCI 21497 12:36:29.546820 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:36:29.595975 tst handover.py: using LAC 21497 12:36:29.723839 tst handover.py: using RAC 77 12:36:29.845562 tst handover.py: using CellId 21497 12:36:29.972209 tst handover.py: using BVCI 21498 12:36:30.086095 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:36:30.097142 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:36:30.107759 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:36:30.118430 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:36:30.129253 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:36:30.139886 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:36:30.260288 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:36:30.383985 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:36:30.885752 run create_hlr_db(pid=5950): Launched 12:36:31.071069 bus /sierra_2: Setting Powered False 12:36:32.151156 run create_hlr_db(pid=5950): Terminated: ok {rc=0} 12:36:32.614312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5952): Launched 12:36:32.950288 run osmo-hlr_10.42.42.2(pid=5953): Launched 12:36:33.078172 run osmo-stp_10.42.42.5: Starting osmo-stp 12:36:33.623233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5955): Launched 12:36:33.959670 run osmo-stp_10.42.42.5(pid=5956): Launched 12:36:34.088626 run osmo-msc_10.42.42.6: Starting osmo-msc 12:36:34.664495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5958): Launched 12:36:35.000476 run osmo-msc_10.42.42.6(pid=5959): Launched 12:36:35.188696 run osmo-stp_10.42.42.5(pid=5956): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5956)] 12:36:35.329658 run osmo-stp_10.42.42.5(pid=5956): stdout: | (launched: 2022-12-09_12:36:33.898324) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:35.470828 run osmo-stp_10.42.42.5(pid=5956): stderr: | 20221209123634090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123634090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123634091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123634091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123634092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123634092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123634092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:35.610094 run osmo-stp_10.42.42.5(pid=5956): stdout: | (launched: 2022-12-09_12:36:33.898324) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:35.743610 run osmo-stp_10.42.42.5(pid=5956): stderr: | 20221209123634090 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123634090 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123634091 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123634091 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123634092 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123634092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123634092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:35.902992 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=5956): Process ended prematurely: osmo-stp_10.42.42.5(pid=5956) [trial-2359↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5956)] [trial-2359↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 12:36:35.912031 tst handover.py:18: Test FAILED (6.9 sec) 12:36:35.940707 run osmo-hlr_10.42.42.2(pid=5953): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5953)] 12:36:35.991943 run osmo-hlr_10.42.42.2(pid=5953): stdout: | (launched: 2022-12-09_12:36:32.888427) 12:36:36.044722 run osmo-hlr_10.42.42.2(pid=5953): stderr: | 20221209123633088 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123633088 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123633089 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123633089 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123633089 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123633089 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123633120 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123633130 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123633130 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123633130 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:36:36.118349 run osmo-msc_10.42.42.6(pid=5959): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5959)] 12:36:36.169259 run osmo-msc_10.42.42.6(pid=5959): stdout: | (launched: 2022-12-09_12:36:34.938667) 12:36:36.221838 run osmo-msc_10.42.42.6(pid=5959): stderr: | 20221209123635261 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123635262 DLGLOBAL DEBUG validating counter group 0x7efe2f0cfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123635262 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123635262 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123635262 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123635262 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123635264 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123635264 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123635264 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123635264 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:36:36.274722 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5952): Terminating (SIGTERM) 12:36:36.317348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5955): Terminating (SIGTERM) 12:36:36.360060 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5958): Terminating (SIGTERM) 12:36:36.402997 --- ParallelTerminationStrategy: PID 5952 died... 12:36:36.423266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5952): Terminated: ok {rc=0} 12:36:36.470785 --- ParallelTerminationStrategy: PID 5955 died... 12:36:36.490732 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5955): Terminated: ok {rc=0} 12:36:36.537917 --- ParallelTerminationStrategy: PID 5958 died... 12:36:36.557791 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5958): Terminated: ok {rc=0} 12:36:36.646895 bus /sierra_3: Setting Powered False 12:36:37.748074 bus /sierra_3: Setting Powered False 12:36:38.865370 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 12:36:40.137319 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:36:40.144267 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 12:36:40.196687 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:36:40.224483 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:36:40.276762 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 12:36:40.327563 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:36:40.354779 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:36:40.912831 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 12:36:40.918270 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:36:40.929878 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:36:40.971383 tst handover.py: using LAC 21498 12:36:41.102291 tst handover.py: using RAC 78 12:36:41.231413 tst handover.py: using CellId 21498 12:36:41.361625 tst handover.py: using BVCI 21499 12:36:41.478243 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:36:41.524508 tst handover.py: using LAC 21499 12:36:41.645962 tst handover.py: using RAC 79 12:36:41.766916 tst handover.py: using CellId 21499 12:36:41.890525 tst handover.py: using BVCI 21500 12:36:42.004797 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:36:42.016219 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:36:42.027400 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:36:42.038417 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:36:42.050127 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:36:42.061746 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:36:42.183143 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:36:42.306872 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:36:42.795656 run create_hlr_db(pid=5964): Launched 12:36:42.925081 bus /sierra_2: Setting Powered False 12:36:43.990710 run create_hlr_db(pid=5964): Terminated: ok {rc=0} 12:36:44.427559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5966): Launched 12:36:44.762525 run osmo-hlr_10.42.42.2(pid=5967): Launched 12:36:44.891971 run osmo-stp_10.42.42.5: Starting osmo-stp 12:36:45.443047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5969): Launched 12:36:45.778234 run osmo-stp_10.42.42.5(pid=5970): Launched 12:36:45.912611 run osmo-msc_10.42.42.6: Starting osmo-msc 12:36:46.587963 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5972): Launched 12:36:46.945763 run osmo-msc_10.42.42.6(pid=5973): Launched 12:36:47.403585 run osmo-stp_10.42.42.5(pid=5970): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5970)] 12:36:47.544180 run osmo-stp_10.42.42.5(pid=5970): stdout: | (launched: 2022-12-09_12:36:45.715825) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:47.683118 run osmo-stp_10.42.42.5(pid=5970): stderr: | 20221209123646051 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123646051 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123646052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123646052 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123646052 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123646060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123646060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:47.823075 run osmo-stp_10.42.42.5(pid=5970): stdout: | (launched: 2022-12-09_12:36:45.715825) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:47.956020 run osmo-stp_10.42.42.5(pid=5970): stderr: | 20221209123646051 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123646051 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123646052 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123646052 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123646052 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123646060 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123646060 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:48.115467 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=5970): Process ended prematurely: osmo-stp_10.42.42.5(pid=5970) [trial-2359↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5970)] [trial-2359↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 12:36:48.124759 tst handover.py:18: Test FAILED (7.2 sec) 12:36:48.153599 run osmo-hlr_10.42.42.2(pid=5967): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5967)] 12:36:48.204910 run osmo-hlr_10.42.42.2(pid=5967): stdout: | (launched: 2022-12-09_12:36:44.700356) 12:36:48.257892 run osmo-hlr_10.42.42.2(pid=5967): stderr: | 20221209123644901 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123644901 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123644902 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123644902 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123644902 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123644902 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123644913 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123644922 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123644922 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123644922 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:36:48.331324 run osmo-msc_10.42.42.6(pid=5973): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5973)] 12:36:48.382641 run osmo-msc_10.42.42.6(pid=5973): stdout: | (launched: 2022-12-09_12:36:46.877954) 12:36:48.435907 run osmo-msc_10.42.42.6(pid=5973): stderr: | 20221209123647292 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123647292 DLGLOBAL DEBUG validating counter group 0x7fa83d3b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123647292 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123647292 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123647292 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123647292 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123647294 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123647295 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123647295 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123647295 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:36:48.489320 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5966): Terminating (SIGTERM) 12:36:48.532298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5969): Terminating (SIGTERM) 12:36:48.575216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5972): Terminating (SIGTERM) 12:36:48.618548 --- ParallelTerminationStrategy: PID 5966 died... 12:36:48.638971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5966): Terminated: ok {rc=0} 12:36:48.686682 --- ParallelTerminationStrategy: PID 5969 died... 12:36:48.706611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5969): Terminated: ok {rc=0} 12:36:48.754306 --- ParallelTerminationStrategy: PID 5972 died... 12:36:48.774213 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5972): Terminated: ok {rc=0} 12:36:48.863934 bus /sierra_3: Setting Powered False 12:36:49.966000 bus /sierra_3: Setting Powered False 12:36:51.083827 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 12:36:52.346740 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:36:52.352393 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 12:36:52.410703 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:36:52.438916 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:36:52.493092 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 12:36:52.549321 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:36:52.577368 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:36:53.130699 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 12:36:53.136537 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:36:53.148268 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:36:53.188604 tst handover.py: using LAC 21500 12:36:53.312449 tst handover.py: using RAC 80 12:36:53.436494 tst handover.py: using CellId 21500 12:36:53.560571 tst handover.py: using BVCI 21501 12:36:53.675888 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:36:53.729719 tst handover.py: using LAC 21501 12:36:53.852307 tst handover.py: using RAC 81 12:36:53.973135 tst handover.py: using CellId 21501 12:36:54.093632 tst handover.py: using BVCI 21502 12:36:54.208136 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:36:54.219302 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:36:54.230292 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:36:54.241243 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:36:54.252052 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:36:54.262893 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:36:54.385698 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:36:54.504437 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:36:54.962209 run create_hlr_db(pid=5978): Launched 12:36:55.091696 bus /sierra_2: Setting Powered False 12:36:56.157945 run create_hlr_db(pid=5978): Terminated: ok {rc=0} 12:36:56.595922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5982): Launched 12:36:56.934663 run osmo-hlr_10.42.42.2(pid=5983): Launched 12:36:57.063214 run osmo-stp_10.42.42.5: Starting osmo-stp 12:36:57.615705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5985): Launched 12:36:57.952727 run osmo-stp_10.42.42.5(pid=5986): Launched 12:36:58.083074 run osmo-msc_10.42.42.6: Starting osmo-msc 12:36:58.659253 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5988): Launched 12:36:58.994483 run osmo-msc_10.42.42.6(pid=5989): Launched 12:36:59.183138 run osmo-stp_10.42.42.5(pid=5986): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5986)] 12:36:59.324256 run osmo-stp_10.42.42.5(pid=5986): stdout: | (launched: 2022-12-09_12:36:57.890988) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:59.466160 run osmo-stp_10.42.42.5(pid=5986): stderr: | 20221209123658085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123658085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123658085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123658086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123658086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123658086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123658086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:59.605826 run osmo-stp_10.42.42.5(pid=5986): stdout: | (launched: 2022-12-09_12:36:57.890988) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:36:59.738707 run osmo-stp_10.42.42.5(pid=5986): stderr: | 20221209123658085 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123658085 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123658085 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123658086 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123658086 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123658086 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123658086 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:36:59.897609 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=5986): Process ended prematurely: osmo-stp_10.42.42.5(pid=5986) [trial-2359↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5986)] [trial-2359↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 12:36:59.906850 tst handover.py:18: Test FAILED (6.8 sec) 12:36:59.935703 run osmo-hlr_10.42.42.2(pid=5983): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5983)] 12:36:59.987257 run osmo-hlr_10.42.42.2(pid=5983): stdout: | (launched: 2022-12-09_12:36:56.872841) 12:37:00.040535 run osmo-hlr_10.42.42.2(pid=5983): stderr: | 20221209123657071 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123657071 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123657071 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123657071 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123657071 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123657071 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123657083 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123657091 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123657092 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123657092 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:37:00.114647 run osmo-msc_10.42.42.6(pid=5989): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=5989)] 12:37:00.165951 run osmo-msc_10.42.42.6(pid=5989): stdout: | (launched: 2022-12-09_12:36:58.932406) 12:37:00.218979 run osmo-msc_10.42.42.6(pid=5989): stderr: | 20221209123659254 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123659254 DLGLOBAL DEBUG validating counter group 0x7feb7842cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123659254 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123659254 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123659255 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123659255 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123659256 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123659257 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123659257 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123659257 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:37:00.272739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5982): Terminating (SIGTERM) 12:37:00.315542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5985): Terminating (SIGTERM) 12:37:00.358498 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5988): Terminating (SIGTERM) 12:37:00.402005 --- ParallelTerminationStrategy: PID 5982 died... 12:37:00.422469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5982): Terminated: ok {rc=0} 12:37:00.470616 --- ParallelTerminationStrategy: PID 5985 died... 12:37:00.490685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5985): Terminated: ok {rc=0} 12:37:00.538718 --- ParallelTerminationStrategy: PID 5988 died... 12:37:00.558859 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=5988): Terminated: ok {rc=0} 12:37:00.650332 bus /sierra_3: Setting Powered False 12:37:01.753232 bus /sierra_3: Setting Powered False 12:37:02.880196 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 12:37:04.147272 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:37:04.153339 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:37:04.195127 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:37:04.221873 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:37:04.275774 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:37:04.317909 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:37:04.344276 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:37:04.892756 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 12:37:04.898012 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:37:04.908810 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 12:37:04.947343 tst handover.py: using LAC 21502 12:37:05.071921 tst handover.py: using RAC 82 12:37:05.197044 tst handover.py: using CellId 21502 12:37:05.321481 tst handover.py: using BVCI 21503 12:37:05.435700 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 12:37:05.473894 tst handover.py: using LAC 21503 12:37:05.604833 tst handover.py: using RAC 83 12:37:05.734395 tst handover.py: using CellId 21503 12:37:05.866613 tst handover.py: using BVCI 21504 12:37:05.990605 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:37:06.002214 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:37:06.013611 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:37:06.025253 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:37:06.036779 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:37:06.048343 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 12:37:06.170364 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 12:37:06.289164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:37:06.748435 run create_hlr_db(pid=5994): Launched 12:37:06.875759 bus /sierra_2: Setting Powered False 12:37:07.937352 run create_hlr_db(pid=5994): Terminated: ok {rc=0} 12:37:08.367241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5996): Launched 12:37:08.702047 run osmo-hlr_10.42.42.2(pid=5997): Launched 12:37:08.831530 run osmo-stp_10.42.42.5: Starting osmo-stp 12:37:09.380137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5999): Launched 12:37:09.715778 run osmo-stp_10.42.42.5(pid=6000): Launched 12:37:09.845780 run osmo-msc_10.42.42.6: Starting osmo-msc 12:37:10.420445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6002): Launched 12:37:10.757190 run osmo-msc_10.42.42.6(pid=6003): Launched 12:37:10.946694 run osmo-stp_10.42.42.5(pid=6000): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6000)] 12:37:11.088204 run osmo-stp_10.42.42.5(pid=6000): stdout: | (launched: 2022-12-09_12:37:09.654374) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:11.230469 run osmo-stp_10.42.42.5(pid=6000): stderr: | 20221209123709848 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123709848 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123709848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123709849 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123709849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123709849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123709849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:11.370870 run osmo-stp_10.42.42.5(pid=6000): stdout: | (launched: 2022-12-09_12:37:09.654374) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:11.503498 run osmo-stp_10.42.42.5(pid=6000): stderr: | 20221209123709848 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123709848 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123709848 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123709849 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123709849 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123709849 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123709849 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:11.662985 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6000): Process ended prematurely: osmo-stp_10.42.42.5(pid=6000) [trial-2359↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6000)] [trial-2359↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 12:37:11.672115 tst handover.py:18: Test FAILED (6.8 sec) 12:37:11.700641 run osmo-hlr_10.42.42.2(pid=5997): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5997)] 12:37:11.751831 run osmo-hlr_10.42.42.2(pid=5997): stdout: | (launched: 2022-12-09_12:37:08.640550) 12:37:11.804763 run osmo-hlr_10.42.42.2(pid=5997): stderr: | 20221209123708840 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123708840 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123708840 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123708841 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123708841 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123708841 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123708856 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123708866 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123708866 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123708866 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:37:11.878076 run osmo-msc_10.42.42.6(pid=6003): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6003)] 12:37:11.929084 run osmo-msc_10.42.42.6(pid=6003): stdout: | (launched: 2022-12-09_12:37:10.695097) 12:37:11.981635 run osmo-msc_10.42.42.6(pid=6003): stderr: | 20221209123711020 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123711020 DLGLOBAL DEBUG validating counter group 0x7fcc4595ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123711021 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123711021 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123711021 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123711021 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123711023 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123711023 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123711023 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123711023 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:37:12.034762 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5996): Terminating (SIGTERM) 12:37:12.077433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5999): Terminating (SIGTERM) 12:37:12.120028 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6002): Terminating (SIGTERM) 12:37:12.162845 --- ParallelTerminationStrategy: PID 5996 died... 12:37:12.183004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=5996): Terminated: ok {rc=0} 12:37:12.230417 --- ParallelTerminationStrategy: PID 5999 died... 12:37:12.250269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=5999): Terminated: ok {rc=0} 12:37:12.298024 --- ParallelTerminationStrategy: PID 6002 died... 12:37:12.317989 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6002): Terminated: ok {rc=0} 12:37:12.408225 bus /sierra_3: Setting Powered False 12:37:13.509350 bus /sierra_3: Setting Powered False 12:37:14.627336 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 12:37:15.904027 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:37:15.911022 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:37:15.971452 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:37:16.001675 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:37:16.057894 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:37:16.138956 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:37:16.176168 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:37:16.723863 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 12:37:16.734131 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:37:16.751959 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:37:16.793849 tst handover.py: using LAC 21504 12:37:16.922217 tst handover.py: using RAC 84 12:37:17.045483 tst handover.py: using CellId 21504 12:37:17.203988 tst handover.py: using BVCI 21505 12:37:17.335458 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:37:17.384401 tst handover.py: using LAC 21505 12:37:17.504009 tst handover.py: using RAC 85 12:37:17.625355 tst handover.py: using CellId 21505 12:37:17.748044 tst handover.py: using BVCI 21506 12:37:17.862516 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:37:17.873604 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:37:17.884239 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:37:17.894991 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:37:17.905884 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:37:17.916528 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:37:18.037820 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:37:18.158989 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:37:18.615673 run create_hlr_db(pid=6008): Launched 12:37:18.742899 bus /sierra_2: Setting Powered False 12:37:19.804326 run create_hlr_db(pid=6008): Terminated: ok {rc=0} 12:37:20.233898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6010): Launched 12:37:20.571005 run osmo-hlr_10.42.42.2(pid=6011): Launched 12:37:20.701319 run osmo-stp_10.42.42.5: Starting osmo-stp 12:37:21.255910 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6013): Launched 12:37:21.592658 run osmo-stp_10.42.42.5(pid=6014): Launched 12:37:21.722298 run osmo-msc_10.42.42.6: Starting osmo-msc 12:37:22.299450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6016): Launched 12:37:22.637333 run osmo-msc_10.42.42.6(pid=6017): Launched 12:37:22.825121 run osmo-stp_10.42.42.5(pid=6014): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6014)] 12:37:22.967047 run osmo-stp_10.42.42.5(pid=6014): stdout: | (launched: 2022-12-09_12:37:21.531091) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:23.108603 run osmo-stp_10.42.42.5(pid=6014): stderr: | 20221209123721723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123721724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123721724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123721724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123721725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123721725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123721725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:23.247994 run osmo-stp_10.42.42.5(pid=6014): stdout: | (launched: 2022-12-09_12:37:21.531091) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:23.381185 run osmo-stp_10.42.42.5(pid=6014): stderr: | 20221209123721723 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123721724 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123721724 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123721724 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123721725 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123721725 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123721725 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:23.540192 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6014): Process ended prematurely: osmo-stp_10.42.42.5(pid=6014) [trial-2359↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6014)] [trial-2359↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 12:37:23.549293 tst handover.py:18: Test FAILED (6.8 sec) 12:37:23.577512 run osmo-hlr_10.42.42.2(pid=6011): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6011)] 12:37:23.628866 run osmo-hlr_10.42.42.2(pid=6011): stdout: | (launched: 2022-12-09_12:37:20.508114) 12:37:23.681663 run osmo-hlr_10.42.42.2(pid=6011): stderr: | 20221209123720705 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123720705 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123720705 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123720705 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123720705 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123720705 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123720719 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123720728 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123720728 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123720728 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:37:23.755809 run osmo-msc_10.42.42.6(pid=6017): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6017)] 12:37:23.806940 run osmo-msc_10.42.42.6(pid=6017): stdout: | (launched: 2022-12-09_12:37:22.575474) 12:37:23.859707 run osmo-msc_10.42.42.6(pid=6017): stderr: | 20221209123722895 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123722896 DLGLOBAL DEBUG validating counter group 0x7fcc81b27c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123722896 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123722896 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123722896 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123722896 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123722898 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123722898 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123722898 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123722898 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:37:23.913166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6010): Terminating (SIGTERM) 12:37:23.956382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6013): Terminating (SIGTERM) 12:37:23.999152 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6016): Terminating (SIGTERM) 12:37:24.042291 --- ParallelTerminationStrategy: PID 6010 died... 12:37:24.062625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6010): Terminated: ok {rc=0} 12:37:24.110020 --- ParallelTerminationStrategy: PID 6013 died... 12:37:24.129872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6013): Terminated: ok {rc=0} 12:37:24.177109 --- ParallelTerminationStrategy: PID 6016 died... 12:37:24.197488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6016): Terminated: ok {rc=0} 12:37:24.286968 bus /sierra_3: Setting Powered False 12:37:25.387602 bus /sierra_3: Setting Powered False 12:37:26.506527 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 12:37:27.768621 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:37:27.773917 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:37:27.827184 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:37:27.853766 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:37:27.907287 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:37:27.959912 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:37:27.986214 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:37:28.536295 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 12:37:28.541502 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:37:28.552360 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:37:28.590282 tst handover.py: using LAC 21506 12:37:28.715600 tst handover.py: using RAC 86 12:37:28.839903 tst handover.py: using CellId 21506 12:37:28.961601 tst handover.py: using BVCI 21507 12:37:29.074793 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:37:29.123189 tst handover.py: using LAC 21507 12:37:29.246218 tst handover.py: using RAC 87 12:37:29.370768 tst handover.py: using CellId 21507 12:37:29.502750 tst handover.py: using BVCI 21508 12:37:29.625258 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:37:29.636833 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:37:29.648225 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:37:29.660311 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:37:29.673398 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:37:29.684900 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:37:29.806504 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:37:29.929883 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:37:30.419324 run create_hlr_db(pid=6022): Launched 12:37:30.547080 bus /sierra_2: Setting Powered False 12:37:31.610941 run create_hlr_db(pid=6022): Terminated: ok {rc=0} 12:37:32.053378 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6024): Launched 12:37:32.402154 run osmo-hlr_10.42.42.2(pid=6025): Launched 12:37:32.532498 run osmo-stp_10.42.42.5: Starting osmo-stp 12:37:33.079159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6027): Launched 12:37:33.413069 run osmo-stp_10.42.42.5(pid=6028): Launched 12:37:33.542063 run osmo-msc_10.42.42.6: Starting osmo-msc 12:37:34.117436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6030): Launched 12:37:34.453183 run osmo-msc_10.42.42.6(pid=6031): Launched 12:37:34.641230 run osmo-stp_10.42.42.5(pid=6028): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6028)] 12:37:34.782204 run osmo-stp_10.42.42.5(pid=6028): stdout: | (launched: 2022-12-09_12:37:33.351463) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:34.923285 run osmo-stp_10.42.42.5(pid=6028): stderr: | 20221209123733544 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123733544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123733544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123733544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123733545 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123733545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123733545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:35.062617 run osmo-stp_10.42.42.5(pid=6028): stdout: | (launched: 2022-12-09_12:37:33.351463) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:35.195110 run osmo-stp_10.42.42.5(pid=6028): stderr: | 20221209123733544 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123733544 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123733544 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123733544 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123733545 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123733545 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123733545 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:35.353681 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6028): Process ended prematurely: osmo-stp_10.42.42.5(pid=6028) [trial-2359↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6028)] [trial-2359↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 12:37:35.362858 tst handover.py:18: Test FAILED (6.8 sec) 12:37:35.390977 run osmo-hlr_10.42.42.2(pid=6025): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6025)] 12:37:35.442173 run osmo-hlr_10.42.42.2(pid=6025): stdout: | (launched: 2022-12-09_12:37:32.340277) 12:37:35.495346 run osmo-hlr_10.42.42.2(pid=6025): stderr: | 20221209123732537 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123732537 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123732537 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123732537 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123732537 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123732537 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123732550 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123732558 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123732559 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123732559 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:37:35.568927 run osmo-msc_10.42.42.6(pid=6031): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6031)] 12:37:35.620119 run osmo-msc_10.42.42.6(pid=6031): stdout: | (launched: 2022-12-09_12:37:34.391375) 12:37:35.672822 run osmo-msc_10.42.42.6(pid=6031): stderr: | 20221209123734712 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123734712 DLGLOBAL DEBUG validating counter group 0x7f326b333c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123734712 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123734712 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123734712 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123734713 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123734714 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123734715 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123734715 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123734715 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:37:35.725905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6024): Terminating (SIGTERM) 12:37:35.768992 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6027): Terminating (SIGTERM) 12:37:35.812534 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6030): Terminating (SIGTERM) 12:37:35.857956 --- ParallelTerminationStrategy: PID 6024 died... 12:37:35.876860 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6024): Terminated: ok {rc=0} 12:37:35.921274 --- ParallelTerminationStrategy: PID 6027 died... 12:37:35.939949 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6027): Terminated: ok {rc=0} 12:37:35.984555 --- ParallelTerminationStrategy: PID 6030 died... 12:37:36.003326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6030): Terminated: ok {rc=0} 12:37:36.087970 bus /sierra_3: Setting Powered False 12:37:37.187450 bus /sierra_3: Setting Powered False 12:37:38.306291 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 12:37:39.575544 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:37:39.581232 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 12:37:39.620042 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 12:37:39.647939 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 12:37:39.701919 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 12:37:39.740078 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 12:37:39.768230 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 12:37:40.318868 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 12:37:40.324410 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:37:40.335903 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 12:37:40.371720 tst handover.py: using LAC 21508 12:37:40.494573 tst handover.py: using RAC 88 12:37:40.623756 tst handover.py: using CellId 21508 12:37:40.745392 tst handover.py: using BVCI 21509 12:37:40.858584 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 12:37:40.892184 tst handover.py: using LAC 21509 12:37:41.014207 tst handover.py: using RAC 89 12:37:41.137381 tst handover.py: using CellId 21509 12:37:41.259946 tst handover.py: using BVCI 21510 12:37:41.372659 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:37:41.383754 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:37:41.394586 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:37:41.405432 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:37:41.416179 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 12:37:41.426808 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 12:37:41.548188 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 12:37:41.672344 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:37:42.133505 run create_hlr_db(pid=6036): Launched 12:37:42.262841 bus /sierra_2: Setting Powered False 12:37:43.325958 run create_hlr_db(pid=6036): Terminated: ok {rc=0} 12:37:43.755979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6038): Launched 12:37:44.092280 run osmo-hlr_10.42.42.2(pid=6039): Launched 12:37:44.222438 run osmo-stp_10.42.42.5: Starting osmo-stp 12:37:44.769337 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6041): Launched 12:37:45.105681 run osmo-stp_10.42.42.5(pid=6042): Launched 12:37:45.235299 run osmo-msc_10.42.42.6: Starting osmo-msc 12:37:45.816578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6044): Launched 12:37:46.165516 run osmo-msc_10.42.42.6(pid=6045): Launched 12:37:46.536740 run osmo-stp_10.42.42.5(pid=6042): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6042)] 12:37:46.832012 run osmo-stp_10.42.42.5(pid=6042): stdout: | (launched: 2022-12-09_12:37:45.043670) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:47.004331 run osmo-stp_10.42.42.5(pid=6042): stderr: | 20221209123745236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123745236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123745236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123745237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123745237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123745237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123745237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:47.147177 run osmo-stp_10.42.42.5(pid=6042): stdout: | (launched: 2022-12-09_12:37:45.043670) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:47.284585 run osmo-stp_10.42.42.5(pid=6042): stderr: | 20221209123745236 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123745236 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123745236 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123745237 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123745237 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123745237 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123745237 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:47.449354 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6042): Process ended prematurely: osmo-stp_10.42.42.5(pid=6042) [trial-2359↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6042)] [trial-2359↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 12:37:47.458719 tst handover.py:18: Test FAILED (7.1 sec) 12:37:47.487897 run osmo-hlr_10.42.42.2(pid=6039): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6039)] 12:37:47.539458 run osmo-hlr_10.42.42.2(pid=6039): stdout: | (launched: 2022-12-09_12:37:44.030801) 12:37:47.592650 run osmo-hlr_10.42.42.2(pid=6039): stderr: | 20221209123744229 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123744229 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123744229 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123744229 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123744229 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123744229 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123744242 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123744250 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123744250 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123744251 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:37:47.666560 run osmo-msc_10.42.42.6(pid=6045): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6045)] 12:37:47.717951 run osmo-msc_10.42.42.6(pid=6045): stdout: | (launched: 2022-12-09_12:37:46.103334) 12:37:47.771337 run osmo-msc_10.42.42.6(pid=6045): stderr: | 20221209123746564 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123746564 DLGLOBAL DEBUG validating counter group 0x7fe5e99bdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123746564 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123746564 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123746564 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123746564 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123746566 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123746566 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123746567 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123746567 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:37:47.824913 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6038): Terminating (SIGTERM) 12:37:47.867619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6041): Terminating (SIGTERM) 12:37:47.910600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6044): Terminating (SIGTERM) 12:37:47.954012 --- ParallelTerminationStrategy: PID 6038 died... 12:37:47.973984 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6038): Terminated: ok {rc=0} 12:37:48.022036 --- ParallelTerminationStrategy: PID 6041 died... 12:37:48.042070 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6041): Terminated: ok {rc=0} 12:37:48.089822 --- ParallelTerminationStrategy: PID 6044 died... 12:37:48.109830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6044): Terminated: ok {rc=0} 12:37:48.201134 bus /sierra_3: Setting Powered False 12:37:49.300233 bus /sierra_3: Setting Powered False 12:37:50.417901 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 12:37:51.663404 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:37:51.669185 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 12:37:51.721825 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 12:37:51.749304 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 12:37:51.803712 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 12:37:51.855626 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 12:37:51.883237 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 12:37:52.435411 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 12:37:52.440762 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:37:52.452197 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:37:52.491268 tst handover.py: using LAC 21510 12:37:52.621755 tst handover.py: using RAC 90 12:37:52.752735 tst handover.py: using CellId 21510 12:37:52.882796 tst handover.py: using BVCI 21511 12:37:53.004456 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:37:53.052295 tst handover.py: using LAC 21511 12:37:53.182262 tst handover.py: using RAC 91 12:37:53.313824 tst handover.py: using CellId 21511 12:37:53.437384 tst handover.py: using BVCI 21512 12:37:53.553541 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:37:53.564677 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:37:53.575798 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:37:53.587289 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:37:53.598914 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:37:53.610322 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:37:53.732468 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:37:53.853564 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:37:54.313617 run create_hlr_db(pid=6053): Launched 12:37:54.442752 bus /sierra_2: Setting Powered False 12:37:55.508469 run create_hlr_db(pid=6053): Terminated: ok {rc=0} 12:37:55.947632 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6055): Launched 12:37:56.283364 run osmo-hlr_10.42.42.2(pid=6056): Launched 12:37:56.413552 run osmo-stp_10.42.42.5: Starting osmo-stp 12:37:56.964267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6058): Launched 12:37:57.299803 run osmo-stp_10.42.42.5(pid=6059): Launched 12:37:57.430187 run osmo-msc_10.42.42.6: Starting osmo-msc 12:37:58.006470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6061): Launched 12:37:58.342232 run osmo-msc_10.42.42.6(pid=6062): Launched 12:37:58.529383 run osmo-stp_10.42.42.5(pid=6059): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6059)] 12:37:58.669907 run osmo-stp_10.42.42.5(pid=6059): stdout: | (launched: 2022-12-09_12:37:57.238027) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:58.811294 run osmo-stp_10.42.42.5(pid=6059): stderr: | 20221209123757430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123757430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123757431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123757431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123757432 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123757432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123757432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:58.950793 run osmo-stp_10.42.42.5(pid=6059): stdout: | (launched: 2022-12-09_12:37:57.238027) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:37:59.083135 run osmo-stp_10.42.42.5(pid=6059): stderr: | 20221209123757430 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123757430 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123757431 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123757431 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123757432 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123757432 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123757432 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:37:59.241667 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6059): Process ended prematurely: osmo-stp_10.42.42.5(pid=6059) [trial-2359↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6059)] [trial-2359↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 12:37:59.250813 tst handover.py:18: Test FAILED (6.8 sec) 12:37:59.279097 run osmo-hlr_10.42.42.2(pid=6056): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6056)] 12:37:59.329983 run osmo-hlr_10.42.42.2(pid=6056): stdout: | (launched: 2022-12-09_12:37:56.221780) 12:37:59.383412 run osmo-hlr_10.42.42.2(pid=6056): stderr: | 20221209123756420 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123756420 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123756420 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123756420 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123756420 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123756420 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123756433 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123756441 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123756442 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123756442 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:37:59.456499 run osmo-msc_10.42.42.6(pid=6062): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6062)] 12:37:59.507319 run osmo-msc_10.42.42.6(pid=6062): stdout: | (launched: 2022-12-09_12:37:58.280222) 12:37:59.559718 run osmo-msc_10.42.42.6(pid=6062): stderr: | 20221209123758602 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123758602 DLGLOBAL DEBUG validating counter group 0x7fd2d6e1fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123758602 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123758602 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123758603 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123758603 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123758604 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123758605 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123758605 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123758605 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:37:59.612404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6055): Terminating (SIGTERM) 12:37:59.655078 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6058): Terminating (SIGTERM) 12:37:59.697560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6061): Terminating (SIGTERM) 12:37:59.740245 --- ParallelTerminationStrategy: PID 6055 died... 12:37:59.760390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6055): Terminated: ok {rc=0} 12:37:59.807856 --- ParallelTerminationStrategy: PID 6058 died... 12:37:59.827696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6058): Terminated: ok {rc=0} 12:37:59.874797 --- ParallelTerminationStrategy: PID 6061 died... 12:37:59.894568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6061): Terminated: ok {rc=0} 12:37:59.983146 bus /sierra_3: Setting Powered False 12:38:01.086739 bus /sierra_3: Setting Powered False 12:38:02.222760 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 12:38:03.530763 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:38:03.536693 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 12:38:03.586772 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:38:03.614025 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:38:03.671211 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 12:38:03.737379 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:38:03.765081 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:38:04.296145 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 12:38:04.303060 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:38:04.315410 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:38:04.354139 tst handover.py: using LAC 21512 12:38:04.481090 tst handover.py: using RAC 92 12:38:04.605257 tst handover.py: using CellId 21512 12:38:04.728922 tst handover.py: using BVCI 21513 12:38:04.846166 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:38:04.890595 tst handover.py: using LAC 21513 12:38:05.014245 tst handover.py: using RAC 93 12:38:05.137503 tst handover.py: using CellId 21513 12:38:05.262271 tst handover.py: using BVCI 21514 12:38:05.382311 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:38:05.394835 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:38:05.408372 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:38:05.420688 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:38:05.435267 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:38:05.448612 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:38:05.574804 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:38:05.705254 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:38:06.202459 run create_hlr_db(pid=6339): Launched 12:38:06.371761 bus /sierra_2: Setting Powered False 12:38:07.439136 run create_hlr_db(pid=6339): Terminated: ok {rc=0} 12:38:07.887241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6341): Launched 12:38:08.241459 run osmo-hlr_10.42.42.2(pid=6342): Launched 12:38:08.499108 run osmo-stp_10.42.42.5: Starting osmo-stp 12:38:09.156119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6344): Launched 12:38:09.513558 run osmo-stp_10.42.42.5(pid=6345): Launched 12:38:09.758582 run osmo-msc_10.42.42.6: Starting osmo-msc 12:38:10.451127 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6347): Launched 12:38:10.789766 run osmo-msc_10.42.42.6(pid=6348): Launched 12:38:11.044813 run osmo-stp_10.42.42.5(pid=6345): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6345)] 12:38:11.306270 run osmo-stp_10.42.42.5(pid=6345): stdout: | (launched: 2022-12-09_12:38:09.450545) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:11.589792 run osmo-stp_10.42.42.5(pid=6345): stderr: | 20221209123809772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123809772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123809777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123809778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123809778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123809778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123809778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:11.758899 run osmo-stp_10.42.42.5(pid=6345): stdout: | (launched: 2022-12-09_12:38:09.450545) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:11.887631 run osmo-stp_10.42.42.5(pid=6345): stderr: | 20221209123809772 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123809772 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123809777 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123809778 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123809778 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123809778 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123809778 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:12.040143 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6345): Process ended prematurely: osmo-stp_10.42.42.5(pid=6345) [trial-2359↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6345)] [trial-2359↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 12:38:12.049650 tst handover.py:18: Test FAILED (7.7 sec) 12:38:12.077799 run osmo-hlr_10.42.42.2(pid=6342): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6342)] 12:38:12.128893 run osmo-hlr_10.42.42.2(pid=6342): stdout: | (launched: 2022-12-09_12:38:08.179303) 12:38:12.181487 run osmo-hlr_10.42.42.2(pid=6342): stderr: | 20221209123808486 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123808486 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123808486 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123808486 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123808486 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123808486 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123808509 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123808522 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123808522 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123808523 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:38:12.254297 run osmo-msc_10.42.42.6(pid=6348): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6348)] 12:38:12.304683 run osmo-msc_10.42.42.6(pid=6348): stdout: | (launched: 2022-12-09_12:38:10.726694) 12:38:12.357463 run osmo-msc_10.42.42.6(pid=6348): stderr: | 20221209123811266 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123811266 DLGLOBAL DEBUG validating counter group 0x7f0b06547c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123811266 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123811266 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123811266 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123811266 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123811268 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123811277 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123811277 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123811277 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:38:12.409932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6341): Terminating (SIGTERM) 12:38:12.452475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6344): Terminating (SIGTERM) 12:38:12.497022 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6347): Terminating (SIGTERM) 12:38:12.541718 --- ParallelTerminationStrategy: PID 6341 died... 12:38:12.562096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6341): Terminated: ok {rc=0} 12:38:12.610072 --- ParallelTerminationStrategy: PID 6344 died... 12:38:12.630119 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6344): Terminated: ok {rc=0} 12:38:12.677164 --- ParallelTerminationStrategy: PID 6347 died... 12:38:12.697454 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6347): Terminated: ok {rc=0} 12:38:12.786007 bus /sierra_3: Setting Powered False 12:38:13.886301 bus /sierra_3: Setting Powered False 12:38:15.004414 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 12:38:16.317607 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:38:16.323198 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 12:38:16.401413 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:38:16.453114 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:38:16.521388 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 12:38:16.598588 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:38:16.629673 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:38:17.222785 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 12:38:17.229726 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:38:17.243440 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:38:17.283574 tst handover.py: using LAC 21514 12:38:17.442684 tst handover.py: using RAC 94 12:38:17.597702 tst handover.py: using CellId 21514 12:38:17.764181 tst handover.py: using BVCI 21515 12:38:17.902292 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:38:17.954340 tst handover.py: using LAC 21515 12:38:18.084929 tst handover.py: using RAC 95 12:38:18.210499 tst handover.py: using CellId 21515 12:38:18.334355 tst handover.py: using BVCI 21516 12:38:18.452892 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:38:18.465245 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:38:18.477380 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:38:18.489364 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:38:18.501689 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:38:18.513996 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:38:18.636854 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:38:18.761167 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:38:19.236488 run create_hlr_db(pid=6353): Launched 12:38:19.405028 bus /sierra_2: Setting Powered False 12:38:20.468774 run create_hlr_db(pid=6353): Terminated: ok {rc=0} 12:38:20.897574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6355): Launched 12:38:21.236124 run osmo-hlr_10.42.42.2(pid=6356): Launched 12:38:21.490765 run osmo-stp_10.42.42.5: Starting osmo-stp 12:38:22.186682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6358): Launched 12:38:22.526585 run osmo-stp_10.42.42.5(pid=6359): Launched 12:38:22.772836 run osmo-msc_10.42.42.6: Starting osmo-msc 12:38:23.475016 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6361): Launched 12:38:23.821699 run osmo-msc_10.42.42.6(pid=6362): Launched 12:38:24.031782 run osmo-stp_10.42.42.5(pid=6359): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6359)] 12:38:24.164650 run osmo-stp_10.42.42.5(pid=6359): stdout: | (launched: 2022-12-09_12:38:22.466419) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:24.298094 run osmo-stp_10.42.42.5(pid=6359): stderr: | 20221209123822788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123822788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123822789 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123822789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123822790 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123822790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123822790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:24.428582 run osmo-stp_10.42.42.5(pid=6359): stdout: | (launched: 2022-12-09_12:38:22.466419) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:24.552788 run osmo-stp_10.42.42.5(pid=6359): stderr: | 20221209123822788 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123822788 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123822789 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123822789 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123822790 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123822790 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123822790 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:24.701892 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6359): Process ended prematurely: osmo-stp_10.42.42.5(pid=6359) [trial-2359↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6359)] [trial-2359↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 12:38:24.710171 tst handover.py:18: Test FAILED (7.5 sec) 12:38:24.736740 run osmo-hlr_10.42.42.2(pid=6356): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6356)] 12:38:24.785295 run osmo-hlr_10.42.42.2(pid=6356): stdout: | (launched: 2022-12-09_12:38:21.174523) 12:38:24.835639 run osmo-hlr_10.42.42.2(pid=6356): stderr: | 20221209123821518 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123821518 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123821518 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123821518 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123821518 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123821518 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123821536 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123821544 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123821544 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123821544 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:38:24.905973 run osmo-msc_10.42.42.6(pid=6362): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6362)] 12:38:24.954705 run osmo-msc_10.42.42.6(pid=6362): stdout: | (launched: 2022-12-09_12:38:23.753751) 12:38:25.005220 run osmo-msc_10.42.42.6(pid=6362): stderr: | 20221209123824060 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123824061 DLGLOBAL DEBUG validating counter group 0x7f9649565c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123824061 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123824061 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123824061 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123824061 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123824063 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123824063 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123824063 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123824063 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:38:25.055654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6355): Terminating (SIGTERM) 12:38:25.095958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6358): Terminating (SIGTERM) 12:38:25.136217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6361): Terminating (SIGTERM) 12:38:25.176576 --- ParallelTerminationStrategy: PID 6355 died... 12:38:25.195955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6355): Terminated: ok {rc=0} 12:38:25.240864 --- ParallelTerminationStrategy: PID 6358 died... 12:38:25.260136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6358): Terminated: ok {rc=0} 12:38:25.304942 --- ParallelTerminationStrategy: PID 6361 died... 12:38:25.323847 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6361): Terminated: ok {rc=0} 12:38:25.411331 bus /sierra_3: Setting Powered False 12:38:26.513051 bus /sierra_3: Setting Powered False 12:38:27.630115 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 12:38:28.890291 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:38:28.895136 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:38:28.934038 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:38:28.960829 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:38:29.013516 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:38:29.051473 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:38:29.077749 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:38:29.628232 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 12:38:29.634779 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:38:29.646544 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 12:38:29.682671 tst handover.py: using LAC 21516 12:38:29.815487 tst handover.py: using RAC 96 12:38:29.948091 tst handover.py: using CellId 21516 12:38:30.080536 tst handover.py: using BVCI 21517 12:38:30.202580 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 12:38:30.241720 tst handover.py: using LAC 21517 12:38:30.372881 tst handover.py: using RAC 97 12:38:30.502247 tst handover.py: using CellId 21517 12:38:30.633355 tst handover.py: using BVCI 21518 12:38:30.754227 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:38:30.765677 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:38:30.776726 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:38:30.788422 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:38:30.799982 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:38:30.811363 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 12:38:30.957700 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 12:38:31.090456 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:38:31.636623 run create_hlr_db(pid=6368): Launched 12:38:31.800611 bus /sierra_2: Setting Powered False 12:38:32.863584 run create_hlr_db(pid=6368): Terminated: ok {rc=0} 12:38:33.294929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6370): Launched 12:38:33.632880 run osmo-hlr_10.42.42.2(pid=6371): Launched 12:38:33.762004 run osmo-stp_10.42.42.5: Starting osmo-stp 12:38:34.313162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6373): Launched 12:38:34.649596 run osmo-stp_10.42.42.5(pid=6374): Launched 12:38:34.777855 run osmo-msc_10.42.42.6: Starting osmo-msc 12:38:35.356793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6376): Launched 12:38:35.693304 run osmo-msc_10.42.42.6(pid=6377): Launched 12:38:35.883029 run osmo-stp_10.42.42.5(pid=6374): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6374)] 12:38:36.023858 run osmo-stp_10.42.42.5(pid=6374): stdout: | (launched: 2022-12-09_12:38:34.587843) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:36.165586 run osmo-stp_10.42.42.5(pid=6374): stderr: | 20221209123834779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123834780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123834780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123834780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123834781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123834781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123834781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:36.305047 run osmo-stp_10.42.42.5(pid=6374): stdout: | (launched: 2022-12-09_12:38:34.587843) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:36.438227 run osmo-stp_10.42.42.5(pid=6374): stderr: | 20221209123834779 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123834780 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123834780 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123834780 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123834781 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123834781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123834781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:36.597306 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6374): Process ended prematurely: osmo-stp_10.42.42.5(pid=6374) [trial-2359↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6374)] [trial-2359↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 12:38:36.606291 tst handover.py:18: Test FAILED (7.0 sec) 12:38:36.634743 run osmo-hlr_10.42.42.2(pid=6371): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6371)] 12:38:36.686085 run osmo-hlr_10.42.42.2(pid=6371): stdout: | (launched: 2022-12-09_12:38:33.571012) 12:38:36.739393 run osmo-hlr_10.42.42.2(pid=6371): stderr: | 20221209123833769 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123833769 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123833769 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123833769 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123833769 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123833769 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123833781 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123833791 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123833792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123833792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:38:36.813841 run osmo-msc_10.42.42.6(pid=6377): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6377)] 12:38:36.865217 run osmo-msc_10.42.42.6(pid=6377): stdout: | (launched: 2022-12-09_12:38:35.631331) 12:38:36.918274 run osmo-msc_10.42.42.6(pid=6377): stderr: | 20221209123835955 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123835955 DLGLOBAL DEBUG validating counter group 0x7f9a5ce17c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123835955 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123835955 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123835955 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123835955 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123835957 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123835957 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123835958 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123835958 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:38:36.971489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6370): Terminating (SIGTERM) 12:38:37.014199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6373): Terminating (SIGTERM) 12:38:37.056891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6376): Terminating (SIGTERM) 12:38:37.099973 --- ParallelTerminationStrategy: PID 6370 died... 12:38:37.120368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6370): Terminated: ok {rc=0} 12:38:37.167791 --- ParallelTerminationStrategy: PID 6373 died... 12:38:37.187555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6373): Terminated: ok {rc=0} 12:38:37.234843 --- ParallelTerminationStrategy: PID 6376 died... 12:38:37.254644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6376): Terminated: ok {rc=0} 12:38:37.344673 bus /sierra_3: Setting Powered False 12:38:38.444232 bus /sierra_3: Setting Powered False 12:38:39.564644 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 12:38:40.809348 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:38:40.814356 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:38:40.865079 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:38:40.891682 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:38:40.946812 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:38:41.000516 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:38:41.028295 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:38:41.574042 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 12:38:41.579976 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:38:41.591098 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:38:41.630781 tst handover.py: using LAC 21518 12:38:41.754562 tst handover.py: using RAC 98 12:38:41.877393 tst handover.py: using CellId 21518 12:38:41.999132 tst handover.py: using BVCI 21519 12:38:42.113835 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:38:42.160885 tst handover.py: using LAC 21519 12:38:42.282194 tst handover.py: using RAC 99 12:38:42.403783 tst handover.py: using CellId 21519 12:38:42.524827 tst handover.py: using BVCI 21520 12:38:42.637729 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:38:42.648618 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:38:42.659515 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:38:42.670400 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:38:42.681433 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:38:42.692197 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:38:42.814975 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:38:42.932630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:38:43.392453 run create_hlr_db(pid=6382): Launched 12:38:43.520003 bus /sierra_2: Setting Powered False 12:38:44.582645 run create_hlr_db(pid=6382): Terminated: ok {rc=0} 12:38:44.994068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6384): Launched 12:38:45.309176 run osmo-hlr_10.42.42.2(pid=6385): Launched 12:38:45.428492 run osmo-stp_10.42.42.5: Starting osmo-stp 12:38:45.985032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6387): Launched 12:38:46.339815 run osmo-stp_10.42.42.5(pid=6388): Launched 12:38:46.634188 run osmo-msc_10.42.42.6: Starting osmo-msc 12:38:47.223757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6390): Launched 12:38:47.562424 run osmo-msc_10.42.42.6(pid=6391): Launched 12:38:47.750454 run osmo-stp_10.42.42.5(pid=6388): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6388)] 12:38:47.891501 run osmo-stp_10.42.42.5(pid=6388): stdout: | (launched: 2022-12-09_12:38:46.277880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:48.032759 run osmo-stp_10.42.42.5(pid=6388): stderr: | 20221209123846548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123846548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123846549 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123846549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123846549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123846550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123846550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:48.171460 run osmo-stp_10.42.42.5(pid=6388): stdout: | (launched: 2022-12-09_12:38:46.277880) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:48.304042 run osmo-stp_10.42.42.5(pid=6388): stderr: | 20221209123846548 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123846548 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123846549 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123846549 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123846549 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123846550 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123846550 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:38:48.462998 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6388): Process ended prematurely: osmo-stp_10.42.42.5(pid=6388) [trial-2359↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6388)] [trial-2359↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 12:38:48.471923 tst handover.py:18: Test FAILED (6.9 sec) 12:38:48.500181 run osmo-hlr_10.42.42.2(pid=6385): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6385)] 12:38:48.551123 run osmo-hlr_10.42.42.2(pid=6385): stdout: | (launched: 2022-12-09_12:38:45.250789) 12:38:48.603764 run osmo-hlr_10.42.42.2(pid=6385): stderr: | 20221209123845428 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123845429 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123845429 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123845429 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123845429 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123845429 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123845441 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123845449 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123845450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123845450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:38:48.676880 run osmo-msc_10.42.42.6(pid=6391): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6391)] 12:38:48.727520 run osmo-msc_10.42.42.6(pid=6391): stdout: | (launched: 2022-12-09_12:38:47.500062) 12:38:48.780292 run osmo-msc_10.42.42.6(pid=6391): stderr: | 20221209123847824 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123847824 DLGLOBAL DEBUG validating counter group 0x7fa51f7c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123847824 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123847824 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123847824 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123847825 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123847826 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123847827 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123847827 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123847827 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:38:48.833718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6384): Terminating (SIGTERM) 12:38:48.876265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6387): Terminating (SIGTERM) 12:38:48.918605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6390): Terminating (SIGTERM) 12:38:48.961134 --- ParallelTerminationStrategy: PID 6384 died... 12:38:48.981318 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6384): Terminated: ok {rc=0} 12:38:49.028312 --- ParallelTerminationStrategy: PID 6387 died... 12:38:49.048033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6387): Terminated: ok {rc=0} 12:38:49.094868 --- ParallelTerminationStrategy: PID 6390 died... 12:38:49.114566 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6390): Terminated: ok {rc=0} 12:38:49.202756 bus /sierra_3: Setting Powered False 12:38:50.300846 bus /sierra_3: Setting Powered False 12:38:51.418016 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 12:38:52.680675 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:38:52.686419 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:38:52.738693 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:38:52.766502 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:38:52.822199 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:38:52.873709 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:38:52.901152 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:38:53.451424 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 12:38:53.456855 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:38:53.468162 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:38:53.504182 tst handover.py: using LAC 21520 12:38:53.634346 tst handover.py: using RAC 100 12:38:53.765253 tst handover.py: using CellId 21520 12:38:53.897320 tst handover.py: using BVCI 21521 12:38:54.018959 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:38:54.068813 tst handover.py: using LAC 21521 12:38:54.199337 tst handover.py: using RAC 101 12:38:54.330861 tst handover.py: using CellId 21521 12:38:54.462272 tst handover.py: using BVCI 21522 12:38:54.586049 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:38:54.597445 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:38:54.608458 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:38:54.619971 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:38:54.631519 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:38:54.642965 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:38:54.762632 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:38:54.885122 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:38:55.373656 run create_hlr_db(pid=6398): Launched 12:38:55.501792 bus /sierra_2: Setting Powered False 12:38:56.567193 run create_hlr_db(pid=6398): Terminated: ok {rc=0} 12:38:57.004653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6400): Launched 12:38:57.341595 run osmo-hlr_10.42.42.2(pid=6401): Launched 12:38:57.470294 run osmo-stp_10.42.42.5: Starting osmo-stp 12:38:58.018772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6403): Launched 12:38:58.354576 run osmo-stp_10.42.42.5(pid=6404): Launched 12:38:58.483856 run osmo-msc_10.42.42.6: Starting osmo-msc 12:38:59.060662 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6406): Launched 12:38:59.399501 run osmo-msc_10.42.42.6(pid=6407): Launched 12:38:59.586567 run osmo-stp_10.42.42.5(pid=6404): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6404)] 12:38:59.727931 run osmo-stp_10.42.42.5(pid=6404): stdout: | (launched: 2022-12-09_12:38:58.293072) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:38:59.870503 run osmo-stp_10.42.42.5(pid=6404): stderr: | 20221209123858485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123858485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123858486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123858486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123858487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123858487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123858487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:00.009978 run osmo-stp_10.42.42.5(pid=6404): stdout: | (launched: 2022-12-09_12:38:58.293072) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:00.142921 run osmo-stp_10.42.42.5(pid=6404): stderr: | 20221209123858485 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123858485 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123858486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123858486 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123858487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123858487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123858487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:00.302097 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6404): Process ended prematurely: osmo-stp_10.42.42.5(pid=6404) [trial-2359↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6404)] [trial-2359↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 12:39:00.311095 tst handover.py:18: Test FAILED (6.8 sec) 12:39:00.339464 run osmo-hlr_10.42.42.2(pid=6401): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6401)] 12:39:00.390571 run osmo-hlr_10.42.42.2(pid=6401): stdout: | (launched: 2022-12-09_12:38:57.279690) 12:39:00.443399 run osmo-hlr_10.42.42.2(pid=6401): stderr: | 20221209123857479 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123857479 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123857479 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123857479 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123857479 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123857479 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123857492 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123857501 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123857501 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123857501 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:39:00.517048 run osmo-msc_10.42.42.6(pid=6407): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6407)] 12:39:00.567994 run osmo-msc_10.42.42.6(pid=6407): stdout: | (launched: 2022-12-09_12:38:59.336430) 12:39:00.620598 run osmo-msc_10.42.42.6(pid=6407): stderr: | 20221209123859661 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123859661 DLGLOBAL DEBUG validating counter group 0x7ff31f662c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123859662 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123859662 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123859662 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123859662 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123859664 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123859664 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123859664 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123859664 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:39:00.673618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6400): Terminating (SIGTERM) 12:39:00.716203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6403): Terminating (SIGTERM) 12:39:00.759224 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6406): Terminating (SIGTERM) 12:39:00.802824 --- ParallelTerminationStrategy: PID 6400 died... 12:39:00.823460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6400): Terminated: ok {rc=0} 12:39:00.872113 --- ParallelTerminationStrategy: PID 6403 died... 12:39:00.892778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6403): Terminated: ok {rc=0} 12:39:00.944307 --- ParallelTerminationStrategy: PID 6406 died... 12:39:00.965043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6406): Terminated: ok {rc=0} 12:39:01.061890 bus /sierra_3: Setting Powered False 12:39:02.172812 bus /sierra_3: Setting Powered False 12:39:03.310011 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 12:39:04.571022 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:39:04.576503 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 12:39:04.628753 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 12:39:04.656854 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 12:39:04.711020 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 12:39:04.762083 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 12:39:04.789681 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 12:39:05.341443 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 12:39:05.346841 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:39:05.358261 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:39:05.392768 tst handover.py: using LAC 21522 12:39:05.523453 tst handover.py: using RAC 102 12:39:05.655462 tst handover.py: using CellId 21522 12:39:05.788132 tst handover.py: using BVCI 21523 12:39:05.910469 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 12:39:05.960202 tst handover.py: using LAC 21523 12:39:06.097454 tst handover.py: using RAC 103 12:39:06.226896 tst handover.py: using CellId 21523 12:39:06.355941 tst handover.py: using BVCI 21524 12:39:06.477677 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:39:06.489021 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:39:06.500400 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:39:06.511858 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:39:06.523347 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 12:39:06.534753 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:39:06.656482 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 12:39:06.777859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:39:07.236009 run create_hlr_db(pid=6412): Launched 12:39:07.363729 bus /sierra_2: Setting Powered False 12:39:08.425354 run create_hlr_db(pid=6412): Terminated: ok {rc=0} 12:39:08.856240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6414): Launched 12:39:09.194202 run osmo-hlr_10.42.42.2(pid=6415): Launched 12:39:09.323733 run osmo-stp_10.42.42.5: Starting osmo-stp 12:39:09.873693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6417): Launched 12:39:10.212526 run osmo-stp_10.42.42.5(pid=6418): Launched 12:39:10.343035 run osmo-msc_10.42.42.6: Starting osmo-msc 12:39:10.925385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6420): Launched 12:39:11.262552 run osmo-msc_10.42.42.6(pid=6421): Launched 12:39:11.451229 run osmo-stp_10.42.42.5(pid=6418): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6418)] 12:39:11.591964 run osmo-stp_10.42.42.5(pid=6418): stdout: | (launched: 2022-12-09_12:39:10.150233) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:11.733534 run osmo-stp_10.42.42.5(pid=6418): stderr: | 20221209123910343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123910343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123910343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123910344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123910344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123910344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123910344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:11.873518 run osmo-stp_10.42.42.5(pid=6418): stdout: | (launched: 2022-12-09_12:39:10.150233) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:12.006477 run osmo-stp_10.42.42.5(pid=6418): stderr: | 20221209123910343 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123910343 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123910343 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123910344 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123910344 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123910344 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123910344 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:12.165634 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6418): Process ended prematurely: osmo-stp_10.42.42.5(pid=6418) [trial-2359↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6418)] [trial-2359↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 12:39:12.174524 tst handover.py:18: Test FAILED (6.8 sec) 12:39:12.202894 run osmo-hlr_10.42.42.2(pid=6415): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6415)] 12:39:12.253791 run osmo-hlr_10.42.42.2(pid=6415): stdout: | (launched: 2022-12-09_12:39:09.132365) 12:39:12.306768 run osmo-hlr_10.42.42.2(pid=6415): stderr: | 20221209123909329 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123909329 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123909329 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123909329 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123909329 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123909329 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123909341 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123909350 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123909350 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123909350 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:39:12.380364 run osmo-msc_10.42.42.6(pid=6421): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6421)] 12:39:12.431325 run osmo-msc_10.42.42.6(pid=6421): stdout: | (launched: 2022-12-09_12:39:11.200530) 12:39:12.483990 run osmo-msc_10.42.42.6(pid=6421): stderr: | 20221209123911524 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123911524 DLGLOBAL DEBUG validating counter group 0x7f618ec12c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123911525 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123911525 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123911525 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123911525 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123911527 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123911527 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123911527 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123911527 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:39:12.536822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6414): Terminating (SIGTERM) 12:39:12.579506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6417): Terminating (SIGTERM) 12:39:12.622838 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6420): Terminating (SIGTERM) 12:39:12.665766 --- ParallelTerminationStrategy: PID 6414 died... 12:39:12.686028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6414): Terminated: ok {rc=0} 12:39:12.733368 --- ParallelTerminationStrategy: PID 6417 died... 12:39:12.753101 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6417): Terminated: ok {rc=0} 12:39:12.800447 --- ParallelTerminationStrategy: PID 6420 died... 12:39:12.820203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6420): Terminated: ok {rc=0} 12:39:12.910258 bus /sierra_3: Setting Powered False 12:39:14.011064 bus /sierra_3: Setting Powered False 12:39:15.129314 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 12:39:16.432878 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:39:16.439743 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 12:39:16.491835 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:39:16.521861 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:39:16.575334 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 12:39:16.624292 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:39:16.654285 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:39:17.202830 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 12:39:17.208921 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:39:17.220099 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:39:17.254084 tst handover.py: using LAC 21524 12:39:17.377032 tst handover.py: using RAC 104 12:39:17.497321 tst handover.py: using CellId 21524 12:39:17.617802 tst handover.py: using BVCI 21525 12:39:17.730286 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:39:17.773368 tst handover.py: using LAC 21525 12:39:17.895531 tst handover.py: using RAC 105 12:39:18.016019 tst handover.py: using CellId 21525 12:39:18.140484 tst handover.py: using BVCI 21526 12:39:18.254839 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:39:18.266120 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:39:18.277013 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:39:18.287995 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:39:18.298949 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:39:18.309859 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:39:18.429337 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:39:18.552887 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:39:19.043774 run create_hlr_db(pid=6426): Launched 12:39:19.173352 bus /sierra_2: Setting Powered False 12:39:20.239283 run create_hlr_db(pid=6426): Terminated: ok {rc=0} 12:39:20.678741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6428): Launched 12:39:21.017199 run osmo-hlr_10.42.42.2(pid=6429): Launched 12:39:21.147647 run osmo-stp_10.42.42.5: Starting osmo-stp 12:39:21.695298 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6431): Launched 12:39:22.032639 run osmo-stp_10.42.42.5(pid=6432): Launched 12:39:22.162454 run osmo-msc_10.42.42.6: Starting osmo-msc 12:39:22.739099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6434): Launched 12:39:23.077213 run osmo-msc_10.42.42.6(pid=6435): Launched 12:39:23.266105 run osmo-stp_10.42.42.5(pid=6432): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6432)] 12:39:23.407450 run osmo-stp_10.42.42.5(pid=6432): stdout: | (launched: 2022-12-09_12:39:21.970881) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:23.549416 run osmo-stp_10.42.42.5(pid=6432): stderr: | 20221209123922163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123922163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123922163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123922164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123922164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123922164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123922164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:23.689558 run osmo-stp_10.42.42.5(pid=6432): stdout: | (launched: 2022-12-09_12:39:21.970881) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:23.822801 run osmo-stp_10.42.42.5(pid=6432): stderr: | 20221209123922163 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123922163 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123922163 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123922164 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123922164 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123922164 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123922164 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:23.981977 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6432): Process ended prematurely: osmo-stp_10.42.42.5(pid=6432) [trial-2359↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6432)] [trial-2359↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 12:39:23.990856 tst handover.py:18: Test FAILED (6.8 sec) 12:39:24.019045 run osmo-hlr_10.42.42.2(pid=6429): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6429)] 12:39:24.070523 run osmo-hlr_10.42.42.2(pid=6429): stdout: | (launched: 2022-12-09_12:39:20.954856) 12:39:24.123621 run osmo-hlr_10.42.42.2(pid=6429): stderr: | 20221209123921154 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123921154 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123921154 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123921154 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123921154 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123921154 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123921165 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123921174 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123921174 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123921174 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:39:24.197258 run osmo-msc_10.42.42.6(pid=6435): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6435)] 12:39:24.248245 run osmo-msc_10.42.42.6(pid=6435): stdout: | (launched: 2022-12-09_12:39:23.015100) 12:39:24.301233 run osmo-msc_10.42.42.6(pid=6435): stderr: | 20221209123923337 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123923337 DLGLOBAL DEBUG validating counter group 0x7fc83317bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123923337 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123923337 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123923337 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123923337 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123923339 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123923339 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123923340 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123923340 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:39:24.354342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6428): Terminating (SIGTERM) 12:39:24.397170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6431): Terminating (SIGTERM) 12:39:24.439910 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6434): Terminating (SIGTERM) 12:39:24.483060 --- ParallelTerminationStrategy: PID 6428 died... 12:39:24.503337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6428): Terminated: ok {rc=0} 12:39:24.550701 --- ParallelTerminationStrategy: PID 6431 died... 12:39:24.571017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6431): Terminated: ok {rc=0} 12:39:24.618602 --- ParallelTerminationStrategy: PID 6434 died... 12:39:24.638356 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6434): Terminated: ok {rc=0} 12:39:24.728133 bus /sierra_3: Setting Powered False 12:39:25.823460 bus /sierra_3: Setting Powered False 12:39:26.937176 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 12:39:28.197352 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:39:28.202931 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 12:39:28.256370 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:39:28.284549 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:39:28.337507 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 12:39:28.387839 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:39:28.414559 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:39:28.966658 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 12:39:28.971893 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:39:28.982998 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:39:29.016533 tst handover.py: using LAC 21526 12:39:29.137992 tst handover.py: using RAC 106 12:39:29.257874 tst handover.py: using CellId 21526 12:39:29.377890 tst handover.py: using BVCI 21527 12:39:29.490228 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:39:29.538203 tst handover.py: using LAC 21527 12:39:29.669175 tst handover.py: using RAC 107 12:39:29.798186 tst handover.py: using CellId 21527 12:39:29.919476 tst handover.py: using BVCI 21528 12:39:30.035067 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:39:30.046160 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:39:30.057098 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:39:30.067930 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:39:30.078776 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:39:30.089643 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:39:30.208297 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:39:30.330114 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:39:30.820286 run create_hlr_db(pid=6440): Launched 12:39:30.973776 bus /sierra_2: Setting Powered False 12:39:32.036234 run create_hlr_db(pid=6440): Terminated: ok {rc=0} 12:39:32.455576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6442): Launched 12:39:32.770991 run osmo-hlr_10.42.42.2(pid=6443): Launched 12:39:32.890854 run osmo-stp_10.42.42.5: Starting osmo-stp 12:39:33.402676 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6445): Launched 12:39:33.718491 run osmo-stp_10.42.42.5(pid=6446): Launched 12:39:33.839784 run osmo-msc_10.42.42.6: Starting osmo-msc 12:39:34.377792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6448): Launched 12:39:34.694491 run osmo-msc_10.42.42.6(pid=6449): Launched 12:39:34.871233 run osmo-stp_10.42.42.5(pid=6446): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6446)] 12:39:35.003790 run osmo-stp_10.42.42.5(pid=6446): stdout: | (launched: 2022-12-09_12:39:33.659974) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:35.135774 run osmo-stp_10.42.42.5(pid=6446): stderr: | 20221209123933832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123933833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123933833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123933833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123933834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123933834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123933834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:35.265557 run osmo-stp_10.42.42.5(pid=6446): stdout: | (launched: 2022-12-09_12:39:33.659974) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:35.389608 run osmo-stp_10.42.42.5(pid=6446): stderr: | 20221209123933832 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123933833 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123933833 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123933833 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123933834 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123933834 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123933834 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:35.538148 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6446): Process ended prematurely: osmo-stp_10.42.42.5(pid=6446) [trial-2359↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6446)] [trial-2359↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 12:39:35.546417 tst handover.py:18: Test FAILED (6.6 sec) 12:39:35.572800 run osmo-hlr_10.42.42.2(pid=6443): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6443)] 12:39:35.620600 run osmo-hlr_10.42.42.2(pid=6443): stdout: | (launched: 2022-12-09_12:39:32.712254) 12:39:35.670256 run osmo-hlr_10.42.42.2(pid=6443): stderr: | 20221209123932891 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123932891 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123932891 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123932891 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123932891 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123932891 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123932903 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123932911 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123932911 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123932911 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:39:35.739790 run osmo-msc_10.42.42.6(pid=6449): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6449)] 12:39:35.787645 run osmo-msc_10.42.42.6(pid=6449): stdout: | (launched: 2022-12-09_12:39:34.635579) 12:39:35.837378 run osmo-msc_10.42.42.6(pid=6449): stderr: | 20221209123934909 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123934909 DLGLOBAL DEBUG validating counter group 0x7fe0a3558c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123934909 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123934910 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123934910 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123934910 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123934912 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123934912 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123934912 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123934912 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:39:35.887369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6442): Terminating (SIGTERM) 12:39:35.927242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6445): Terminating (SIGTERM) 12:39:35.967001 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6448): Terminating (SIGTERM) 12:39:36.007238 --- ParallelTerminationStrategy: PID 6442 died... 12:39:36.026552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6442): Terminated: ok {rc=0} 12:39:36.071130 --- ParallelTerminationStrategy: PID 6445 died... 12:39:36.090064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6445): Terminated: ok {rc=0} 12:39:36.134537 --- ParallelTerminationStrategy: PID 6448 died... 12:39:36.153470 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6448): Terminated: ok {rc=0} 12:39:36.240197 bus /sierra_3: Setting Powered False 12:39:37.341376 bus /sierra_3: Setting Powered False 12:39:38.458618 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 12:39:39.719826 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:39:39.725271 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:39:39.762204 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:39:39.788863 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:39:39.842944 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:39:39.882216 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:39:39.910416 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:39:40.458679 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 12:39:40.464505 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:39:40.476022 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 12:39:40.512051 tst handover.py: using LAC 21528 12:39:40.645784 tst handover.py: using RAC 108 12:39:40.777842 tst handover.py: using CellId 21528 12:39:40.910967 tst handover.py: using BVCI 21529 12:39:41.033378 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 12:39:41.068151 tst handover.py: using LAC 21529 12:39:41.197863 tst handover.py: using RAC 109 12:39:41.327099 tst handover.py: using CellId 21529 12:39:41.456903 tst handover.py: using BVCI 21530 12:39:41.579477 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:39:41.591052 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:39:41.602427 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:39:41.614003 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:39:41.625638 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:39:41.637313 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 12:39:41.758768 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 12:39:41.878641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:39:42.368441 run create_hlr_db(pid=6454): Launched 12:39:42.499168 bus /sierra_2: Setting Powered False 12:39:43.564733 run create_hlr_db(pid=6454): Terminated: ok {rc=0} 12:39:44.004521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6456): Launched 12:39:44.341888 run osmo-hlr_10.42.42.2(pid=6457): Launched 12:39:44.470406 run osmo-stp_10.42.42.5: Starting osmo-stp 12:39:45.018972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6459): Launched 12:39:45.355104 run osmo-stp_10.42.42.5(pid=6460): Launched 12:39:45.484680 run osmo-msc_10.42.42.6: Starting osmo-msc 12:39:46.076681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6462): Launched 12:39:46.489695 run osmo-msc_10.42.42.6(pid=6463): Launched 12:39:46.844891 run osmo-stp_10.42.42.5(pid=6460): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6460)] 12:39:47.008001 run osmo-stp_10.42.42.5(pid=6460): stdout: | (launched: 2022-12-09_12:39:45.293303) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:47.186173 run osmo-stp_10.42.42.5(pid=6460): stderr: | 20221209123945486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123945486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123945486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123945487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123945487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123945487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123945487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:47.374567 run osmo-stp_10.42.42.5(pid=6460): stdout: | (launched: 2022-12-09_12:39:45.293303) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:47.518472 run osmo-stp_10.42.42.5(pid=6460): stderr: | 20221209123945486 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123945486 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123945486 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123945487 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123945487 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123945487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123945487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:47.675506 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6460): Process ended prematurely: osmo-stp_10.42.42.5(pid=6460) [trial-2359↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6460)] [trial-2359↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 12:39:47.684548 tst handover.py:18: Test FAILED (7.2 sec) 12:39:47.713441 run osmo-hlr_10.42.42.2(pid=6457): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6457)] 12:39:47.765314 run osmo-hlr_10.42.42.2(pid=6457): stdout: | (launched: 2022-12-09_12:39:44.279736) 12:39:47.818808 run osmo-hlr_10.42.42.2(pid=6457): stderr: | 20221209123944480 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123944480 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123944480 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123944480 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123944481 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123944481 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123944493 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123944502 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123944502 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123944502 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:39:47.893341 run osmo-msc_10.42.42.6(pid=6463): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6463)] 12:39:47.944809 run osmo-msc_10.42.42.6(pid=6463): stdout: | (launched: 2022-12-09_12:39:46.420454) 12:39:47.998069 run osmo-msc_10.42.42.6(pid=6463): stderr: | 20221209123946955 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123946955 DLGLOBAL DEBUG validating counter group 0x7f8edb867c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123946956 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123946956 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123946956 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123946956 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123946970 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123946971 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123946971 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123946971 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:39:48.051621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6456): Terminating (SIGTERM) 12:39:48.094561 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6459): Terminating (SIGTERM) 12:39:48.137676 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6462): Terminating (SIGTERM) 12:39:48.180731 --- ParallelTerminationStrategy: PID 6456 died... 12:39:48.201306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6456): Terminated: ok {rc=0} 12:39:48.248844 --- ParallelTerminationStrategy: PID 6459 died... 12:39:48.268867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6459): Terminated: ok {rc=0} 12:39:48.316249 --- ParallelTerminationStrategy: PID 6462 died... 12:39:48.336294 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6462): Terminated: ok {rc=0} 12:39:48.426546 bus /sierra_3: Setting Powered False 12:39:49.526374 bus /sierra_3: Setting Powered False 12:39:50.639620 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 12:39:51.885217 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:39:51.890871 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:39:51.941769 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:39:51.969309 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:39:52.023213 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:39:52.073761 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:39:52.101162 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:39:52.652375 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 12:39:52.658052 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:39:52.669356 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:39:52.705213 tst handover.py: using LAC 21530 12:39:52.826899 tst handover.py: using RAC 110 12:39:52.949430 tst handover.py: using CellId 21530 12:39:53.071736 tst handover.py: using BVCI 21531 12:39:53.184114 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:39:53.232324 tst handover.py: using LAC 21531 12:39:53.357910 tst handover.py: using RAC 111 12:39:53.477411 tst handover.py: using CellId 21531 12:39:53.597846 tst handover.py: using BVCI 21532 12:39:53.711106 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:39:53.721935 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:39:53.732502 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:39:53.743048 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:39:53.753831 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:39:53.764358 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:39:53.885265 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:39:54.002831 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:39:54.452485 run create_hlr_db(pid=6468): Launched 12:39:54.577611 bus /sierra_2: Setting Powered False 12:39:55.638586 run create_hlr_db(pid=6468): Terminated: ok {rc=0} 12:39:56.043069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6470): Launched 12:39:56.351306 run osmo-hlr_10.42.42.2(pid=6471): Launched 12:39:56.467832 run osmo-stp_10.42.42.5: Starting osmo-stp 12:39:56.970184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6473): Launched 12:39:57.278465 run osmo-stp_10.42.42.5(pid=6474): Launched 12:39:57.396068 run osmo-msc_10.42.42.6: Starting osmo-msc 12:39:57.926195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6476): Launched 12:39:58.233959 run osmo-msc_10.42.42.6(pid=6477): Launched 12:39:58.404812 run osmo-stp_10.42.42.5(pid=6474): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6474)] 12:39:58.533973 run osmo-stp_10.42.42.5(pid=6474): stdout: | (launched: 2022-12-09_12:39:57.220250) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:58.662733 run osmo-stp_10.42.42.5(pid=6474): stderr: | 20221209123957388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123957388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123957389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123957389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123957390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123957390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123957390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:58.789790 run osmo-stp_10.42.42.5(pid=6474): stdout: | (launched: 2022-12-09_12:39:57.220250) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:39:58.911167 run osmo-stp_10.42.42.5(pid=6474): stderr: | 20221209123957388 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209123957388 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209123957389 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209123957389 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209123957390 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209123957390 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209123957390 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:39:59.057513 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6474): Process ended prematurely: osmo-stp_10.42.42.5(pid=6474) [trial-2359↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6474)] [trial-2359↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 12:39:59.065679 tst handover.py:18: Test FAILED (6.4 sec) 12:39:59.092074 run osmo-hlr_10.42.42.2(pid=6471): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6471)] 12:39:59.140196 run osmo-hlr_10.42.42.2(pid=6471): stdout: | (launched: 2022-12-09_12:39:56.293704) 12:39:59.190274 run osmo-hlr_10.42.42.2(pid=6471): stderr: | 20221209123956469 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209123956469 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209123956469 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209123956469 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209123956469 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209123956469 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209123956482 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209123956490 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209123956490 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209123956490 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:39:59.260133 run osmo-msc_10.42.42.6(pid=6477): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6477)] 12:39:59.308214 run osmo-msc_10.42.42.6(pid=6477): stdout: | (launched: 2022-12-09_12:39:58.176327) 12:39:59.358049 run osmo-msc_10.42.42.6(pid=6477): stderr: | 20221209123958446 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209123958446 DLGLOBAL DEBUG validating counter group 0x7f06230dbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209123958446 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209123958446 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209123958447 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209123958447 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209123958448 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209123958450 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209123958450 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209123958450 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:39:59.408264 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6470): Terminating (SIGTERM) 12:39:59.448290 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6473): Terminating (SIGTERM) 12:39:59.488410 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6476): Terminating (SIGTERM) 12:39:59.528543 --- ParallelTerminationStrategy: PID 6470 died... 12:39:59.547797 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6470): Terminated: ok {rc=0} 12:39:59.592544 --- ParallelTerminationStrategy: PID 6473 died... 12:39:59.611247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6473): Terminated: ok {rc=0} 12:39:59.655157 --- ParallelTerminationStrategy: PID 6476 died... 12:39:59.673779 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6476): Terminated: ok {rc=0} 12:39:59.759920 bus /sierra_3: Setting Powered False 12:40:00.866481 bus /sierra_3: Setting Powered False 12:40:01.989279 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 12:40:03.244271 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:40:03.249311 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:40:03.297532 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:40:03.324014 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:40:03.381090 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:40:03.428681 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:40:03.455090 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:40:04.001127 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 12:40:04.006299 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:40:04.017158 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:40:04.049952 tst handover.py: using LAC 21532 12:40:04.168703 tst handover.py: using RAC 112 12:40:04.287371 tst handover.py: using CellId 21532 12:40:04.407210 tst handover.py: using BVCI 21533 12:40:04.518817 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:40:04.565177 tst handover.py: using LAC 21533 12:40:04.684258 tst handover.py: using RAC 113 12:40:04.813933 tst handover.py: using CellId 21533 12:40:04.943581 tst handover.py: using BVCI 21534 12:40:05.063726 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:40:05.075072 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:40:05.086262 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:40:05.098345 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:40:05.110371 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:40:05.122315 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:40:05.243156 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:40:05.362428 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:40:05.812936 run create_hlr_db(pid=6485): Launched 12:40:05.939299 bus /sierra_2: Setting Powered False 12:40:07.000723 run create_hlr_db(pid=6485): Terminated: ok {rc=0} 12:40:07.425489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6487): Launched 12:40:07.759020 run osmo-hlr_10.42.42.2(pid=6488): Launched 12:40:07.885522 run osmo-stp_10.42.42.5: Starting osmo-stp 12:40:08.423683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6490): Launched 12:40:08.754502 run osmo-stp_10.42.42.5(pid=6491): Launched 12:40:08.881459 run osmo-msc_10.42.42.6: Starting osmo-msc 12:40:09.449537 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6493): Launched 12:40:09.782194 run osmo-msc_10.42.42.6(pid=6494): Launched 12:40:09.966622 run osmo-stp_10.42.42.5(pid=6491): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6491)] 12:40:10.105278 run osmo-stp_10.42.42.5(pid=6491): stdout: | (launched: 2022-12-09_12:40:08.693580) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:10.244397 run osmo-stp_10.42.42.5(pid=6491): stderr: | 20221209124008884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124008884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124008884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124008885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124008885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124008885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124008885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:10.382677 run osmo-stp_10.42.42.5(pid=6491): stdout: | (launched: 2022-12-09_12:40:08.693580) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:10.513112 run osmo-stp_10.42.42.5(pid=6491): stderr: | 20221209124008884 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124008884 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124008884 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124008885 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124008885 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124008885 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124008885 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:10.670588 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6491): Process ended prematurely: osmo-stp_10.42.42.5(pid=6491) [trial-2359↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6491)] [trial-2359↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 12:40:10.679370 tst handover.py:18: Test FAILED (6.7 sec) 12:40:10.707836 run osmo-hlr_10.42.42.2(pid=6488): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6488)] 12:40:10.758584 run osmo-hlr_10.42.42.2(pid=6488): stdout: | (launched: 2022-12-09_12:40:07.697850) 12:40:10.811514 run osmo-hlr_10.42.42.2(pid=6488): stderr: | 20221209124007895 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124007895 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124007895 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124007895 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124007895 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124007895 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124007908 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124007918 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124007919 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124007919 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:40:10.884935 run osmo-msc_10.42.42.6(pid=6494): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6494)] 12:40:10.935784 run osmo-msc_10.42.42.6(pid=6494): stdout: | (launched: 2022-12-09_12:40:09.720695) 12:40:10.988103 run osmo-msc_10.42.42.6(pid=6494): stderr: | 20221209124010041 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124010041 DLGLOBAL DEBUG validating counter group 0x7f539be4ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124010042 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124010042 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124010042 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124010042 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124010044 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124010044 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124010044 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124010044 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:40:11.040825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6487): Terminating (SIGTERM) 12:40:11.083860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6490): Terminating (SIGTERM) 12:40:11.126560 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6493): Terminating (SIGTERM) 12:40:11.169579 --- ParallelTerminationStrategy: PID 6487 died... 12:40:11.189865 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6487): Terminated: ok {rc=0} 12:40:11.237222 --- ParallelTerminationStrategy: PID 6490 died... 12:40:11.256906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6490): Terminated: ok {rc=0} 12:40:11.304077 --- ParallelTerminationStrategy: PID 6493 died... 12:40:11.324069 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6493): Terminated: ok {rc=0} 12:40:11.413102 bus /sierra_3: Setting Powered False 12:40:12.515650 bus /sierra_3: Setting Powered False 12:40:13.633974 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 12:40:14.901038 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:40:14.907867 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 12:40:14.970084 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 12:40:14.998044 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 12:40:15.050202 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 12:40:15.111452 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 12:40:15.139286 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 12:40:15.690743 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 12:40:15.696932 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:40:15.708546 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:40:15.756775 tst handover.py: using LAC 21534 12:40:15.882829 tst handover.py: using RAC 114 12:40:16.015256 tst handover.py: using CellId 21534 12:40:16.146619 tst handover.py: using BVCI 21535 12:40:16.311035 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 12:40:16.354237 tst handover.py: using LAC 21535 12:40:16.522541 tst handover.py: using RAC 115 12:40:16.692800 tst handover.py: using CellId 21535 12:40:16.822944 tst handover.py: using BVCI 21536 12:40:16.955207 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:40:16.967850 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:40:16.981580 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:40:16.995247 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:40:17.010209 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 12:40:17.023989 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:40:17.150883 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 12:40:17.286389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:40:17.769433 run create_hlr_db(pid=6499): Launched 12:40:17.897447 bus /sierra_2: Setting Powered False 12:40:18.963149 run create_hlr_db(pid=6499): Terminated: ok {rc=0} 12:40:19.395034 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6501): Launched 12:40:19.726148 run osmo-hlr_10.42.42.2(pid=6502): Launched 12:40:19.854233 run osmo-stp_10.42.42.5: Starting osmo-stp 12:40:20.396044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6504): Launched 12:40:20.726744 run osmo-stp_10.42.42.5(pid=6505): Launched 12:40:20.853574 run osmo-msc_10.42.42.6: Starting osmo-msc 12:40:21.421766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6507): Launched 12:40:21.752050 run osmo-msc_10.42.42.6(pid=6508): Launched 12:40:21.936856 run osmo-stp_10.42.42.5(pid=6505): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6505)] 12:40:22.075888 run osmo-stp_10.42.42.5(pid=6505): stdout: | (launched: 2022-12-09_12:40:20.666570) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:22.215545 run osmo-stp_10.42.42.5(pid=6505): stderr: | 20221209124020855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124020855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124020856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124020856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124020857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124020857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124020857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:22.352917 run osmo-stp_10.42.42.5(pid=6505): stdout: | (launched: 2022-12-09_12:40:20.666570) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:22.484435 run osmo-stp_10.42.42.5(pid=6505): stderr: | 20221209124020855 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124020855 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124020856 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124020856 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124020857 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124020857 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124020857 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:22.641686 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6505): Process ended prematurely: osmo-stp_10.42.42.5(pid=6505) [trial-2359↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6505)] [trial-2359↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 12:40:22.650533 tst handover.py:18: Test FAILED (6.9 sec) 12:40:22.678776 run osmo-hlr_10.42.42.2(pid=6502): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6502)] 12:40:22.729281 run osmo-hlr_10.42.42.2(pid=6502): stdout: | (launched: 2022-12-09_12:40:19.665961) 12:40:22.781720 run osmo-hlr_10.42.42.2(pid=6502): stderr: | 20221209124019859 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124019860 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124019860 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124019860 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124019860 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124019860 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124019872 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124019881 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124019881 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124019881 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:40:22.855184 run osmo-msc_10.42.42.6(pid=6508): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6508)] 12:40:22.906124 run osmo-msc_10.42.42.6(pid=6508): stdout: | (launched: 2022-12-09_12:40:21.691874) 12:40:22.958402 run osmo-msc_10.42.42.6(pid=6508): stderr: | 20221209124022011 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124022011 DLGLOBAL DEBUG validating counter group 0x7f4823b6bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124022012 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124022012 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124022012 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124022012 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124022014 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124022014 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124022014 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124022014 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:40:23.011319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6501): Terminating (SIGTERM) 12:40:23.053706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6504): Terminating (SIGTERM) 12:40:23.096201 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6507): Terminating (SIGTERM) 12:40:23.138958 --- ParallelTerminationStrategy: PID 6501 died... 12:40:23.159163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6501): Terminated: ok {rc=0} 12:40:23.206441 --- ParallelTerminationStrategy: PID 6504 died... 12:40:23.226104 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6504): Terminated: ok {rc=0} 12:40:23.273108 --- ParallelTerminationStrategy: PID 6507 died... 12:40:23.292803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6507): Terminated: ok {rc=0} 12:40:23.381115 bus /sierra_3: Setting Powered False 12:40:24.481522 bus /sierra_3: Setting Powered False 12:40:25.597416 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 12:40:26.869812 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:40:26.875914 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 12:40:26.941863 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:40:26.969449 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:40:27.023424 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 12:40:27.088551 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:40:27.115973 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:40:27.667879 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 12:40:27.673416 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:40:27.684883 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:40:27.734586 tst handover.py: using LAC 21536 12:40:27.866251 tst handover.py: using RAC 116 12:40:27.995435 tst handover.py: using CellId 21536 12:40:28.126195 tst handover.py: using BVCI 21537 12:40:28.246384 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:40:28.300123 tst handover.py: using LAC 21537 12:40:28.430606 tst handover.py: using RAC 117 12:40:28.558153 tst handover.py: using CellId 21537 12:40:28.685716 tst handover.py: using BVCI 21538 12:40:28.798995 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:40:28.810403 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:40:28.821480 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:40:28.833035 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:40:28.844648 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:40:28.856081 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:40:28.976086 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:40:29.097780 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:40:29.551899 run create_hlr_db(pid=6513): Launched 12:40:29.680437 bus /sierra_2: Setting Powered False 12:40:30.742281 run create_hlr_db(pid=6513): Terminated: ok {rc=0} 12:40:31.192206 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6515): Launched 12:40:31.546796 run osmo-hlr_10.42.42.2(pid=6516): Launched 12:40:31.776694 run osmo-stp_10.42.42.5: Starting osmo-stp 12:40:32.478020 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6518): Launched 12:40:32.809719 run osmo-stp_10.42.42.5(pid=6519): Launched 12:40:32.937082 run osmo-msc_10.42.42.6: Starting osmo-msc 12:40:33.514826 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6521): Launched 12:40:33.846670 run osmo-msc_10.42.42.6(pid=6522): Launched 12:40:34.033533 run osmo-stp_10.42.42.5(pid=6519): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6519)] 12:40:34.173870 run osmo-stp_10.42.42.5(pid=6519): stdout: | (launched: 2022-12-09_12:40:32.749505) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:34.314607 run osmo-stp_10.42.42.5(pid=6519): stderr: | 20221209124032938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124032938 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124032938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124032939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124032939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124032939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124032939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:34.452599 run osmo-stp_10.42.42.5(pid=6519): stdout: | (launched: 2022-12-09_12:40:32.749505) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:34.584432 run osmo-stp_10.42.42.5(pid=6519): stderr: | 20221209124032938 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124032938 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124032938 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124032939 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124032939 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124032939 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124032939 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:34.741923 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6519): Process ended prematurely: osmo-stp_10.42.42.5(pid=6519) [trial-2359↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6519)] [trial-2359↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 12:40:34.750909 tst handover.py:18: Test FAILED (7.1 sec) 12:40:34.779343 run osmo-hlr_10.42.42.2(pid=6516): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6516)] 12:40:34.830232 run osmo-hlr_10.42.42.2(pid=6516): stdout: | (launched: 2022-12-09_12:40:31.482839) 12:40:34.883440 run osmo-hlr_10.42.42.2(pid=6516): stderr: | 20221209124031800 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124031800 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124031800 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124031800 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124031800 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124031800 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124031818 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124031828 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124031828 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124031828 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:40:34.956573 run osmo-msc_10.42.42.6(pid=6522): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6522)] 12:40:35.007295 run osmo-msc_10.42.42.6(pid=6522): stdout: | (launched: 2022-12-09_12:40:33.786141) 12:40:35.060090 run osmo-msc_10.42.42.6(pid=6522): stderr: | 20221209124034104 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124034104 DLGLOBAL DEBUG validating counter group 0x7f4b71a4cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124034104 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124034104 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124034104 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124034105 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124034106 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124034107 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124034107 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124034107 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:40:35.113323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6515): Terminating (SIGTERM) 12:40:35.155988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6518): Terminating (SIGTERM) 12:40:35.198726 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6521): Terminating (SIGTERM) 12:40:35.241683 --- ParallelTerminationStrategy: PID 6515 died... 12:40:35.262029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6515): Terminated: ok {rc=0} 12:40:35.309874 --- ParallelTerminationStrategy: PID 6518 died... 12:40:35.330016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6518): Terminated: ok {rc=0} 12:40:35.377456 --- ParallelTerminationStrategy: PID 6521 died... 12:40:35.397546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6521): Terminated: ok {rc=0} 12:40:35.487096 bus /sierra_3: Setting Powered False 12:40:36.587490 bus /sierra_3: Setting Powered False 12:40:37.707373 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 12:40:38.985777 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:40:38.990909 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:40:39.041737 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:40:39.068431 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:40:39.119452 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:40:39.169707 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:40:39.195971 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:40:39.747290 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 12:40:39.752672 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:40:39.763690 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 12:40:39.811225 tst handover.py: using LAC 21538 12:40:39.931033 tst handover.py: using RAC 118 12:40:40.050632 tst handover.py: using CellId 21538 12:40:40.171447 tst handover.py: using BVCI 21539 12:40:40.283072 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 12:40:40.316309 tst handover.py: using LAC 21539 12:40:40.435671 tst handover.py: using RAC 119 12:40:40.555857 tst handover.py: using CellId 21539 12:40:40.676368 tst handover.py: using BVCI 21540 12:40:40.798187 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:40:40.809866 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:40:40.821190 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:40:40.832624 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:40:40.844572 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:40:40.856215 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 12:40:40.978138 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 12:40:41.100589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:40:41.584433 run create_hlr_db(pid=6527): Launched 12:40:41.710681 bus /sierra_2: Setting Powered False 12:40:42.775898 run create_hlr_db(pid=6527): Terminated: ok {rc=0} 12:40:43.209641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6529): Launched 12:40:43.543130 run osmo-hlr_10.42.42.2(pid=6530): Launched 12:40:43.669808 run osmo-stp_10.42.42.5: Starting osmo-stp 12:40:44.209690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6532): Launched 12:40:44.542914 run osmo-stp_10.42.42.5(pid=6533): Launched 12:40:44.671080 run osmo-msc_10.42.42.6: Starting osmo-msc 12:40:45.241494 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6535): Launched 12:40:45.574553 run osmo-msc_10.42.42.6(pid=6536): Launched 12:40:45.760642 run osmo-stp_10.42.42.5(pid=6533): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6533)] 12:40:45.900569 run osmo-stp_10.42.42.5(pid=6533): stdout: | (launched: 2022-12-09_12:40:44.482744) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:46.155705 run osmo-stp_10.42.42.5(pid=6533): stderr: | 20221209124044671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124044671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124044671 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124044672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124044672 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124044672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124044672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:46.297202 run osmo-stp_10.42.42.5(pid=6533): stdout: | (launched: 2022-12-09_12:40:44.482744) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:46.431525 run osmo-stp_10.42.42.5(pid=6533): stderr: | 20221209124044671 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124044671 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124044671 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124044672 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124044672 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124044672 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124044672 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:46.592556 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6533): Process ended prematurely: osmo-stp_10.42.42.5(pid=6533) [trial-2359↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6533)] [trial-2359↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 12:40:46.602665 tst handover.py:18: Test FAILED (6.8 sec) 12:40:46.633620 run osmo-hlr_10.42.42.2(pid=6530): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6530)] 12:40:46.686409 run osmo-hlr_10.42.42.2(pid=6530): stdout: | (launched: 2022-12-09_12:40:43.482479) 12:40:46.740860 run osmo-hlr_10.42.42.2(pid=6530): stderr: | 20221209124043679 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124043679 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124043679 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124043679 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124043679 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124043679 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124043691 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124043700 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124043701 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124043701 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:40:46.816009 run osmo-msc_10.42.42.6(pid=6536): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6536)] 12:40:46.869153 run osmo-msc_10.42.42.6(pid=6536): stdout: | (launched: 2022-12-09_12:40:45.514228) 12:40:46.923692 run osmo-msc_10.42.42.6(pid=6536): stderr: | 20221209124045839 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124045839 DLGLOBAL DEBUG validating counter group 0x7fe8a10ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124045839 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124045839 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124045839 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124045839 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124045855 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124045856 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124045856 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124045856 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:40:46.978414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6529): Terminating (SIGTERM) 12:40:47.022756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6532): Terminating (SIGTERM) 12:40:47.067218 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6535): Terminating (SIGTERM) 12:40:47.112019 --- ParallelTerminationStrategy: PID 6529 died... 12:40:47.132579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6529): Terminated: ok {rc=0} 12:40:47.183687 --- ParallelTerminationStrategy: PID 6532 died... 12:40:47.204414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6532): Terminated: ok {rc=0} 12:40:47.253261 --- ParallelTerminationStrategy: PID 6535 died... 12:40:47.273377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6535): Terminated: ok {rc=0} 12:40:47.363641 bus /sierra_3: Setting Powered False 12:40:48.463599 bus /sierra_3: Setting Powered False 12:40:49.581423 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 12:40:50.840628 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:40:50.846907 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:40:50.911834 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:40:50.939143 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:40:50.995360 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:40:51.061171 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:40:51.088725 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:40:51.631604 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 12:40:51.637211 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:40:51.648218 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:40:51.695523 tst handover.py: using LAC 21540 12:40:51.818660 tst handover.py: using RAC 120 12:40:51.941565 tst handover.py: using CellId 21540 12:40:52.062692 tst handover.py: using BVCI 21541 12:40:52.176291 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:40:52.225039 tst handover.py: using LAC 21541 12:40:52.347623 tst handover.py: using RAC 121 12:40:52.478533 tst handover.py: using CellId 21541 12:40:52.609303 tst handover.py: using BVCI 21542 12:40:52.729570 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:40:52.740918 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:40:52.752180 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:40:52.763709 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:40:52.775314 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:40:52.786680 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:40:52.906063 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:40:53.023965 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:40:53.478573 run create_hlr_db(pid=6541): Launched 12:40:53.607453 bus /sierra_2: Setting Powered False 12:40:54.669110 run create_hlr_db(pid=6541): Terminated: ok {rc=0} 12:40:55.094429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6543): Launched 12:40:55.426982 run osmo-hlr_10.42.42.2(pid=6544): Launched 12:40:55.554217 run osmo-stp_10.42.42.5: Starting osmo-stp 12:40:56.099266 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6546): Launched 12:40:56.431676 run osmo-stp_10.42.42.5(pid=6547): Launched 12:40:56.561048 run osmo-msc_10.42.42.6: Starting osmo-msc 12:40:57.136820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6549): Launched 12:40:57.471490 run osmo-msc_10.42.42.6(pid=6550): Launched 12:40:57.659865 run osmo-stp_10.42.42.5(pid=6547): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6547)] 12:40:57.800682 run osmo-stp_10.42.42.5(pid=6547): stdout: | (launched: 2022-12-09_12:40:56.371403) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:57.942755 run osmo-stp_10.42.42.5(pid=6547): stderr: | 20221209124056559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124056559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124056559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124056560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124056560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124056560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124056560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:58.081752 run osmo-stp_10.42.42.5(pid=6547): stdout: | (launched: 2022-12-09_12:40:56.371403) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:40:58.215060 run osmo-stp_10.42.42.5(pid=6547): stderr: | 20221209124056559 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124056559 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124056559 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124056560 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124056560 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124056560 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124056560 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:40:58.373813 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6547): Process ended prematurely: osmo-stp_10.42.42.5(pid=6547) [trial-2359↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6547)] [trial-2359↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 12:40:58.382775 tst handover.py:18: Test FAILED (6.7 sec) 12:40:58.411738 run osmo-hlr_10.42.42.2(pid=6544): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6544)] 12:40:58.463344 run osmo-hlr_10.42.42.2(pid=6544): stdout: | (launched: 2022-12-09_12:40:55.366095) 12:40:58.516632 run osmo-hlr_10.42.42.2(pid=6544): stderr: | 20221209124055560 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124055560 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124055560 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124055560 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124055561 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124055561 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124055573 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124055582 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124055582 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124055582 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:40:58.590810 run osmo-msc_10.42.42.6(pid=6550): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6550)] 12:40:58.642103 run osmo-msc_10.42.42.6(pid=6550): stdout: | (launched: 2022-12-09_12:40:57.410517) 12:40:58.695352 run osmo-msc_10.42.42.6(pid=6550): stderr: | 20221209124057729 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124057729 DLGLOBAL DEBUG validating counter group 0x7f37765dac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124057729 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124057729 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124057729 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124057730 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124057731 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124057732 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124057732 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124057732 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:40:58.749009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6543): Terminating (SIGTERM) 12:40:58.792367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6546): Terminating (SIGTERM) 12:40:58.835875 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6549): Terminating (SIGTERM) 12:40:58.879832 --- ParallelTerminationStrategy: PID 6543 died... 12:40:58.900409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6543): Terminated: ok {rc=0} 12:40:58.948732 --- ParallelTerminationStrategy: PID 6546 died... 12:40:58.968915 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6546): Terminated: ok {rc=0} 12:40:59.016519 --- ParallelTerminationStrategy: PID 6549 died... 12:40:59.036609 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6549): Terminated: ok {rc=0} 12:40:59.126548 bus /sierra_3: Setting Powered False 12:41:00.228329 bus /sierra_3: Setting Powered False 12:41:01.345909 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 12:41:02.622373 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:41:02.628139 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:41:02.692791 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:41:02.720624 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:41:02.778899 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:41:02.844437 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:41:02.872469 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:41:03.417394 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 12:41:03.423041 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:41:03.434632 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:41:03.484061 tst handover.py: using LAC 21542 12:41:03.612050 tst handover.py: using RAC 122 12:41:03.739499 tst handover.py: using CellId 21542 12:41:03.869751 tst handover.py: using BVCI 21543 12:41:03.990406 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:41:04.037779 tst handover.py: using LAC 21543 12:41:04.167392 tst handover.py: using RAC 123 12:41:04.299771 tst handover.py: using CellId 21543 12:41:04.429034 tst handover.py: using BVCI 21544 12:41:04.549907 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:41:04.561413 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:41:04.572687 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:41:04.584198 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:41:04.595802 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:41:04.607327 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:41:04.731116 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:41:04.853270 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:41:05.307913 run create_hlr_db(pid=6555): Launched 12:41:05.434613 bus /sierra_2: Setting Powered False 12:41:06.496217 run create_hlr_db(pid=6555): Terminated: ok {rc=0} 12:41:06.901635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6557): Launched 12:41:07.212292 run osmo-hlr_10.42.42.2(pid=6558): Launched 12:41:07.329573 run osmo-stp_10.42.42.5: Starting osmo-stp 12:41:07.834763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6560): Launched 12:41:08.143846 run osmo-stp_10.42.42.5(pid=6561): Launched 12:41:08.261484 run osmo-msc_10.42.42.6: Starting osmo-msc 12:41:08.794333 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6563): Launched 12:41:09.104520 run osmo-msc_10.42.42.6(pid=6564): Launched 12:41:09.276526 run osmo-stp_10.42.42.5(pid=6561): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6561)] 12:41:09.406930 run osmo-stp_10.42.42.5(pid=6561): stdout: | (launched: 2022-12-09_12:41:08.086972) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:09.537608 run osmo-stp_10.42.42.5(pid=6561): stderr: | 20221209124108255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124108255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124108255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124108256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124108256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124108256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124108256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:09.666123 run osmo-stp_10.42.42.5(pid=6561): stdout: | (launched: 2022-12-09_12:41:08.086972) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:09.788454 run osmo-stp_10.42.42.5(pid=6561): stderr: | 20221209124108255 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124108255 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124108255 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124108256 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124108256 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124108256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124108256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:09.935554 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6561): Process ended prematurely: osmo-stp_10.42.42.5(pid=6561) [trial-2359↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6561)] [trial-2359↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 12:41:09.943757 tst handover.py:18: Test FAILED (6.5 sec) 12:41:09.969969 run osmo-hlr_10.42.42.2(pid=6558): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6558)] 12:41:10.018376 run osmo-hlr_10.42.42.2(pid=6558): stdout: | (launched: 2022-12-09_12:41:07.154750) 12:41:10.068522 run osmo-hlr_10.42.42.2(pid=6558): stderr: | 20221209124107330 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124107330 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124107330 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124107330 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124107330 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124107331 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124107342 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124107351 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124107351 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124107351 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:41:10.138302 run osmo-msc_10.42.42.6(pid=6564): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6564)] 12:41:10.186690 run osmo-msc_10.42.42.6(pid=6564): stdout: | (launched: 2022-12-09_12:41:09.047709) 12:41:10.236721 run osmo-msc_10.42.42.6(pid=6564): stderr: | 20221209124109318 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124109318 DLGLOBAL DEBUG validating counter group 0x7f269fb57c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124109319 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124109319 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124109319 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124109319 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124109321 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124109321 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124109321 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124109321 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:41:10.286985 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6557): Terminating (SIGTERM) 12:41:10.327593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6560): Terminating (SIGTERM) 12:41:10.368084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6563): Terminating (SIGTERM) 12:41:10.408693 --- ParallelTerminationStrategy: PID 6557 died... 12:41:10.428036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6557): Terminated: ok {rc=0} 12:41:10.473401 --- ParallelTerminationStrategy: PID 6560 died... 12:41:10.492432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6560): Terminated: ok {rc=0} 12:41:10.536677 --- ParallelTerminationStrategy: PID 6563 died... 12:41:10.555573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6563): Terminated: ok {rc=0} 12:41:10.639322 bus /sierra_3: Setting Powered False 12:41:11.734591 bus /sierra_3: Setting Powered False 12:41:12.850398 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 12:41:14.129462 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:41:14.135307 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 12:41:14.197644 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 12:41:14.225197 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 12:41:14.280748 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 12:41:14.343905 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 12:41:14.371990 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 12:41:14.923991 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 12:41:14.929824 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:41:14.941621 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:41:14.987417 tst handover.py: using LAC 21544 12:41:15.118451 tst handover.py: using RAC 124 12:41:15.249954 tst handover.py: using CellId 21544 12:41:15.381363 tst handover.py: using BVCI 21545 12:41:15.503084 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 12:41:15.554232 tst handover.py: using LAC 21545 12:41:15.685679 tst handover.py: using RAC 125 12:41:15.814688 tst handover.py: using CellId 21545 12:41:15.963057 tst handover.py: using BVCI 21546 12:41:16.078055 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:41:16.089929 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:41:16.101599 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:41:16.113977 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:41:16.126107 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 12:41:16.137724 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:41:16.286668 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 12:41:16.435097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:41:16.901903 run create_hlr_db(pid=6569): Launched 12:41:17.067558 bus /sierra_2: Setting Powered False 12:41:18.128934 run create_hlr_db(pid=6569): Terminated: ok {rc=0} 12:41:18.535042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6571): Launched 12:41:18.844446 run osmo-hlr_10.42.42.2(pid=6572): Launched 12:41:18.961307 run osmo-stp_10.42.42.5: Starting osmo-stp 12:41:19.465159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6574): Launched 12:41:19.774710 run osmo-stp_10.42.42.5(pid=6575): Launched 12:41:19.893619 run osmo-msc_10.42.42.6: Starting osmo-msc 12:41:20.427734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6577): Launched 12:41:20.736801 run osmo-msc_10.42.42.6(pid=6578): Launched 12:41:20.909972 run osmo-stp_10.42.42.5(pid=6575): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6575)] 12:41:21.039714 run osmo-stp_10.42.42.5(pid=6575): stdout: | (launched: 2022-12-09_12:41:19.717938) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:21.169414 run osmo-stp_10.42.42.5(pid=6575): stderr: | 20221209124119887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124119887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124119887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124119888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124119888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124119888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124119888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:21.297232 run osmo-stp_10.42.42.5(pid=6575): stdout: | (launched: 2022-12-09_12:41:19.717938) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:21.419199 run osmo-stp_10.42.42.5(pid=6575): stderr: | 20221209124119887 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124119887 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124119887 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124119888 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124119888 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124119888 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124119888 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:21.565439 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6575): Process ended prematurely: osmo-stp_10.42.42.5(pid=6575) [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6575)] [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 12:41:21.573330 tst handover.py:18: Test FAILED (6.6 sec) 12:41:21.599718 run osmo-hlr_10.42.42.2(pid=6572): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6572)] 12:41:21.648793 run osmo-hlr_10.42.42.2(pid=6572): stdout: | (launched: 2022-12-09_12:41:18.787738) 12:41:21.698668 run osmo-hlr_10.42.42.2(pid=6572): stderr: | 20221209124118963 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124118963 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124118963 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124118963 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124118963 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124118963 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124118976 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124118984 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124118985 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124118985 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:41:21.768312 run osmo-msc_10.42.42.6(pid=6578): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6578)] 12:41:21.816522 run osmo-msc_10.42.42.6(pid=6578): stdout: | (launched: 2022-12-09_12:41:20.680014) 12:41:21.866316 run osmo-msc_10.42.42.6(pid=6578): stderr: | 20221209124120951 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124120951 DLGLOBAL DEBUG validating counter group 0x7f4dbbbb3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124120951 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124120951 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124120951 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124120952 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124120953 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124120954 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124120954 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124120954 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:41:21.916709 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6571): Terminating (SIGTERM) 12:41:21.956442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6574): Terminating (SIGTERM) 12:41:21.996124 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6577): Terminating (SIGTERM) 12:41:22.036263 --- ParallelTerminationStrategy: PID 6571 died... 12:41:22.055492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6571): Terminated: ok {rc=0} 12:41:22.099767 --- ParallelTerminationStrategy: PID 6574 died... 12:41:22.118541 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6574): Terminated: ok {rc=0} 12:41:22.162563 --- ParallelTerminationStrategy: PID 6577 died... 12:41:22.181196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6577): Terminated: ok {rc=0} 12:41:22.264754 bus /sierra_3: Setting Powered False 12:41:23.359422 bus /sierra_3: Setting Powered False 12:41:24.475456 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 12:41:25.748326 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:41:25.753843 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:41:25.800715 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:41:25.827358 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:41:25.879977 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:41:25.929280 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:41:25.957450 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:41:26.504809 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 12:41:26.510214 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:41:26.521319 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 12:41:26.568136 tst handover.py: using LAC 21546 12:41:26.698221 tst handover.py: using RAC 126 12:41:26.826572 tst handover.py: using CellId 21546 12:41:26.957444 tst handover.py: using BVCI 21547 12:41:27.076489 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 12:41:27.112411 tst handover.py: using LAC 21547 12:41:27.243365 tst handover.py: using RAC 127 12:41:27.371355 tst handover.py: using CellId 21547 12:41:27.498940 tst handover.py: using BVCI 21548 12:41:27.619417 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:41:27.631161 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:41:27.642497 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:41:27.654401 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:41:27.666049 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:41:27.678205 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 12:41:27.797978 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 12:41:27.915001 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:41:28.367588 run create_hlr_db(pid=6583): Launched 12:41:28.497278 bus /sierra_2: Setting Powered False 12:41:29.562507 run create_hlr_db(pid=6583): Terminated: ok {rc=0} 12:41:29.995624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6585): Launched 12:41:30.326813 run osmo-hlr_10.42.42.2(pid=6586): Launched 12:41:30.455086 run osmo-stp_10.42.42.5: Starting osmo-stp 12:41:31.017795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6588): Launched 12:41:31.403127 run osmo-stp_10.42.42.5(pid=6589): Launched 12:41:31.652330 run osmo-msc_10.42.42.6: Starting osmo-msc 12:41:32.261812 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6591): Launched 12:41:32.599400 run osmo-msc_10.42.42.6(pid=6592): Launched 12:41:32.784355 run osmo-stp_10.42.42.5(pid=6589): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6589)] 12:41:32.924380 run osmo-stp_10.42.42.5(pid=6589): stdout: | (launched: 2022-12-09_12:41:31.342425) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:33.064838 run osmo-stp_10.42.42.5(pid=6589): stderr: | 20221209124131571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124131571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124131571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124131572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124131572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124131572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124131572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:33.202969 run osmo-stp_10.42.42.5(pid=6589): stdout: | (launched: 2022-12-09_12:41:31.342425) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:33.334921 run osmo-stp_10.42.42.5(pid=6589): stderr: | 20221209124131571 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124131571 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124131571 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124131572 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124131572 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124131572 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124131572 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:33.492252 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6589): Process ended prematurely: osmo-stp_10.42.42.5(pid=6589) [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6589)] [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 12:41:33.501399 tst handover.py:18: Test FAILED (7.0 sec) 12:41:33.530312 run osmo-hlr_10.42.42.2(pid=6586): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6586)] 12:41:33.581464 run osmo-hlr_10.42.42.2(pid=6586): stdout: | (launched: 2022-12-09_12:41:30.266713) 12:41:33.634623 run osmo-hlr_10.42.42.2(pid=6586): stderr: | 20221209124130461 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124130461 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124130461 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124130461 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124130461 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124130461 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124130473 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124130481 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124130481 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124130481 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:41:33.708386 run osmo-msc_10.42.42.6(pid=6592): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6592)] 12:41:33.759386 run osmo-msc_10.42.42.6(pid=6592): stdout: | (launched: 2022-12-09_12:41:32.538666) 12:41:33.812119 run osmo-msc_10.42.42.6(pid=6592): stderr: | 20221209124132857 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124132857 DLGLOBAL DEBUG validating counter group 0x7f9a0a743c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124132857 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124132857 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124132858 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124132858 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124132860 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124132861 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124132861 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124132861 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:41:33.865426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6585): Terminating (SIGTERM) 12:41:33.907873 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6588): Terminating (SIGTERM) 12:41:33.950595 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6591): Terminating (SIGTERM) 12:41:33.993880 --- ParallelTerminationStrategy: PID 6585 died... 12:41:34.013982 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6585): Terminated: ok {rc=0} 12:41:34.061298 --- ParallelTerminationStrategy: PID 6588 died... 12:41:34.081182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6588): Terminated: ok {rc=0} 12:41:34.128363 --- ParallelTerminationStrategy: PID 6591 died... 12:41:34.148167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6591): Terminated: ok {rc=0} 12:41:34.237497 bus /sierra_3: Setting Powered False 12:41:35.336738 bus /sierra_3: Setting Powered False 12:41:36.452692 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 12:41:37.708927 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:41:37.715701 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:41:37.776857 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:41:37.804097 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:41:37.855166 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:41:37.914747 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:41:37.941571 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:41:38.499628 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 12:41:38.506095 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:41:38.518317 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:41:38.563717 tst handover.py: using LAC 21548 12:41:38.693318 tst handover.py: using RAC 128 12:41:38.820594 tst handover.py: using CellId 21548 12:41:38.948837 tst handover.py: using BVCI 21549 12:41:39.068729 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:41:39.121996 tst handover.py: using LAC 21549 12:41:39.242862 tst handover.py: using RAC 129 12:41:39.363606 tst handover.py: using CellId 21549 12:41:39.482457 tst handover.py: using BVCI 21550 12:41:39.593461 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:41:39.604446 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:41:39.615396 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:41:39.626399 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:41:39.637503 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:41:39.648346 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:41:39.766934 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:41:39.883606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:41:40.337420 run create_hlr_db(pid=6597): Launched 12:41:40.464481 bus /sierra_2: Setting Powered False 12:41:41.526575 run create_hlr_db(pid=6597): Terminated: ok {rc=0} 12:41:41.952491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6599): Launched 12:41:42.284868 run osmo-hlr_10.42.42.2(pid=6600): Launched 12:41:42.411706 run osmo-stp_10.42.42.5: Starting osmo-stp 12:41:42.955232 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6602): Launched 12:41:43.287345 run osmo-stp_10.42.42.5(pid=6603): Launched 12:41:43.413829 run osmo-msc_10.42.42.6: Starting osmo-msc 12:41:43.983912 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6605): Launched 12:41:44.315861 run osmo-msc_10.42.42.6(pid=6606): Launched 12:41:44.500493 run osmo-stp_10.42.42.5(pid=6603): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6603)] 12:41:44.640235 run osmo-stp_10.42.42.5(pid=6603): stdout: | (launched: 2022-12-09_12:41:43.226467) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:44.780047 run osmo-stp_10.42.42.5(pid=6603): stderr: | 20221209124143415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124143415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124143415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124143416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124143416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124143416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124143416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:44.918604 run osmo-stp_10.42.42.5(pid=6603): stdout: | (launched: 2022-12-09_12:41:43.226467) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:45.050290 run osmo-stp_10.42.42.5(pid=6603): stderr: | 20221209124143415 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124143415 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124143415 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124143416 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124143416 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124143416 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124143416 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:45.207864 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6603): Process ended prematurely: osmo-stp_10.42.42.5(pid=6603) [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6603)] [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 12:41:45.216794 tst handover.py:18: Test FAILED (6.7 sec) 12:41:45.245363 run osmo-hlr_10.42.42.2(pid=6600): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6600)] 12:41:45.296277 run osmo-hlr_10.42.42.2(pid=6600): stdout: | (launched: 2022-12-09_12:41:42.223996) 12:41:45.348741 run osmo-hlr_10.42.42.2(pid=6600): stderr: | 20221209124142421 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124142421 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124142421 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124142421 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124142421 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124142421 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124142433 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124142444 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124142444 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124142444 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:41:45.421622 run osmo-msc_10.42.42.6(pid=6606): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6606)] 12:41:45.472307 run osmo-msc_10.42.42.6(pid=6606): stdout: | (launched: 2022-12-09_12:41:44.255164) 12:41:45.524712 run osmo-msc_10.42.42.6(pid=6606): stderr: | 20221209124144574 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124144574 DLGLOBAL DEBUG validating counter group 0x7fcbb7702c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124144574 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124144574 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124144575 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124144575 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124144576 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124144577 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124144577 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124144577 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:41:45.577342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6599): Terminating (SIGTERM) 12:41:45.620008 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6602): Terminating (SIGTERM) 12:41:45.662567 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6605): Terminating (SIGTERM) 12:41:45.705423 --- ParallelTerminationStrategy: PID 6599 died... 12:41:45.725750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6599): Terminated: ok {rc=0} 12:41:45.773194 --- ParallelTerminationStrategy: PID 6602 died... 12:41:45.793162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6602): Terminated: ok {rc=0} 12:41:45.840617 --- ParallelTerminationStrategy: PID 6605 died... 12:41:45.861891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6605): Terminated: ok {rc=0} 12:41:45.953127 bus /sierra_3: Setting Powered False 12:41:47.065486 bus /sierra_3: Setting Powered False 12:41:48.199846 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 12:41:49.472596 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:41:49.478125 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:41:49.536388 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:41:49.563138 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:41:49.617523 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:41:49.675954 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:41:49.702379 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:41:50.252884 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 12:41:50.258079 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:41:50.269183 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:41:50.312322 tst handover.py: using LAC 21550 12:41:50.435351 tst handover.py: using RAC 130 12:41:50.555792 tst handover.py: using CellId 21550 12:41:50.678612 tst handover.py: using BVCI 21551 12:41:50.792265 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:41:50.840837 tst handover.py: using LAC 21551 12:41:50.963841 tst handover.py: using RAC 131 12:41:51.084314 tst handover.py: using CellId 21551 12:41:51.204885 tst handover.py: using BVCI 21552 12:41:51.316826 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:41:51.328034 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:41:51.338937 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:41:51.349851 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:41:51.360681 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:41:51.371533 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:41:51.493400 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:41:51.611787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:41:52.065498 run create_hlr_db(pid=6611): Launched 12:41:52.193674 bus /sierra_2: Setting Powered False 12:41:53.255402 run create_hlr_db(pid=6611): Terminated: ok {rc=0} 12:41:53.662867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6613): Launched 12:41:53.974588 run osmo-hlr_10.42.42.2(pid=6614): Launched 12:41:54.092176 run osmo-stp_10.42.42.5: Starting osmo-stp 12:41:54.612728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6616): Launched 12:41:54.922303 run osmo-stp_10.42.42.5(pid=6617): Launched 12:41:55.039815 run osmo-msc_10.42.42.6: Starting osmo-msc 12:41:55.570918 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6619): Launched 12:41:55.880874 run osmo-msc_10.42.42.6(pid=6620): Launched 12:41:56.054147 run osmo-stp_10.42.42.5(pid=6617): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6617)] 12:41:56.184093 run osmo-stp_10.42.42.5(pid=6617): stdout: | (launched: 2022-12-09_12:41:54.864794) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:56.313985 run osmo-stp_10.42.42.5(pid=6617): stderr: | 20221209124155033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124155033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124155034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124155034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124155035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124155035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124155035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:56.441761 run osmo-stp_10.42.42.5(pid=6617): stdout: | (launched: 2022-12-09_12:41:54.864794) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:41:56.563685 run osmo-stp_10.42.42.5(pid=6617): stderr: | 20221209124155033 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124155033 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124155034 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124155034 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124155035 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124155035 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124155035 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:41:56.709651 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6617): Process ended prematurely: osmo-stp_10.42.42.5(pid=6617) [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6617)] [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 12:41:56.717886 tst handover.py:18: Test FAILED (6.5 sec) 12:41:56.744207 run osmo-hlr_10.42.42.2(pid=6614): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6614)] 12:41:56.791858 run osmo-hlr_10.42.42.2(pid=6614): stdout: | (launched: 2022-12-09_12:41:53.917271) 12:41:56.841233 run osmo-hlr_10.42.42.2(pid=6614): stderr: | 20221209124154091 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124154091 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124154091 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124154091 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124154091 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124154091 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124154103 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124154112 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124154112 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124154112 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:41:56.910221 run osmo-msc_10.42.42.6(pid=6620): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6620)] 12:41:56.957810 run osmo-msc_10.42.42.6(pid=6620): stdout: | (launched: 2022-12-09_12:41:55.822986) 12:41:57.007197 run osmo-msc_10.42.42.6(pid=6620): stderr: | 20221209124156094 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124156094 DLGLOBAL DEBUG validating counter group 0x7f69b66afc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124156094 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124156094 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124156094 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124156094 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124156096 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124156097 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124156097 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124156097 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:41:57.056843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6613): Terminating (SIGTERM) 12:41:57.096590 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6616): Terminating (SIGTERM) 12:41:57.136300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6619): Terminating (SIGTERM) 12:41:57.176118 --- ParallelTerminationStrategy: PID 6613 died... 12:41:57.195509 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6613): Terminated: ok {rc=0} 12:41:57.239519 --- ParallelTerminationStrategy: PID 6616 died... 12:41:57.258178 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6616): Terminated: ok {rc=0} 12:41:57.302348 --- ParallelTerminationStrategy: PID 6619 died... 12:41:57.321214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6619): Terminated: ok {rc=0} 12:41:57.405937 bus /sierra_3: Setting Powered False 12:41:58.505403 bus /sierra_3: Setting Powered False 12:41:59.623474 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 12:42:00.977418 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:42:00.983823 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 12:42:01.167182 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 12:42:01.201651 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 12:42:01.282149 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 12:42:01.401774 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 12:42:01.434481 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 12:42:01.909229 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 12:42:01.914331 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:42:01.927131 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 12:42:01.978055 tst handover.py: using LAC 21552 12:42:02.114162 tst handover.py: using RAC 132 12:42:02.246931 tst handover.py: using CellId 21552 12:42:02.401049 tst handover.py: using BVCI 21553 12:42:02.514799 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 12:42:02.552428 tst handover.py: using LAC 21553 12:42:02.673545 tst handover.py: using RAC 133 12:42:02.793766 tst handover.py: using CellId 21553 12:42:02.913024 tst handover.py: using BVCI 21554 12:42:03.025604 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:42:03.036420 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:42:03.047273 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:42:03.058149 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:42:03.068992 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 12:42:03.079684 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 12:42:03.199661 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 12:42:03.321535 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:42:03.807763 run create_hlr_db(pid=6635): Launched 12:42:03.935411 bus /sierra_2: Setting Powered False 12:42:05.001752 run create_hlr_db(pid=6635): Terminated: ok {rc=0} 12:42:05.420929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6637): Launched 12:42:05.731292 run osmo-hlr_10.42.42.2(pid=6638): Launched 12:42:05.848798 run osmo-stp_10.42.42.5: Starting osmo-stp 12:42:06.370640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6640): Launched 12:42:06.680321 run osmo-stp_10.42.42.5(pid=6641): Launched 12:42:06.798240 run osmo-msc_10.42.42.6: Starting osmo-msc 12:42:07.332461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6643): Launched 12:42:07.642760 run osmo-msc_10.42.42.6(pid=6644): Launched 12:42:07.814536 run osmo-stp_10.42.42.5(pid=6641): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6641)] 12:42:07.943819 run osmo-stp_10.42.42.5(pid=6641): stdout: | (launched: 2022-12-09_12:42:06.622546) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:08.075009 run osmo-stp_10.42.42.5(pid=6641): stderr: | 20221209124206791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124206791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124206791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124206792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124206792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124206792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124206792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:08.203234 run osmo-stp_10.42.42.5(pid=6641): stdout: | (launched: 2022-12-09_12:42:06.622546) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:08.325476 run osmo-stp_10.42.42.5(pid=6641): stderr: | 20221209124206791 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124206791 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124206791 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124206792 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124206792 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124206792 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124206792 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:08.471712 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6641): Process ended prematurely: osmo-stp_10.42.42.5(pid=6641) [trial-2359↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6641)] [trial-2359↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 12:42:08.479913 tst handover.py:18: Test FAILED (6.6 sec) 12:42:08.506230 run osmo-hlr_10.42.42.2(pid=6638): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6638)] 12:42:08.554148 run osmo-hlr_10.42.42.2(pid=6638): stdout: | (launched: 2022-12-09_12:42:05.673939) 12:42:08.603913 run osmo-hlr_10.42.42.2(pid=6638): stderr: | 20221209124205849 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124205849 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124205849 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124205849 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124205849 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124205849 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124205861 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124205872 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124205873 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124205873 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:42:08.673544 run osmo-msc_10.42.42.6(pid=6644): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6644)] 12:42:08.721900 run osmo-msc_10.42.42.6(pid=6644): stdout: | (launched: 2022-12-09_12:42:07.585307) 12:42:08.771542 run osmo-msc_10.42.42.6(pid=6644): stderr: | 20221209124207856 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124207856 DLGLOBAL DEBUG validating counter group 0x7f6b3a836c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124207856 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124207856 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124207856 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124207857 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124207858 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124207859 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124207859 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124207859 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:42:08.821621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6637): Terminating (SIGTERM) 12:42:08.861594 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6640): Terminating (SIGTERM) 12:42:08.901897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6643): Terminating (SIGTERM) 12:42:08.942258 --- ParallelTerminationStrategy: PID 6637 died... 12:42:08.961613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6637): Terminated: ok {rc=0} 12:42:09.006093 --- ParallelTerminationStrategy: PID 6640 died... 12:42:09.024924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6640): Terminated: ok {rc=0} 12:42:09.070198 --- ParallelTerminationStrategy: PID 6643 died... 12:42:09.089300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6643): Terminated: ok {rc=0} 12:42:09.173557 bus /sierra_3: Setting Powered False 12:42:10.271891 bus /sierra_3: Setting Powered False 12:42:11.391353 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 12:42:12.655217 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:42:12.660903 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:42:12.727381 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:42:12.755013 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:42:12.809602 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:42:12.878625 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:42:12.906454 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:42:13.454357 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 12:42:13.459756 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:42:13.471145 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:42:13.520880 tst handover.py: using LAC 21554 12:42:13.650537 tst handover.py: using RAC 134 12:42:13.780030 tst handover.py: using CellId 21554 12:42:13.910804 tst handover.py: using BVCI 21555 12:42:14.032445 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:42:14.082405 tst handover.py: using LAC 21555 12:42:14.212510 tst handover.py: using RAC 135 12:42:14.341159 tst handover.py: using CellId 21555 12:42:14.475170 tst handover.py: using BVCI 21556 12:42:14.588388 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:42:14.599595 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:42:14.610456 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:42:14.622674 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:42:14.633445 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:42:14.644261 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:42:14.765090 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:42:14.887826 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:42:15.372608 run create_hlr_db(pid=6649): Launched 12:42:15.499140 bus /sierra_2: Setting Powered False 12:42:16.560739 run create_hlr_db(pid=6649): Terminated: ok {rc=0} 12:42:16.987400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6651): Launched 12:42:17.316079 run osmo-hlr_10.42.42.2(pid=6652): Launched 12:42:17.434583 run osmo-stp_10.42.42.5: Starting osmo-stp 12:42:17.940120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6654): Launched 12:42:18.251070 run osmo-stp_10.42.42.5(pid=6655): Launched 12:42:18.368145 run osmo-msc_10.42.42.6: Starting osmo-msc 12:42:18.898249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6657): Launched 12:42:19.207199 run osmo-msc_10.42.42.6(pid=6658): Launched 12:42:19.381271 run osmo-stp_10.42.42.5(pid=6655): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6655)] 12:42:19.511017 run osmo-stp_10.42.42.5(pid=6655): stdout: | (launched: 2022-12-09_12:42:18.193708) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:19.641554 run osmo-stp_10.42.42.5(pid=6655): stderr: | 20221209124218362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124218362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124218362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124218363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124218363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124218363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124218363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:19.769718 run osmo-stp_10.42.42.5(pid=6655): stdout: | (launched: 2022-12-09_12:42:18.193708) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:19.891802 run osmo-stp_10.42.42.5(pid=6655): stderr: | 20221209124218362 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124218362 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124218362 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124218363 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124218363 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124218363 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124218363 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:20.038263 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6655): Process ended prematurely: osmo-stp_10.42.42.5(pid=6655) [trial-2359↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6655)] [trial-2359↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 12:42:20.046507 tst handover.py:18: Test FAILED (6.6 sec) 12:42:20.072542 run osmo-hlr_10.42.42.2(pid=6652): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6652)] 12:42:20.120882 run osmo-hlr_10.42.42.2(pid=6652): stdout: | (launched: 2022-12-09_12:42:17.258176) 12:42:20.170253 run osmo-hlr_10.42.42.2(pid=6652): stderr: | 20221209124217432 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124217432 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124217432 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124217432 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124217432 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124217432 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124217476 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124217487 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124217487 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124217487 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:42:20.239454 run osmo-msc_10.42.42.6(pid=6658): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6658)] 12:42:20.287147 run osmo-msc_10.42.42.6(pid=6658): stdout: | (launched: 2022-12-09_12:42:19.149966) 12:42:20.336875 run osmo-msc_10.42.42.6(pid=6658): stderr: | 20221209124219420 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124219420 DLGLOBAL DEBUG validating counter group 0x7f96e14edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124219420 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124219420 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124219421 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124219421 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124219422 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124219423 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124219424 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124219424 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:42:20.386649 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6651): Terminating (SIGTERM) 12:42:20.426328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6654): Terminating (SIGTERM) 12:42:20.465987 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6657): Terminating (SIGTERM) 12:42:20.505938 --- ParallelTerminationStrategy: PID 6651 died... 12:42:20.525128 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6651): Terminated: ok {rc=0} 12:42:20.569260 --- ParallelTerminationStrategy: PID 6654 died... 12:42:20.588000 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6654): Terminated: ok {rc=0} 12:42:20.631953 --- ParallelTerminationStrategy: PID 6657 died... 12:42:20.650614 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6657): Terminated: ok {rc=0} 12:42:20.736651 bus /sierra_3: Setting Powered False 12:42:21.836291 bus /sierra_3: Setting Powered False 12:42:22.951262 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 12:42:24.230170 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:42:24.235319 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:42:24.298058 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:42:24.324626 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:42:24.378968 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:42:24.442346 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:42:24.468682 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:42:25.019276 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 12:42:25.024512 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:42:25.035575 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:42:25.087374 tst handover.py: using LAC 21556 12:42:25.209057 tst handover.py: using RAC 136 12:42:25.330521 tst handover.py: using CellId 21556 12:42:25.452833 tst handover.py: using BVCI 21557 12:42:25.565821 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:42:25.614274 tst handover.py: using LAC 21557 12:42:25.749819 tst handover.py: using RAC 137 12:42:25.883141 tst handover.py: using CellId 21557 12:42:26.018898 tst handover.py: using BVCI 21558 12:42:26.141309 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:42:26.153206 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:42:26.164758 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:42:26.177360 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:42:26.190453 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:42:26.202194 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:42:26.325341 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:42:26.442821 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:42:26.895379 run create_hlr_db(pid=6663): Launched 12:42:27.021485 bus /sierra_2: Setting Powered False 12:42:28.084054 run create_hlr_db(pid=6663): Terminated: ok {rc=0} 12:42:28.490812 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6665): Launched 12:42:28.799830 run osmo-hlr_10.42.42.2(pid=6666): Launched 12:42:28.917222 run osmo-stp_10.42.42.5: Starting osmo-stp 12:42:29.420850 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6668): Launched 12:42:29.730138 run osmo-stp_10.42.42.5(pid=6669): Launched 12:42:29.847204 run osmo-msc_10.42.42.6: Starting osmo-msc 12:42:30.378385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6671): Launched 12:42:30.687986 run osmo-msc_10.42.42.6(pid=6672): Launched 12:42:30.866221 run osmo-stp_10.42.42.5(pid=6669): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6669)] 12:42:31.127019 run osmo-stp_10.42.42.5(pid=6669): stdout: | (launched: 2022-12-09_12:42:29.672446) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:31.382454 run osmo-stp_10.42.42.5(pid=6669): stderr: | 20221209124229841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124229841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124229842 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124229842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124229842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124229843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124229843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:31.535785 run osmo-stp_10.42.42.5(pid=6669): stdout: | (launched: 2022-12-09_12:42:29.672446) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:31.675773 run osmo-stp_10.42.42.5(pid=6669): stderr: | 20221209124229841 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124229841 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124229842 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124229842 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124229842 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124229843 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124229843 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:31.839838 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6669): Process ended prematurely: osmo-stp_10.42.42.5(pid=6669) [trial-2359↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6669)] [trial-2359↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 12:42:31.850070 tst handover.py:18: Test FAILED (6.8 sec) 12:42:31.882291 run osmo-hlr_10.42.42.2(pid=6666): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6666)] 12:42:31.935727 run osmo-hlr_10.42.42.2(pid=6666): stdout: | (launched: 2022-12-09_12:42:28.742449) 12:42:31.991087 run osmo-hlr_10.42.42.2(pid=6666): stderr: | 20221209124228918 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124228918 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124228918 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124228918 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124228918 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124228918 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124228983 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124228993 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124228993 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124228993 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:42:32.067842 run osmo-msc_10.42.42.6(pid=6672): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6672)] 12:42:32.122745 run osmo-msc_10.42.42.6(pid=6672): stdout: | (launched: 2022-12-09_12:42:30.630590) 12:42:32.177409 run osmo-msc_10.42.42.6(pid=6672): stderr: | 20221209124231006 DLSS7 DEBUG XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124231007 DLGLOBAL DEBUG validating counter group 0x7fd670467c40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124231007 DLSS7 DEBUG XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124231007 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124231007 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124231007 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124231009 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124231009 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124231009 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124231010 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:42:32.233878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6665): Terminating (SIGTERM) 12:42:32.279236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6668): Terminating (SIGTERM) 12:42:32.326249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6671): Terminating (SIGTERM) 12:42:32.370015 --- ParallelTerminationStrategy: PID 6665 died... 12:42:32.390364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6665): Terminated: ok {rc=0} 12:42:32.438360 --- ParallelTerminationStrategy: PID 6668 died... 12:42:32.458480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6668): Terminated: ok {rc=0} 12:42:32.505761 --- ParallelTerminationStrategy: PID 6671 died... 12:42:32.525754 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6671): Terminated: ok {rc=0} 12:42:32.615406 bus /sierra_3: Setting Powered False 12:42:33.715379 bus /sierra_3: Setting Powered False 12:42:34.833391 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 12:42:36.116557 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:42:36.122224 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 12:42:36.175651 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 12:42:36.204057 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 12:42:36.257321 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 12:42:36.309464 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 12:42:36.337124 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 12:42:36.895606 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 12:42:36.901414 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:42:36.912597 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:42:36.948038 tst handover.py: using LAC 21558 12:42:37.076363 tst handover.py: using RAC 138 12:42:37.206387 tst handover.py: using CellId 21558 12:42:37.335758 tst handover.py: using BVCI 21559 12:42:37.457980 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 12:42:37.506401 tst handover.py: using LAC 21559 12:42:37.635983 tst handover.py: using RAC 139 12:42:37.765470 tst handover.py: using CellId 21559 12:42:37.895129 tst handover.py: using BVCI 21560 12:42:38.015881 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:42:38.027178 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:42:38.038393 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:42:38.049977 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:42:38.061747 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 12:42:38.073191 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:42:38.194135 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 12:42:38.311810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:42:38.764291 run create_hlr_db(pid=6677): Launched 12:42:38.891306 bus /sierra_2: Setting Powered False 12:42:39.952582 run create_hlr_db(pid=6677): Terminated: ok {rc=0} 12:42:40.359098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6679): Launched 12:42:40.669776 run osmo-hlr_10.42.42.2(pid=6680): Launched 12:42:40.786791 run osmo-stp_10.42.42.5: Starting osmo-stp 12:42:41.297165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6682): Launched 12:42:41.606757 run osmo-stp_10.42.42.5(pid=6683): Launched 12:42:41.724152 run osmo-msc_10.42.42.6: Starting osmo-msc 12:42:42.255203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6685): Launched 12:42:42.564562 run osmo-msc_10.42.42.6(pid=6686): Launched 12:42:42.737279 run osmo-stp_10.42.42.5(pid=6683): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6683)] 12:42:42.867819 run osmo-stp_10.42.42.5(pid=6683): stdout: | (launched: 2022-12-09_12:42:41.549143) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:42.997736 run osmo-stp_10.42.42.5(pid=6683): stderr: | 20221209124241718 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124241719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124241719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124241719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124241720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124241720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124241720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:43.125948 run osmo-stp_10.42.42.5(pid=6683): stdout: | (launched: 2022-12-09_12:42:41.549143) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:43.247923 run osmo-stp_10.42.42.5(pid=6683): stderr: | 20221209124241718 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124241719 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124241719 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124241719 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124241720 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124241720 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124241720 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:43.394108 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6683): Process ended prematurely: osmo-stp_10.42.42.5(pid=6683) [trial-2359↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6683)] [trial-2359↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 12:42:43.402189 tst handover.py:18: Test FAILED (6.5 sec) 12:42:43.428255 run osmo-hlr_10.42.42.2(pid=6680): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6680)] 12:42:43.476131 run osmo-hlr_10.42.42.2(pid=6680): stdout: | (launched: 2022-12-09_12:42:40.611937) 12:42:43.525714 run osmo-hlr_10.42.42.2(pid=6680): stderr: | 20221209124240786 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124240786 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124240786 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124240786 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124240786 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124240786 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124240797 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124240805 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124240806 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124240806 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:42:43.594787 run osmo-msc_10.42.42.6(pid=6686): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6686)] 12:42:43.642739 run osmo-msc_10.42.42.6(pid=6686): stdout: | (launched: 2022-12-09_12:42:42.506898) 12:42:43.692086 run osmo-msc_10.42.42.6(pid=6686): stderr: | 20221209124242778 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124242778 DLGLOBAL DEBUG validating counter group 0x7f7a39b0ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124242779 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124242779 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124242779 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124242779 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124242781 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124242781 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124242781 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124242781 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:42:43.742145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6679): Terminating (SIGTERM) 12:42:43.781895 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6682): Terminating (SIGTERM) 12:42:43.821866 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6685): Terminating (SIGTERM) 12:42:43.861980 --- ParallelTerminationStrategy: PID 6679 died... 12:42:43.881178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6679): Terminated: ok {rc=0} 12:42:43.925197 --- ParallelTerminationStrategy: PID 6682 died... 12:42:43.943700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6682): Terminated: ok {rc=0} 12:42:43.987856 --- ParallelTerminationStrategy: PID 6685 died... 12:42:44.006551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6685): Terminated: ok {rc=0} 12:42:44.092769 bus /sierra_3: Setting Powered False 12:42:45.192703 bus /sierra_3: Setting Powered False 12:42:46.314066 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 12:42:47.577697 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:42:47.583838 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:42:47.633922 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:42:47.660361 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:42:47.711108 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:42:47.760526 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:42:47.787031 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:42:48.339891 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 12:42:48.345232 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:42:48.355939 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:42:48.390563 tst handover.py: using LAC 21560 12:42:48.509542 tst handover.py: using RAC 140 12:42:48.643319 tst handover.py: using CellId 21560 12:42:48.764225 tst handover.py: using BVCI 21561 12:42:48.876358 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:42:48.922864 tst handover.py: using LAC 21561 12:42:49.043767 tst handover.py: using RAC 141 12:42:49.164032 tst handover.py: using CellId 21561 12:42:49.284173 tst handover.py: using BVCI 21562 12:42:49.396663 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:42:49.407912 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:42:49.418700 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:42:49.429479 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:42:49.440266 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:42:49.451000 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:42:49.566346 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:42:49.685639 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:42:50.139735 run create_hlr_db(pid=6691): Launched 12:42:50.266248 bus /sierra_2: Setting Powered False 12:42:51.328261 run create_hlr_db(pid=6691): Terminated: ok {rc=0} 12:42:51.754527 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6693): Launched 12:42:52.091952 run osmo-hlr_10.42.42.2(pid=6694): Launched 12:42:52.217640 run osmo-stp_10.42.42.5: Starting osmo-stp 12:42:52.759029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6696): Launched 12:42:53.091392 run osmo-stp_10.42.42.5(pid=6697): Launched 12:42:53.217383 run osmo-msc_10.42.42.6: Starting osmo-msc 12:42:53.787708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6699): Launched 12:42:54.120176 run osmo-msc_10.42.42.6(pid=6700): Launched 12:42:54.305447 run osmo-stp_10.42.42.5(pid=6697): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6697)] 12:42:54.445704 run osmo-stp_10.42.42.5(pid=6697): stdout: | (launched: 2022-12-09_12:42:53.030533) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:54.586305 run osmo-stp_10.42.42.5(pid=6697): stderr: | 20221209124253218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124253219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124253219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124253219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124253220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124253220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124253220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:54.723862 run osmo-stp_10.42.42.5(pid=6697): stdout: | (launched: 2022-12-09_12:42:53.030533) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:42:54.855686 run osmo-stp_10.42.42.5(pid=6697): stderr: | 20221209124253218 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124253219 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124253219 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124253219 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124253220 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124253220 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124253220 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:42:55.013992 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6697): Process ended prematurely: osmo-stp_10.42.42.5(pid=6697) [trial-2359↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6697)] [trial-2359↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 12:42:55.022837 tst handover.py:18: Test FAILED (6.7 sec) 12:42:55.051181 run osmo-hlr_10.42.42.2(pid=6694): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6694)] 12:42:55.102177 run osmo-hlr_10.42.42.2(pid=6694): stdout: | (launched: 2022-12-09_12:42:52.031193) 12:42:55.155368 run osmo-hlr_10.42.42.2(pid=6694): stderr: | 20221209124252226 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124252226 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124252226 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124252226 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124252226 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124252226 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124252239 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124252248 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124252248 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124252248 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:42:55.229221 run osmo-msc_10.42.42.6(pid=6700): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6700)] 12:42:55.280278 run osmo-msc_10.42.42.6(pid=6700): stdout: | (launched: 2022-12-09_12:42:54.059416) 12:42:55.332914 run osmo-msc_10.42.42.6(pid=6700): stderr: | 20221209124254377 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124254377 DLGLOBAL DEBUG validating counter group 0x7f1c9764cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124254377 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124254377 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124254377 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124254377 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124254379 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124254379 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124254379 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124254380 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:42:55.386221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6693): Terminating (SIGTERM) 12:42:55.428818 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6696): Terminating (SIGTERM) 12:42:55.471615 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6699): Terminating (SIGTERM) 12:42:55.514726 --- ParallelTerminationStrategy: PID 6693 died... 12:42:55.535143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6693): Terminated: ok {rc=0} 12:42:55.582788 --- ParallelTerminationStrategy: PID 6696 died... 12:42:55.602792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6696): Terminated: ok {rc=0} 12:42:55.650749 --- ParallelTerminationStrategy: PID 6699 died... 12:42:55.670830 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6699): Terminated: ok {rc=0} 12:42:55.759940 bus /sierra_3: Setting Powered False 12:42:56.861102 bus /sierra_3: Setting Powered False 12:42:57.980742 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2359 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 12:42:59.235577 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 12:42:59.240854 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 12:42:59.302952 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 12:42:59.329583 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 12:42:59.382826 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 12:42:59.446145 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 12:42:59.472600 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 12:43:00.019771 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2359 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 12:43:00.024913 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:43:00.035816 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:43:00.083356 tst handover.py: using LAC 21562 12:43:00.209774 tst handover.py: using RAC 142 12:43:00.330571 tst handover.py: using CellId 21562 12:43:00.452301 tst handover.py: using BVCI 21563 12:43:00.563950 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 12:43:00.614663 tst handover.py: using LAC 21563 12:43:00.734597 tst handover.py: using RAC 143 12:43:00.870506 tst handover.py: using CellId 21563 12:43:01.019475 tst handover.py: using BVCI 21564 12:43:01.148015 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:43:01.160449 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:43:01.172781 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:43:01.187312 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:43:01.201078 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 12:43:01.214519 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:43:01.340372 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 12:43:01.468208 run osmo-hlr_10.42.42.2: Starting osmo-hlr 12:43:01.979966 run create_hlr_db(pid=6705): Launched 12:43:02.144267 bus /sierra_2: Setting Powered False 12:43:03.206505 run create_hlr_db(pid=6705): Terminated: ok {rc=0} 12:43:03.632198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6707): Launched 12:43:03.964928 run osmo-hlr_10.42.42.2(pid=6708): Launched 12:43:04.091668 run osmo-stp_10.42.42.5: Starting osmo-stp 12:43:04.631769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6710): Launched 12:43:04.964295 run osmo-stp_10.42.42.5(pid=6711): Launched 12:43:05.091283 run osmo-msc_10.42.42.6: Starting osmo-msc 12:43:05.661771 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6713): Launched 12:43:05.993769 run osmo-msc_10.42.42.6(pid=6714): Launched 12:43:06.178351 run osmo-stp_10.42.42.5(pid=6711): ERR: Terminated: ERROR {rc=1} [trial-2359↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6711)] 12:43:06.318247 run osmo-stp_10.42.42.5(pid=6711): stdout: | (launched: 2022-12-09_12:43:04.903058) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:43:06.458724 run osmo-stp_10.42.42.5(pid=6711): stderr: | 20221209124305092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124305092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124305092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124305093 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124305093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124305093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124305093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:43:06.596753 run osmo-stp_10.42.42.5(pid=6711): stdout: | (launched: 2022-12-09_12:43:04.903058) | Copyright (C) 2015-2020 by Harald Welte | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 12:43:06.728189 run osmo-stp_10.42.42.5(pid=6711): stderr: | 20221209124305092 DLSS7 INFO Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | 20221209124305092 DLSS7 INFO Created m3ua server on (null):2905 (osmo_ss7.c:2207) | 20221209124305092 DLSS7 INFO (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | 20221209124305093 DLGLOBAL NOTICE unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221209124305093 DLGLOBAL ERROR unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221209124305093 DLGLOBAL ERROR no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221209124305093 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 12:43:06.885711 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=6711): Process ended prematurely: osmo-stp_10.42.42.5(pid=6711) [trial-2359↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6711)] [trial-2359↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 12:43:06.894596 tst handover.py:18: Test FAILED (6.9 sec) 12:43:06.922903 run osmo-hlr_10.42.42.2(pid=6708): ERR: Terminated: ERROR {rc=237} [trial-2359↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=6708)] 12:43:06.974234 run osmo-hlr_10.42.42.2(pid=6708): stdout: | (launched: 2022-12-09_12:43:03.903667) 12:43:07.026873 run osmo-hlr_10.42.42.2(pid=6708): stderr: | 20221209124304099 DDB DEBUG SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | 20221209124304099 DDB DEBUG SQLite3 compiled with 'SOUNDEX' (db.c:579) | 20221209124304099 DDB DEBUG SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | 20221209124304099 DDB DEBUG SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | 20221209124304099 DDB DEBUG SQLite3 compiled with 'USE_URI' (db.c:579) | 20221209124304099 DDB DEBUG Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | 20221209124304112 DDB NOTICE Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | 20221209124304121 DLGLOBAL ERROR unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221209124304122 DLGLOBAL ERROR no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221209124304122 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 12:43:07.100228 run osmo-msc_10.42.42.6(pid=6714): ERR: Terminated: ERROR {rc=2} [trial-2359↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=6714)] 12:43:07.151104 run osmo-msc_10.42.42.6(pid=6714): stdout: | (launched: 2022-12-09_12:43:05.932578) 12:43:07.203701 run osmo-msc_10.42.42.6(pid=6714): stderr: | 20221209124306252 DLSS7 DEBUG XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | 20221209124306253 DLGLOBAL DEBUG validating counter group 0x7f811bc0cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | 20221209124306253 DLSS7 DEBUG XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | 20221209124306253 DLSS7 INFO 0: as-as0: Created AS (osmo_ss7.c:1034) | 20221209124306253 DLSS7 INFO 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | 20221209124306253 DLSS7 INFO 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | 20221209124306255 DMNCC DEBUG Using internal MNCC handler. (msc_main.c:678) | 20221209124306255 DLGLOBAL ERROR unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221209124306256 DLGLOBAL ERROR no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221209124306256 DLGLOBAL ERROR Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 12:43:07.256610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6707): Terminating (SIGTERM) 12:43:07.299375 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6710): Terminating (SIGTERM) 12:43:07.342130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6713): Terminating (SIGTERM) 12:43:07.384895 --- ParallelTerminationStrategy: PID 6707 died... 12:43:07.405188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=6707): Terminated: ok {rc=0} 12:43:07.452542 --- ParallelTerminationStrategy: PID 6710 died... 12:43:07.472398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=6710): Terminated: ok {rc=0} 12:43:07.519822 --- ParallelTerminationStrategy: PID 6713 died... 12:43:07.539661 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=6713): Terminated: ok {rc=0} 12:43:07.628684 bus /sierra_3: Setting Powered False 12:43:08.729132 bus /sierra_3: Setting Powered False 12:43:09.847251 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2359 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 12:43:11.122264 tst trial-2359: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359/run.2022-12-09_11-17-44/trial-2359.xml -------------------------------------------------------------------------------------------- trial-2359 FAIL -------------------------------------------------------------------------------------------- 12:43:13.165434 tst trial-2359: trial-2359: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (5.1 sec) Error: osmo-nitb_10.42.42.2(pid=30636): Process ended prematurely: osmo-nitb_10.42.42.2(pid=30636) [trial-2359↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=30636)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.4 sec) Error: osmo-stp_10.42.42.5(pid=30656): Process ended prematurely: osmo-stp_10.42.42.5(pid=30656) [trial-2359↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=30656)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=31092): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31092) [trial-2359↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31092)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31203): Process ended prematurely: osmo-stp_10.42.42.5(pid=31203) [trial-2359↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31203)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31217): Process ended prematurely: osmo-stp_10.42.42.5(pid=31217) [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31217)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31228): Process ended prematurely: osmo-stp_10.42.42.5(pid=31228) [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31228)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31243): Process ended prematurely: osmo-stp_10.42.42.5(pid=31243) [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31243)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=31254): Process ended prematurely: osmo-stp_10.42.42.5(pid=31254) [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31254)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31268): Process ended prematurely: osmo-stp_10.42.42.5(pid=31268) [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31268)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31279): Process ended prematurely: osmo-stp_10.42.42.5(pid=31279) [trial-2359↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31279)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31294): Process ended prematurely: osmo-stp_10.42.42.5(pid=31294) [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31294)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31305): Process ended prematurely: osmo-stp_10.42.42.5(pid=31305) [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31305)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31319): Process ended prematurely: osmo-stp_10.42.42.5(pid=31319) [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31319)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=31330): Process ended prematurely: osmo-stp_10.42.42.5(pid=31330) [trial-2359↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31330)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31344): Process ended prematurely: osmo-stp_10.42.42.5(pid=31344) [trial-2359↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31344)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=31357): Process ended prematurely: osmo-stp_10.42.42.5(pid=31357) [trial-2359↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31357)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=31371): Process ended prematurely: osmo-stp_10.42.42.5(pid=31371) [trial-2359↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31371)] FAIL: mo_mt_call_osmux.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31382): Process ended prematurely: osmo-stp_10.42.42.5(pid=31382) [trial-2359↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31382)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=31667): Process ended prematurely: osmo-stp_10.42.42.5(pid=31667) [trial-2359↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31667)] FAIL: emergency_preemptive_call.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=31678): Process ended prematurely: osmo-stp_10.42.42.5(pid=31678) [trial-2359↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31678)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.6 sec) Error: osmo-stp_10.42.42.5(pid=31696): Process ended prematurely: osmo-stp_10.42.42.5(pid=31696) [trial-2359↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31696)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=31708): Process ended prematurely: osmo-stp_10.42.42.5(pid=31708) [trial-2359↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31708)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=31726): Process ended prematurely: osmo-stp_10.42.42.5(pid=31726) [trial-2359↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31726)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31737): Process ended prematurely: osmo-stp_10.42.42.5(pid=31737) [trial-2359↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31737)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31747): Process ended prematurely: osmo-stp_10.42.42.5(pid=31747) [trial-2359↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31747)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=31765): Process ended prematurely: osmo-stp_10.42.42.5(pid=31765) [trial-2359↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31765)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=31777): Process ended prematurely: osmo-stp_10.42.42.5(pid=31777) [trial-2359↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31777)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=31798): Process ended prematurely: osmo-stp_10.42.42.5(pid=31798) [trial-2359↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31798)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31809): Process ended prematurely: osmo-stp_10.42.42.5(pid=31809) [trial-2359↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31809)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=31819): Process ended prematurely: osmo-stp_10.42.42.5(pid=31819) [trial-2359↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31819)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=31836): Process ended prematurely: osmo-stp_10.42.42.5(pid=31836) [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31836)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=31848): Process ended prematurely: osmo-stp_10.42.42.5(pid=31848) [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31848)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=31866): Process ended prematurely: osmo-stp_10.42.42.5(pid=31866) [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31866)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=31876): Process ended prematurely: osmo-stp_10.42.42.5(pid=31876) [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31876)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=31886): Process ended prematurely: osmo-stp_10.42.42.5(pid=31886) [trial-2359↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31886)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=31905): Process ended prematurely: osmo-stp_10.42.42.5(pid=31905) [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31905)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=31917): Process ended prematurely: osmo-stp_10.42.42.5(pid=31917) [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31917)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=31935): Process ended prematurely: osmo-stp_10.42.42.5(pid=31935) [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31935)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=31945): Process ended prematurely: osmo-stp_10.42.42.5(pid=31945) [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31945)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=31955): Process ended prematurely: osmo-stp_10.42.42.5(pid=31955) [trial-2359↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31955)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=31972): Process ended prematurely: osmo-stp_10.42.42.5(pid=31972) [trial-2359↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31972)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=31985): Process ended prematurely: osmo-stp_10.42.42.5(pid=31985) [trial-2359↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=31985)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=31993): Process ended prematurely: osmo-nitb_10.42.42.2(pid=31993) [trial-2359↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=31993)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32003): Process ended prematurely: osmo-stp_10.42.42.5(pid=32003) [trial-2359↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32003)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=32012): Process ended prematurely: osmo-nitb_10.42.42.2(pid=32012) [trial-2359↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=32012)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32022): Process ended prematurely: osmo-stp_10.42.42.5(pid=32022) [trial-2359↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32022)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32036): Process ended prematurely: osmo-stp_10.42.42.5(pid=32036) [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32036)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=32047): Process ended prematurely: osmo-stp_10.42.42.5(pid=32047) [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32047)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32061): Process ended prematurely: osmo-stp_10.42.42.5(pid=32061) [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32061)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32072): Process ended prematurely: osmo-stp_10.42.42.5(pid=32072) [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32072)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32086): Process ended prematurely: osmo-stp_10.42.42.5(pid=32086) [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32086)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32098): Process ended prematurely: osmo-stp_10.42.42.5(pid=32098) [trial-2359↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32098)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=32114): Process ended prematurely: osmo-stp_10.42.42.5(pid=32114) [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32114)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32125): Process ended prematurely: osmo-stp_10.42.42.5(pid=32125) [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32125)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=32142): Process ended prematurely: osmo-stp_10.42.42.5(pid=32142) [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32142)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32153): Process ended prematurely: osmo-stp_10.42.42.5(pid=32153) [trial-2359↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32153)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32167): Process ended prematurely: osmo-stp_10.42.42.5(pid=32167) [trial-2359↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32167)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32178): Process ended prematurely: osmo-stp_10.42.42.5(pid=32178) [trial-2359↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32178)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=32192): Process ended prematurely: osmo-stp_10.42.42.5(pid=32192) [trial-2359↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32192)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=32203): Process ended prematurely: osmo-stp_10.42.42.5(pid=32203) [trial-2359↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32203)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=32217): Process ended prematurely: osmo-stp_10.42.42.5(pid=32217) [trial-2359↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32217)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=32228): Process ended prematurely: osmo-stp_10.42.42.5(pid=32228) [trial-2359↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32228)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=32246): Process ended prematurely: osmo-stp_10.42.42.5(pid=32246) [trial-2359↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32246)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=32258): Process ended prematurely: osmo-stp_10.42.42.5(pid=32258) [trial-2359↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32258)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=32276): Process ended prematurely: osmo-stp_10.42.42.5(pid=32276) [trial-2359↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32276)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=32286): Process ended prematurely: osmo-stp_10.42.42.5(pid=32286) [trial-2359↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32286)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=32296): Process ended prematurely: osmo-stp_10.42.42.5(pid=32296) [trial-2359↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32296)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=32317): Process ended prematurely: osmo-stp_10.42.42.5(pid=32317) [trial-2359↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32317)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=32329): Process ended prematurely: osmo-stp_10.42.42.5(pid=32329) [trial-2359↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32329)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=32348): Process ended prematurely: osmo-stp_10.42.42.5(pid=32348) [trial-2359↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32348)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32358): Process ended prematurely: osmo-stp_10.42.42.5(pid=32358) [trial-2359↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32358)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=32368): Process ended prematurely: osmo-stp_10.42.42.5(pid=32368) [trial-2359↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32368)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=32386): Process ended prematurely: osmo-stp_10.42.42.5(pid=32386) [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32386)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=32398): Process ended prematurely: osmo-stp_10.42.42.5(pid=32398) [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32398)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=32416): Process ended prematurely: osmo-stp_10.42.42.5(pid=32416) [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32416)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32426): Process ended prematurely: osmo-stp_10.42.42.5(pid=32426) [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32426)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=32436): Process ended prematurely: osmo-stp_10.42.42.5(pid=32436) [trial-2359↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32436)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=32455): Process ended prematurely: osmo-stp_10.42.42.5(pid=32455) [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32455)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=32467): Process ended prematurely: osmo-stp_10.42.42.5(pid=32467) [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32467)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=32495): Process ended prematurely: osmo-stp_10.42.42.5(pid=32495) [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=32495)] FAIL: ping.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=576): Process ended prematurely: osmo-stp_10.42.42.5(pid=576) [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=576)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=587): Process ended prematurely: osmo-stp_10.42.42.5(pid=587) [trial-2359↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=587)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=600): Process ended prematurely: osmo-stp_10.42.42.5(pid=600) [trial-2359↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=600)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=615): Process ended prematurely: osmo-stp_10.42.42.5(pid=615) [trial-2359↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=615)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=624): Process ended prematurely: osmo-nitb_10.42.42.2(pid=624) [trial-2359↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=624)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=634): Process ended prematurely: osmo-stp_10.42.42.5(pid=634) [trial-2359↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=634)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=643): Process ended prematurely: osmo-nitb_10.42.42.2(pid=643) [trial-2359↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=643)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=653): Process ended prematurely: osmo-stp_10.42.42.5(pid=653) [trial-2359↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=653)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=667): Process ended prematurely: osmo-stp_10.42.42.5(pid=667) [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=667)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=678): Process ended prematurely: osmo-stp_10.42.42.5(pid=678) [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=678)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=692): Process ended prematurely: osmo-stp_10.42.42.5(pid=692) [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=692)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=703): Process ended prematurely: osmo-stp_10.42.42.5(pid=703) [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=703)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=718): Process ended prematurely: osmo-stp_10.42.42.5(pid=718) [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=718)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=729): Process ended prematurely: osmo-stp_10.42.42.5(pid=729) [trial-2359↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=729)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=744): Process ended prematurely: osmo-stp_10.42.42.5(pid=744) [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=744)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=755): Process ended prematurely: osmo-stp_10.42.42.5(pid=755) [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=755)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=1069): Process ended prematurely: osmo-stp_10.42.42.5(pid=1069) [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1069)] FAIL: mo_mt_call_osmux.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=1080): Process ended prematurely: osmo-stp_10.42.42.5(pid=1080) [trial-2359↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1080)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1094): Process ended prematurely: osmo-stp_10.42.42.5(pid=1094) [trial-2359↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1094)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1105): Process ended prematurely: osmo-stp_10.42.42.5(pid=1105) [trial-2359↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1105)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1121): Process ended prematurely: osmo-stp_10.42.42.5(pid=1121) [trial-2359↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1121)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1141): Process ended prematurely: osmo-stp_10.42.42.5(pid=1141) [trial-2359↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1141)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1156): Process ended prematurely: osmo-stp_10.42.42.5(pid=1156) [trial-2359↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1156)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1167): Process ended prematurely: osmo-stp_10.42.42.5(pid=1167) [trial-2359↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1167)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1183): Process ended prematurely: osmo-stp_10.42.42.5(pid=1183) [trial-2359↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1183)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1194): Process ended prematurely: osmo-stp_10.42.42.5(pid=1194) [trial-2359↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1194)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1210): Process ended prematurely: osmo-stp_10.42.42.5(pid=1210) [trial-2359↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1210)] FAIL: emergency_preemptive_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1224): Process ended prematurely: osmo-stp_10.42.42.5(pid=1224) [trial-2359↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1224)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=1244): Process ended prematurely: osmo-stp_10.42.42.5(pid=1244) [trial-2359↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1244)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=1256): Process ended prematurely: osmo-stp_10.42.42.5(pid=1256) [trial-2359↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1256)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=1275): Process ended prematurely: osmo-stp_10.42.42.5(pid=1275) [trial-2359↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1275)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1285): Process ended prematurely: osmo-stp_10.42.42.5(pid=1285) [trial-2359↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1285)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1295): Process ended prematurely: osmo-stp_10.42.42.5(pid=1295) [trial-2359↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1295)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=1312): Process ended prematurely: osmo-stp_10.42.42.5(pid=1312) [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1312)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=1324): Process ended prematurely: osmo-stp_10.42.42.5(pid=1324) [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1324)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=1342): Process ended prematurely: osmo-stp_10.42.42.5(pid=1342) [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1342)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1358): Process ended prematurely: osmo-stp_10.42.42.5(pid=1358) [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1358)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1368): Process ended prematurely: osmo-stp_10.42.42.5(pid=1368) [trial-2359↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1368)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=1386): Process ended prematurely: osmo-stp_10.42.42.5(pid=1386) [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1386)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=1398): Process ended prematurely: osmo-stp_10.42.42.5(pid=1398) [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1398)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=1416): Process ended prematurely: osmo-stp_10.42.42.5(pid=1416) [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1416)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1426): Process ended prematurely: osmo-stp_10.42.42.5(pid=1426) [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1426)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1436): Process ended prematurely: osmo-stp_10.42.42.5(pid=1436) [trial-2359↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1436)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=1453): Process ended prematurely: osmo-stp_10.42.42.5(pid=1453) [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1453)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=1465): Process ended prematurely: osmo-stp_10.42.42.5(pid=1465) [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1465)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=1483): Process ended prematurely: osmo-stp_10.42.42.5(pid=1483) [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1483)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1494): Process ended prematurely: osmo-stp_10.42.42.5(pid=1494) [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1494)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1504): Process ended prematurely: osmo-stp_10.42.42.5(pid=1504) [trial-2359↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1504)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=1522): Process ended prematurely: osmo-stp_10.42.42.5(pid=1522) [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1522)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=1534): Process ended prematurely: osmo-stp_10.42.42.5(pid=1534) [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1534)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=1552): Process ended prematurely: osmo-stp_10.42.42.5(pid=1552) [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1552)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1566): Process ended prematurely: osmo-stp_10.42.42.5(pid=1566) [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1566)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1576): Process ended prematurely: osmo-stp_10.42.42.5(pid=1576) [trial-2359↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1576)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=1589): Process ended prematurely: osmo-stp_10.42.42.5(pid=1589) [trial-2359↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1589)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1602): Process ended prematurely: osmo-stp_10.42.42.5(pid=1602) [trial-2359↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1602)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=1610): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1610) [trial-2359↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1610)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1620): Process ended prematurely: osmo-stp_10.42.42.5(pid=1620) [trial-2359↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1620)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=1629): Process ended prematurely: osmo-nitb_10.42.42.2(pid=1629) [trial-2359↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=1629)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1639): Process ended prematurely: osmo-stp_10.42.42.5(pid=1639) [trial-2359↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1639)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=1653): Process ended prematurely: osmo-stp_10.42.42.5(pid=1653) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1653)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1664): Process ended prematurely: osmo-stp_10.42.42.5(pid=1664) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1664)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1678): Process ended prematurely: osmo-stp_10.42.42.5(pid=1678) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1678)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1689): Process ended prematurely: osmo-stp_10.42.42.5(pid=1689) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1689)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1703): Process ended prematurely: osmo-stp_10.42.42.5(pid=1703) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1703)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1714): Process ended prematurely: osmo-stp_10.42.42.5(pid=1714) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1714)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1728): Process ended prematurely: osmo-stp_10.42.42.5(pid=1728) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1728)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1740): Process ended prematurely: osmo-stp_10.42.42.5(pid=1740) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1740)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1754): Process ended prematurely: osmo-stp_10.42.42.5(pid=1754) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1754)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1765): Process ended prematurely: osmo-stp_10.42.42.5(pid=1765) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1765)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=1780): Process ended prematurely: osmo-stp_10.42.42.5(pid=1780) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1780)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=1791): Process ended prematurely: osmo-stp_10.42.42.5(pid=1791) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1791)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=1805): Process ended prematurely: osmo-stp_10.42.42.5(pid=1805) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1805)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1817): Process ended prematurely: osmo-stp_10.42.42.5(pid=1817) [trial-2359↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1817)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=1832): Process ended prematurely: osmo-stp_10.42.42.5(pid=1832) [trial-2359↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1832)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1843): Process ended prematurely: osmo-stp_10.42.42.5(pid=1843) [trial-2359↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1843)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=1861): Process ended prematurely: osmo-stp_10.42.42.5(pid=1861) [trial-2359↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1861)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=1873): Process ended prematurely: osmo-stp_10.42.42.5(pid=1873) [trial-2359↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1873)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=1891): Process ended prematurely: osmo-stp_10.42.42.5(pid=1891) [trial-2359↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1891)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=1905): Process ended prematurely: osmo-stp_10.42.42.5(pid=1905) [trial-2359↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1905)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1916): Process ended prematurely: osmo-stp_10.42.42.5(pid=1916) [trial-2359↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1916)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=1935): Process ended prematurely: osmo-stp_10.42.42.5(pid=1935) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1935)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=1947): Process ended prematurely: osmo-stp_10.42.42.5(pid=1947) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1947)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=1966): Process ended prematurely: osmo-stp_10.42.42.5(pid=1966) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1966)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=1976): Process ended prematurely: osmo-stp_10.42.42.5(pid=1976) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1976)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=1986): Process ended prematurely: osmo-stp_10.42.42.5(pid=1986) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=1986)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=2006): Process ended prematurely: osmo-stp_10.42.42.5(pid=2006) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2006)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=2018): Process ended prematurely: osmo-stp_10.42.42.5(pid=2018) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2018)] FAIL: iperf3m4.py (11.4 sec) Error: osmo-stp_10.42.42.5(pid=2036): Process ended prematurely: osmo-stp_10.42.42.5(pid=2036) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2036)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2048): Process ended prematurely: osmo-stp_10.42.42.5(pid=2048) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2048)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=2058): Process ended prematurely: osmo-stp_10.42.42.5(pid=2058) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2058)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=2075): Process ended prematurely: osmo-stp_10.42.42.5(pid=2075) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2075)] FAIL: iperf3.py (8.0 sec) Error: osmo-stp_10.42.42.5(pid=2087): Process ended prematurely: osmo-stp_10.42.42.5(pid=2087) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2087)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=2105): Process ended prematurely: osmo-stp_10.42.42.5(pid=2105) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2105)] FAIL: ping.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=2386): Process ended prematurely: osmo-stp_10.42.42.5(pid=2386) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2386)] FAIL: ping_idle_ping.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=2396): Process ended prematurely: osmo-stp_10.42.42.5(pid=2396) [trial-2359↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2396)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=2410): Process ended prematurely: osmo-stp_10.42.42.5(pid=2410) [trial-2359↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2410)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2424): Process ended prematurely: osmo-stp_10.42.42.5(pid=2424) [trial-2359↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2424)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=2433): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2433) [trial-2359↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2433)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2443): Process ended prematurely: osmo-stp_10.42.42.5(pid=2443) [trial-2359↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2443)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=2452): Process ended prematurely: osmo-nitb_10.42.42.2(pid=2452) [trial-2359↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=2452)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2462): Process ended prematurely: osmo-stp_10.42.42.5(pid=2462) [trial-2359↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2462)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2476): Process ended prematurely: osmo-stp_10.42.42.5(pid=2476) [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2476)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2487): Process ended prematurely: osmo-stp_10.42.42.5(pid=2487) [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2487)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2502): Process ended prematurely: osmo-stp_10.42.42.5(pid=2502) [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2502)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=2513): Process ended prematurely: osmo-stp_10.42.42.5(pid=2513) [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2513)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=2530): Process ended prematurely: osmo-stp_10.42.42.5(pid=2530) [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2530)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2541): Process ended prematurely: osmo-stp_10.42.42.5(pid=2541) [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2541)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2556): Process ended prematurely: osmo-stp_10.42.42.5(pid=2556) [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2556)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2567): Process ended prematurely: osmo-stp_10.42.42.5(pid=2567) [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2567)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2582): Process ended prematurely: osmo-stp_10.42.42.5(pid=2582) [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2582)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=2593): Process ended prematurely: osmo-stp_10.42.42.5(pid=2593) [trial-2359↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2593)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2607): Process ended prematurely: osmo-stp_10.42.42.5(pid=2607) [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2607)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2618): Process ended prematurely: osmo-stp_10.42.42.5(pid=2618) [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2618)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=2632): Process ended prematurely: osmo-stp_10.42.42.5(pid=2632) [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2632)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2644): Process ended prematurely: osmo-stp_10.42.42.5(pid=2644) [trial-2359↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2644)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2658): Process ended prematurely: osmo-stp_10.42.42.5(pid=2658) [trial-2359↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2658)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2669): Process ended prematurely: osmo-stp_10.42.42.5(pid=2669) [trial-2359↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2669)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=2684): Process ended prematurely: osmo-stp_10.42.42.5(pid=2684) [trial-2359↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2684)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2695): Process ended prematurely: osmo-stp_10.42.42.5(pid=2695) [trial-2359↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2695)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=2713): Process ended prematurely: osmo-stp_10.42.42.5(pid=2713) [trial-2359↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2713)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=2725): Process ended prematurely: osmo-stp_10.42.42.5(pid=2725) [trial-2359↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2725)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=2743): Process ended prematurely: osmo-stp_10.42.42.5(pid=2743) [trial-2359↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2743)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=2754): Process ended prematurely: osmo-stp_10.42.42.5(pid=2754) [trial-2359↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2754)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=2764): Process ended prematurely: osmo-stp_10.42.42.5(pid=2764) [trial-2359↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2764)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=2782): Process ended prematurely: osmo-stp_10.42.42.5(pid=2782) [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2782)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=2794): Process ended prematurely: osmo-stp_10.42.42.5(pid=2794) [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2794)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=2812): Process ended prematurely: osmo-stp_10.42.42.5(pid=2812) [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2812)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=2822): Process ended prematurely: osmo-stp_10.42.42.5(pid=2822) [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2822)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=2832): Process ended prematurely: osmo-stp_10.42.42.5(pid=2832) [trial-2359↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2832)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=2850): Process ended prematurely: osmo-stp_10.42.42.5(pid=2850) [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2850)] FAIL: iperf3.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=2889): Process ended prematurely: osmo-stp_10.42.42.5(pid=2889) [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2889)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=2924): Process ended prematurely: osmo-stp_10.42.42.5(pid=2924) [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2924)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=2934): Process ended prematurely: osmo-stp_10.42.42.5(pid=2934) [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2934)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=2945): Process ended prematurely: osmo-stp_10.42.42.5(pid=2945) [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2945)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=2963): Process ended prematurely: osmo-stp_10.42.42.5(pid=2963) [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2963)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=2976): Process ended prematurely: osmo-stp_10.42.42.5(pid=2976) [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2976)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=2994): Process ended prematurely: osmo-stp_10.42.42.5(pid=2994) [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=2994)] FAIL: ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=3004): Process ended prematurely: osmo-stp_10.42.42.5(pid=3004) [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3004)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3014): Process ended prematurely: osmo-stp_10.42.42.5(pid=3014) [trial-2359↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3014)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=3032): Process ended prematurely: osmo-stp_10.42.42.5(pid=3032) [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3032)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=3044): Process ended prematurely: osmo-stp_10.42.42.5(pid=3044) [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3044)] FAIL: iperf3m4.py (11.2 sec) Error: osmo-stp_10.42.42.5(pid=3064): Process ended prematurely: osmo-stp_10.42.42.5(pid=3064) [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3064)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3074): Process ended prematurely: osmo-stp_10.42.42.5(pid=3074) [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3074)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3086): Process ended prematurely: osmo-stp_10.42.42.5(pid=3086) [trial-2359↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3086)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=3099): Process ended prematurely: osmo-stp_10.42.42.5(pid=3099) [trial-2359↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3099)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=3113): Process ended prematurely: osmo-stp_10.42.42.5(pid=3113) [trial-2359↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3113)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=3121): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3121) [trial-2359↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3121)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3131): Process ended prematurely: osmo-stp_10.42.42.5(pid=3131) [trial-2359↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3131)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=3140): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3140) [trial-2359↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3140)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=3150): Process ended prematurely: osmo-stp_10.42.42.5(pid=3150) [trial-2359↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3150)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3164): Process ended prematurely: osmo-stp_10.42.42.5(pid=3164) [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3164)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3175): Process ended prematurely: osmo-stp_10.42.42.5(pid=3175) [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3175)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3189): Process ended prematurely: osmo-stp_10.42.42.5(pid=3189) [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3189)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3200): Process ended prematurely: osmo-stp_10.42.42.5(pid=3200) [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3200)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3214): Process ended prematurely: osmo-stp_10.42.42.5(pid=3214) [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3214)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3225): Process ended prematurely: osmo-stp_10.42.42.5(pid=3225) [trial-2359↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3225)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3239): Process ended prematurely: osmo-stp_10.42.42.5(pid=3239) [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3239)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3253): Process ended prematurely: osmo-stp_10.42.42.5(pid=3253) [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3253)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3268): Process ended prematurely: osmo-stp_10.42.42.5(pid=3268) [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3268)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=3279): Process ended prematurely: osmo-stp_10.42.42.5(pid=3279) [trial-2359↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3279)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3293): Process ended prematurely: osmo-stp_10.42.42.5(pid=3293) [trial-2359↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3293)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=3304): Process ended prematurely: osmo-stp_10.42.42.5(pid=3304) [trial-2359↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3304)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3319): Process ended prematurely: osmo-stp_10.42.42.5(pid=3319) [trial-2359↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3319)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3330): Process ended prematurely: osmo-stp_10.42.42.5(pid=3330) [trial-2359↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3330)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3344): Process ended prematurely: osmo-stp_10.42.42.5(pid=3344) [trial-2359↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3344)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3355): Process ended prematurely: osmo-stp_10.42.42.5(pid=3355) [trial-2359↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3355)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=3373): Process ended prematurely: osmo-stp_10.42.42.5(pid=3373) [trial-2359↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3373)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=3385): Process ended prematurely: osmo-stp_10.42.42.5(pid=3385) [trial-2359↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3385)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=3403): Process ended prematurely: osmo-stp_10.42.42.5(pid=3403) [trial-2359↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3403)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3414): Process ended prematurely: osmo-stp_10.42.42.5(pid=3414) [trial-2359↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3414)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3424): Process ended prematurely: osmo-stp_10.42.42.5(pid=3424) [trial-2359↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3424)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=3447): Process ended prematurely: osmo-stp_10.42.42.5(pid=3447) [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3447)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=3459): Process ended prematurely: osmo-stp_10.42.42.5(pid=3459) [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3459)] FAIL: iperf3m4.py (12.4 sec) Error: osmo-stp_10.42.42.5(pid=3749): Process ended prematurely: osmo-stp_10.42.42.5(pid=3749) [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3749)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3759): Process ended prematurely: osmo-stp_10.42.42.5(pid=3759) [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3759)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3769): Process ended prematurely: osmo-stp_10.42.42.5(pid=3769) [trial-2359↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3769)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=3789): Process ended prematurely: osmo-stp_10.42.42.5(pid=3789) [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3789)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=3801): Process ended prematurely: osmo-stp_10.42.42.5(pid=3801) [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3801)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=3819): Process ended prematurely: osmo-stp_10.42.42.5(pid=3819) [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3819)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=3829): Process ended prematurely: osmo-stp_10.42.42.5(pid=3829) [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3829)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3846): Process ended prematurely: osmo-stp_10.42.42.5(pid=3846) [trial-2359↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3846)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=3863): Process ended prematurely: osmo-stp_10.42.42.5(pid=3863) [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3863)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=3875): Process ended prematurely: osmo-stp_10.42.42.5(pid=3875) [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3875)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=3896): Process ended prematurely: osmo-stp_10.42.42.5(pid=3896) [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3896)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=3906): Process ended prematurely: osmo-stp_10.42.42.5(pid=3906) [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3906)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=3916): Process ended prematurely: osmo-stp_10.42.42.5(pid=3916) [trial-2359↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3916)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=3930): Process ended prematurely: osmo-stp_10.42.42.5(pid=3930) [trial-2359↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3930)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=3943): Process ended prematurely: osmo-stp_10.42.42.5(pid=3943) [trial-2359↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3943)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=3952): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3952) [trial-2359↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3952)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3962): Process ended prematurely: osmo-stp_10.42.42.5(pid=3962) [trial-2359↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3962)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=3973): Process ended prematurely: osmo-nitb_10.42.42.2(pid=3973) [trial-2359↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=3973)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=3983): Process ended prematurely: osmo-stp_10.42.42.5(pid=3983) [trial-2359↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3983)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=3997): Process ended prematurely: osmo-stp_10.42.42.5(pid=3997) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=3997)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4008): Process ended prematurely: osmo-stp_10.42.42.5(pid=4008) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4008)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4022): Process ended prematurely: osmo-stp_10.42.42.5(pid=4022) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4022)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4033): Process ended prematurely: osmo-stp_10.42.42.5(pid=4033) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4033)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4047): Process ended prematurely: osmo-stp_10.42.42.5(pid=4047) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4047)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4058): Process ended prematurely: osmo-stp_10.42.42.5(pid=4058) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4058)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4072): Process ended prematurely: osmo-stp_10.42.42.5(pid=4072) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4072)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4083): Process ended prematurely: osmo-stp_10.42.42.5(pid=4083) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4083)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4097): Process ended prematurely: osmo-stp_10.42.42.5(pid=4097) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4097)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4108): Process ended prematurely: osmo-stp_10.42.42.5(pid=4108) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4108)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4122): Process ended prematurely: osmo-stp_10.42.42.5(pid=4122) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4122)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4133): Process ended prematurely: osmo-stp_10.42.42.5(pid=4133) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4133)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4147): Process ended prematurely: osmo-stp_10.42.42.5(pid=4147) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4147)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4158): Process ended prematurely: osmo-stp_10.42.42.5(pid=4158) [trial-2359↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4158)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4172): Process ended prematurely: osmo-stp_10.42.42.5(pid=4172) [trial-2359↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4172)] FAIL: emergency_preemptive_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4183): Process ended prematurely: osmo-stp_10.42.42.5(pid=4183) [trial-2359↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4183)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=4202): Process ended prematurely: osmo-stp_10.42.42.5(pid=4202) [trial-2359↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4202)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=4214): Process ended prematurely: osmo-stp_10.42.42.5(pid=4214) [trial-2359↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4214)] FAIL: iperf3m4.py (11.0 sec) Error: osmo-stp_10.42.42.5(pid=4235): Process ended prematurely: osmo-stp_10.42.42.5(pid=4235) [trial-2359↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4235)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4245): Process ended prematurely: osmo-stp_10.42.42.5(pid=4245) [trial-2359↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4245)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=4255): Process ended prematurely: osmo-stp_10.42.42.5(pid=4255) [trial-2359↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4255)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=4272): Process ended prematurely: osmo-stp_10.42.42.5(pid=4272) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4272)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=4284): Process ended prematurely: osmo-stp_10.42.42.5(pid=4284) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4284)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=4302): Process ended prematurely: osmo-stp_10.42.42.5(pid=4302) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4302)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4313): Process ended prematurely: osmo-stp_10.42.42.5(pid=4313) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4313)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4324): Process ended prematurely: osmo-stp_10.42.42.5(pid=4324) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4324)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=4342): Process ended prematurely: osmo-stp_10.42.42.5(pid=4342) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4342)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=4354): Process ended prematurely: osmo-stp_10.42.42.5(pid=4354) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4354)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=4375): Process ended prematurely: osmo-stp_10.42.42.5(pid=4375) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4375)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=4386): Process ended prematurely: osmo-stp_10.42.42.5(pid=4386) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4386)] FAIL: ping_idle_ping.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=4396): Process ended prematurely: osmo-stp_10.42.42.5(pid=4396) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4396)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=4414): Process ended prematurely: osmo-stp_10.42.42.5(pid=4414) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4414)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=4426): Process ended prematurely: osmo-stp_10.42.42.5(pid=4426) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4426)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=4444): Process ended prematurely: osmo-stp_10.42.42.5(pid=4444) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4444)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4454): Process ended prematurely: osmo-stp_10.42.42.5(pid=4454) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4454)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=4464): Process ended prematurely: osmo-stp_10.42.42.5(pid=4464) [trial-2359↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4464)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4477): Process ended prematurely: osmo-stp_10.42.42.5(pid=4477) [trial-2359↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4477)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=4490): Process ended prematurely: osmo-stp_10.42.42.5(pid=4490) [trial-2359↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4490)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=4499): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4499) [trial-2359↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4499)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4509): Process ended prematurely: osmo-stp_10.42.42.5(pid=4509) [trial-2359↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4509)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=4519): Process ended prematurely: osmo-nitb_10.42.42.2(pid=4519) [trial-2359↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=4519)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4529): Process ended prematurely: osmo-stp_10.42.42.5(pid=4529) [trial-2359↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4529)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4543): Process ended prematurely: osmo-stp_10.42.42.5(pid=4543) [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4543)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=4554): Process ended prematurely: osmo-stp_10.42.42.5(pid=4554) [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4554)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=4569): Process ended prematurely: osmo-stp_10.42.42.5(pid=4569) [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4569)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4583): Process ended prematurely: osmo-stp_10.42.42.5(pid=4583) [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4583)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=4598): Process ended prematurely: osmo-stp_10.42.42.5(pid=4598) [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4598)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4609): Process ended prematurely: osmo-stp_10.42.42.5(pid=4609) [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4609)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4623): Process ended prematurely: osmo-stp_10.42.42.5(pid=4623) [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4623)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4634): Process ended prematurely: osmo-stp_10.42.42.5(pid=4634) [trial-2359↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4634)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=4648): Process ended prematurely: osmo-stp_10.42.42.5(pid=4648) [trial-2359↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4648)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4659): Process ended prematurely: osmo-stp_10.42.42.5(pid=4659) [trial-2359↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4659)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=4675): Process ended prematurely: osmo-stp_10.42.42.5(pid=4675) [trial-2359↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4675)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=4686): Process ended prematurely: osmo-stp_10.42.42.5(pid=4686) [trial-2359↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4686)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=4707): Process ended prematurely: osmo-stp_10.42.42.5(pid=4707) [trial-2359↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4707)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=4719): Process ended prematurely: osmo-stp_10.42.42.5(pid=4719) [trial-2359↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4719)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=4737): Process ended prematurely: osmo-stp_10.42.42.5(pid=4737) [trial-2359↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4737)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=4747): Process ended prematurely: osmo-stp_10.42.42.5(pid=4747) [trial-2359↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4747)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=4757): Process ended prematurely: osmo-stp_10.42.42.5(pid=4757) [trial-2359↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4757)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=4775): Process ended prematurely: osmo-stp_10.42.42.5(pid=4775) [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=4775)] FAIL: iperf3.py (8.9 sec) Error: osmo-stp_10.42.42.5(pid=5058): Process ended prematurely: osmo-stp_10.42.42.5(pid=5058) [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5058)] FAIL: iperf3m4.py (12.6 sec) Error: osmo-stp_10.42.42.5(pid=5076): Process ended prematurely: osmo-stp_10.42.42.5(pid=5076) [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5076)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5087): Process ended prematurely: osmo-stp_10.42.42.5(pid=5087) [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5087)] FAIL: ping_idle_ping.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=5097): Process ended prematurely: osmo-stp_10.42.42.5(pid=5097) [trial-2359↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5097)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.1 sec) Error: osmo-stp_10.42.42.5(pid=5114): Process ended prematurely: osmo-stp_10.42.42.5(pid=5114) [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5114)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=5126): Process ended prematurely: osmo-stp_10.42.42.5(pid=5126) [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5126)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=5144): Process ended prematurely: osmo-stp_10.42.42.5(pid=5144) [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5144)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5155): Process ended prematurely: osmo-stp_10.42.42.5(pid=5155) [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5155)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5165): Process ended prematurely: osmo-stp_10.42.42.5(pid=5165) [trial-2359↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5165)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5179): Process ended prematurely: osmo-stp_10.42.42.5(pid=5179) [trial-2359↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5179)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5195): Process ended prematurely: osmo-stp_10.42.42.5(pid=5195) [trial-2359↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5195)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=5204): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5204) [trial-2359↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5204)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5214): Process ended prematurely: osmo-stp_10.42.42.5(pid=5214) [trial-2359↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5214)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5229): Process ended prematurely: osmo-stp_10.42.42.5(pid=5229) [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5229)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5240): Process ended prematurely: osmo-stp_10.42.42.5(pid=5240) [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5240)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5254): Process ended prematurely: osmo-stp_10.42.42.5(pid=5254) [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5254)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5265): Process ended prematurely: osmo-stp_10.42.42.5(pid=5265) [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5265)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5279): Process ended prematurely: osmo-stp_10.42.42.5(pid=5279) [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5279)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=5290): Process ended prematurely: osmo-stp_10.42.42.5(pid=5290) [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5290)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5304): Process ended prematurely: osmo-stp_10.42.42.5(pid=5304) [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5304)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=5315): Process ended prematurely: osmo-stp_10.42.42.5(pid=5315) [trial-2359↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5315)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5330): Process ended prematurely: osmo-stp_10.42.42.5(pid=5330) [trial-2359↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5330)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5341): Process ended prematurely: osmo-stp_10.42.42.5(pid=5341) [trial-2359↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5341)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5355): Process ended prematurely: osmo-stp_10.42.42.5(pid=5355) [trial-2359↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5355)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=5366): Process ended prematurely: osmo-stp_10.42.42.5(pid=5366) [trial-2359↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5366)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5383): Process ended prematurely: osmo-stp_10.42.42.5(pid=5383) [trial-2359↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5383)] FAIL: emergency_preemptive_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5394): Process ended prematurely: osmo-stp_10.42.42.5(pid=5394) [trial-2359↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5394)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=5412): Process ended prematurely: osmo-stp_10.42.42.5(pid=5412) [trial-2359↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5412)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=5424): Process ended prematurely: osmo-stp_10.42.42.5(pid=5424) [trial-2359↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5424)] FAIL: iperf3m4.py (11.3 sec) Error: osmo-stp_10.42.42.5(pid=5443): Process ended prematurely: osmo-stp_10.42.42.5(pid=5443) [trial-2359↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5443)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5453): Process ended prematurely: osmo-stp_10.42.42.5(pid=5453) [trial-2359↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5453)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5463): Process ended prematurely: osmo-stp_10.42.42.5(pid=5463) [trial-2359↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5463)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=5481): Process ended prematurely: osmo-stp_10.42.42.5(pid=5481) [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5481)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=5493): Process ended prematurely: osmo-stp_10.42.42.5(pid=5493) [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5493)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=5511): Process ended prematurely: osmo-stp_10.42.42.5(pid=5511) [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5511)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5521): Process ended prematurely: osmo-stp_10.42.42.5(pid=5521) [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5521)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5534): Process ended prematurely: osmo-stp_10.42.42.5(pid=5534) [trial-2359↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5534)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=5551): Process ended prematurely: osmo-stp_10.42.42.5(pid=5551) [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5551)] FAIL: iperf3.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=5565): Process ended prematurely: osmo-stp_10.42.42.5(pid=5565) [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5565)] FAIL: iperf3m4.py (11.1 sec) Error: osmo-stp_10.42.42.5(pid=5583): Process ended prematurely: osmo-stp_10.42.42.5(pid=5583) [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5583)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5593): Process ended prematurely: osmo-stp_10.42.42.5(pid=5593) [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5593)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5603): Process ended prematurely: osmo-stp_10.42.42.5(pid=5603) [trial-2359↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5603)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=5620): Process ended prematurely: osmo-stp_10.42.42.5(pid=5620) [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5620)] FAIL: iperf3.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=5632): Process ended prematurely: osmo-stp_10.42.42.5(pid=5632) [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5632)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=5650): Process ended prematurely: osmo-stp_10.42.42.5(pid=5650) [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5650)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5660): Process ended prematurely: osmo-stp_10.42.42.5(pid=5660) [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5660)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5670): Process ended prematurely: osmo-stp_10.42.42.5(pid=5670) [trial-2359↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5670)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5683): Process ended prematurely: osmo-stp_10.42.42.5(pid=5683) [trial-2359↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5683)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.5 sec) Error: osmo-nitb_10.42.42.2(pid=5692): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5692) [trial-2359↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5692)] FAIL: esme_connect_policy_closed.py (2.1 sec) Error: osmo-nitb_10.42.42.2(pid=5694): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5694) [trial-2359↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5694)] FAIL: esme_ms_sms_storeforward.py (2.9 sec) Error: osmo-nitb_10.42.42.2(pid=5696): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5696) [trial-2359↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5696)] FAIL: esme_ms_sms_transaction.py (3.5 sec) Error: osmo-nitb_10.42.42.2(pid=5698): Process ended prematurely: osmo-nitb_10.42.42.2(pid=5698) [trial-2359↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=5698)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.7 sec) Error: osmo-hlr_10.42.42.2(pid=5710): Process ended prematurely: osmo-hlr_10.42.42.2(pid=5710) [trial-2359↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5710)] FAIL: esme_connect_policy_closed.py (6.2 sec) Error: osmo-hlr_10.42.42.2(pid=5721): Process ended prematurely: osmo-hlr_10.42.42.2(pid=5721) [trial-2359↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=5721)] FAIL: esme_ms_sms_storeforward.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=5733): Process ended prematurely: osmo-stp_10.42.42.5(pid=5733) [trial-2359↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5733)] FAIL: esme_ms_sms_transaction.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5745): Process ended prematurely: osmo-stp_10.42.42.5(pid=5745) [trial-2359↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5745)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=5759): Process ended prematurely: osmo-stp_10.42.42.5(pid=5759) [trial-2359↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5759)] FAIL: register_a5_0_authreq.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5770): Process ended prematurely: osmo-stp_10.42.42.5(pid=5770) [trial-2359↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5770)] FAIL: register_a5_1_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5781): Process ended prematurely: osmo-stp_10.42.42.5(pid=5781) [trial-2359↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5781)] FAIL: register_a5_3_authreq.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=5792): Process ended prematurely: osmo-stp_10.42.42.5(pid=5792) [trial-2359↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5792)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.2 sec) Error: srsepc(pid=5813): Process ended prematurely: srsepc(pid=5813) [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=5813)] FAIL: iperf3_bidir.py (19.4 sec) Error: srsepc(pid=5831): Process ended prematurely: srsepc(pid=5831) [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=5831)] FAIL: iperf3_dl.py (19.2 sec) Error: srsepc(pid=5847): Process ended prematurely: srsepc(pid=5847) [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=5847)] FAIL: iperf3_ul.py (19.6 sec) Error: srsepc(pid=5863): Process ended prematurely: srsepc(pid=5863) [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=5863)] FAIL: ping.py (18.6 sec) Error: srsepc(pid=5882): Process ended prematurely: srsepc(pid=5882) [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=5882)] FAIL: rrc_idle_mo_ping.py (18.8 sec) Error: srsepc(pid=5898): Process ended prematurely: srsepc(pid=5898) [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=5898)] FAIL: rrc_idle_mt_ping.py (18.8 sec) Error: srsepc(pid=5914): Process ended prematurely: srsepc(pid=5914) [trial-2359↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=5914)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=5928): Process ended prematurely: osmo-stp_10.42.42.5(pid=5928) [trial-2359↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5928)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=5942): Process ended prematurely: osmo-stp_10.42.42.5(pid=5942) [trial-2359↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5942)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=5956): Process ended prematurely: osmo-stp_10.42.42.5(pid=5956) [trial-2359↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5956)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=5970): Process ended prematurely: osmo-stp_10.42.42.5(pid=5970) [trial-2359↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5970)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=5986): Process ended prematurely: osmo-stp_10.42.42.5(pid=5986) [trial-2359↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=5986)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6000): Process ended prematurely: osmo-stp_10.42.42.5(pid=6000) [trial-2359↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6000)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6014): Process ended prematurely: osmo-stp_10.42.42.5(pid=6014) [trial-2359↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6014)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6028): Process ended prematurely: osmo-stp_10.42.42.5(pid=6028) [trial-2359↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6028)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=6042): Process ended prematurely: osmo-stp_10.42.42.5(pid=6042) [trial-2359↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6042)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6059): Process ended prematurely: osmo-stp_10.42.42.5(pid=6059) [trial-2359↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6059)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=6345): Process ended prematurely: osmo-stp_10.42.42.5(pid=6345) [trial-2359↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6345)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=6359): Process ended prematurely: osmo-stp_10.42.42.5(pid=6359) [trial-2359↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6359)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=6374): Process ended prematurely: osmo-stp_10.42.42.5(pid=6374) [trial-2359↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6374)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=6388): Process ended prematurely: osmo-stp_10.42.42.5(pid=6388) [trial-2359↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6388)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6404): Process ended prematurely: osmo-stp_10.42.42.5(pid=6404) [trial-2359↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6404)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6418): Process ended prematurely: osmo-stp_10.42.42.5(pid=6418) [trial-2359↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6418)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6432): Process ended prematurely: osmo-stp_10.42.42.5(pid=6432) [trial-2359↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6432)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6446): Process ended prematurely: osmo-stp_10.42.42.5(pid=6446) [trial-2359↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6446)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=6460): Process ended prematurely: osmo-stp_10.42.42.5(pid=6460) [trial-2359↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6460)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=6474): Process ended prematurely: osmo-stp_10.42.42.5(pid=6474) [trial-2359↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6474)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6491): Process ended prematurely: osmo-stp_10.42.42.5(pid=6491) [trial-2359↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6491)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=6505): Process ended prematurely: osmo-stp_10.42.42.5(pid=6505) [trial-2359↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6505)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=6519): Process ended prematurely: osmo-stp_10.42.42.5(pid=6519) [trial-2359↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6519)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6533): Process ended prematurely: osmo-stp_10.42.42.5(pid=6533) [trial-2359↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6533)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6547): Process ended prematurely: osmo-stp_10.42.42.5(pid=6547) [trial-2359↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6547)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6561): Process ended prematurely: osmo-stp_10.42.42.5(pid=6561) [trial-2359↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6561)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6575): Process ended prematurely: osmo-stp_10.42.42.5(pid=6575) [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6575)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=6589): Process ended prematurely: osmo-stp_10.42.42.5(pid=6589) [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6589)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6603): Process ended prematurely: osmo-stp_10.42.42.5(pid=6603) [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6603)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6617): Process ended prematurely: osmo-stp_10.42.42.5(pid=6617) [trial-2359↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6617)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6641): Process ended prematurely: osmo-stp_10.42.42.5(pid=6641) [trial-2359↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6641)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=6655): Process ended prematurely: osmo-stp_10.42.42.5(pid=6655) [trial-2359↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6655)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=6669): Process ended prematurely: osmo-stp_10.42.42.5(pid=6669) [trial-2359↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6669)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=6683): Process ended prematurely: osmo-stp_10.42.42.5(pid=6683) [trial-2359↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6683)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=6697): Process ended prematurely: osmo-stp_10.42.42.5(pid=6697) [trial-2359↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6697)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=6711): Process ended prematurely: osmo-stp_10.42.42.5(pid=6711) [trial-2359↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=6711)] + rm -rf trial-2359/inst + cd trial-2359 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-09 11:17:33 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359-run.tgz run.2022-12-09_11-17-44 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2359-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17653.tgz osmo-bts-oc2g.build-5531.tgz osmo-bts-sysmo.build-8035.tgz osmo-bts.build-7504.tgz osmo-ggsn.build-6678.tgz osmo-hlr.build-8697.tgz osmo-hnbgw.build-2947.tgz osmo-mgw.build-8943.tgz osmo-msc.build-29259.tgz osmo-nitb.build-12965.tgz osmo-pcu-oc2g.build-3907.tgz osmo-pcu-sysmo.build-5189.tgz osmo-pcu.build-5150.tgz osmo-sgsn.build-30035.tgz osmo-stp.build-9238.tgz osmo-trx.build-4674.tgz osmocom-bb.build-4694.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE