![[Jenkins]](/jenkins/static/b68c8964/images/svgs/logo.svg){kind=logo}
Started by upstream project "osmo-gsm-tester_build-osmo-pcu" build number 5151 originally caused by: Started by upstream project "master-osmo-pcu" build number 5353 originally caused by: Started by upstream project "master-libosmo-gprs" build number 133 originally caused by: Started by timer Started by upstream project "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3908 originally caused by: Started by upstream project "master-osmo-pcu" build number 5353 originally caused by: Started by upstream project "master-libosmo-gprs" build number 133 originally caused by: Started by timer Running as SYSTEM Building remotely on osmo-gsm-tester-prod (osmo-gsm-tester) in workspace /home/jenkins/workspace/osmo-gsm-tester_run-prod The recommended git tool is: NONE No credentials specified > git rev-parse --resolve-git-dir /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/.git # timeout=10 Fetching changes from the remote Git repository > git config remote.origin.url https://gerrit.osmocom.org/osmo-gsm-tester # timeout=10 Fetching upstream changes from https://gerrit.osmocom.org/osmo-gsm-tester > git --version # timeout=10 > git --version # 'git version 2.20.1' > git fetch --tags --force --progress -- https://gerrit.osmocom.org/osmo-gsm-tester +refs/heads/*:refs/remotes/origin/* # timeout=10 > git rev-parse refs/remotes/origin/master^{commit} # timeout=10 Checking out Revision bfc438bb2b17f4129018768a1f7bab52f1e96750 (refs/remotes/origin/master) > git config core.sparsecheckout # timeout=10 > git checkout -f bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Commit message: "templates: osmo-msc: modernize" > git rev-list --no-walk bfc438bb2b17f4129018768a1f7bab52f1e96750 # timeout=10 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bsc" build number 17657 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts" build number 7507 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-ggsn" build number 6680 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hlr" build number 8701 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-mgw" build number 8946 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-hnbgw" build number 2953 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-msc" build number 29267 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu" build number 5151 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-sgsn" build number 30044 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-trx" build number 4676 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-nitb" build number 12970 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-stp" build number 9241 Copied 2 artifacts from "osmo-gsm-tester_build-osmocom-bb" build number 4701 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-sysmo" build number 8038 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-sysmo" build number 5190 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-bts-oc2g" build number 5534 Copied 2 artifacts from "osmo-gsm-tester_build-osmo-pcu-oc2g" build number 3908 Copied 2 artifacts from "osmo-gsm-tester_build-open5gs" build number 8 Copied 2 artifacts from "osmo-gsm-tester_build-srslte" build number 19 [osmo-gsm-tester_run-prod] $ /bin/sh /tmp/jenkins15861606600771452714.sh + unlink osmo-gsm-tester/sysmocom/resources.conf + ln -s resources.conf.prod osmo-gsm-tester/sysmocom/resources.conf + PATH=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src:/usr/local/bin:/usr/bin:/bin:/usr/games ./osmo-gsm-tester/contrib/jenkins-run.sh + base=/home/jenkins/workspace/osmo-gsm-tester_run-prod + dirname -- ./osmo-gsm-tester/contrib/jenkins-run.sh + CDPATH= cd -- ./osmo-gsm-tester/contrib + pwd -P + SCRIPT_DIR=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib + OSMO_GSM_TESTER_CONF=/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf + date +%F %T + time_start=2022-12-10 06:54:09 + trial_dir_prefix=trial- + rm -rf trial-2370 trial-2370-bin.tgz trial-2370-run.tgz + trial_dir=trial-2371 + mkdir -p trial-2371 + mv open5gs.build-8.tgz osmo-bsc.build-17657.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6680.tgz osmo-hlr.build-8701.tgz osmo-hnbgw.build-2953.tgz osmo-mgw.build-8946.tgz osmo-msc.build-29267.tgz osmo-nitb.build-12970.tgz osmo-pcu-oc2g.build-3908.tgz osmo-pcu-sysmo.build-5190.tgz osmo-pcu.build-5151.tgz osmo-sgsn.build-30044.tgz osmo-stp.build-9241.tgz osmo-trx.build-4676.tgz osmocom-bb.build-4701.tgz srslte.build-19.tgz trial-2371 + cat open5gs.build-8.md5 osmo-bsc.build-17657.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6680.md5 osmo-hlr.build-8701.md5 osmo-hnbgw.build-2953.md5 osmo-mgw.build-8946.md5 osmo-msc.build-29267.md5 osmo-nitb.build-12970.md5 osmo-pcu-oc2g.build-3908.md5 osmo-pcu-sysmo.build-5190.md5 osmo-pcu.build-5151.md5 osmo-sgsn.build-30044.md5 osmo-stp.build-9241.md5 osmo-trx.build-4676.md5 osmocom-bb.build-4701.md5 srslte.build-19.md5 + rm open5gs.build-8.md5 osmo-bsc.build-17657.md5 osmo-bts-oc2g.build-5534.md5 osmo-bts-sysmo.build-8038.md5 osmo-bts.build-7507.md5 osmo-ggsn.build-6680.md5 osmo-hlr.build-8701.md5 osmo-hnbgw.build-2953.md5 osmo-mgw.build-8946.md5 osmo-msc.build-29267.md5 osmo-nitb.build-12970.md5 osmo-pcu-oc2g.build-3908.md5 osmo-pcu-sysmo.build-5190.md5 osmo-pcu.build-5151.md5 osmo-sgsn.build-30044.md5 osmo-stp.build-9241.md5 osmo-trx.build-4676.md5 osmocom-bb.build-4701.md5 srslte.build-19.md5 + exit_code=1 + which osmo-gsm-tester.py + python3 -u /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo-gsm-tester.py -c /home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/contrib/../sysmocom/main.conf trial-2371 combinations: None trial: 'trial-2371' tests: None Running default suites: nitb_sms:sysmo sms:sysmo nitb_ussd:sysmo ussd:sysmo voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:sysmo+mod-bts0-dynts-osmo emergency:sysmo gprs:sysmo gprs:sysmo+mod-bts0-egprs gprs:sysmo+mod-bts0-dynts-ipa gprs:sysmo+mod-bts0-dynts-osmo dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:sysmo+mod-bts0-dynts67-osmo nitb_sms:oc2g sms:oc2g nitb_ussd:oc2g ussd:oc2g voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:oc2g+mod-bts0-dynts-osmo emergency:oc2g gprs:oc2g gprs:oc2g+mod-bts0-egprs gprs:oc2g+mod-bts0-dynts-ipa gprs:oc2g+mod-bts0-dynts-osmo dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:oc2g+mod-bts0-dynts67-osmo nitb_sms:trx-b200 sms:trx-b200 nitb_ussd:trx-b200 ussd:trx-b200 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-b200+mod-bts0-dynts-osmo voice:trx-b200+mod-bts0-trxdversion0 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-b200 gprs:trx-b200 gprs:trx-b200+mod-bts0-egprs gprs:trx-b200+mod-bts0-dynts-ipa gprs:trx-b200+mod-bts0-dynts-osmo gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-b200+mod-bts0-dynts67-osmo nitb_sms:trx-sysmocell5000 sms:trx-sysmocell5000 nitb_ussd:trx-sysmocell5000 ussd:trx-sysmocell5000 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-sysmocell5000+mod-bts0-dynts-osmo emergency:trx-sysmocell5000 gprs:trx-sysmocell5000 gprs:trx-sysmocell5000+mod-bts0-egprs gprs:trx-sysmocell5000+mod-bts0-dynts-ipa gprs:trx-sysmocell5000+mod-bts0-dynts-osmo dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo nitb_sms:trx-umtrx sms:trx-umtrx nitb_ussd:trx-umtrx ussd:trx-umtrx voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-umtrx+mod-bts0-dynts-osmo voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:trx-umtrx gprs:trx-umtrx gprs:trx-umtrx+mod-bts0-egprs gprs:trx-umtrx+mod-bts0-dynts-ipa gprs:trx-umtrx+mod-bts0-dynts-osmo gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-umtrx+mod-bts0-dynts67-osmo nitb_sms:trx-lms sms:trx-lms nitb_ussd:trx-lms ussd:trx-lms voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms+mod-bts0-dynts-osmo emergency:trx-lms gprs:trx-lms gprs:trx-lms+mod-bts0-egprs gprs:trx-lms+mod-bts0-dynts-ipa gprs:trx-lms+mod-bts0-dynts-osmo dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms+mod-bts0-dynts67-osmo nitb_sms:trx-lms-limenet-micro sms:trx-lms-limenet-micro nitb_ussd:trx-lms-limenet-micro ussd:trx-lms-limenet-micro voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo emergency:trx-lms-limenet-micro gprs:trx-lms-limenet-micro gprs:trx-lms-limenet-micro+mod-bts0-egprs gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo nitb_sms:nanobts sms:nanobts+band-1900 nitb_ussd:nanobts+band-1900 ussd:nanobts+band-1900 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any emergency:nanobts+band-1900 gprs:nanobts+band-1900 gprs:nanobts+band-1900+mod-bts0-egprs gprs:nanobts+band-1900+mod-bts0-dynts-ipa dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any sms:nanobts+band-900 nitb_ussd:nanobts+band-900 ussd:nanobts+band-900 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend emergency:nanobts+band-900 gprs:nanobts+band-900 gprs:nanobts+band-900+mod-bts0-egprs gprs:nanobts+band-900+mod-bts0-dynts-ipa gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any nitb_smpp smpp encryption 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover_2G:nanobts+bts1-oc2g handover_2G:nanobts+bts1-octphy handover_2G:nanobts+bts1-trx-lms handover_2G:nanobts+bts1-trx-lms-limenet-micro handover_2G:nanobts+bts1-trx-sysmocell5000 handover_2G:nanobts+bts1-sysmo handover_2G:nanobts+bts1-trx-b200 handover_2G:nanobts+bts1-trx-umtrx handover_2G:oc2g+bts1-octphy handover_2G:oc2g+bts1-trx-lms handover_2G:oc2g+bts1-trx-lms-limenet-micro handover_2G:oc2g+bts1-trx-sysmocell5000 handover_2G:oc2g+bts1-sysmo handover_2G:oc2g+bts1-trx-b200 handover_2G:oc2g+bts1-trx-umtrx handover_2G:octphy+bts1-trx-lms handover_2G:octphy+bts1-trx-lms-limenet-micro handover_2G:octphy+bts1-trx-sysmocell5000 handover_2G:octphy+bts1-sysmo handover_2G:octphy+bts1-trx-b200 handover_2G:octphy+bts1-trx-umtrx handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover_2G:trx-lms+bts1-trx-sysmocell5000 handover_2G:trx-lms+bts1-sysmo handover_2G:trx-lms+bts1-trx-b200 handover_2G:trx-lms+bts1-trx-umtrx handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover_2G:trx-sysmocell5000+bts1-sysmo handover_2G:trx-sysmocell5000+bts1-trx-b200 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover_2G:sysmo+bts1-trx-b200 handover_2G:sysmo+bts1-trx-umtrx handover_2G:trx-b200+bts1-trx-umtrx -------------------------------------------------------------------------------------------- trial-2371 -------------------------------------------------------------------------------------------- 06:54:20.644416 tst trial-2371: Detailed log at /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/log --------------------------------------------------------------------- trial-2371 nitb_sms:sysmo --------------------------------------------------------------------- 06:56:29.206782 tst nitb_sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:56:29.210338 tst nitb_sms:sysmo: Verifying 1 x bts (candidates: 11) 06:56:29.230838 tst nitb_sms:sysmo: Verifying 1 x ip_address (candidates: 9) 06:56:29.238760 tst nitb_sms:sysmo: Verifying 2 x modem (candidates: 12) 06:56:29.292626 tst nitb_sms:sysmo: Reserving 1 x bts (candidates: 11) 06:56:29.313314 tst nitb_sms:sysmo: Reserving 1 x ip_address (candidates: 9) 06:56:29.320658 tst nitb_sms:sysmo: Reserving 2 x modem (candidates: 12) 06:56:29.858524 tst nitb_sms:sysmo: RESERVED RESOURCES for nitb_sms: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 nitb_sms:sysmo mo_mt_sms.py ---------------------------------------------- 06:56:29.863456 tst nitb_sms:sysmo: Using 1 x ip_address (candidates: 1) 06:56:29.874201 tst nitb_sms:sysmo: Using 1 x bts (candidates: 1) 06:56:30.249135 tst mo_mt_sms.py: using LAC 26635 06:56:30.483762 tst mo_mt_sms.py: using RAC 115 06:56:30.598988 tst mo_mt_sms.py: using CellId 26635 06:56:30.713833 tst mo_mt_sms.py: using BVCI 26636 06:56:30.819901 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 06:56:31.026573 tst nitb_sms:sysmo: Using 1 x modem (candidates: 2) 06:56:31.154514 tst mo_mt_sms.py:9: start nitb and bts... 06:56:31.359558 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:56:33.632418 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8088): Launched 06:56:33.935778 run osmo-nitb_10.42.42.2(pid=8089): Launched 06:56:34.100439 run osmo-nitb_10.42.42.2(pid=8089): ERR: Terminated: ERROR {rc=2} [trial-2371↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8089)] 06:56:34.224798 run osmo-nitb_10.42.42.2(pid=8089): stdout: | (launched: 2022-12-10_06:56:33.878963) 06:56:34.350295 run osmo-nitb_10.42.42.2(pid=8089): stderr: | (launched: 2022-12-10_06:56:33.924059) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:56:34.476134 run osmo-nitb_10.42.42.2(pid=8089): stdout: | (launched: 2022-12-10_06:56:33.878963) 06:56:34.596363 run osmo-nitb_10.42.42.2(pid=8089): stderr: | (launched: 2022-12-10_06:56:33.924059) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:56:34.740530 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=8089): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8089) [trial-2371↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8089)] [trial-2371↪nitb_sms:sysmo↪mo_mt_sms.py:11] 06:56:34.748744 tst mo_mt_sms.py:11: Test FAILED (4.9 sec) 06:56:34.755291 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8088): Terminating (SIGTERM) 06:56:34.965194 --- ParallelTerminationStrategy: PID 8088 died... 06:56:34.985735 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8088): Terminated: ok {rc=0} 06:56:35.070892 bus /sierra_3: Setting Powered False 06:56:36.172705 bus /sierra_3: Setting Powered False 06:56:37.294486 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 nitb_sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 sms:sysmo --------------------------------------------------------------------- 06:56:38.473405 tst sms:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:56:38.477429 tst sms:sysmo: Verifying 1 x bts (candidates: 11) 06:56:38.498018 tst sms:sysmo: Verifying 6 x ip_address (candidates: 9) 06:56:38.525671 tst sms:sysmo: Verifying 2 x modem (candidates: 12) 06:56:38.581696 tst sms:sysmo: Reserving 1 x bts (candidates: 11) 06:56:38.603088 tst sms:sysmo: Reserving 6 x ip_address (candidates: 9) 06:56:38.629474 tst sms:sysmo: Reserving 2 x modem (candidates: 12) 06:56:39.172518 tst sms:sysmo: RESERVED RESOURCES for sms: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 sms:sysmo mo_mt_sms.py ---------------------------------------------- 06:56:39.177802 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 06:56:39.188286 tst sms:sysmo: Using 1 x bts (candidates: 1) 06:56:39.222885 tst mo_mt_sms.py: using LAC 26636 06:56:39.339580 tst mo_mt_sms.py: using RAC 116 06:56:39.455508 tst mo_mt_sms.py: using CellId 26636 06:56:39.570606 tst mo_mt_sms.py: using BVCI 26637 06:56:39.679266 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 06:56:39.689854 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 06:56:39.700257 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 06:56:39.710970 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 06:56:39.721677 tst sms:sysmo: Using 1 x ip_address (candidates: 6) 06:56:39.732325 tst sms:sysmo: Using 1 x modem (candidates: 2) 06:56:39.851273 tst sms:sysmo: Using 1 x modem (candidates: 2) 06:56:39.971411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:56:41.682636 run create_hlr_db(pid=8094): Launched 06:56:41.799631 bus /sierra_2: Setting Powered False 06:56:42.859749 run create_hlr_db(pid=8094): Terminated: ok {rc=0} 06:56:43.304618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8096): Launched 06:56:43.631988 run osmo-hlr_10.42.42.2(pid=8097): Launched 06:56:43.759131 run osmo-stp_10.42.42.5: Starting osmo-stp 06:56:46.354521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8099): Launched 06:56:46.682528 run osmo-stp_10.42.42.5(pid=8100): Launched 06:56:46.974871 run osmo-msc_10.42.42.6: Starting osmo-msc 06:56:52.227978 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8102): Launched 06:56:52.533240 run osmo-msc_10.42.42.6(pid=8103): Launched 06:56:52.702368 run osmo-stp_10.42.42.5(pid=8100): ERR: Terminated: ERROR {rc=1} [trial-2371↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8100)] 06:56:52.830124 run osmo-stp_10.42.42.5(pid=8100): stdout: | (launched: 2022-12-10_06:56:46.623407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:56:52.957862 run osmo-stp_10.42.42.5(pid=8100): stderr: | [0;m[38;5;43m20221210065646821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065646821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065646821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065646822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065646822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065646822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065646822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:56:53.084147 run osmo-stp_10.42.42.5(pid=8100): stdout: | (launched: 2022-12-10_06:56:46.623407) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:56:53.205311 run osmo-stp_10.42.42.5(pid=8100): stderr: | [0;m[38;5;43m20221210065646821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065646821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065646821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065646822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065646822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065646822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065646822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:56:53.350844 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=8100): Process ended prematurely: osmo-stp_10.42.42.5(pid=8100) [trial-2371↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8100)] [trial-2371↪sms:sysmo↪mo_mt_sms.py:16] 06:56:53.359253 tst mo_mt_sms.py:16: Test FAILED (14.2 sec) 06:56:53.385991 run osmo-hlr_10.42.42.2(pid=8097): ERR: Terminated: ERROR {rc=237} [trial-2371↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8097)] 06:56:53.434793 run osmo-hlr_10.42.42.2(pid=8097): stdout: | (launched: 2022-12-10_06:56:43.571383) 06:56:53.485352 run osmo-hlr_10.42.42.2(pid=8097): stderr: | [0;m[1;31m20221210065643772 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210065643773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210065643773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210065643773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210065643773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210065643773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210065643786 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/sms:sysmo/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210065643796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065643797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065643797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:56:53.555222 run osmo-msc_10.42.42.6(pid=8103): ERR: Terminated: ERROR {rc=2} [trial-2371↪sms:sysmo↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8103)] 06:56:53.603861 run osmo-msc_10.42.42.6(pid=8103): stdout: | (launched: 2022-12-10_06:56:52.475965) 06:56:53.653895 run osmo-msc_10.42.42.6(pid=8103): stderr: | [0;m[38;5;43m20221210065652751 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210065652751 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f14510e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210065652752 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210065652754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210065652754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210065652755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210065652756 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210065652757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065652757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065652757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:56:53.704690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8096): Terminating (SIGTERM) 06:56:53.745262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8099): Terminating (SIGTERM) 06:56:53.786544 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8102): Terminating (SIGTERM) 06:56:53.827731 --- ParallelTerminationStrategy: PID 8096 died... 06:56:53.847135 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8096): Terminated: ok {rc=0} 06:56:53.892297 --- ParallelTerminationStrategy: PID 8099 died... 06:56:53.911619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8099): Terminated: ok {rc=0} 06:56:53.956699 --- ParallelTerminationStrategy: PID 8102 died... 06:56:53.975721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8102): Terminated: ok {rc=0} 06:56:54.063714 bus /sierra_3: Setting Powered False 06:56:55.164825 bus /sierra_3: Setting Powered False 06:56:56.282798 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 sms:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 nitb_ussd:sysmo --------------------------------------------------------------------- 06:56:57.502083 tst nitb_ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:56:57.505876 tst nitb_ussd:sysmo: Verifying 1 x bts (candidates: 11) 06:56:57.528168 tst nitb_ussd:sysmo: Verifying 1 x ip_address (candidates: 9) 06:56:57.537552 tst nitb_ussd:sysmo: Verifying 1 x modem (candidates: 12) 06:56:57.571741 tst nitb_ussd:sysmo: Reserving 1 x bts (candidates: 11) 06:56:57.593226 tst nitb_ussd:sysmo: Reserving 1 x ip_address (candidates: 9) 06:56:57.600204 tst nitb_ussd:sysmo: Reserving 1 x modem (candidates: 12) 06:56:58.120644 tst nitb_ussd:sysmo: RESERVED RESOURCES for nitb_ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2371 nitb_ussd:sysmo assert_extension.py ---------------------------------------------- 06:56:58.126152 tst nitb_ussd:sysmo: Using 1 x ip_address (candidates: 1) 06:56:58.136852 tst nitb_ussd:sysmo: Using 1 x bts (candidates: 1) 06:56:58.172084 tst assert_extension.py: using LAC 26637 06:56:58.290467 tst assert_extension.py: using RAC 117 06:56:58.409379 tst assert_extension.py: using CellId 26637 06:56:58.528167 tst assert_extension.py: using BVCI 26638 06:56:58.638377 tst nitb_ussd:sysmo: Using 1 x modem (candidates: 1) 06:56:58.753075 tst assert_extension.py:10: start nitb and bts... 06:56:58.956123 run osmo-nitb_10.42.42.2: Starting osmo-nitb 06:56:59.576107 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8108): Launched 06:56:59.880256 run osmo-nitb_10.42.42.2(pid=8109): Launched 06:57:00.049569 run osmo-nitb_10.42.42.2(pid=8109): ERR: Terminated: ERROR {rc=2} [trial-2371↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8109)] 06:57:00.185516 run osmo-nitb_10.42.42.2(pid=8109): stdout: | (launched: 2022-12-10_06:56:59.823174) 06:57:00.323054 run osmo-nitb_10.42.42.2(pid=8109): stderr: | (launched: 2022-12-10_06:56:59.868117) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:57:00.460070 run osmo-nitb_10.42.42.2(pid=8109): stdout: | (launched: 2022-12-10_06:56:59.823174) 06:57:00.591561 run osmo-nitb_10.42.42.2(pid=8109): stderr: | (launched: 2022-12-10_06:56:59.868117) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f5483dba268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8109): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8109) [trial-2371↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8109)] 06:57:00.996137 tst osmo-nitb_10.42.42.2(pid=8109): stdout: | (launched: 2022-12-10_06:56:59.823174) 06:57:01.123107 tst osmo-nitb_10.42.42.2(pid=8109): stderr: | (launched: 2022-12-10_06:56:59.868117) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 06:57:01.272247 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=8109): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8109) [trial-2371↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8109)] [trial-2371↪nitb_ussd:sysmo↪assert_extension.py:12] 06:57:01.281635 tst assert_extension.py:12: Test FAILED (3.1 sec) 06:57:01.289478 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8108): Terminating (SIGTERM) 06:57:01.502443 --- ParallelTerminationStrategy: PID 8108 died... 06:57:01.529147 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8108): Terminated: ok {rc=0} 06:57:01.635523 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 nitb_ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 ussd:sysmo --------------------------------------------------------------------- 06:57:02.824117 tst ussd:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:57:02.829132 tst ussd:sysmo: Verifying 1 x bts (candidates: 11) 06:57:02.851527 tst ussd:sysmo: Verifying 6 x ip_address (candidates: 9) 06:57:02.878564 tst ussd:sysmo: Verifying 1 x modem (candidates: 12) 06:57:02.913807 tst ussd:sysmo: Reserving 1 x bts (candidates: 11) 06:57:02.935442 tst ussd:sysmo: Reserving 6 x ip_address (candidates: 9) 06:57:02.962813 tst ussd:sysmo: Reserving 1 x modem (candidates: 12) 06:57:03.489474 tst ussd:sysmo: RESERVED RESOURCES for ussd: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2371 ussd:sysmo assert_extension.py ---------------------------------------------- 06:57:03.494669 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 06:57:03.505586 tst ussd:sysmo: Using 1 x bts (candidates: 1) 06:57:03.540510 tst assert_extension.py: using LAC 26638 06:57:03.662197 tst assert_extension.py: using RAC 118 06:57:03.781411 tst assert_extension.py: using CellId 26638 06:57:03.907794 tst assert_extension.py: using BVCI 26639 06:57:04.018465 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 06:57:04.029262 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 06:57:04.039786 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 06:57:04.050675 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 06:57:04.061413 tst ussd:sysmo: Using 1 x ip_address (candidates: 6) 06:57:04.072012 tst ussd:sysmo: Using 1 x modem (candidates: 1) 06:57:04.186795 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:57:04.657150 run create_hlr_db(pid=8114): Launched 06:57:04.773748 bus /sierra_2: Setting Powered False 06:57:05.833743 run create_hlr_db(pid=8114): Terminated: ok {rc=0} 06:57:06.259198 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8116): Launched 06:57:06.565349 run osmo-hlr_10.42.42.2(pid=8117): Launched 06:57:06.683943 run osmo-stp_10.42.42.5: Starting osmo-stp 06:57:07.207840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8119): Launched 06:57:07.514930 run osmo-stp_10.42.42.5(pid=8120): Launched 06:57:07.632534 run osmo-msc_10.42.42.6: Starting osmo-msc 06:57:08.179803 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8122): Launched 06:57:08.483671 run osmo-msc_10.42.42.6(pid=8123): Launched 06:57:08.654486 run osmo-stp_10.42.42.5(pid=8120): ERR: Terminated: ERROR {rc=1} [trial-2371↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8120)] 06:57:08.783743 run osmo-stp_10.42.42.5(pid=8120): stdout: | (launched: 2022-12-10_06:57:07.457730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:57:08.913169 run osmo-stp_10.42.42.5(pid=8120): stderr: | [0;m[38;5;43m20221210065707629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065707629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065707629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065707630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065707630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065707630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065707630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:57:09.040259 run osmo-stp_10.42.42.5(pid=8120): stdout: | (launched: 2022-12-10_06:57:07.457730) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:57:09.161262 run osmo-stp_10.42.42.5(pid=8120): stderr: | [0;m[38;5;43m20221210065707629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065707629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065707629 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065707630 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065707630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065707630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065707630 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:57:09.305473 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=8120): Process ended prematurely: osmo-stp_10.42.42.5(pid=8120) [trial-2371↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8120)] [trial-2371↪ussd:sysmo↪assert_extension.py:17] 06:57:09.313899 tst assert_extension.py:17: Test FAILED (5.8 sec) 06:57:09.340788 run osmo-hlr_10.42.42.2(pid=8117): ERR: Terminated: ERROR {rc=237} [trial-2371↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8117)] 06:57:09.389876 run osmo-hlr_10.42.42.2(pid=8117): stdout: | (launched: 2022-12-10_06:57:06.507791) 06:57:09.440909 run osmo-hlr_10.42.42.2(pid=8117): stderr: | [0;m[1;31m20221210065706685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210065706685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210065706685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210065706685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210065706685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210065706685 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210065706720 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/ussd:sysmo/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210065706730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065706730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065706730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:57:09.510781 run osmo-msc_10.42.42.6(pid=8123): ERR: Terminated: ERROR {rc=2} [trial-2371↪ussd:sysmo↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8123)] 06:57:09.559588 run osmo-msc_10.42.42.6(pid=8123): stdout: | (launched: 2022-12-10_06:57:08.426430) 06:57:09.610016 run osmo-msc_10.42.42.6(pid=8123): stderr: | [0;m[38;5;43m20221210065708700 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210065708700 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6876d39c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210065708700 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210065708700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210065708701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210065708701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210065708703 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210065708703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065708703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065708703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:57:09.660652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8116): Terminating (SIGTERM) 06:57:09.701149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8119): Terminating (SIGTERM) 06:57:09.741798 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8122): Terminating (SIGTERM) 06:57:09.782540 --- ParallelTerminationStrategy: PID 8116 died... 06:57:09.801976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8116): Terminated: ok {rc=0} 06:57:09.847125 --- ParallelTerminationStrategy: PID 8119 died... 06:57:09.866085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8119): Terminated: ok {rc=0} 06:57:09.911154 --- ParallelTerminationStrategy: PID 8122 died... 06:57:09.930236 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8122): Terminated: ok {rc=0} 06:57:10.018446 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 ussd:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 06:57:11.224042 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:57:11.230882 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 06:57:11.252274 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 06:57:11.278865 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 06:57:11.329901 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 06:57:11.350635 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 06:57:11.377410 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 06:57:11.926684 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 06:57:11.985492 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:57:11.997247 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:57:12.054613 tst mo_mt_call.py: using LAC 26639 06:57:12.182393 tst mo_mt_call.py: using RAC 119 06:57:12.310234 tst mo_mt_call.py: using CellId 26639 06:57:12.437990 tst mo_mt_call.py: using BVCI 26640 06:57:12.559795 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:57:12.571369 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:57:12.582792 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:57:12.594744 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:57:12.606668 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:57:12.618659 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:57:12.740545 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:57:12.859095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:57:13.373227 run create_hlr_db(pid=8128): Launched 06:57:13.508723 bus /sierra_2: Setting Powered False 06:57:14.573596 run create_hlr_db(pid=8128): Terminated: ok {rc=0} 06:57:15.015799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8130): Launched 06:57:15.328399 run osmo-hlr_10.42.42.2(pid=8131): Launched 06:57:15.446526 run osmo-stp_10.42.42.5: Starting osmo-stp 06:57:16.005601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8133): Launched 06:57:16.325375 run osmo-stp_10.42.42.5(pid=8134): Launched 06:57:16.662032 run osmo-msc_10.42.42.6: Starting osmo-msc 06:57:17.273338 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8136): Launched 06:57:17.592739 run osmo-msc_10.42.42.6(pid=8137): Launched 06:57:17.766778 run osmo-stp_10.42.42.5(pid=8134): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8134)] 06:57:17.897282 run osmo-stp_10.42.42.5(pid=8134): stdout: | (launched: 2022-12-10_06:57:16.266237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:57:18.027481 run osmo-stp_10.42.42.5(pid=8134): stderr: | [0;m[38;5;43m20221210065716486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065716487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065716487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065716487 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065716488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065716488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065716488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:57:18.156020 run osmo-stp_10.42.42.5(pid=8134): stdout: | (launched: 2022-12-10_06:57:16.266237) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:57:18.278659 run osmo-stp_10.42.42.5(pid=8134): stderr: | [0;m[38;5;43m20221210065716486 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065716487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065716487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065716487 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065716488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065716488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065716488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:57:18.425645 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8134): Process ended prematurely: osmo-stp_10.42.42.5(pid=8134) [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8134)] [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 06:57:18.434633 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 06:57:18.461636 run osmo-hlr_10.42.42.2(pid=8131): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8131)] 06:57:18.510354 run osmo-hlr_10.42.42.2(pid=8131): stdout: | (launched: 2022-12-10_06:57:15.270322) 06:57:18.560502 run osmo-hlr_10.42.42.2(pid=8131): stderr: | [0;m[1;31m20221210065715450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210065715450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210065715450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210065715450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210065715450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210065715450 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210065715466 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210065715476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065715476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065715476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:57:18.630274 run osmo-msc_10.42.42.6(pid=8137): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8137)] 06:57:18.679060 run osmo-msc_10.42.42.6(pid=8137): stdout: | (launched: 2022-12-10_06:57:17.534996) 06:57:18.729314 run osmo-msc_10.42.42.6(pid=8137): stderr: | [0;m[38;5;43m20221210065717811 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210065717811 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1cd24c9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210065717811 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210065717811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210065717811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210065717811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210065717813 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210065717813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065717814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065717814 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:57:18.780071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8130): Terminating (SIGTERM) 06:57:18.820634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8133): Terminating (SIGTERM) 06:57:18.861375 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8136): Terminating (SIGTERM) 06:57:18.902129 --- ParallelTerminationStrategy: PID 8130 died... 06:57:18.921653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8130): Terminated: ok {rc=0} 06:57:18.966548 --- ParallelTerminationStrategy: PID 8133 died... 06:57:18.985374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8133): Terminated: ok {rc=0} 06:57:19.030263 --- ParallelTerminationStrategy: PID 8136 died... 06:57:19.049252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8136): Terminated: ok {rc=0} 06:57:19.136299 bus /sierra_3: Setting Powered False 06:57:20.237849 bus /sierra_3: Setting Powered False 06:57:21.355381 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 06:57:22.506487 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:57:22.518243 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 06:57:22.574703 tst mo_mt_call_osmux.py: using LAC 26640 06:57:22.697282 tst mo_mt_call_osmux.py: using RAC 120 06:57:22.817497 tst mo_mt_call_osmux.py: using CellId 26640 06:57:22.938506 tst mo_mt_call_osmux.py: using BVCI 26641 06:57:23.052219 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:57:23.063324 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:57:23.074382 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:57:23.085543 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:57:23.096608 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 06:57:23.107721 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:57:23.229127 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 06:57:23.347709 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:57:23.829512 run create_hlr_db(pid=8139): Launched 06:57:23.947264 bus /sierra_2: Setting Powered False 06:57:25.008713 run create_hlr_db(pid=8139): Terminated: ok {rc=0} 06:57:25.462885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8141): Launched 06:57:25.797940 run osmo-hlr_10.42.42.2(pid=8142): Launched 06:57:25.925385 run osmo-stp_10.42.42.5: Starting osmo-stp 06:57:26.502234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8144): Launched 06:57:26.835799 run osmo-stp_10.42.42.5(pid=8145): Launched 06:57:26.964181 run osmo-msc_10.42.42.6: Starting osmo-msc 06:57:27.563881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8147): Launched 06:57:27.898292 run osmo-msc_10.42.42.6(pid=8148): Launched 06:57:28.084917 run osmo-stp_10.42.42.5(pid=8145): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8145)] 06:57:28.223855 run osmo-stp_10.42.42.5(pid=8145): stdout: | (launched: 2022-12-10_06:57:26.774243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:57:28.363170 run osmo-stp_10.42.42.5(pid=8145): stderr: | [0;m[38;5;43m20221210065726968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065726968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065726968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065726968 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065726969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065726969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065726969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:57:28.501993 run osmo-stp_10.42.42.5(pid=8145): stdout: | (launched: 2022-12-10_06:57:26.774243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:57:28.633974 run osmo-stp_10.42.42.5(pid=8145): stderr: | [0;m[38;5;43m20221210065726968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065726968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065726968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065726968 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065726969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065726969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065726969 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:57:28.792057 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8145): Process ended prematurely: osmo-stp_10.42.42.5(pid=8145) [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8145)] [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 06:57:28.801770 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 06:57:28.829772 run osmo-hlr_10.42.42.2(pid=8142): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8142)] 06:57:28.880690 run osmo-hlr_10.42.42.2(pid=8142): stdout: | (launched: 2022-12-10_06:57:25.736433) 06:57:28.933664 run osmo-hlr_10.42.42.2(pid=8142): stderr: | [0;m[1;31m20221210065725939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210065725939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210065725939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210065725939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210065725939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210065725939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210065725952 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210065725960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065725960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065725960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:57:29.006724 run osmo-msc_10.42.42.6(pid=8148): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8148)] 06:57:29.058221 run osmo-msc_10.42.42.6(pid=8148): stdout: | (launched: 2022-12-10_06:57:27.836248) 06:57:29.110880 run osmo-msc_10.42.42.6(pid=8148): stderr: | [0;m[38;5;43m20221210065728163 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210065728163 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f71cc551c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210065728163 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210065728163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210065728163 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210065728164 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210065728165 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210065728166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065728166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065728166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:57:29.163571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8141): Terminating (SIGTERM) 06:57:29.205832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8144): Terminating (SIGTERM) 06:57:29.248186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8147): Terminating (SIGTERM) 06:57:29.290702 --- ParallelTerminationStrategy: PID 8141 died... 06:57:29.310608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8141): Terminated: ok {rc=0} 06:57:29.357417 --- ParallelTerminationStrategy: PID 8144 died... 06:57:29.377144 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8144): Terminated: ok {rc=0} 06:57:29.423641 --- ParallelTerminationStrategy: PID 8147 died... 06:57:29.443387 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8147): Terminated: ok {rc=0} 06:57:29.532651 bus /sierra_3: Setting Powered False 06:57:30.632612 bus /sierra_3: Setting Powered False 06:57:31.750152 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 06:57:32.991626 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:57:32.998686 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 06:57:33.020715 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 06:57:33.048492 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 06:57:33.103086 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 06:57:33.124690 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 06:57:33.151929 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 06:57:33.706802 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 06:57:33.759404 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:57:33.770880 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:57:33.827346 tst mo_mt_call.py: using LAC 26641 06:57:33.955830 tst mo_mt_call.py: using RAC 121 06:57:34.077577 tst mo_mt_call.py: using CellId 26641 06:57:34.207372 tst mo_mt_call.py: using BVCI 26642 06:57:34.327742 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:57:34.339249 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:57:34.350608 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:57:34.361966 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:57:34.373353 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:57:34.384633 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:57:34.504454 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:57:34.626716 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:57:35.142333 run create_hlr_db(pid=8155): Launched 06:57:35.276525 bus /sierra_2: Setting Powered False 06:57:36.342908 run create_hlr_db(pid=8155): Terminated: ok {rc=0} 06:57:36.805623 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8157): Launched 06:57:37.140267 run osmo-hlr_10.42.42.2(pid=8158): Launched 06:57:37.268552 run osmo-stp_10.42.42.5: Starting osmo-stp 06:57:37.840170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8160): Launched 06:57:38.174688 run osmo-stp_10.42.42.5(pid=8161): Launched 06:57:38.301502 run osmo-msc_10.42.42.6: Starting osmo-msc 06:57:38.902380 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8163): Launched 06:57:39.235694 run osmo-msc_10.42.42.6(pid=8164): Launched 06:57:39.421330 run osmo-stp_10.42.42.5(pid=8161): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8161)] 06:57:39.560055 run osmo-stp_10.42.42.5(pid=8161): stdout: | (launched: 2022-12-10_06:57:38.112893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:57:39.699977 run osmo-stp_10.42.42.5(pid=8161): stderr: | [0;m[38;5;43m20221210065738310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065738310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065738310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065738311 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065738311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065738311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065738311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:57:39.838267 run osmo-stp_10.42.42.5(pid=8161): stdout: | (launched: 2022-12-10_06:57:38.112893) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:57:39.970924 run osmo-stp_10.42.42.5(pid=8161): stderr: | [0;m[38;5;43m20221210065738310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065738310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065738310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065738311 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065738311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065738311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065738311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:57:40.119490 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8161): Process ended prematurely: osmo-stp_10.42.42.5(pid=8161) [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8161)] [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 06:57:40.128383 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 06:57:40.155423 run osmo-hlr_10.42.42.2(pid=8158): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8158)] 06:57:40.204719 run osmo-hlr_10.42.42.2(pid=8158): stdout: | (launched: 2022-12-10_06:57:37.078629) 06:57:40.255188 run osmo-hlr_10.42.42.2(pid=8158): stderr: | [0;m[1;31m20221210065737282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210065737282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210065737282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210065737282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210065737282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210065737282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210065737321 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210065737331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065737331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065737331 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:57:40.325202 run osmo-msc_10.42.42.6(pid=8164): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8164)] 06:57:40.374056 run osmo-msc_10.42.42.6(pid=8164): stdout: | (launched: 2022-12-10_06:57:39.174028) 06:57:40.424291 run osmo-msc_10.42.42.6(pid=8164): stderr: | [0;m[38;5;43m20221210065739498 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210065739499 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7ccf682c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210065739499 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210065739499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210065739499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210065739499 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210065739502 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210065739503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065739503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065739503 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:57:40.475032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8157): Terminating (SIGTERM) 06:57:40.515326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8160): Terminating (SIGTERM) 06:57:40.555757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8163): Terminating (SIGTERM) 06:57:40.596395 --- ParallelTerminationStrategy: PID 8157 died... 06:57:40.615603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8157): Terminated: ok {rc=0} 06:57:40.660815 --- ParallelTerminationStrategy: PID 8160 died... 06:57:40.679602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8160): Terminated: ok {rc=0} 06:57:40.724404 --- ParallelTerminationStrategy: PID 8163 died... 06:57:40.743285 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8163): Terminated: ok {rc=0} 06:57:40.828673 bus /sierra_3: Setting Powered False 06:57:41.926678 bus /sierra_3: Setting Powered False 06:57:43.044002 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 06:57:44.191918 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:57:44.203604 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 06:57:44.261654 tst mo_mt_call_osmux.py: using LAC 26642 06:57:44.398826 tst mo_mt_call_osmux.py: using RAC 122 06:57:44.527276 tst mo_mt_call_osmux.py: using CellId 26642 06:57:44.649347 tst mo_mt_call_osmux.py: using BVCI 26643 06:57:44.762926 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:57:44.774281 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:57:44.785500 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:57:44.797243 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:57:44.809164 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 06:57:44.820759 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:57:44.944642 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 06:57:45.063773 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:57:45.548057 run create_hlr_db(pid=8166): Launched 06:57:45.667630 bus /sierra_2: Setting Powered False 06:57:46.727608 run create_hlr_db(pid=8166): Terminated: ok {rc=0} 06:57:47.238679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8168): Launched 06:57:47.582432 run osmo-hlr_10.42.42.2(pid=8169): Launched 06:57:47.711644 run osmo-stp_10.42.42.5: Starting osmo-stp 06:57:48.286972 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8171): Launched 06:57:48.620247 run osmo-stp_10.42.42.5(pid=8172): Launched 06:57:48.748338 run osmo-msc_10.42.42.6: Starting osmo-msc 06:57:49.350908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8174): Launched 06:57:49.684614 run osmo-msc_10.42.42.6(pid=8175): Launched 06:57:49.869381 run osmo-stp_10.42.42.5(pid=8172): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8172)] 06:57:50.008526 run osmo-stp_10.42.42.5(pid=8172): stdout: | (launched: 2022-12-10_06:57:48.558388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:57:50.149134 run osmo-stp_10.42.42.5(pid=8172): stderr: | [0;m[38;5;43m20221210065748754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065748755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065748755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065748755 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065748756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065748756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065748756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:57:50.287996 run osmo-stp_10.42.42.5(pid=8172): stdout: | (launched: 2022-12-10_06:57:48.558388) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:57:50.419682 run osmo-stp_10.42.42.5(pid=8172): stderr: | [0;m[38;5;43m20221210065748754 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065748755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065748755 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065748755 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065748756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065748756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065748756 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:57:50.577784 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8172): Process ended prematurely: osmo-stp_10.42.42.5(pid=8172) [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8172)] [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 06:57:50.587285 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 06:57:50.615043 run osmo-hlr_10.42.42.2(pid=8169): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8169)] 06:57:50.665602 run osmo-hlr_10.42.42.2(pid=8169): stdout: | (launched: 2022-12-10_06:57:47.520395) 06:57:50.717840 run osmo-hlr_10.42.42.2(pid=8169): stderr: | [0;m[1;31m20221210065747724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210065747724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210065747724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210065747724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210065747724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210065747724 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210065747739 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210065747747 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065747748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065747748 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:57:50.790648 run osmo-msc_10.42.42.6(pid=8175): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8175)] 06:57:50.841126 run osmo-msc_10.42.42.6(pid=8175): stdout: | (launched: 2022-12-10_06:57:49.622840) 06:57:50.893218 run osmo-msc_10.42.42.6(pid=8175): stderr: | [0;m[38;5;43m20221210065749948 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210065749948 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f85890edc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210065749949 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210065749949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210065749949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210065749949 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210065749951 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210065749951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065749951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065749951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:57:50.946029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8168): Terminating (SIGTERM) 06:57:50.988100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8171): Terminating (SIGTERM) 06:57:51.030444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8174): Terminating (SIGTERM) 06:57:51.072488 --- ParallelTerminationStrategy: PID 8168 died... 06:57:51.092686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8168): Terminated: ok {rc=0} 06:57:51.139773 --- ParallelTerminationStrategy: PID 8171 died... 06:57:51.159654 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8171): Terminated: ok {rc=0} 06:57:51.206272 --- ParallelTerminationStrategy: PID 8174 died... 06:57:51.226043 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8174): Terminated: ok {rc=0} 06:57:51.315259 bus /sierra_3: Setting Powered False 06:57:52.413615 bus /sierra_3: Setting Powered False 06:57:53.530813 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 06:57:54.770429 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:57:54.777769 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 06:57:54.799298 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 06:57:54.826818 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 06:57:54.882132 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 06:57:54.904090 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 06:57:54.931232 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 06:57:55.480795 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 06:57:55.533998 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:57:55.545678 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:57:55.603731 tst mo_mt_call.py: using LAC 26643 06:57:55.733315 tst mo_mt_call.py: using RAC 123 06:57:55.864049 tst mo_mt_call.py: using CellId 26643 06:57:55.993743 tst mo_mt_call.py: using BVCI 26644 06:57:56.115373 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:57:56.127071 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:57:56.138368 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:57:56.149773 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:57:56.161093 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:57:56.172453 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:57:56.291747 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:57:56.413141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:57:56.929514 run create_hlr_db(pid=8180): Launched 06:57:57.065416 bus /sierra_2: Setting Powered False 06:57:58.131507 run create_hlr_db(pid=8180): Terminated: ok {rc=0} 06:57:58.574261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8182): Launched 06:57:58.887394 run osmo-hlr_10.42.42.2(pid=8183): Launched 06:57:59.005754 run osmo-stp_10.42.42.5: Starting osmo-stp 06:57:59.541835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8185): Launched 06:57:59.854828 run osmo-stp_10.42.42.5(pid=8186): Launched 06:57:59.974967 run osmo-msc_10.42.42.6: Starting osmo-msc 06:58:00.535155 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8188): Launched 06:58:00.861739 run osmo-msc_10.42.42.6(pid=8189): Launched 06:58:01.251248 run osmo-stp_10.42.42.5(pid=8186): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8186)] 06:58:01.603343 run osmo-stp_10.42.42.5(pid=8186): stdout: | (launched: 2022-12-10_06:57:59.796213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:01.748458 run osmo-stp_10.42.42.5(pid=8186): stderr: | [0;m[38;5;43m20221210065759968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065759968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065759968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065759969 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065759971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065759971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065759971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:01.880201 run osmo-stp_10.42.42.5(pid=8186): stdout: | (launched: 2022-12-10_06:57:59.796213) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:02.006490 run osmo-stp_10.42.42.5(pid=8186): stderr: | [0;m[38;5;43m20221210065759968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065759968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065759968 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065759969 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065759971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065759971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065759971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:02.157460 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8186): Process ended prematurely: osmo-stp_10.42.42.5(pid=8186) [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8186)] [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 06:58:02.166995 tst mo_mt_call.py:8: Test FAILED (6.7 sec) 06:58:02.195208 run osmo-hlr_10.42.42.2(pid=8183): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8183)] 06:58:02.245118 run osmo-hlr_10.42.42.2(pid=8183): stdout: | (launched: 2022-12-10_06:57:58.829272) 06:58:02.296428 run osmo-hlr_10.42.42.2(pid=8183): stderr: | [0;m[1;31m20221210065759007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210065759007 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210065759008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210065759008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210065759008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210065759008 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210065759024 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210065759034 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065759035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065759035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:58:02.368062 run osmo-msc_10.42.42.6(pid=8189): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8189)] 06:58:02.417061 run osmo-msc_10.42.42.6(pid=8189): stdout: | (launched: 2022-12-10_06:58:00.790388) 06:58:02.467517 run osmo-msc_10.42.42.6(pid=8189): stderr: | [0;m[38;5;43m20221210065801307 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210065801307 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f62eaac6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210065801307 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210065801309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210065801309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210065801309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210065801313 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210065801314 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065801315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065801315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:58:02.518293 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8182): Terminating (SIGTERM) 06:58:02.558935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8185): Terminating (SIGTERM) 06:58:02.599612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8188): Terminating (SIGTERM) 06:58:02.640313 --- ParallelTerminationStrategy: PID 8182 died... 06:58:02.659801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8182): Terminated: ok {rc=0} 06:58:02.705591 --- ParallelTerminationStrategy: PID 8185 died... 06:58:02.724517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8185): Terminated: ok {rc=0} 06:58:02.769663 --- ParallelTerminationStrategy: PID 8188 died... 06:58:02.788626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8188): Terminated: ok {rc=0} 06:58:02.876555 bus /sierra_3: Setting Powered False 06:58:03.977950 bus /sierra_3: Setting Powered False 06:58:05.096057 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 06:58:06.246574 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:58:06.258358 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 06:58:06.315083 tst mo_mt_call_osmux.py: using LAC 26644 06:58:06.441690 tst mo_mt_call_osmux.py: using RAC 124 06:58:06.571810 tst mo_mt_call_osmux.py: using CellId 26644 06:58:06.700431 tst mo_mt_call_osmux.py: using BVCI 26645 06:58:06.823017 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:58:06.834799 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:58:06.846366 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:58:06.857778 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:58:06.869108 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 06:58:06.880510 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:58:06.997745 tst voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 06:58:07.119336 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:58:07.636535 run create_hlr_db(pid=8191): Launched 06:58:07.771917 bus /sierra_2: Setting Powered False 06:58:08.838000 run create_hlr_db(pid=8191): Terminated: ok {rc=0} 06:58:09.281854 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8193): Launched 06:58:09.595990 run osmo-hlr_10.42.42.2(pid=8194): Launched 06:58:09.713931 run osmo-stp_10.42.42.5: Starting osmo-stp 06:58:10.265307 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8196): Launched 06:58:10.577336 run osmo-stp_10.42.42.5(pid=8197): Launched 06:58:10.695181 run osmo-msc_10.42.42.6: Starting osmo-msc 06:58:11.257225 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8199): Launched 06:58:11.569436 run osmo-msc_10.42.42.6(pid=8200): Launched 06:58:11.742825 run osmo-stp_10.42.42.5(pid=8197): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8197)] 06:58:11.874992 run osmo-stp_10.42.42.5(pid=8197): stdout: | (launched: 2022-12-10_06:58:10.518809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:12.006382 run osmo-stp_10.42.42.5(pid=8197): stderr: | [0;m[38;5;43m20221210065810694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065810694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065810695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065810695 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065810696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065810696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065810696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:12.135828 run osmo-stp_10.42.42.5(pid=8197): stdout: | (launched: 2022-12-10_06:58:10.518809) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:12.259057 run osmo-stp_10.42.42.5(pid=8197): stderr: | [0;m[38;5;43m20221210065810694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065810694 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065810695 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065810695 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065810696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065810696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065810696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:12.406850 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8197): Process ended prematurely: osmo-stp_10.42.42.5(pid=8197) [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8197)] [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 06:58:12.415757 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 06:58:12.442745 run osmo-hlr_10.42.42.2(pid=8194): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8194)] 06:58:12.491224 run osmo-hlr_10.42.42.2(pid=8194): stdout: | (launched: 2022-12-10_06:58:09.537720) 06:58:12.541865 run osmo-hlr_10.42.42.2(pid=8194): stderr: | [0;m[1;31m20221210065809716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210065809716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210065809716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210065809716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210065809716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210065809716 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210065809728 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210065809736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065809737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065809737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:58:12.612416 run osmo-msc_10.42.42.6(pid=8200): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8200)] 06:58:12.661052 run osmo-msc_10.42.42.6(pid=8200): stdout: | (launched: 2022-12-10_06:58:11.510947) 06:58:12.711357 run osmo-msc_10.42.42.6(pid=8200): stderr: | [0;m[38;5;43m20221210065811787 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210065811787 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8aef8bac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210065811787 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210065811787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210065811788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210065811788 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210065811790 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210065811790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065811790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065811790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:58:12.761802 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8193): Terminating (SIGTERM) 06:58:12.801995 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8196): Terminating (SIGTERM) 06:58:12.843100 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8199): Terminating (SIGTERM) 06:58:12.883717 --- ParallelTerminationStrategy: PID 8193 died... 06:58:12.903108 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8193): Terminated: ok {rc=0} 06:58:12.948298 --- ParallelTerminationStrategy: PID 8196 died... 06:58:12.967285 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8196): Terminated: ok {rc=0} 06:58:13.012298 --- ParallelTerminationStrategy: PID 8199 died... 06:58:13.031220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8199): Terminated: ok {rc=0} 06:58:13.119246 bus /sierra_3: Setting Powered False 06:58:14.220916 bus /sierra_3: Setting Powered False 06:58:15.338048 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 06:58:16.613028 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:58:16.620012 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 06:58:16.642889 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 06:58:16.672436 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 06:58:16.726173 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 06:58:16.753720 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 06:58:16.791130 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 06:58:17.324545 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 06:58:17.377626 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:58:17.389213 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:58:17.447178 tst mo_mt_call.py: using LAC 26645 06:58:17.578828 tst mo_mt_call.py: using RAC 125 06:58:17.709847 tst mo_mt_call.py: using CellId 26645 06:58:17.838796 tst mo_mt_call.py: using BVCI 26646 06:58:17.961634 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:58:17.973351 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:58:17.984713 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:58:17.996264 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:58:18.007785 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:58:18.019126 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:58:18.140379 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:58:18.260237 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:58:18.742069 run create_hlr_db(pid=8205): Launched 06:58:18.862399 bus /sierra_2: Setting Powered False 06:58:19.928293 run create_hlr_db(pid=8205): Terminated: ok {rc=0} 06:58:20.372322 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8207): Launched 06:58:20.685221 run osmo-hlr_10.42.42.2(pid=8208): Launched 06:58:20.804197 run osmo-stp_10.42.42.5: Starting osmo-stp 06:58:21.351365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8210): Launched 06:58:21.662771 run osmo-stp_10.42.42.5(pid=8211): Launched 06:58:21.783120 run osmo-msc_10.42.42.6: Starting osmo-msc 06:58:22.342725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8213): Launched 06:58:22.654809 run osmo-msc_10.42.42.6(pid=8214): Launched 06:58:22.829872 run osmo-stp_10.42.42.5(pid=8211): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8211)] 06:58:22.960835 run osmo-stp_10.42.42.5(pid=8211): stdout: | (launched: 2022-12-10_06:58:21.604876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:23.091555 run osmo-stp_10.42.42.5(pid=8211): stderr: | [0;m[38;5;43m20221210065821778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065821778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065821778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065821779 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065821779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065821779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065821779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:23.220285 run osmo-stp_10.42.42.5(pid=8211): stdout: | (launched: 2022-12-10_06:58:21.604876) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:23.343362 run osmo-stp_10.42.42.5(pid=8211): stderr: | [0;m[38;5;43m20221210065821778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065821778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065821778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065821779 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065821779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065821779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065821779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:23.491113 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8211): Process ended prematurely: osmo-stp_10.42.42.5(pid=8211) [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8211)] [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 06:58:23.499854 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:58:23.526787 run osmo-hlr_10.42.42.2(pid=8208): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8208)] 06:58:23.575088 run osmo-hlr_10.42.42.2(pid=8208): stdout: | (launched: 2022-12-10_06:58:20.627123) 06:58:23.625605 run osmo-hlr_10.42.42.2(pid=8208): stderr: | [0;m[1;31m20221210065820805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210065820805 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210065820806 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210065820806 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210065820806 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210065820806 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210065820818 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210065820828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065820829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065820829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:58:23.695352 run osmo-msc_10.42.42.6(pid=8214): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8214)] 06:58:23.743565 run osmo-msc_10.42.42.6(pid=8214): stdout: | (launched: 2022-12-10_06:58:22.596707) 06:58:23.793634 run osmo-msc_10.42.42.6(pid=8214): stderr: | [0;m[38;5;43m20221210065822872 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210065822872 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3c4c758c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210065822872 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210065822872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210065822872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210065822872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210065822874 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210065822875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065822875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065822875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:58:23.844278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8207): Terminating (SIGTERM) 06:58:23.884251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8210): Terminating (SIGTERM) 06:58:23.924186 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8213): Terminating (SIGTERM) 06:58:23.964647 --- ParallelTerminationStrategy: PID 8207 died... 06:58:23.983976 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8207): Terminated: ok {rc=0} 06:58:24.029410 --- ParallelTerminationStrategy: PID 8210 died... 06:58:24.048129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8210): Terminated: ok {rc=0} 06:58:24.093324 --- ParallelTerminationStrategy: PID 8213 died... 06:58:24.112061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8213): Terminated: ok {rc=0} 06:58:24.200015 bus /sierra_3: Setting Powered False 06:58:25.299693 bus /sierra_3: Setting Powered False 06:58:26.416594 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 06:58:27.565634 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:58:27.577242 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 06:58:27.634323 tst mo_mt_call_osmux.py: using LAC 26646 06:58:27.755451 tst mo_mt_call_osmux.py: using RAC 126 06:58:27.887805 tst mo_mt_call_osmux.py: using CellId 26646 06:58:28.018451 tst mo_mt_call_osmux.py: using BVCI 26647 06:58:28.141965 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:58:28.153807 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:58:28.165401 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:58:28.177142 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:58:28.188781 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 06:58:28.200445 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:58:28.317689 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 06:58:28.435504 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:58:28.920154 run create_hlr_db(pid=8217): Launched 06:58:29.040690 bus /sierra_2: Setting Powered False 06:58:30.103103 run create_hlr_db(pid=8217): Terminated: ok {rc=0} 06:58:30.537703 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8219): Launched 06:58:30.867437 run osmo-hlr_10.42.42.2(pid=8220): Launched 06:58:31.139306 run osmo-stp_10.42.42.5: Starting osmo-stp 06:58:31.828710 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8222): Launched 06:58:32.162743 run osmo-stp_10.42.42.5(pid=8223): Launched 06:58:32.378615 run osmo-msc_10.42.42.6: Starting osmo-msc 06:58:32.989103 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8225): Launched 06:58:33.323871 run osmo-msc_10.42.42.6(pid=8226): Launched 06:58:33.511356 run osmo-stp_10.42.42.5(pid=8223): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8223)] 06:58:33.651488 run osmo-stp_10.42.42.5(pid=8223): stdout: | (launched: 2022-12-10_06:58:32.103246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:33.791763 run osmo-stp_10.42.42.5(pid=8223): stderr: | [0;m[38;5;43m20221210065832376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065832377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065832377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065832377 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065832378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065832378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065832378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:33.931064 run osmo-stp_10.42.42.5(pid=8223): stdout: | (launched: 2022-12-10_06:58:32.103246) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:34.063707 run osmo-stp_10.42.42.5(pid=8223): stderr: | [0;m[38;5;43m20221210065832376 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065832377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065832377 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065832377 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065832378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065832378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065832378 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:34.222848 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8223): Process ended prematurely: osmo-stp_10.42.42.5(pid=8223) [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8223)] [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 06:58:34.232623 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 06:58:34.261865 run osmo-hlr_10.42.42.2(pid=8220): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8220)] 06:58:34.313208 run osmo-hlr_10.42.42.2(pid=8220): stdout: | (launched: 2022-12-10_06:58:30.792869) 06:58:34.366170 run osmo-hlr_10.42.42.2(pid=8220): stderr: | [0;m[1;31m20221210065831186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210065831187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210065831187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210065831187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210065831187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210065831187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210065831213 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210065831236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065831236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065831236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:58:34.439462 run osmo-msc_10.42.42.6(pid=8226): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8226)] 06:58:34.490616 run osmo-msc_10.42.42.6(pid=8226): stdout: | (launched: 2022-12-10_06:58:33.262205) 06:58:34.543678 run osmo-msc_10.42.42.6(pid=8226): stderr: | [0;m[38;5;43m20221210065833585 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210065833585 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc98c51ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210065833585 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210065833585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210065833585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210065833585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210065833587 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210065833587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065833587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065833587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:58:34.596662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8219): Terminating (SIGTERM) 06:58:34.639345 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8222): Terminating (SIGTERM) 06:58:34.682304 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8225): Terminating (SIGTERM) 06:58:34.725305 --- ParallelTerminationStrategy: PID 8219 died... 06:58:34.745553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8219): Terminated: ok {rc=0} 06:58:34.792596 --- ParallelTerminationStrategy: PID 8222 died... 06:58:34.812559 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8222): Terminated: ok {rc=0} 06:58:34.859188 --- ParallelTerminationStrategy: PID 8225 died... 06:58:34.878960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8225): Terminated: ok {rc=0} 06:58:34.968032 bus /sierra_3: Setting Powered False 06:58:36.069043 bus /sierra_3: Setting Powered False 06:58:37.186612 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 06:58:38.425183 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:58:38.432265 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 06:58:38.454272 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 06:58:38.481500 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 06:58:38.535914 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 06:58:38.557528 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 06:58:38.584607 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 06:58:39.132117 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 06:58:39.186453 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:58:39.198152 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:58:39.255540 tst mo_mt_call.py: using LAC 26647 06:58:39.387100 tst mo_mt_call.py: using RAC 127 06:58:39.518526 tst mo_mt_call.py: using CellId 26647 06:58:39.647953 tst mo_mt_call.py: using BVCI 26648 06:58:39.768127 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:58:39.779794 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:58:39.791149 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:58:39.802912 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:58:39.814326 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:58:39.825839 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:58:39.945631 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:58:40.065289 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:58:40.549258 run create_hlr_db(pid=8231): Launched 06:58:40.668885 bus /sierra_2: Setting Powered False 06:58:41.730654 run create_hlr_db(pid=8231): Terminated: ok {rc=0} 06:58:42.187115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8233): Launched 06:58:42.522189 run osmo-hlr_10.42.42.2(pid=8234): Launched 06:58:42.651346 run osmo-stp_10.42.42.5: Starting osmo-stp 06:58:43.228699 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8236): Launched 06:58:43.563234 run osmo-stp_10.42.42.5(pid=8237): Launched 06:58:43.691198 run osmo-msc_10.42.42.6: Starting osmo-msc 06:58:44.292099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8239): Launched 06:58:44.627836 run osmo-msc_10.42.42.6(pid=8240): Launched 06:58:44.814344 run osmo-stp_10.42.42.5(pid=8237): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8237)] 06:58:44.954173 run osmo-stp_10.42.42.5(pid=8237): stdout: | (launched: 2022-12-10_06:58:43.501392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:45.095590 run osmo-stp_10.42.42.5(pid=8237): stderr: | [0;m[38;5;43m20221210065843698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065843698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065843698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065843698 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065843699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065843699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065843699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:45.235103 run osmo-stp_10.42.42.5(pid=8237): stdout: | (launched: 2022-12-10_06:58:43.501392) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:45.367589 run osmo-stp_10.42.42.5(pid=8237): stderr: | [0;m[38;5;43m20221210065843698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065843698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065843698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065843698 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065843699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065843699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065843699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:45.526059 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8237): Process ended prematurely: osmo-stp_10.42.42.5(pid=8237) [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8237)] [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 06:58:45.535664 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 06:58:45.563808 run osmo-hlr_10.42.42.2(pid=8234): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8234)] 06:58:45.615007 run osmo-hlr_10.42.42.2(pid=8234): stdout: | (launched: 2022-12-10_06:58:42.460022) 06:58:45.667691 run osmo-hlr_10.42.42.2(pid=8234): stderr: | [0;m[1;31m20221210065842663 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210065842664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210065842664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210065842664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210065842664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210065842664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210065842675 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210065842687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065842687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065842687 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:58:45.740730 run osmo-msc_10.42.42.6(pid=8240): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8240)] 06:58:45.791642 run osmo-msc_10.42.42.6(pid=8240): stdout: | (launched: 2022-12-10_06:58:44.565867) 06:58:45.844148 run osmo-msc_10.42.42.6(pid=8240): stderr: | [0;m[38;5;43m20221210065844894 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210065844894 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f90f831ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210065844894 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210065844894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210065844894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210065844894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210065844896 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210065844896 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065844897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065844897 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:58:45.912382 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8233): Terminating (SIGTERM) 06:58:45.964509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8236): Terminating (SIGTERM) 06:58:46.009122 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8239): Terminating (SIGTERM) 06:58:46.055617 --- ParallelTerminationStrategy: PID 8233 died... 06:58:46.076926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8233): Terminated: ok {rc=0} 06:58:46.126706 --- ParallelTerminationStrategy: PID 8236 died... 06:58:46.147696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8236): Terminated: ok {rc=0} 06:58:46.195964 --- ParallelTerminationStrategy: PID 8239 died... 06:58:46.217249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8239): Terminated: ok {rc=0} 06:58:46.307828 bus /sierra_3: Setting Powered False 06:58:47.409412 bus /sierra_3: Setting Powered False 06:58:48.528229 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 06:58:49.676857 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:58:49.688915 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 06:58:49.745960 tst mo_mt_call_osmux.py: using LAC 26648 06:58:49.869364 tst mo_mt_call_osmux.py: using RAC 128 06:58:49.991953 tst mo_mt_call_osmux.py: using CellId 26648 06:58:50.114690 tst mo_mt_call_osmux.py: using BVCI 26649 06:58:50.229505 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:58:50.240615 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:58:50.251614 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:58:50.263077 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:58:50.274360 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 06:58:50.285735 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:58:50.403964 tst voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 06:58:50.524429 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:58:51.005269 run create_hlr_db(pid=8242): Launched 06:58:51.124635 bus /sierra_2: Setting Powered False 06:58:52.186507 run create_hlr_db(pid=8242): Terminated: ok {rc=0} 06:58:52.619341 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8244): Launched 06:58:52.930773 run osmo-hlr_10.42.42.2(pid=8245): Launched 06:58:53.050518 run osmo-stp_10.42.42.5: Starting osmo-stp 06:58:53.595283 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8247): Launched 06:58:53.906827 run osmo-stp_10.42.42.5(pid=8248): Launched 06:58:54.027089 run osmo-msc_10.42.42.6: Starting osmo-msc 06:58:54.602811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8250): Launched 06:58:54.915765 run osmo-msc_10.42.42.6(pid=8251): Launched 06:58:55.090726 run osmo-stp_10.42.42.5(pid=8248): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8248)] 06:58:55.222407 run osmo-stp_10.42.42.5(pid=8248): stdout: | (launched: 2022-12-10_06:58:53.848422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:55.353320 run osmo-stp_10.42.42.5(pid=8248): stderr: | [0;m[38;5;43m20221210065854022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065854022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065854022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065854023 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065854023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065854023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065854023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:55.482498 run osmo-stp_10.42.42.5(pid=8248): stdout: | (launched: 2022-12-10_06:58:53.848422) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:58:55.605790 run osmo-stp_10.42.42.5(pid=8248): stderr: | [0;m[38;5;43m20221210065854022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065854022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065854022 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065854023 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065854023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065854023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065854023 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:58:55.753510 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8248): Process ended prematurely: osmo-stp_10.42.42.5(pid=8248) [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8248)] [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 06:58:55.762453 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 06:58:55.789147 run osmo-hlr_10.42.42.2(pid=8245): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8245)] 06:58:55.838349 run osmo-hlr_10.42.42.2(pid=8245): stdout: | (launched: 2022-12-10_06:58:52.872672) 06:58:55.888555 run osmo-hlr_10.42.42.2(pid=8245): stderr: | [0;m[1;31m20221210065853050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210065853050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210065853050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210065853050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210065853050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210065853050 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210065853062 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210065853073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065853073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065853073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:58:55.958435 run osmo-msc_10.42.42.6(pid=8251): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8251)] 06:58:56.006938 run osmo-msc_10.42.42.6(pid=8251): stdout: | (launched: 2022-12-10_06:58:54.857645) 06:58:56.056781 run osmo-msc_10.42.42.6(pid=8251): stderr: | [0;m[38;5;43m20221210065855134 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210065855135 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe0229b9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210065855135 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210065855135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210065855135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210065855135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210065855137 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210065855137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065855137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065855138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:58:56.107257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8244): Terminating (SIGTERM) 06:58:56.147486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8247): Terminating (SIGTERM) 06:58:56.188178 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8250): Terminating (SIGTERM) 06:58:56.228864 --- ParallelTerminationStrategy: PID 8244 died... 06:58:56.248283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8244): Terminated: ok {rc=0} 06:58:56.293748 --- ParallelTerminationStrategy: PID 8247 died... 06:58:56.312744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8247): Terminated: ok {rc=0} 06:58:56.357791 --- ParallelTerminationStrategy: PID 8250 died... 06:58:56.376618 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8250): Terminated: ok {rc=0} 06:58:56.464483 bus /sierra_3: Setting Powered False 06:58:57.565089 bus /sierra_3: Setting Powered False 06:58:58.682471 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 06:58:59.920614 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:58:59.927220 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 06:58:59.948720 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 06:58:59.975709 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 06:59:00.027354 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 06:59:00.048044 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 06:59:00.074867 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 06:59:00.627433 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 06:59:00.677822 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:59:00.689146 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:59:00.745621 tst mo_mt_call.py: using LAC 26649 06:59:00.897729 tst mo_mt_call.py: using RAC 129 06:59:01.032804 tst mo_mt_call.py: using CellId 26649 06:59:01.157417 tst mo_mt_call.py: using BVCI 26650 06:59:01.314522 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:59:01.330234 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:59:01.344517 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:59:01.358995 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:59:01.371089 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:59:01.383454 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:59:01.523144 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:59:01.668600 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:59:02.231675 run create_hlr_db(pid=8256): Launched 06:59:02.359484 bus /sierra_2: Setting Powered False 06:59:03.420686 run create_hlr_db(pid=8256): Terminated: ok {rc=0} 06:59:03.883898 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8270): Launched 06:59:04.219059 run osmo-hlr_10.42.42.2(pid=8271): Launched 06:59:04.347593 run osmo-stp_10.42.42.5: Starting osmo-stp 06:59:04.920167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8273): Launched 06:59:05.255816 run osmo-stp_10.42.42.5(pid=8274): Launched 06:59:05.384447 run osmo-msc_10.42.42.6: Starting osmo-msc 06:59:05.985442 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8276): Launched 06:59:06.318818 run osmo-msc_10.42.42.6(pid=8277): Launched 06:59:06.503903 run osmo-stp_10.42.42.5(pid=8274): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8274)] 06:59:06.644589 run osmo-stp_10.42.42.5(pid=8274): stdout: | (launched: 2022-12-10_06:59:05.193825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:06.784839 run osmo-stp_10.42.42.5(pid=8274): stderr: | [0;m[38;5;43m20221210065905388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065905388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065905388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065905388 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065905392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065905392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065905392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:06.924129 run osmo-stp_10.42.42.5(pid=8274): stdout: | (launched: 2022-12-10_06:59:05.193825) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:07.056596 run osmo-stp_10.42.42.5(pid=8274): stderr: | [0;m[38;5;43m20221210065905388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065905388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065905388 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065905388 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065905392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065905392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065905392 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:07.214806 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8274): Process ended prematurely: osmo-stp_10.42.42.5(pid=8274) [trial-2371↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8274)] [trial-2371↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 06:59:07.224199 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 06:59:07.251949 run osmo-hlr_10.42.42.2(pid=8271): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8271)] 06:59:07.302431 run osmo-hlr_10.42.42.2(pid=8271): stdout: | (launched: 2022-12-10_06:59:04.157679) 06:59:07.354948 run osmo-hlr_10.42.42.2(pid=8271): stderr: | [0;m[1;31m20221210065904359 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210065904360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210065904360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210065904360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210065904360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210065904360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210065904372 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210065904381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065904381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065904381 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:59:07.427862 run osmo-msc_10.42.42.6(pid=8277): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8277)] 06:59:07.478617 run osmo-msc_10.42.42.6(pid=8277): stdout: | (launched: 2022-12-10_06:59:06.256863) 06:59:07.531373 run osmo-msc_10.42.42.6(pid=8277): stderr: | [0;m[38;5;43m20221210065906582 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210065906582 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f10afbe1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210065906582 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210065906582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210065906582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210065906582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210065906584 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210065906584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065906584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065906585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:59:07.583872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8270): Terminating (SIGTERM) 06:59:07.626113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8273): Terminating (SIGTERM) 06:59:07.668121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8276): Terminating (SIGTERM) 06:59:07.710435 --- ParallelTerminationStrategy: PID 8270 died... 06:59:07.730597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8270): Terminated: ok {rc=0} 06:59:07.777095 --- ParallelTerminationStrategy: PID 8273 died... 06:59:07.796728 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8273): Terminated: ok {rc=0} 06:59:07.843131 --- ParallelTerminationStrategy: PID 8276 died... 06:59:07.862972 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8276): Terminated: ok {rc=0} 06:59:07.951973 bus /sierra_3: Setting Powered False 06:59:09.051734 bus /sierra_3: Setting Powered False 06:59:10.169989 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 06:59:11.322740 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:59:11.335317 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 06:59:11.393094 tst mo_mt_call_osmux.py: using LAC 26650 06:59:11.522145 tst mo_mt_call_osmux.py: using RAC 130 06:59:11.646009 tst mo_mt_call_osmux.py: using CellId 26650 06:59:11.768851 tst mo_mt_call_osmux.py: using BVCI 26651 06:59:11.895228 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:59:11.907308 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:59:11.919160 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:59:11.930900 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:59:11.942372 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 06:59:11.953849 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:59:12.072311 tst voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 06:59:12.190508 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:59:12.673435 run create_hlr_db(pid=8279): Launched 06:59:12.791162 bus /sierra_2: Setting Powered False 06:59:13.852020 run create_hlr_db(pid=8279): Terminated: ok {rc=0} 06:59:14.306009 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8281): Launched 06:59:14.640142 run osmo-hlr_10.42.42.2(pid=8282): Launched 06:59:14.769435 run osmo-stp_10.42.42.5: Starting osmo-stp 06:59:15.346367 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8284): Launched 06:59:15.681719 run osmo-stp_10.42.42.5(pid=8285): Launched 06:59:15.808361 run osmo-msc_10.42.42.6: Starting osmo-msc 06:59:16.524725 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8287): Launched 06:59:16.859448 run osmo-msc_10.42.42.6(pid=8288): Launched 06:59:17.264352 run osmo-stp_10.42.42.5(pid=8285): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8285)] 06:59:17.410739 run osmo-stp_10.42.42.5(pid=8285): stdout: | (launched: 2022-12-10_06:59:15.619632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:17.550957 run osmo-stp_10.42.42.5(pid=8285): stderr: | [0;m[38;5;43m20221210065915815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065915815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065915815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065915816 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065915818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065915818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065915818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:17.689856 run osmo-stp_10.42.42.5(pid=8285): stdout: | (launched: 2022-12-10_06:59:15.619632) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:17.822425 run osmo-stp_10.42.42.5(pid=8285): stderr: | [0;m[38;5;43m20221210065915815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065915815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065915815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065915816 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065915818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065915818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065915818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:17.981100 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8285): Process ended prematurely: osmo-stp_10.42.42.5(pid=8285) [trial-2371↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8285)] [trial-2371↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 06:59:17.991285 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 06:59:18.020389 run osmo-hlr_10.42.42.2(pid=8282): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8282)] 06:59:18.071723 run osmo-hlr_10.42.42.2(pid=8282): stdout: | (launched: 2022-12-10_06:59:14.578320) 06:59:18.124552 run osmo-hlr_10.42.42.2(pid=8282): stderr: | [0;m[1;31m20221210065914780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210065914780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210065914780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210065914780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210065914780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210065914780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210065914793 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210065914803 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065914804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065914804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:59:18.197966 run osmo-msc_10.42.42.6(pid=8288): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8288)] 06:59:18.249206 run osmo-msc_10.42.42.6(pid=8288): stdout: | (launched: 2022-12-10_06:59:16.799749) 06:59:18.301547 run osmo-msc_10.42.42.6(pid=8288): stderr: | [0;m[38;5;43m20221210065917272 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210065917272 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffadd44dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210065917272 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210065917273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210065917273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210065917273 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210065917275 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210065917275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065917275 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065917276 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:59:18.354458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8281): Terminating (SIGTERM) 06:59:18.396529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8284): Terminating (SIGTERM) 06:59:18.438710 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8287): Terminating (SIGTERM) 06:59:18.481599 --- ParallelTerminationStrategy: PID 8281 died... 06:59:18.501928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8281): Terminated: ok {rc=0} 06:59:18.548535 --- ParallelTerminationStrategy: PID 8284 died... 06:59:18.568336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8284): Terminated: ok {rc=0} 06:59:18.614933 --- ParallelTerminationStrategy: PID 8287 died... 06:59:18.634714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8287): Terminated: ok {rc=0} 06:59:18.723462 bus /sierra_3: Setting Powered False 06:59:19.824318 bus /sierra_3: Setting Powered False 06:59:20.944121 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 06:59:22.191588 tst voice:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:59:22.198906 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 06:59:22.220432 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 06:59:22.246969 tst voice:sysmo+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 06:59:22.298170 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 06:59:22.319868 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 06:59:22.347068 tst voice:sysmo+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 06:59:22.900091 tst voice:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 06:59:22.953263 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:59:22.964583 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:59:23.021969 tst mo_mt_call.py: using LAC 26651 06:59:23.151959 tst mo_mt_call.py: using RAC 131 06:59:23.286285 tst mo_mt_call.py: using CellId 26651 06:59:23.415426 tst mo_mt_call.py: using BVCI 26652 06:59:23.537320 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:59:23.548688 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:59:23.559997 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:59:23.571124 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:59:23.582309 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:59:23.593551 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:59:23.710175 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:59:23.833548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:59:24.351704 run create_hlr_db(pid=8293): Launched 06:59:24.486895 bus /sierra_2: Setting Powered False 06:59:25.551552 run create_hlr_db(pid=8293): Terminated: ok {rc=0} 06:59:25.996061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8295): Launched 06:59:26.307464 run osmo-hlr_10.42.42.2(pid=8296): Launched 06:59:26.427079 run osmo-stp_10.42.42.5: Starting osmo-stp 06:59:26.979707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8298): Launched 06:59:27.294075 run osmo-stp_10.42.42.5(pid=8299): Launched 06:59:27.414294 run osmo-msc_10.42.42.6: Starting osmo-msc 06:59:27.978641 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8301): Launched 06:59:28.292433 run osmo-msc_10.42.42.6(pid=8302): Launched 06:59:28.467781 run osmo-stp_10.42.42.5(pid=8299): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8299)] 06:59:28.599337 run osmo-stp_10.42.42.5(pid=8299): stdout: | (launched: 2022-12-10_06:59:27.235812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:28.730385 run osmo-stp_10.42.42.5(pid=8299): stderr: | [0;m[38;5;43m20221210065927411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065927411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065927411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065927412 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065927412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065927412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065927412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:28.859361 run osmo-stp_10.42.42.5(pid=8299): stdout: | (launched: 2022-12-10_06:59:27.235812) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:28.982786 run osmo-stp_10.42.42.5(pid=8299): stderr: | [0;m[38;5;43m20221210065927411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065927411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065927411 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065927412 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065927412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065927412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065927412 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:29.130568 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8299): Process ended prematurely: osmo-stp_10.42.42.5(pid=8299) [trial-2371↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8299)] [trial-2371↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 06:59:29.139478 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 06:59:29.166372 run osmo-hlr_10.42.42.2(pid=8296): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8296)] 06:59:29.215130 run osmo-hlr_10.42.42.2(pid=8296): stdout: | (launched: 2022-12-10_06:59:26.249678) 06:59:29.265874 run osmo-hlr_10.42.42.2(pid=8296): stderr: | [0;m[1;31m20221210065926426 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210065926427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210065926427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210065926427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210065926427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210065926427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210065926439 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210065926447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065926447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065926447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:59:29.335912 run osmo-msc_10.42.42.6(pid=8302): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8302)] 06:59:29.384666 run osmo-msc_10.42.42.6(pid=8302): stdout: | (launched: 2022-12-10_06:59:28.234301) 06:59:29.435130 run osmo-msc_10.42.42.6(pid=8302): stderr: | [0;m[38;5;43m20221210065928505 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210065928505 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbdfab99c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210065928505 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210065928506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210065928506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210065928506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210065928508 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210065928508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065928508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065928508 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:59:29.486222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8295): Terminating (SIGTERM) 06:59:29.526522 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8298): Terminating (SIGTERM) 06:59:29.566767 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8301): Terminating (SIGTERM) 06:59:29.607082 --- ParallelTerminationStrategy: PID 8295 died... 06:59:29.626409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8295): Terminated: ok {rc=0} 06:59:29.671627 --- ParallelTerminationStrategy: PID 8298 died... 06:59:29.690477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8298): Terminated: ok {rc=0} 06:59:29.735300 --- ParallelTerminationStrategy: PID 8301 died... 06:59:29.754156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8301): Terminated: ok {rc=0} 06:59:29.842139 bus /sierra_3: Setting Powered False 06:59:30.945338 bus /sierra_3: Setting Powered False 06:59:32.072882 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:sysmo+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 06:59:33.228196 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:59:33.240394 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 06:59:33.299770 tst mo_mt_call_osmux.py: using LAC 26652 06:59:33.429061 tst mo_mt_call_osmux.py: using RAC 132 06:59:33.560466 tst mo_mt_call_osmux.py: using CellId 26652 06:59:33.691792 tst mo_mt_call_osmux.py: using BVCI 26653 06:59:33.806200 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:59:33.817380 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:59:33.828228 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:59:33.839141 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:59:33.850085 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 06:59:33.861132 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:59:33.982548 tst voice:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 06:59:34.105363 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:59:34.621733 run create_hlr_db(pid=8304): Launched 06:59:34.757079 bus /sierra_2: Setting Powered False 06:59:35.822743 run create_hlr_db(pid=8304): Terminated: ok {rc=0} 06:59:36.267763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8306): Launched 06:59:36.580492 run osmo-hlr_10.42.42.2(pid=8307): Launched 06:59:36.699099 run osmo-stp_10.42.42.5: Starting osmo-stp 06:59:37.249268 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8309): Launched 06:59:37.561387 run osmo-stp_10.42.42.5(pid=8310): Launched 06:59:37.680674 run osmo-msc_10.42.42.6: Starting osmo-msc 06:59:38.243371 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8312): Launched 06:59:38.555705 run osmo-msc_10.42.42.6(pid=8313): Launched 06:59:38.732771 run osmo-stp_10.42.42.5(pid=8310): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8310)] 06:59:38.863825 run osmo-stp_10.42.42.5(pid=8310): stdout: | (launched: 2022-12-10_06:59:37.502780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:38.994771 run osmo-stp_10.42.42.5(pid=8310): stderr: | [0;m[38;5;43m20221210065937677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065937677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065937677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065937678 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065937678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065937678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065937678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:39.123612 run osmo-stp_10.42.42.5(pid=8310): stdout: | (launched: 2022-12-10_06:59:37.502780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:39.246932 run osmo-stp_10.42.42.5(pid=8310): stderr: | [0;m[38;5;43m20221210065937677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065937677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065937677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065937678 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065937678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065937678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065937678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:39.394406 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8310): Process ended prematurely: osmo-stp_10.42.42.5(pid=8310) [trial-2371↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8310)] [trial-2371↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 06:59:39.403561 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 06:59:39.430432 run osmo-hlr_10.42.42.2(pid=8307): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8307)] 06:59:39.478971 run osmo-hlr_10.42.42.2(pid=8307): stdout: | (launched: 2022-12-10_06:59:36.522343) 06:59:39.528650 run osmo-hlr_10.42.42.2(pid=8307): stderr: | [0;m[1;31m20221210065936701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210065936701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210065936701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210065936701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210065936701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210065936701 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210065936713 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:sysmo+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210065936721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065936722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065936723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:59:39.599053 run osmo-msc_10.42.42.6(pid=8313): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8313)] 06:59:39.647220 run osmo-msc_10.42.42.6(pid=8313): stdout: | (launched: 2022-12-10_06:59:38.497327) 06:59:39.697569 run osmo-msc_10.42.42.6(pid=8313): stderr: | [0;m[38;5;43m20221210065938771 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210065938771 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f65375fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210065938771 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210065938771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210065938771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210065938772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210065938773 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210065938774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065938774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065938774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:59:39.747800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8306): Terminating (SIGTERM) 06:59:39.787920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8309): Terminating (SIGTERM) 06:59:39.828503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8312): Terminating (SIGTERM) 06:59:39.869180 --- ParallelTerminationStrategy: PID 8306 died... 06:59:39.888489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8306): Terminated: ok {rc=0} 06:59:39.933625 --- ParallelTerminationStrategy: PID 8309 died... 06:59:39.952376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8309): Terminated: ok {rc=0} 06:59:39.997363 --- ParallelTerminationStrategy: PID 8312 died... 06:59:40.015974 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8312): Terminated: ok {rc=0} 06:59:40.103814 bus /sierra_3: Setting Powered False 06:59:41.204909 bus /sierra_3: Setting Powered False 06:59:42.319760 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 emergency:sysmo --------------------------------------------------------------------- 06:59:43.560530 tst emergency:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 06:59:43.565158 tst emergency:sysmo: Verifying 1 x bts (candidates: 11) 06:59:43.586651 tst emergency:sysmo: Verifying 6 x ip_address (candidates: 9) 06:59:43.614111 tst emergency:sysmo: Verifying 4 x modem (candidates: 12) 06:59:43.698821 tst emergency:sysmo: Reserving 1 x bts (candidates: 11) 06:59:43.720133 tst emergency:sysmo: Reserving 6 x ip_address (candidates: 9) 06:59:43.747315 tst emergency:sysmo: Reserving 4 x modem (candidates: 12) 06:59:44.330163 tst emergency:sysmo: RESERVED RESOURCES for emergency: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2371 emergency:sysmo emergency_mo_mt_call.py ---------------------------------------------- 06:59:44.335987 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 06:59:44.347070 tst emergency:sysmo: Using 1 x bts (candidates: 1) 06:59:44.384738 tst emergency_mo_mt_call.py: using LAC 26653 06:59:44.503530 tst emergency_mo_mt_call.py: using RAC 133 06:59:44.621388 tst emergency_mo_mt_call.py: using CellId 26653 06:59:44.741691 tst emergency_mo_mt_call.py: using BVCI 26654 06:59:44.853634 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 06:59:44.864210 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 06:59:44.874863 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 06:59:44.885714 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 06:59:44.896354 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 06:59:44.906981 tst emergency:sysmo: Using 1 x modem (candidates: 4) 06:59:45.027313 tst emergency:sysmo: Using 1 x modem (candidates: 4) 06:59:45.148353 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:59:45.623072 run create_hlr_db(pid=8318): Launched 06:59:45.740196 bus /sierra_2: Setting Powered False 06:59:46.799676 run create_hlr_db(pid=8318): Terminated: ok {rc=0} 06:59:47.237739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8320): Launched 06:59:47.556217 run osmo-hlr_10.42.42.2(pid=8321): Launched 06:59:47.675327 run osmo-stp_10.42.42.5: Starting osmo-stp 06:59:48.213733 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8323): Launched 06:59:48.519751 run osmo-stp_10.42.42.5(pid=8324): Launched 06:59:48.646910 tst emergency_mo_mt_call.py: using MSISDN 7607 06:59:48.802816 run osmo-msc_10.42.42.6: Starting osmo-msc 06:59:49.350479 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8326): Launched 06:59:49.657434 run osmo-msc_10.42.42.6(pid=8327): Launched 06:59:49.830292 run osmo-stp_10.42.42.5(pid=8324): ERR: Terminated: ERROR {rc=1} [trial-2371↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8324)] 06:59:49.959542 run osmo-stp_10.42.42.5(pid=8324): stdout: | (launched: 2022-12-10_06:59:48.462200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:50.088471 run osmo-stp_10.42.42.5(pid=8324): stderr: | [0;m[38;5;43m20221210065948635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065948635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065948636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065948636 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065948636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065948637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065948637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:50.215031 run osmo-stp_10.42.42.5(pid=8324): stdout: | (launched: 2022-12-10_06:59:48.462200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 06:59:50.335809 run osmo-stp_10.42.42.5(pid=8324): stderr: | [0;m[38;5;43m20221210065948635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065948635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065948636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065948636 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065948636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065948637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065948637 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 06:59:50.480412 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=8324): Process ended prematurely: osmo-stp_10.42.42.5(pid=8324) [trial-2371↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8324)] [trial-2371↪emergency:sysmo↪emergency_mo_mt_call.py:19] 06:59:50.488744 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 06:59:50.515326 run osmo-hlr_10.42.42.2(pid=8321): ERR: Terminated: ERROR {rc=237} [trial-2371↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8321)] 06:59:50.564340 run osmo-hlr_10.42.42.2(pid=8321): stdout: | (launched: 2022-12-10_06:59:47.498380) 06:59:50.614716 run osmo-hlr_10.42.42.2(pid=8321): stderr: | [0;m[1;31m20221210065947675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210065947675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210065947675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210065947675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210065947675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210065947676 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210065947689 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/emergency:sysmo/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210065947698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065947698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065947698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 06:59:50.684846 run osmo-msc_10.42.42.6(pid=8327): ERR: Terminated: ERROR {rc=2} [trial-2371↪emergency:sysmo↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8327)] 06:59:50.734060 run osmo-msc_10.42.42.6(pid=8327): stdout: | (launched: 2022-12-10_06:59:49.599675) 06:59:50.784459 run osmo-msc_10.42.42.6(pid=8327): stderr: | [0;m[38;5;43m20221210065949873 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210065949874 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa2ab009c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210065949874 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210065949874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210065949874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210065949874 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210065949876 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210065949876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210065949876 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210065949877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 06:59:50.835282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8320): Terminating (SIGTERM) 06:59:50.875746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8323): Terminating (SIGTERM) 06:59:50.916413 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8326): Terminating (SIGTERM) 06:59:50.957434 --- ParallelTerminationStrategy: PID 8320 died... 06:59:50.976749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8320): Terminated: ok {rc=0} 06:59:51.022594 --- ParallelTerminationStrategy: PID 8323 died... 06:59:51.041526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8323): Terminated: ok {rc=0} 06:59:51.086744 --- ParallelTerminationStrategy: PID 8326 died... 06:59:51.105648 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8326): Terminated: ok {rc=0} 06:59:51.193375 bus /sierra_3: Setting Powered False 06:59:52.295457 bus /sierra_3: Setting Powered False 06:59:53.413065 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 emergency:sysmo emergency_preemptive_call.py ---------------------------------------------- 06:59:54.501910 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 06:59:54.513984 tst emergency:sysmo: Using 1 x bts (candidates: 1) 06:59:54.551898 tst emergency_preemptive_call.py: using LAC 26654 06:59:54.673889 tst emergency_preemptive_call.py: using RAC 134 06:59:54.793651 tst emergency_preemptive_call.py: using CellId 26654 06:59:54.913395 tst emergency_preemptive_call.py: using BVCI 26655 06:59:55.024329 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 06:59:55.035030 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 06:59:55.045571 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 06:59:55.056308 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 06:59:55.067079 tst emergency:sysmo: Using 1 x ip_address (candidates: 6) 06:59:55.077569 tst emergency:sysmo: Using 1 x modem (candidates: 4) 06:59:55.196220 tst emergency:sysmo: Using 1 x modem (candidates: 4) 06:59:55.318723 tst emergency:sysmo: Using 1 x modem (candidates: 4) 06:59:55.434864 tst emergency:sysmo: Using 1 x modem (candidates: 4) 06:59:55.554198 run osmo-hlr_10.42.42.2: Starting osmo-hlr 06:59:56.060861 run create_hlr_db(pid=8330): Launched 06:59:56.194212 bus /sierra_2: Setting Powered False 06:59:57.258421 run create_hlr_db(pid=8330): Terminated: ok {rc=0} 06:59:57.696066 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8332): Launched 06:59:58.005331 run osmo-hlr_10.42.42.2(pid=8333): Launched 06:59:58.122461 run osmo-stp_10.42.42.5: Starting osmo-stp 06:59:58.664231 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8335): Launched 06:59:58.972201 run osmo-stp_10.42.42.5(pid=8336): Launched 06:59:59.098525 tst emergency_preemptive_call.py: using MSISDN 7608 06:59:59.254280 run osmo-msc_10.42.42.6: Starting osmo-msc 06:59:59.801516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8338): Launched 07:00:00.107608 run osmo-msc_10.42.42.6(pid=8339): Launched 07:00:00.285955 run osmo-stp_10.42.42.5(pid=8336): ERR: Terminated: ERROR {rc=1} [trial-2371↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8336)] 07:00:00.415777 run osmo-stp_10.42.42.5(pid=8336): stdout: | (launched: 2022-12-10_06:59:58.914627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:00.544735 run osmo-stp_10.42.42.5(pid=8336): stderr: | [0;m[38;5;43m20221210065959088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065959089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065959089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065959089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065959090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065959090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065959090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:00.672195 run osmo-stp_10.42.42.5(pid=8336): stdout: | (launched: 2022-12-10_06:59:58.914627) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:00.794169 run osmo-stp_10.42.42.5(pid=8336): stderr: | [0;m[38;5;43m20221210065959088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210065959089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210065959089 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210065959089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210065959090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210065959090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210065959090 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:00.948147 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=8336): Process ended prematurely: osmo-stp_10.42.42.5(pid=8336) [trial-2371↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8336)] [trial-2371↪emergency:sysmo↪emergency_preemptive_call.py:32] 07:00:00.957315 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 07:00:00.985625 run osmo-hlr_10.42.42.2(pid=8333): ERR: Terminated: ERROR {rc=237} [trial-2371↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8333)] 07:00:01.036007 run osmo-hlr_10.42.42.2(pid=8333): stdout: | (launched: 2022-12-10_06:59:57.947369) 07:00:01.088044 run osmo-hlr_10.42.42.2(pid=8333): stderr: | [0;m[1;31m20221210065958127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210065958127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210065958127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210065958127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210065958127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210065958127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210065958143 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/emergency:sysmo/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210065958153 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210065958154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210065958154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:00:01.160792 run osmo-msc_10.42.42.6(pid=8339): ERR: Terminated: ERROR {rc=2} [trial-2371↪emergency:sysmo↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8339)] 07:00:01.211970 run osmo-msc_10.42.42.6(pid=8339): stdout: | (launched: 2022-12-10_07:00:00.049834) 07:00:01.264198 run osmo-msc_10.42.42.6(pid=8339): stderr: | [0;m[38;5;43m20221210070000325 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210070000325 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f623f9a0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210070000325 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210070000326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210070000326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210070000326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210070000328 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210070000328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210070000328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210070000328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:00:01.317169 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8332): Terminating (SIGTERM) 07:00:01.359771 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8335): Terminating (SIGTERM) 07:00:01.402553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8338): Terminating (SIGTERM) 07:00:01.445391 --- ParallelTerminationStrategy: PID 8332 died... 07:00:01.465381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8332): Terminated: ok {rc=0} 07:00:01.513429 --- ParallelTerminationStrategy: PID 8335 died... 07:00:01.533400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8335): Terminated: ok {rc=0} 07:00:01.581864 --- ParallelTerminationStrategy: PID 8338 died... 07:00:01.601828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8338): Terminated: ok {rc=0} 07:00:01.695492 bus /sierra_9: Setting Powered False 07:00:02.795567 bus /sierra_9: Setting Powered False 07:00:03.912600 bus /sierra_8: Setting Powered False 07:00:05.012051 bus /sierra_8: Setting Powered False 07:00:06.129816 bus /sierra_3: Setting Powered False 07:00:07.226128 bus /sierra_3: Setting Powered False 07:00:08.344354 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 emergency:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:sysmo --------------------------------------------------------------------- 07:00:09.607324 tst gprs:sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:00:09.611521 tst gprs:sysmo: Verifying 1 x bts (candidates: 11) 07:00:09.632315 tst gprs:sysmo: Verifying 9 x ip_address (candidates: 9) 07:00:09.671223 tst gprs:sysmo: Verifying 4 x modem (candidates: 12) 07:00:09.758467 tst gprs:sysmo: Reserving 1 x bts (candidates: 11) 07:00:09.779027 tst gprs:sysmo: Reserving 9 x ip_address (candidates: 9) 07:00:09.817483 tst gprs:sysmo: Reserving 4 x modem (candidates: 12) 07:00:10.405587 tst gprs:sysmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:sysmo cs_paging_gprs_active.py ---------------------------------------------- 07:00:10.457630 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:10.468104 tst gprs:sysmo: Using 1 x bts (candidates: 1) 07:00:10.503451 tst cs_paging_gprs_active.py: using LAC 26655 07:00:10.625218 tst cs_paging_gprs_active.py: using RAC 135 07:00:10.746119 tst cs_paging_gprs_active.py: using CellId 26655 07:00:10.868484 tst cs_paging_gprs_active.py: using BVCI 26656 07:00:10.981301 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:10.991865 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:11.002776 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:11.013512 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:11.024044 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:11.034705 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:11.045480 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:11.056052 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:11.066918 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:00:11.184059 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:00:11.306967 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:00:11.534001 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:00:11.870345 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8348): Launched 07:00:12.164043 run iperf3-srv_10.42.42.10(pid=8349): Launched 07:00:12.291526 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:00:12.517116 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:00:12.852902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8350): Launched 07:00:13.145910 run iperf3-srv_10.42.42.10(pid=8351): Launched 07:00:13.271846 tst cs_paging_gprs_active.py:38: start network... 07:00:13.496602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:00:14.013951 run create_hlr_db(pid=8352): Launched 07:00:14.151433 bus /sierra_2: Setting Powered False 07:00:15.216931 run create_hlr_db(pid=8352): Terminated: ok {rc=0} 07:00:15.663579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8354): Launched 07:00:16.009604 run osmo-hlr_10.42.42.2(pid=8355): Launched 07:00:16.352470 run osmo-stp_10.42.42.5: Starting osmo-stp 07:00:16.962515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8357): Launched 07:00:17.299633 run osmo-stp_10.42.42.5(pid=8358): Launched 07:00:17.447247 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:00:19.033493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8360): Launched 07:00:19.162103 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:00:19.445176 run patchelf(pid=8361): Launched 07:00:19.632349 run osmo-stp_10.42.42.5(pid=8358): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8358)] 07:00:19.772551 run osmo-stp_10.42.42.5(pid=8358): stdout: | (launched: 2022-12-10_07:00:17.238175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:19.914571 run osmo-stp_10.42.42.5(pid=8358): stderr: | [0;m[38;5;43m20221210070017457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070017457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070017457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070017458 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070017458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070017458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070017458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:20.057473 run osmo-stp_10.42.42.5(pid=8358): stdout: | (launched: 2022-12-10_07:00:17.238175) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:20.193390 run osmo-stp_10.42.42.5(pid=8358): stderr: | [0;m[38;5;43m20221210070017457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070017457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070017457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070017458 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070017458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070017458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070017458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:20.354638 run patchelf(pid=8361): Terminating (SIGINT) 07:00:20.541827 run patchelf(pid=8361): Terminated: ok {rc=0} 07:00:20.676881 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8358): Process ended prematurely: osmo-stp_10.42.42.5(pid=8358) [trial-2371↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8358)] [trial-2371↪gprs:sysmo↪cs_paging_gprs_active.py:38] 07:00:20.686975 tst cs_paging_gprs_active.py:38: Test FAILED (10.3 sec) 07:00:20.715602 run osmo-hlr_10.42.42.2(pid=8355): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:sysmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8355)] 07:00:20.765747 run osmo-hlr_10.42.42.2(pid=8355): stdout: | (launched: 2022-12-10_07:00:15.950163) 07:00:20.817799 run osmo-hlr_10.42.42.2(pid=8355): stderr: | [0;m[1;31m20221210070016206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070016206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070016206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070016206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070016206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070016206 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070016222 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:sysmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070016236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070016238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070016238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:00:20.870311 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8348): Terminating (SIGTERM) 07:00:20.912621 run iperf3-srv_10.42.42.10(pid=8349): Terminating (SIGTERM) 07:00:20.955481 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8350): Terminating (SIGTERM) 07:00:20.998312 run iperf3-srv_10.42.42.10(pid=8351): Terminating (SIGTERM) 07:00:21.041145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8354): Terminating (SIGTERM) 07:00:21.083810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8357): Terminating (SIGTERM) 07:00:21.126388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8360): Terminating (SIGTERM) 07:00:21.169120 --- ParallelTerminationStrategy: PID 8348 died... 07:00:21.189441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8348): Terminated: ok {rc=0} 07:00:21.237135 --- ParallelTerminationStrategy: PID 8349 died... 07:00:21.256820 run iperf3-srv_10.42.42.10(pid=8349): Terminated {rc=256} 07:00:21.303450 --- ParallelTerminationStrategy: PID 8350 died... 07:00:21.323374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8350): Terminated: ok {rc=0} 07:00:21.370049 --- ParallelTerminationStrategy: PID 8351 died... 07:00:21.389877 run iperf3-srv_10.42.42.10(pid=8351): Terminated {rc=256} 07:00:21.436592 --- ParallelTerminationStrategy: PID 8354 died... 07:00:21.456535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8354): Terminated: ok {rc=0} 07:00:21.503302 --- ParallelTerminationStrategy: PID 8357 died... 07:00:21.523195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8357): Terminated: ok {rc=0} 07:00:21.570187 --- ParallelTerminationStrategy: PID 8360 died... 07:00:21.590134 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8360): Terminated: ok {rc=0} 07:00:21.679746 bus /gobi_0: Setting Powered False 07:00:22.779932 bus /gobi_0: Setting Powered False 07:00:23.898726 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:sysmo iperf3.py ---------------------------------------------- 07:00:25.052916 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:25.064638 tst gprs:sysmo: Using 1 x bts (candidates: 1) 07:00:25.101338 tst iperf3.py: using LAC 26656 07:00:25.232055 tst iperf3.py: using RAC 136 07:00:25.368339 tst iperf3.py: using CellId 26656 07:00:25.498610 tst iperf3.py: using BVCI 26657 07:00:25.619349 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:25.630478 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:25.641441 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:25.652319 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:25.663168 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:25.673972 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:25.684860 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:25.695811 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:25.706972 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:00:25.827843 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:00:26.053496 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:00:26.388843 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8362): Launched 07:00:26.680409 run iperf3-srv_10.42.42.10(pid=8363): Launched 07:00:26.806481 tst iperf3.py:8: start network... 07:00:27.031846 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:00:27.547703 run create_hlr_db(pid=8364): Launched 07:00:27.684121 bus /gobi_6: Setting Powered False 07:00:28.749295 run create_hlr_db(pid=8364): Terminated: ok {rc=0} 07:00:29.193697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8366): Launched 07:00:29.506205 run osmo-hlr_10.42.42.2(pid=8367): Launched 07:00:29.626551 run osmo-stp_10.42.42.5: Starting osmo-stp 07:00:30.177668 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8369): Launched 07:00:30.490180 run osmo-stp_10.42.42.5(pid=8370): Launched 07:00:30.611616 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:00:31.193540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8372): Launched 07:00:31.333968 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:00:31.624208 run patchelf(pid=8373): Launched 07:00:31.826146 run osmo-stp_10.42.42.5(pid=8370): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8370)] 07:00:31.970282 run osmo-stp_10.42.42.5(pid=8370): stdout: | (launched: 2022-12-10_07:00:30.431879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:32.117835 run osmo-stp_10.42.42.5(pid=8370): stderr: | [0;m[38;5;43m20221210070030605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070030605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070030606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070030606 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070030606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070030607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070030607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:32.261322 run osmo-stp_10.42.42.5(pid=8370): stdout: | (launched: 2022-12-10_07:00:30.431879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:32.397845 run osmo-stp_10.42.42.5(pid=8370): stderr: | [0;m[38;5;43m20221210070030605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070030605 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070030606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070030606 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070030606 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070030607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070030607 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:32.559005 run patchelf(pid=8373): Terminating (SIGINT) 07:00:32.746863 run patchelf(pid=8373): Terminated: ok {rc=0} 07:00:32.882046 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8370): Process ended prematurely: osmo-stp_10.42.42.5(pid=8370) [trial-2371↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8370)] [trial-2371↪gprs:sysmo↪iperf3.py:8] 07:00:32.892301 tst iperf3.py:8: Test FAILED (7.9 sec) 07:00:32.921306 run osmo-hlr_10.42.42.2(pid=8367): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:sysmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8367)] 07:00:32.972406 run osmo-hlr_10.42.42.2(pid=8367): stdout: | (launched: 2022-12-10_07:00:29.447678) 07:00:33.025632 run osmo-hlr_10.42.42.2(pid=8367): stderr: | [0;m[1;31m20221210070029628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070029628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070029628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070029628 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070029629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070029629 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070029640 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:sysmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070029651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070029651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070029651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:00:33.079310 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8362): Terminating (SIGTERM) 07:00:33.122169 run iperf3-srv_10.42.42.10(pid=8363): Terminating (SIGTERM) 07:00:33.164822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8366): Terminating (SIGTERM) 07:00:33.207573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8369): Terminating (SIGTERM) 07:00:33.250820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8372): Terminating (SIGTERM) 07:00:33.293885 --- ParallelTerminationStrategy: PID 8362 died... 07:00:33.314326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8362): Terminated: ok {rc=0} 07:00:33.361561 --- ParallelTerminationStrategy: PID 8363 died... 07:00:33.381513 run iperf3-srv_10.42.42.10(pid=8363): Terminated {rc=256} 07:00:33.428488 --- ParallelTerminationStrategy: PID 8366 died... 07:00:33.448475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8366): Terminated: ok {rc=0} 07:00:33.495519 --- ParallelTerminationStrategy: PID 8369 died... 07:00:33.515588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8369): Terminated: ok {rc=0} 07:00:33.562726 --- ParallelTerminationStrategy: PID 8372 died... 07:00:33.582828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8372): Terminated: ok {rc=0} 07:00:33.672761 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:sysmo iperf3m4.py ---------------------------------------------- 07:00:34.827662 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:34.839444 tst gprs:sysmo: Using 1 x bts (candidates: 1) 07:00:34.876046 tst iperf3m4.py: using LAC 26657 07:00:35.005649 tst iperf3m4.py: using RAC 137 07:00:35.138915 tst iperf3m4.py: using CellId 26657 07:00:35.269752 tst iperf3m4.py: using BVCI 26658 07:00:35.390409 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:35.401539 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:35.412370 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:35.423405 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:35.434305 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:35.445114 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:35.456099 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:35.466993 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:35.478153 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:00:35.595706 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:00:35.716041 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:00:35.832550 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:00:35.950037 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:00:36.159416 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:00:36.473423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8374): Launched 07:00:36.747698 run iperf3-srv_10.42.42.10(pid=8375): Launched 07:00:36.866343 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:00:37.075714 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:00:37.390430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8376): Launched 07:00:37.663058 run iperf3-srv_10.42.42.10(pid=8377): Launched 07:00:37.781414 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:00:37.989789 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:00:38.303021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8378): Launched 07:00:38.576191 run iperf3-srv_10.42.42.10(pid=8379): Launched 07:00:38.694032 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:00:38.902365 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:00:39.216188 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8380): Launched 07:00:39.506436 run iperf3-srv_10.42.42.10(pid=8381): Launched 07:00:39.623976 tst iperf3m4.py:8: start network... 07:00:39.831859 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:00:40.314349 run create_hlr_db(pid=8382): Launched 07:00:40.435255 bus /gobi_6: Setting Powered False 07:00:41.496660 run create_hlr_db(pid=8382): Terminated: ok {rc=0} 07:00:41.953514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8384): Launched 07:00:42.288637 run osmo-hlr_10.42.42.2(pid=8385): Launched 07:00:42.417165 run osmo-stp_10.42.42.5: Starting osmo-stp 07:00:42.993931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8387): Launched 07:00:43.329895 run osmo-stp_10.42.42.5(pid=8388): Launched 07:00:43.455779 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:00:44.029519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8390): Launched 07:00:44.158373 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:00:44.441464 run patchelf(pid=8391): Launched 07:00:44.627515 run osmo-stp_10.42.42.5(pid=8388): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8388)] 07:00:44.768471 run osmo-stp_10.42.42.5(pid=8388): stdout: | (launched: 2022-12-10_07:00:43.267650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:44.911316 run osmo-stp_10.42.42.5(pid=8388): stderr: | [0;m[38;5;43m20221210070043464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070043464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070043464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070043465 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070043465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070043465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070043465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:45.054551 run osmo-stp_10.42.42.5(pid=8388): stdout: | (launched: 2022-12-10_07:00:43.267650) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:00:45.191487 run osmo-stp_10.42.42.5(pid=8388): stderr: | [0;m[38;5;43m20221210070043464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070043464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070043464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070043465 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070043465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070043465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070043465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:00:45.353146 run patchelf(pid=8391): Terminating (SIGINT) 07:00:45.540387 run patchelf(pid=8391): Terminated: ok {rc=0} 07:00:45.675380 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8388): Process ended prematurely: osmo-stp_10.42.42.5(pid=8388) [trial-2371↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8388)] [trial-2371↪gprs:sysmo↪iperf3m4.py:8] 07:00:45.685429 tst iperf3m4.py:8: Test FAILED (10.9 sec) 07:00:45.714215 run osmo-hlr_10.42.42.2(pid=8385): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:sysmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8385)] 07:00:45.765395 run osmo-hlr_10.42.42.2(pid=8385): stdout: | (launched: 2022-12-10_07:00:42.226415) 07:00:45.818065 run osmo-hlr_10.42.42.2(pid=8385): stderr: | [0;m[1;31m20221210070042428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070042428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070042428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070042428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070042428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070042429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070042441 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:sysmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070042450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070042450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070042450 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:00:45.882047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8374): Terminating (SIGTERM) 07:00:45.926730 run iperf3-srv_10.42.42.10(pid=8375): Terminating (SIGTERM) 07:00:45.989375 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8376): Terminating (SIGTERM) 07:00:46.036870 run iperf3-srv_10.42.42.10(pid=8377): Terminating (SIGTERM) 07:00:46.096198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8378): Terminating (SIGTERM) 07:00:46.152171 run iperf3-srv_10.42.42.10(pid=8379): Terminating (SIGTERM) 07:00:46.210480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8380): Terminating (SIGTERM) 07:00:46.255324 run iperf3-srv_10.42.42.10(pid=8381): Terminating (SIGTERM) 07:00:46.298168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8384): Terminating (SIGTERM) 07:00:46.343605 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8387): Terminating (SIGTERM) 07:00:46.388984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8390): Terminating (SIGTERM) 07:00:46.435367 --- ParallelTerminationStrategy: PID 8374 died... 07:00:46.455979 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8374): Terminated: ok {rc=0} 07:00:46.506697 --- ParallelTerminationStrategy: PID 8375 died... 07:00:46.527125 run iperf3-srv_10.42.42.10(pid=8375): Terminated {rc=256} 07:00:46.575777 --- ParallelTerminationStrategy: PID 8376 died... 07:00:46.596299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8376): Terminated: ok {rc=0} 07:00:46.645885 --- ParallelTerminationStrategy: PID 8377 died... 07:00:46.666601 run iperf3-srv_10.42.42.10(pid=8377): Terminated {rc=256} 07:00:46.716250 --- ParallelTerminationStrategy: PID 8378 died... 07:00:46.736601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8378): Terminated: ok {rc=0} 07:00:46.785547 --- ParallelTerminationStrategy: PID 8379 died... 07:00:46.806724 run iperf3-srv_10.42.42.10(pid=8379): Terminated {rc=256} 07:00:46.855298 --- ParallelTerminationStrategy: PID 8380 died... 07:00:46.875498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8380): Terminated: ok {rc=0} 07:00:46.924003 --- ParallelTerminationStrategy: PID 8381 died... 07:00:46.944000 run iperf3-srv_10.42.42.10(pid=8381): Terminated {rc=256} 07:00:46.992528 --- ParallelTerminationStrategy: PID 8384 died... 07:00:47.014143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8384): Terminated: ok {rc=0} 07:00:47.062934 --- ParallelTerminationStrategy: PID 8387 died... 07:00:47.083088 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8387): Terminated: ok {rc=0} 07:00:47.132001 --- ParallelTerminationStrategy: PID 8390 died... 07:00:47.152008 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8390): Terminated: ok {rc=0} 07:00:47.244020 bus /gobi_4: Setting Powered False 07:00:48.345659 bus /gobi_4: Setting Powered False 07:00:49.466536 bus /gobi_1: Setting Powered False 07:00:50.566722 bus /gobi_1: Setting Powered False 07:00:51.684679 bus /gobi_0: Setting Powered False 07:00:52.785028 bus /gobi_0: Setting Powered False 07:00:53.902152 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:sysmo ping.py ---------------------------------------------- 07:00:55.006732 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:55.018507 tst gprs:sysmo: Using 1 x bts (candidates: 1) 07:00:55.059569 tst ping.py: using LAC 26658 07:00:55.190507 tst ping.py: using RAC 138 07:00:55.320099 tst ping.py: using CellId 26658 07:00:55.450189 tst ping.py: using BVCI 26659 07:00:55.569426 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:55.580565 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:55.591585 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:55.602618 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:55.613534 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:55.624324 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:55.635551 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:00:55.646520 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:00:55.767708 tst ping.py:19: start network... 07:00:55.988791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:00:56.498803 run create_hlr_db(pid=8392): Launched 07:00:56.631425 bus /gobi_6: Setting Powered False 07:00:57.696150 run create_hlr_db(pid=8392): Terminated: ok {rc=0} 07:00:58.137779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8394): Launched 07:00:58.450660 run osmo-hlr_10.42.42.2(pid=8395): Launched 07:00:58.568681 run osmo-stp_10.42.42.5: Starting osmo-stp 07:00:59.106405 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8397): Launched 07:00:59.412198 run osmo-stp_10.42.42.5(pid=8398): Launched 07:00:59.530438 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:01:00.057237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8400): Launched 07:01:00.173935 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:01:00.432407 run patchelf(pid=8401): Launched 07:01:00.603433 run osmo-stp_10.42.42.5(pid=8398): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8398)] 07:01:00.732148 run osmo-stp_10.42.42.5(pid=8398): stdout: | (launched: 2022-12-10_07:00:59.354662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:00.864701 run osmo-stp_10.42.42.5(pid=8398): stderr: | [0;m[38;5;43m20221210070059524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070059524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070059525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070059525 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070059527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070059527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070059528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:01.003549 run osmo-stp_10.42.42.5(pid=8398): stdout: | (launched: 2022-12-10_07:00:59.354662) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:01.131988 run osmo-stp_10.42.42.5(pid=8398): stderr: | [0;m[38;5;43m20221210070059524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070059524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070059525 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070059525 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070059527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070059527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070059528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:01.285212 run patchelf(pid=8401): Terminating (SIGINT) 07:01:01.462090 run patchelf(pid=8401): Terminated: ok {rc=0} 07:01:01.589857 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8398): Process ended prematurely: osmo-stp_10.42.42.5(pid=8398) [trial-2371↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8398)] [trial-2371↪gprs:sysmo↪ping.py:22] 07:01:01.599621 tst ping.py:22: Test FAILED (6.6 sec) 07:01:01.629946 run osmo-hlr_10.42.42.2(pid=8395): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:sysmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8395)] 07:01:01.680876 run osmo-hlr_10.42.42.2(pid=8395): stdout: | (launched: 2022-12-10_07:00:58.392690) 07:01:01.733457 run osmo-hlr_10.42.42.2(pid=8395): stderr: | [0;m[1;31m20221210070058571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070058571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070058571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070058571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070058571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070058571 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070058583 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:sysmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070058592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070058592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070058592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:01:01.786839 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8394): Terminating (SIGTERM) 07:01:01.829932 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8397): Terminating (SIGTERM) 07:01:01.873070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8400): Terminating (SIGTERM) 07:01:01.916751 --- ParallelTerminationStrategy: PID 8394 died... 07:01:01.936934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8394): Terminated: ok {rc=0} 07:01:01.986677 --- ParallelTerminationStrategy: PID 8397 died... 07:01:02.006591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8397): Terminated: ok {rc=0} 07:01:02.055128 --- ParallelTerminationStrategy: PID 8400 died... 07:01:02.075385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8400): Terminated: ok {rc=0} 07:01:02.165855 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:sysmo ping_idle_ping.py ---------------------------------------------- 07:01:03.256305 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:03.268215 tst gprs:sysmo: Using 1 x bts (candidates: 1) 07:01:03.305904 tst ping_idle_ping.py: using LAC 26659 07:01:03.435784 tst ping_idle_ping.py: using RAC 139 07:01:03.564341 tst ping_idle_ping.py: using CellId 26659 07:01:03.692606 tst ping_idle_ping.py: using BVCI 26660 07:01:03.813984 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:03.825059 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:03.836008 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:03.847149 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:03.858281 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:03.869292 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:03.880471 tst gprs:sysmo: Using 1 x ip_address (candidates: 9) 07:01:03.891588 tst gprs:sysmo: Using 1 x modem (candidates: 4) 07:01:04.020620 tst ping_idle_ping.py:24: start network... 07:01:04.226131 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:01:04.701496 run create_hlr_db(pid=8402): Launched 07:01:04.819445 bus /gobi_6: Setting Powered False 07:01:05.879859 run create_hlr_db(pid=8402): Terminated: ok {rc=0} 07:01:06.306491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8404): Launched 07:01:06.614253 run osmo-hlr_10.42.42.2(pid=8405): Launched 07:01:06.733272 run osmo-stp_10.42.42.5: Starting osmo-stp 07:01:07.275941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8407): Launched 07:01:07.584225 run osmo-stp_10.42.42.5(pid=8408): Launched 07:01:07.716239 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:01:08.286060 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8410): Launched 07:01:08.411819 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:01:08.691819 run patchelf(pid=8411): Launched 07:01:08.875527 run osmo-stp_10.42.42.5(pid=8408): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8408)] 07:01:09.014087 run osmo-stp_10.42.42.5(pid=8408): stdout: | (launched: 2022-12-10_07:01:07.526602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:09.155497 run osmo-stp_10.42.42.5(pid=8408): stderr: | [0;m[38;5;43m20221210070107715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070107715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070107716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070107716 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070107717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070107717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070107717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:09.295868 run osmo-stp_10.42.42.5(pid=8408): stdout: | (launched: 2022-12-10_07:01:07.526602) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:09.430883 run osmo-stp_10.42.42.5(pid=8408): stderr: | [0;m[38;5;43m20221210070107715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070107715 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070107716 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070107716 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070107717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070107717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070107717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:09.590173 run patchelf(pid=8411): Terminating (SIGINT) 07:01:09.774576 run patchelf(pid=8411): Terminated: ok {rc=0} 07:01:09.907066 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8408): Process ended prematurely: osmo-stp_10.42.42.5(pid=8408) [trial-2371↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8408)] [trial-2371↪gprs:sysmo↪ping_idle_ping.py:27] 07:01:09.916506 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 07:01:09.944587 run osmo-hlr_10.42.42.2(pid=8405): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:sysmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8405)] 07:01:09.995035 run osmo-hlr_10.42.42.2(pid=8405): stdout: | (launched: 2022-12-10_07:01:06.556430) 07:01:10.047576 run osmo-hlr_10.42.42.2(pid=8405): stderr: | [0;m[1;31m20221210070106735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070106735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070106735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070106735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070106735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070106735 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070106747 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:sysmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070106755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070106755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070106755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:01:10.100473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8404): Terminating (SIGTERM) 07:01:10.142768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8407): Terminating (SIGTERM) 07:01:10.184922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8410): Terminating (SIGTERM) 07:01:10.227502 --- ParallelTerminationStrategy: PID 8404 died... 07:01:10.247940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8404): Terminated: ok {rc=0} 07:01:10.294760 --- ParallelTerminationStrategy: PID 8407 died... 07:01:10.314891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8407): Terminated: ok {rc=0} 07:01:10.361736 --- ParallelTerminationStrategy: PID 8410 died... 07:01:10.381712 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8410): Terminated: ok {rc=0} 07:01:10.471183 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:sysmo+mod-bts0-egprs --------------------------------------------------------------------- 07:01:11.754164 tst gprs:sysmo+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:01:11.759492 tst gprs:sysmo+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:01:11.780648 tst gprs:sysmo+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:01:11.819798 tst gprs:sysmo+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:01:11.907536 tst gprs:sysmo+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:01:11.928091 tst gprs:sysmo+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:01:11.966355 tst gprs:sysmo+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:01:12.557929 tst gprs:sysmo+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:sysmo+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:01:12.608397 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:12.619539 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:01:12.656254 tst cs_paging_gprs_active.py: using LAC 26660 07:01:12.789180 tst cs_paging_gprs_active.py: using RAC 140 07:01:12.925103 tst cs_paging_gprs_active.py: using CellId 26660 07:01:13.056307 tst cs_paging_gprs_active.py: using BVCI 26661 07:01:13.178097 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:13.189753 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:13.201014 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:13.212824 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:13.224576 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:13.236388 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:13.248342 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:13.260056 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:13.271946 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:01:13.392813 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:01:13.511378 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:01:13.723573 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:01:14.039147 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8416): Launched 07:01:14.314550 run iperf3-srv_10.42.42.10(pid=8417): Launched 07:01:14.434105 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:01:14.644388 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:01:14.959407 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8418): Launched 07:01:15.234446 run iperf3-srv_10.42.42.10(pid=8419): Launched 07:01:15.353957 tst cs_paging_gprs_active.py:38: start network... 07:01:15.564350 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:01:16.056134 run create_hlr_db(pid=8420): Launched 07:01:16.216004 bus /gobi_6: Setting Powered False 07:01:17.286425 run create_hlr_db(pid=8420): Terminated: ok {rc=0} 07:01:17.723995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8422): Launched 07:01:18.038325 run osmo-hlr_10.42.42.2(pid=8423): Launched 07:01:18.159880 run osmo-stp_10.42.42.5: Starting osmo-stp 07:01:18.694563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8425): Launched 07:01:19.009352 run osmo-stp_10.42.42.5(pid=8426): Launched 07:01:19.130304 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:01:19.668443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8428): Launched 07:01:19.791291 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:01:20.055851 run patchelf(pid=8429): Launched 07:01:20.230562 run osmo-stp_10.42.42.5(pid=8426): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8426)] 07:01:20.362689 run osmo-stp_10.42.42.5(pid=8426): stdout: | (launched: 2022-12-10_07:01:18.950663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:20.495941 run osmo-stp_10.42.42.5(pid=8426): stderr: | [0;m[38;5;43m20221210070119124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070119124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070119124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070119124 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070119125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070119125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070119125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:20.629540 run osmo-stp_10.42.42.5(pid=8426): stdout: | (launched: 2022-12-10_07:01:18.950663) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:20.757128 run osmo-stp_10.42.42.5(pid=8426): stderr: | [0;m[38;5;43m20221210070119124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070119124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070119124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070119124 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070119125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070119125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070119125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:20.908281 run patchelf(pid=8429): Terminating (SIGINT) 07:01:21.083678 run patchelf(pid=8429): Terminated: ok {rc=0} 07:01:21.210602 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8426): Process ended prematurely: osmo-stp_10.42.42.5(pid=8426) [trial-2371↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8426)] [trial-2371↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:01:21.219981 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 07:01:21.247866 run osmo-hlr_10.42.42.2(pid=8423): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8423)] 07:01:21.296632 run osmo-hlr_10.42.42.2(pid=8423): stdout: | (launched: 2022-12-10_07:01:17.979761) 07:01:21.347191 run osmo-hlr_10.42.42.2(pid=8423): stderr: | [0;m[1;31m20221210070118158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070118158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070118158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070118158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070118158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070118158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070118195 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:sysmo+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070118205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070118205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070118205 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:01:21.398302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8416): Terminating (SIGTERM) 07:01:21.439677 run iperf3-srv_10.42.42.10(pid=8417): Terminating (SIGTERM) 07:01:21.480560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8418): Terminating (SIGTERM) 07:01:21.521550 run iperf3-srv_10.42.42.10(pid=8419): Terminating (SIGTERM) 07:01:21.562485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8422): Terminating (SIGTERM) 07:01:21.603406 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8425): Terminating (SIGTERM) 07:01:21.644051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8428): Terminating (SIGTERM) 07:01:21.685222 --- ParallelTerminationStrategy: PID 8416 died... 07:01:21.704650 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8416): Terminated: ok {rc=0} 07:01:21.750092 --- ParallelTerminationStrategy: PID 8417 died... 07:01:21.769086 run iperf3-srv_10.42.42.10(pid=8417): Terminated {rc=256} 07:01:21.814140 --- ParallelTerminationStrategy: PID 8418 died... 07:01:21.833471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8418): Terminated: ok {rc=0} 07:01:21.878622 --- ParallelTerminationStrategy: PID 8419 died... 07:01:21.897569 run iperf3-srv_10.42.42.10(pid=8419): Terminated {rc=256} 07:01:21.942357 --- ParallelTerminationStrategy: PID 8422 died... 07:01:21.961394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8422): Terminated: ok {rc=0} 07:01:22.006464 --- ParallelTerminationStrategy: PID 8425 died... 07:01:22.025584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8425): Terminated: ok {rc=0} 07:01:22.070715 --- ParallelTerminationStrategy: PID 8428 died... 07:01:22.089641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8428): Terminated: ok {rc=0} 07:01:22.176887 bus /gobi_0: Setting Powered False 07:01:23.277288 bus /gobi_0: Setting Powered False 07:01:24.396872 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:sysmo+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:01:25.549881 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:25.561993 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:01:25.601290 tst iperf3.py: using LAC 26661 07:01:25.725476 tst iperf3.py: using RAC 141 07:01:25.850552 tst iperf3.py: using CellId 26661 07:01:25.975298 tst iperf3.py: using BVCI 26662 07:01:26.090278 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:26.101413 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:26.112152 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:26.123068 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:26.133975 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:26.144791 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:26.155596 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:26.166655 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:26.177796 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:01:26.300816 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:01:26.527378 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:01:26.862789 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8430): Launched 07:01:27.154092 run iperf3-srv_10.42.42.10(pid=8431): Launched 07:01:27.280407 tst iperf3.py:8: start network... 07:01:27.505607 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:01:28.022645 run create_hlr_db(pid=8432): Launched 07:01:28.149394 bus /gobi_6: Setting Powered False 07:01:29.211018 run create_hlr_db(pid=8432): Terminated: ok {rc=0} 07:01:29.666492 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8434): Launched 07:01:30.001405 run osmo-hlr_10.42.42.2(pid=8435): Launched 07:01:30.128309 run osmo-stp_10.42.42.5: Starting osmo-stp 07:01:30.702464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8437): Launched 07:01:31.065656 run osmo-stp_10.42.42.5(pid=8438): Launched 07:01:31.343633 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:01:31.941486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8440): Launched 07:01:32.081488 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:01:32.367387 run patchelf(pid=8441): Launched 07:01:32.553783 run osmo-stp_10.42.42.5(pid=8438): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8438)] 07:01:32.694267 run osmo-stp_10.42.42.5(pid=8438): stdout: | (launched: 2022-12-10_07:01:31.002992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:32.836587 run osmo-stp_10.42.42.5(pid=8438): stderr: | [0;m[38;5;43m20221210070131204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070131204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070131204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070131205 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070131207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070131207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070131207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:32.978918 run osmo-stp_10.42.42.5(pid=8438): stdout: | (launched: 2022-12-10_07:01:31.002992) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:33.116168 run osmo-stp_10.42.42.5(pid=8438): stderr: | [0;m[38;5;43m20221210070131204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070131204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070131204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070131205 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070131207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070131207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070131207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:33.277349 run patchelf(pid=8441): Terminating (SIGINT) 07:01:33.463933 run patchelf(pid=8441): Terminated: ok {rc=0} 07:01:33.599324 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8438): Process ended prematurely: osmo-stp_10.42.42.5(pid=8438) [trial-2371↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8438)] [trial-2371↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8] 07:01:33.609753 tst iperf3.py:8: Test FAILED (8.1 sec) 07:01:33.638662 run osmo-hlr_10.42.42.2(pid=8435): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:sysmo+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8435)] 07:01:33.689472 run osmo-hlr_10.42.42.2(pid=8435): stdout: | (launched: 2022-12-10_07:01:29.939154) 07:01:33.741933 run osmo-hlr_10.42.42.2(pid=8435): stderr: | [0;m[1;31m20221210070130140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070130140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070130140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070130140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070130140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070130140 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070130152 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:sysmo+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070130163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070130164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070130164 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:01:33.794832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8430): Terminating (SIGTERM) 07:01:33.837458 run iperf3-srv_10.42.42.10(pid=8431): Terminating (SIGTERM) 07:01:33.879870 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8434): Terminating (SIGTERM) 07:01:33.922411 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8437): Terminating (SIGTERM) 07:01:33.964537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8440): Terminating (SIGTERM) 07:01:34.007143 --- ParallelTerminationStrategy: PID 8430 died... 07:01:34.027498 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8430): Terminated: ok {rc=0} 07:01:34.074748 --- ParallelTerminationStrategy: PID 8431 died... 07:01:34.094626 run iperf3-srv_10.42.42.10(pid=8431): Terminated {rc=256} 07:01:34.141642 --- ParallelTerminationStrategy: PID 8434 died... 07:01:34.161611 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8434): Terminated: ok {rc=0} 07:01:34.208341 --- ParallelTerminationStrategy: PID 8437 died... 07:01:34.228433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8437): Terminated: ok {rc=0} 07:01:34.275201 --- ParallelTerminationStrategy: PID 8440 died... 07:01:34.295114 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8440): Terminated: ok {rc=0} 07:01:34.384183 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:sysmo+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:01:35.532333 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:35.544110 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:01:35.585874 tst iperf3m4.py: using LAC 26662 07:01:35.709244 tst iperf3m4.py: using RAC 142 07:01:35.831435 tst iperf3m4.py: using CellId 26662 07:01:35.954063 tst iperf3m4.py: using BVCI 26663 07:01:36.068060 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:36.078949 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:36.089953 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:36.101238 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:36.112348 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:36.123494 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:36.134897 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:36.146075 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:36.157505 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:01:36.277290 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:01:36.401401 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:01:36.526335 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:01:36.643805 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:01:36.853691 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:01:37.169216 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8442): Launched 07:01:37.441580 run iperf3-srv_10.42.42.10(pid=8443): Launched 07:01:37.561505 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:01:37.770479 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:01:38.083996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8444): Launched 07:01:38.358291 run iperf3-srv_10.42.42.10(pid=8445): Launched 07:01:38.474726 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:01:38.682821 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:01:38.996648 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8446): Launched 07:01:39.270907 run iperf3-srv_10.42.42.10(pid=8447): Launched 07:01:39.387444 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:01:39.596182 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:01:39.910283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8448): Launched 07:01:40.184102 run iperf3-srv_10.42.42.10(pid=8449): Launched 07:01:40.302384 tst iperf3m4.py:8: start network... 07:01:40.510782 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:01:40.993641 run create_hlr_db(pid=8450): Launched 07:01:41.112361 bus /gobi_6: Setting Powered False 07:01:42.174614 run create_hlr_db(pid=8450): Terminated: ok {rc=0} 07:01:42.609219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8452): Launched 07:01:42.921824 run osmo-hlr_10.42.42.2(pid=8453): Launched 07:01:43.040659 run osmo-stp_10.42.42.5: Starting osmo-stp 07:01:43.580708 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8455): Launched 07:01:43.895710 run osmo-stp_10.42.42.5(pid=8456): Launched 07:01:44.014790 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:01:44.551846 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8458): Launched 07:01:44.671257 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:01:44.935913 run patchelf(pid=8459): Launched 07:01:45.108257 run osmo-stp_10.42.42.5(pid=8456): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8456)] 07:01:45.239432 run osmo-stp_10.42.42.5(pid=8456): stdout: | (launched: 2022-12-10_07:01:43.836445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:45.372353 run osmo-stp_10.42.42.5(pid=8456): stderr: | [0;m[38;5;43m20221210070144010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070144010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070144010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070144011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070144011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070144011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070144011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:45.505512 run osmo-stp_10.42.42.5(pid=8456): stdout: | (launched: 2022-12-10_07:01:43.836445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:01:45.632320 run osmo-stp_10.42.42.5(pid=8456): stderr: | [0;m[38;5;43m20221210070144010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070144010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070144010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070144011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070144011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070144011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070144011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:01:45.782518 run patchelf(pid=8459): Terminating (SIGINT) 07:01:45.996030 run patchelf(pid=8459): Terminated: ok {rc=0} 07:01:46.136333 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8456): Process ended prematurely: osmo-stp_10.42.42.5(pid=8456) [trial-2371↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8456)] [trial-2371↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8] 07:01:46.147241 tst iperf3m4.py:8: Test FAILED (10.7 sec) 07:01:46.178412 run osmo-hlr_10.42.42.2(pid=8453): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8453)] 07:01:46.231724 run osmo-hlr_10.42.42.2(pid=8453): stdout: | (launched: 2022-12-10_07:01:42.863043) 07:01:46.287037 run osmo-hlr_10.42.42.2(pid=8453): stderr: | [0;m[1;31m20221210070143044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070143044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070143044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070143044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070143044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070143044 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070143056 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:sysmo+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070143066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070143066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070143066 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:01:46.341655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8442): Terminating (SIGTERM) 07:01:46.385995 run iperf3-srv_10.42.42.10(pid=8443): Terminating (SIGTERM) 07:01:46.433756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8444): Terminating (SIGTERM) 07:01:46.478249 run iperf3-srv_10.42.42.10(pid=8445): Terminating (SIGTERM) 07:01:46.524612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8446): Terminating (SIGTERM) 07:01:46.569451 run iperf3-srv_10.42.42.10(pid=8447): Terminating (SIGTERM) 07:01:46.617934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8448): Terminating (SIGTERM) 07:01:46.662151 run iperf3-srv_10.42.42.10(pid=8449): Terminating (SIGTERM) 07:01:46.709778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8452): Terminating (SIGTERM) 07:01:46.754334 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8455): Terminating (SIGTERM) 07:01:46.799750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8458): Terminating (SIGTERM) 07:01:46.846710 --- ParallelTerminationStrategy: PID 8442 died... 07:01:46.867512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8442): Terminated: ok {rc=0} 07:01:46.917385 --- ParallelTerminationStrategy: PID 8443 died... 07:01:46.938557 run iperf3-srv_10.42.42.10(pid=8443): Terminated {rc=256} 07:01:46.986916 --- ParallelTerminationStrategy: PID 8444 died... 07:01:47.008867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8444): Terminated: ok {rc=0} 07:01:47.057524 --- ParallelTerminationStrategy: PID 8445 died... 07:01:47.078185 run iperf3-srv_10.42.42.10(pid=8445): Terminated {rc=256} 07:01:47.126578 --- ParallelTerminationStrategy: PID 8446 died... 07:01:47.147176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8446): Terminated: ok {rc=0} 07:01:47.194571 --- ParallelTerminationStrategy: PID 8447 died... 07:01:47.214749 run iperf3-srv_10.42.42.10(pid=8447): Terminated {rc=256} 07:01:47.261674 --- ParallelTerminationStrategy: PID 8448 died... 07:01:47.281711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8448): Terminated: ok {rc=0} 07:01:47.328690 --- ParallelTerminationStrategy: PID 8449 died... 07:01:47.349113 run iperf3-srv_10.42.42.10(pid=8449): Terminated {rc=256} 07:01:47.396198 --- ParallelTerminationStrategy: PID 8452 died... 07:01:47.416414 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8452): Terminated: ok {rc=0} 07:01:47.463240 --- ParallelTerminationStrategy: PID 8455 died... 07:01:47.483329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8455): Terminated: ok {rc=0} 07:01:47.530158 --- ParallelTerminationStrategy: PID 8458 died... 07:01:47.550222 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8458): Terminated: ok {rc=0} 07:01:47.639697 bus /gobi_4: Setting Powered False 07:01:48.739387 bus /gobi_4: Setting Powered False 07:01:49.858591 bus /gobi_1: Setting Powered False 07:01:50.958224 bus /gobi_1: Setting Powered False 07:01:52.075273 bus /gobi_0: Setting Powered False 07:01:53.175308 bus /gobi_0: Setting Powered False 07:01:54.294099 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:sysmo+mod-bts0-egprs ping.py ---------------------------------------------- 07:01:55.399727 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:55.411931 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:01:55.450991 tst ping.py: using LAC 26663 07:01:55.581256 tst ping.py: using RAC 143 07:01:55.712405 tst ping.py: using CellId 26663 07:01:55.840811 tst ping.py: using BVCI 26664 07:01:55.959996 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:55.971446 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:55.982824 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:55.994187 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:56.005361 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:56.016824 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:56.028187 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:01:56.039497 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:01:56.158110 tst ping.py:19: start network... 07:01:56.365276 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:01:56.842250 run create_hlr_db(pid=8460): Launched 07:01:56.959583 bus /gobi_6: Setting Powered False 07:01:58.020334 run create_hlr_db(pid=8460): Terminated: ok {rc=0} 07:01:58.448731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8462): Launched 07:01:58.756398 run osmo-hlr_10.42.42.2(pid=8463): Launched 07:01:58.873020 run osmo-stp_10.42.42.5: Starting osmo-stp 07:01:59.411219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8465): Launched 07:01:59.717223 run osmo-stp_10.42.42.5(pid=8466): Launched 07:01:59.834718 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:02:00.361645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8468): Launched 07:02:00.478623 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:02:00.738211 run patchelf(pid=8469): Launched 07:02:00.946456 run osmo-stp_10.42.42.5(pid=8466): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8466)] 07:02:01.078225 run osmo-stp_10.42.42.5(pid=8466): stdout: | (launched: 2022-12-10_07:01:59.658892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:01.212362 run osmo-stp_10.42.42.5(pid=8466): stderr: | [0;m[38;5;43m20221210070159834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070159834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070159834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070159835 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070159835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070159835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070159835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:01.347384 run osmo-stp_10.42.42.5(pid=8466): stdout: | (launched: 2022-12-10_07:01:59.658892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:01.475803 run osmo-stp_10.42.42.5(pid=8466): stderr: | [0;m[38;5;43m20221210070159834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070159834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070159834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070159835 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070159835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070159835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070159835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:01.628096 run patchelf(pid=8469): Terminating (SIGINT) 07:02:01.805176 run patchelf(pid=8469): Terminated: ok {rc=0} 07:02:01.932696 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8466): Process ended prematurely: osmo-stp_10.42.42.5(pid=8466) [trial-2371↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8466)] [trial-2371↪gprs:sysmo+mod-bts0-egprs↪ping.py:22] 07:02:01.942636 tst ping.py:22: Test FAILED (6.5 sec) 07:02:01.973036 run osmo-hlr_10.42.42.2(pid=8463): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:sysmo+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8463)] 07:02:02.023899 run osmo-hlr_10.42.42.2(pid=8463): stdout: | (launched: 2022-12-10_07:01:58.698195) 07:02:02.076540 run osmo-hlr_10.42.42.2(pid=8463): stderr: | [0;m[1;31m20221210070158878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070158878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070158878 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070158879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070158879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070158879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070158895 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:sysmo+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070158905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070158906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070158906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:02:02.129430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8462): Terminating (SIGTERM) 07:02:02.171744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8465): Terminating (SIGTERM) 07:02:02.214364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8468): Terminating (SIGTERM) 07:02:02.254835 --- ParallelTerminationStrategy: PID 8462 died... 07:02:02.274154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8462): Terminated: ok {rc=0} 07:02:02.319108 --- ParallelTerminationStrategy: PID 8465 died... 07:02:02.338027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8465): Terminated: ok {rc=0} 07:02:02.382660 --- ParallelTerminationStrategy: PID 8468 died... 07:02:02.401805 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8468): Terminated: ok {rc=0} 07:02:02.488619 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:sysmo+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:02:03.577825 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:03.590375 tst gprs:sysmo+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:02:03.630292 tst ping_idle_ping.py: using LAC 26664 07:02:03.759577 tst ping_idle_ping.py: using RAC 144 07:02:03.881909 tst ping_idle_ping.py: using CellId 26664 07:02:04.005302 tst ping_idle_ping.py: using BVCI 26665 07:02:04.117110 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:04.127957 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:04.138784 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:04.150353 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:04.161771 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:04.173067 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:04.184516 tst gprs:sysmo+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:02:04.196064 tst gprs:sysmo+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:02:04.325033 tst ping_idle_ping.py:24: start network... 07:02:04.548293 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:02:05.060205 run create_hlr_db(pid=8470): Launched 07:02:05.196277 bus /gobi_6: Setting Powered False 07:02:06.258043 run create_hlr_db(pid=8470): Terminated: ok {rc=0} 07:02:06.719844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8472): Launched 07:02:07.050995 run osmo-hlr_10.42.42.2(pid=8473): Launched 07:02:07.177518 run osmo-stp_10.42.42.5: Starting osmo-stp 07:02:07.748600 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8475): Launched 07:02:08.079838 run osmo-stp_10.42.42.5(pid=8476): Launched 07:02:08.205437 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:02:08.775598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8478): Launched 07:02:08.900628 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:02:09.181199 run patchelf(pid=8479): Launched 07:02:09.363398 run osmo-stp_10.42.42.5(pid=8476): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8476)] 07:02:09.502382 run osmo-stp_10.42.42.5(pid=8476): stdout: | (launched: 2022-12-10_07:02:08.017811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:09.643328 run osmo-stp_10.42.42.5(pid=8476): stderr: | [0;m[38;5;43m20221210070208212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070208212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070208213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070208213 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070208213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070208214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070208214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:09.784089 run osmo-stp_10.42.42.5(pid=8476): stdout: | (launched: 2022-12-10_07:02:08.017811) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:09.919603 run osmo-stp_10.42.42.5(pid=8476): stderr: | [0;m[38;5;43m20221210070208212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070208212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070208213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070208213 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070208213 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070208214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070208214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:10.080176 run patchelf(pid=8479): Terminating (SIGINT) 07:02:10.265125 run patchelf(pid=8479): Terminated: ok {rc=0} 07:02:10.397826 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8476): Process ended prematurely: osmo-stp_10.42.42.5(pid=8476) [trial-2371↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8476)] [trial-2371↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27] 07:02:10.407454 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 07:02:10.435971 run osmo-hlr_10.42.42.2(pid=8473): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8473)] 07:02:10.487055 run osmo-hlr_10.42.42.2(pid=8473): stdout: | (launched: 2022-12-10_07:02:06.989166) 07:02:10.539828 run osmo-hlr_10.42.42.2(pid=8473): stderr: | [0;m[1;31m20221210070207192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070207192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070207192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070207192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070207192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070207192 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070207204 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:sysmo+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070207214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070207214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070207214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:02:10.593115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8472): Terminating (SIGTERM) 07:02:10.635851 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8475): Terminating (SIGTERM) 07:02:10.678642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8478): Terminating (SIGTERM) 07:02:10.721718 --- ParallelTerminationStrategy: PID 8472 died... 07:02:10.742205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8472): Terminated: ok {rc=0} 07:02:10.789673 --- ParallelTerminationStrategy: PID 8475 died... 07:02:10.809744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8475): Terminated: ok {rc=0} 07:02:10.857083 --- ParallelTerminationStrategy: PID 8478 died... 07:02:10.877164 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8478): Terminated: ok {rc=0} 07:02:10.967005 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:sysmo+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:sysmo+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:02:12.259386 tst gprs:sysmo+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:02:12.266030 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:02:12.288327 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:02:12.329793 tst gprs:sysmo+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:02:12.417085 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:02:12.437875 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:02:12.477116 tst gprs:sysmo+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:02:13.068685 tst gprs:sysmo+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:sysmo+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:02:13.119203 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:13.130308 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:02:13.185879 tst cs_paging_gprs_active.py: using LAC 26665 07:02:13.307442 tst cs_paging_gprs_active.py: using RAC 145 07:02:13.429606 tst cs_paging_gprs_active.py: using CellId 26665 07:02:13.552415 tst cs_paging_gprs_active.py: using BVCI 26666 07:02:13.666546 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:13.677566 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:13.688205 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:13.699346 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:13.710511 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:13.721589 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:13.732854 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:13.743655 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:13.754924 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:02:13.878477 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:02:13.997451 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:02:14.207478 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:02:14.522096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8484): Launched 07:02:14.794940 run iperf3-srv_10.42.42.10(pid=8485): Launched 07:02:14.912134 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:02:15.122018 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:02:15.436879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8486): Launched 07:02:15.709863 run iperf3-srv_10.42.42.10(pid=8487): Launched 07:02:15.826862 tst cs_paging_gprs_active.py:38: start network... 07:02:16.080380 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:02:16.618318 run create_hlr_db(pid=8488): Launched 07:02:16.789908 bus /gobi_6: Setting Powered False 07:02:17.851870 run create_hlr_db(pid=8488): Terminated: ok {rc=0} 07:02:18.325801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8490): Launched 07:02:18.662243 run osmo-hlr_10.42.42.2(pid=8491): Launched 07:02:18.790016 run osmo-stp_10.42.42.5: Starting osmo-stp 07:02:19.368930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8493): Launched 07:02:19.704705 run osmo-stp_10.42.42.5(pid=8494): Launched 07:02:19.831787 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:02:20.413354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8496): Launched 07:02:20.541235 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:02:20.826176 run patchelf(pid=8497): Launched 07:02:21.013259 run osmo-stp_10.42.42.5(pid=8494): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8494)] 07:02:21.155202 run osmo-stp_10.42.42.5(pid=8494): stdout: | (launched: 2022-12-10_07:02:19.641740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:21.298060 run osmo-stp_10.42.42.5(pid=8494): stderr: | [0;m[38;5;43m20221210070219839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070219839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070219840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070219840 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070219841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070219841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070219841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:21.441223 run osmo-stp_10.42.42.5(pid=8494): stdout: | (launched: 2022-12-10_07:02:19.641740) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:21.577717 run osmo-stp_10.42.42.5(pid=8494): stderr: | [0;m[38;5;43m20221210070219839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070219839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070219840 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070219840 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070219841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070219841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070219841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:21.739824 run patchelf(pid=8497): Terminating (SIGINT) 07:02:21.928699 run patchelf(pid=8497): Terminated: ok {rc=0} 07:02:22.064363 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8494): Process ended prematurely: osmo-stp_10.42.42.5(pid=8494) [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8494)] [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:02:22.074532 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 07:02:22.104110 run osmo-hlr_10.42.42.2(pid=8491): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8491)] 07:02:22.155059 run osmo-hlr_10.42.42.2(pid=8491): stdout: | (launched: 2022-12-10_07:02:18.599488) 07:02:22.207580 run osmo-hlr_10.42.42.2(pid=8491): stderr: | [0;m[1;31m20221210070218804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070218804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070218804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070218804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070218804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070218804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070218817 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:sysmo+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070218825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070218826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070218826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:02:22.260853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8484): Terminating (SIGTERM) 07:02:22.303259 run iperf3-srv_10.42.42.10(pid=8485): Terminating (SIGTERM) 07:02:22.346130 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8486): Terminating (SIGTERM) 07:02:22.388731 run iperf3-srv_10.42.42.10(pid=8487): Terminating (SIGTERM) 07:02:22.431397 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8490): Terminating (SIGTERM) 07:02:22.474029 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8493): Terminating (SIGTERM) 07:02:22.516422 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8496): Terminating (SIGTERM) 07:02:22.559290 --- ParallelTerminationStrategy: PID 8484 died... 07:02:22.579739 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8484): Terminated: ok {rc=0} 07:02:22.627697 --- ParallelTerminationStrategy: PID 8485 died... 07:02:22.647723 run iperf3-srv_10.42.42.10(pid=8485): Terminated {rc=256} 07:02:22.694610 --- ParallelTerminationStrategy: PID 8486 died... 07:02:22.714718 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8486): Terminated: ok {rc=0} 07:02:22.761517 --- ParallelTerminationStrategy: PID 8487 died... 07:02:22.781521 run iperf3-srv_10.42.42.10(pid=8487): Terminated {rc=256} 07:02:22.828144 --- ParallelTerminationStrategy: PID 8490 died... 07:02:22.848056 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8490): Terminated: ok {rc=0} 07:02:22.895059 --- ParallelTerminationStrategy: PID 8493 died... 07:02:22.915116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8493): Terminated: ok {rc=0} 07:02:22.962172 --- ParallelTerminationStrategy: PID 8496 died... 07:02:22.982296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8496): Terminated: ok {rc=0} 07:02:23.071500 bus /gobi_0: Setting Powered False 07:02:24.174007 bus /gobi_0: Setting Powered False 07:02:25.294499 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:sysmo+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:02:26.443503 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:26.455298 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:02:26.514412 tst iperf3.py: using LAC 26666 07:02:26.637825 tst iperf3.py: using RAC 146 07:02:26.761642 tst iperf3.py: using CellId 26666 07:02:26.892049 tst iperf3.py: using BVCI 26667 07:02:27.013094 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:27.024697 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:27.036036 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:27.047485 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:27.058765 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:27.070163 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:27.081927 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:27.093017 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:27.104847 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:02:27.221182 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:02:27.432356 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:02:27.747890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8498): Launched 07:02:28.022156 run iperf3-srv_10.42.42.10(pid=8499): Launched 07:02:28.138928 tst iperf3.py:8: start network... 07:02:28.347987 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:02:28.830955 run create_hlr_db(pid=8500): Launched 07:02:28.950477 bus /gobi_6: Setting Powered False 07:02:30.012390 run create_hlr_db(pid=8500): Terminated: ok {rc=0} 07:02:30.449677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8502): Launched 07:02:30.768407 run osmo-hlr_10.42.42.2(pid=8503): Launched 07:02:30.934017 run osmo-stp_10.42.42.5: Starting osmo-stp 07:02:31.679374 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8505): Launched 07:02:32.010853 run osmo-stp_10.42.42.5(pid=8506): Launched 07:02:32.151531 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:02:32.788937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8508): Launched 07:02:32.908180 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:02:33.173448 run patchelf(pid=8509): Launched 07:02:33.346368 run osmo-stp_10.42.42.5(pid=8506): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8506)] 07:02:33.477551 run osmo-stp_10.42.42.5(pid=8506): stdout: | (launched: 2022-12-10_07:02:31.949430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:33.610802 run osmo-stp_10.42.42.5(pid=8506): stderr: | [0;m[38;5;43m20221210070232305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070232305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070232306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070232306 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070232306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070232306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070232307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:33.743807 run osmo-stp_10.42.42.5(pid=8506): stdout: | (launched: 2022-12-10_07:02:31.949430) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:33.870810 run osmo-stp_10.42.42.5(pid=8506): stderr: | [0;m[38;5;43m20221210070232305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070232305 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070232306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070232306 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070232306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070232306 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070232307 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:34.021586 run patchelf(pid=8509): Terminating (SIGINT) 07:02:34.196251 run patchelf(pid=8509): Terminated: ok {rc=0} 07:02:34.322447 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8506): Process ended prematurely: osmo-stp_10.42.42.5(pid=8506) [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8506)] [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8] 07:02:34.331817 tst iperf3.py:8: Test FAILED (7.9 sec) 07:02:34.359815 run osmo-hlr_10.42.42.2(pid=8503): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8503)] 07:02:34.408546 run osmo-hlr_10.42.42.2(pid=8503): stdout: | (launched: 2022-12-10_07:02:30.708895) 07:02:34.459143 run osmo-hlr_10.42.42.2(pid=8503): stderr: | [0;m[1;31m20221210070230949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070230949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070230949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070230949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070230949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070230949 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070230972 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:sysmo+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070230988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070230989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070230989 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:02:34.510384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8498): Terminating (SIGTERM) 07:02:34.551149 run iperf3-srv_10.42.42.10(pid=8499): Terminating (SIGTERM) 07:02:34.591658 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8502): Terminating (SIGTERM) 07:02:34.632506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8505): Terminating (SIGTERM) 07:02:34.673009 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8508): Terminating (SIGTERM) 07:02:34.713801 --- ParallelTerminationStrategy: PID 8498 died... 07:02:34.733225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8498): Terminated: ok {rc=0} 07:02:34.778480 --- ParallelTerminationStrategy: PID 8499 died... 07:02:34.797450 run iperf3-srv_10.42.42.10(pid=8499): Terminated {rc=256} 07:02:34.842814 --- ParallelTerminationStrategy: PID 8502 died... 07:02:34.861855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8502): Terminated: ok {rc=0} 07:02:34.907109 --- ParallelTerminationStrategy: PID 8505 died... 07:02:34.925929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8505): Terminated: ok {rc=0} 07:02:34.971069 --- ParallelTerminationStrategy: PID 8508 died... 07:02:34.990190 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8508): Terminated: ok {rc=0} 07:02:35.077707 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:sysmo+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:02:36.227584 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:36.239260 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:02:36.295315 tst iperf3m4.py: using LAC 26667 07:02:36.419573 tst iperf3m4.py: using RAC 147 07:02:36.550502 tst iperf3m4.py: using CellId 26667 07:02:36.681414 tst iperf3m4.py: using BVCI 26668 07:02:36.802553 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:36.814507 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:36.826013 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:36.838049 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:36.850093 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:36.861976 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:36.874074 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:36.886014 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:36.898174 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:02:37.018858 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:02:37.145424 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:02:37.266794 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:02:37.386868 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:02:37.597524 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:02:37.913239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8511): Launched 07:02:38.220919 run iperf3-srv_10.42.42.10(pid=8516): Launched 07:02:38.337722 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:02:38.546380 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:02:38.860734 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8517): Launched 07:02:39.134027 run iperf3-srv_10.42.42.10(pid=8518): Launched 07:02:39.250506 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:02:39.459040 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:02:39.773094 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8519): Launched 07:02:40.047028 run iperf3-srv_10.42.42.10(pid=8520): Launched 07:02:40.164020 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:02:40.373020 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:02:40.688505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8521): Launched 07:02:40.961999 run iperf3-srv_10.42.42.10(pid=8522): Launched 07:02:41.078246 tst iperf3m4.py:8: start network... 07:02:41.287307 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:02:41.771141 run create_hlr_db(pid=8523): Launched 07:02:41.889768 bus /gobi_6: Setting Powered False 07:02:42.951908 run create_hlr_db(pid=8523): Terminated: ok {rc=0} 07:02:43.386174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8525): Launched 07:02:43.699420 run osmo-hlr_10.42.42.2(pid=8526): Launched 07:02:43.818333 run osmo-stp_10.42.42.5: Starting osmo-stp 07:02:44.364874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8528): Launched 07:02:44.676626 run osmo-stp_10.42.42.5(pid=8529): Launched 07:02:44.795536 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:02:45.330822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8531): Launched 07:02:45.449364 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:02:45.712735 run patchelf(pid=8532): Launched 07:02:45.899563 run osmo-stp_10.42.42.5(pid=8529): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8529)] 07:02:46.039152 run osmo-stp_10.42.42.5(pid=8529): stdout: | (launched: 2022-12-10_07:02:44.617661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:46.176389 run osmo-stp_10.42.42.5(pid=8529): stderr: | [0;m[38;5;43m20221210070244789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070244789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070244790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070244790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070244790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070244790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070244791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:46.313519 run osmo-stp_10.42.42.5(pid=8529): stdout: | (launched: 2022-12-10_07:02:44.617661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:02:46.444197 run osmo-stp_10.42.42.5(pid=8529): stderr: | [0;m[38;5;43m20221210070244789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070244789 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070244790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070244790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070244790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070244790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070244791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:02:46.599032 run patchelf(pid=8532): Terminating (SIGINT) 07:02:46.778437 run patchelf(pid=8532): Terminated: ok {rc=0} 07:02:46.908464 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8529): Process ended prematurely: osmo-stp_10.42.42.5(pid=8529) [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8529)] [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:02:46.919125 tst iperf3m4.py:8: Test FAILED (10.7 sec) 07:02:46.950463 run osmo-hlr_10.42.42.2(pid=8526): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8526)] 07:02:47.001904 run osmo-hlr_10.42.42.2(pid=8526): stdout: | (launched: 2022-12-10_07:02:43.639469) 07:02:47.054666 run osmo-hlr_10.42.42.2(pid=8526): stderr: | [0;m[1;31m20221210070243817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070243817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070243817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070243817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070243817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070243817 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070243828 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:sysmo+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070243836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070243836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070243837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:02:47.108038 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8511): Terminating (SIGTERM) 07:02:47.150996 run iperf3-srv_10.42.42.10(pid=8516): Terminating (SIGTERM) 07:02:47.193540 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8517): Terminating (SIGTERM) 07:02:47.236133 run iperf3-srv_10.42.42.10(pid=8518): Terminating (SIGTERM) 07:02:47.278261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8519): Terminating (SIGTERM) 07:02:47.318954 run iperf3-srv_10.42.42.10(pid=8520): Terminating (SIGTERM) 07:02:47.359249 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8521): Terminating (SIGTERM) 07:02:47.399624 run iperf3-srv_10.42.42.10(pid=8522): Terminating (SIGTERM) 07:02:47.439792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8525): Terminating (SIGTERM) 07:02:47.480108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8528): Terminating (SIGTERM) 07:02:47.520451 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8531): Terminating (SIGTERM) 07:02:47.560999 --- ParallelTerminationStrategy: PID 8511 died... 07:02:47.580350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8511): Terminated: ok {rc=0} 07:02:47.625531 --- ParallelTerminationStrategy: PID 8516 died... 07:02:47.644412 run iperf3-srv_10.42.42.10(pid=8516): Terminated {rc=256} 07:02:47.689209 --- ParallelTerminationStrategy: PID 8517 died... 07:02:47.708013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8517): Terminated: ok {rc=0} 07:02:47.753050 --- ParallelTerminationStrategy: PID 8518 died... 07:02:47.771881 run iperf3-srv_10.42.42.10(pid=8518): Terminated {rc=256} 07:02:47.816622 --- ParallelTerminationStrategy: PID 8519 died... 07:02:47.835682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8519): Terminated: ok {rc=0} 07:02:47.880456 --- ParallelTerminationStrategy: PID 8520 died... 07:02:47.899432 run iperf3-srv_10.42.42.10(pid=8520): Terminated {rc=256} 07:02:47.944212 --- ParallelTerminationStrategy: PID 8521 died... 07:02:47.963252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8521): Terminated: ok {rc=0} 07:02:48.008375 --- ParallelTerminationStrategy: PID 8522 died... 07:02:48.027532 run iperf3-srv_10.42.42.10(pid=8522): Terminated {rc=256} 07:02:48.072468 --- ParallelTerminationStrategy: PID 8525 died... 07:02:48.091395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8525): Terminated: ok {rc=0} 07:02:48.137628 --- ParallelTerminationStrategy: PID 8528 died... 07:02:48.156782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8528): Terminated: ok {rc=0} 07:02:48.202489 --- ParallelTerminationStrategy: PID 8531 died... 07:02:48.221636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8531): Terminated: ok {rc=0} 07:02:48.309378 bus /gobi_4: Setting Powered False 07:02:49.410471 bus /gobi_4: Setting Powered False 07:02:50.528676 bus /gobi_1: Setting Powered False 07:02:51.629549 bus /gobi_1: Setting Powered False 07:02:52.748204 bus /gobi_0: Setting Powered False 07:02:53.848593 bus /gobi_0: Setting Powered False 07:02:54.968222 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:sysmo+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:02:56.076038 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:56.088305 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:02:56.147574 tst ping.py: using LAC 26668 07:02:56.276901 tst ping.py: using RAC 148 07:02:56.405374 tst ping.py: using CellId 26668 07:02:56.534906 tst ping.py: using BVCI 26669 07:02:56.655671 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:56.667210 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:56.678512 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:56.689763 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:56.700711 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:56.711821 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:56.723290 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:02:56.734529 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:02:56.850630 tst ping.py:19: start network... 07:02:57.056606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:02:57.531443 run create_hlr_db(pid=8533): Launched 07:02:57.648723 bus /gobi_6: Setting Powered False 07:02:58.709826 run create_hlr_db(pid=8533): Terminated: ok {rc=0} 07:02:59.139574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8535): Launched 07:02:59.447747 run osmo-hlr_10.42.42.2(pid=8536): Launched 07:02:59.565079 run osmo-stp_10.42.42.5: Starting osmo-stp 07:03:00.104885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8538): Launched 07:03:00.412267 run osmo-stp_10.42.42.5(pid=8539): Launched 07:03:00.529249 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:03:01.065874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8541): Launched 07:03:01.228287 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:03:01.517874 run patchelf(pid=8543): Launched 07:03:01.754295 run osmo-stp_10.42.42.5(pid=8539): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8539)] 07:03:01.902480 run osmo-stp_10.42.42.5(pid=8539): stdout: | (launched: 2022-12-10_07:03:00.354344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:02.036846 run osmo-stp_10.42.42.5(pid=8539): stderr: | [0;m[38;5;43m20221210070300527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070300527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070300527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070300527 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070300528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070300528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070300528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:02.171837 run osmo-stp_10.42.42.5(pid=8539): stdout: | (launched: 2022-12-10_07:03:00.354344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:02.300025 run osmo-stp_10.42.42.5(pid=8539): stderr: | [0;m[38;5;43m20221210070300527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070300527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070300527 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070300527 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070300528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070300528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070300528 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:02.448081 run patchelf(pid=8543): Terminating (SIGINT) 07:03:02.620020 run patchelf(pid=8543): Terminated: ok {rc=0} 07:03:02.743903 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8539): Process ended prematurely: osmo-stp_10.42.42.5(pid=8539) [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8539)] [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22] 07:03:02.753152 tst ping.py:22: Test FAILED (6.7 sec) 07:03:02.780788 run osmo-hlr_10.42.42.2(pid=8536): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8536)] 07:03:02.830317 run osmo-hlr_10.42.42.2(pid=8536): stdout: | (launched: 2022-12-10_07:02:59.388626) 07:03:02.881126 run osmo-hlr_10.42.42.2(pid=8536): stderr: | [0;m[1;31m20221210070259567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070259567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070259567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070259567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070259567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070259567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070259580 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:sysmo+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070259588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070259588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070259588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:03:02.931983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8535): Terminating (SIGTERM) 07:03:02.972725 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8538): Terminating (SIGTERM) 07:03:03.013715 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8541): Terminating (SIGTERM) 07:03:03.054832 --- ParallelTerminationStrategy: PID 8535 died... 07:03:03.074446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8535): Terminated: ok {rc=0} 07:03:03.120231 --- ParallelTerminationStrategy: PID 8538 died... 07:03:03.139370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8538): Terminated: ok {rc=0} 07:03:03.185288 --- ParallelTerminationStrategy: PID 8541 died... 07:03:03.204316 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8541): Terminated: ok {rc=0} 07:03:03.292774 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:sysmo+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:03:04.384656 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:04.396926 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:03:04.457314 tst ping_idle_ping.py: using LAC 26669 07:03:04.578510 tst ping_idle_ping.py: using RAC 149 07:03:04.702785 tst ping_idle_ping.py: using CellId 26669 07:03:04.823534 tst ping_idle_ping.py: using BVCI 26670 07:03:04.936403 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:04.947457 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:04.958374 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:04.969915 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:04.981317 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:04.992570 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:05.006119 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:03:05.018381 tst gprs:sysmo+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:03:05.138486 tst ping_idle_ping.py:24: start network... 07:03:05.361982 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:03:05.875376 run create_hlr_db(pid=8544): Launched 07:03:06.009942 bus /gobi_6: Setting Powered False 07:03:07.071072 run create_hlr_db(pid=8544): Terminated: ok {rc=0} 07:03:07.534706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8546): Launched 07:03:07.850352 run osmo-hlr_10.42.42.2(pid=8547): Launched 07:03:07.967543 run osmo-stp_10.42.42.5: Starting osmo-stp 07:03:08.516260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8549): Launched 07:03:08.825349 run osmo-stp_10.42.42.5(pid=8550): Launched 07:03:08.942256 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:03:09.473292 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8552): Launched 07:03:09.590097 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:03:09.851637 run patchelf(pid=8553): Launched 07:03:10.022226 run osmo-stp_10.42.42.5(pid=8550): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8550)] 07:03:10.152193 run osmo-stp_10.42.42.5(pid=8550): stdout: | (launched: 2022-12-10_07:03:08.766933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:10.283657 run osmo-stp_10.42.42.5(pid=8550): stderr: | [0;m[38;5;43m20221210070308941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070308941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070308942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070308942 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070308942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070308943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070308943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:10.415706 run osmo-stp_10.42.42.5(pid=8550): stdout: | (launched: 2022-12-10_07:03:08.766933) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:10.541389 run osmo-stp_10.42.42.5(pid=8550): stderr: | [0;m[38;5;43m20221210070308941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070308941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070308942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070308942 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070308942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070308943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070308943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:10.689820 run patchelf(pid=8553): Terminating (SIGINT) 07:03:10.861896 run patchelf(pid=8553): Terminated: ok {rc=0} 07:03:10.985965 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8550): Process ended prematurely: osmo-stp_10.42.42.5(pid=8550) [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8550)] [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 07:03:10.994947 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 07:03:11.022007 run osmo-hlr_10.42.42.2(pid=8547): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8547)] 07:03:11.070674 run osmo-hlr_10.42.42.2(pid=8547): stdout: | (launched: 2022-12-10_07:03:07.790639) 07:03:11.121148 run osmo-hlr_10.42.42.2(pid=8547): stderr: | [0;m[1;31m20221210070307969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070307969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070307969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070307969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070307969 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070307970 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070307983 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:sysmo+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070307993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070307993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070307993 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:03:11.171876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8546): Terminating (SIGTERM) 07:03:11.212528 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8549): Terminating (SIGTERM) 07:03:11.253255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8552): Terminating (SIGTERM) 07:03:11.294307 --- ParallelTerminationStrategy: PID 8546 died... 07:03:11.313809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8546): Terminated: ok {rc=0} 07:03:11.359165 --- ParallelTerminationStrategy: PID 8549 died... 07:03:11.378322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8549): Terminated: ok {rc=0} 07:03:11.423441 --- ParallelTerminationStrategy: PID 8552 died... 07:03:11.442663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8552): Terminated: ok {rc=0} 07:03:11.528822 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:sysmo+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:sysmo+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:03:12.814609 tst gprs:sysmo+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:03:12.822518 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:03:12.845409 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 07:03:12.885221 tst gprs:sysmo+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 07:03:12.974580 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:03:12.996087 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 07:03:13.035443 tst gprs:sysmo+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 07:03:13.631318 tst gprs:sysmo+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:sysmo+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 07:03:13.685145 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:13.696539 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:03:13.755344 tst cs_paging_gprs_active.py: using LAC 26670 07:03:13.885406 tst cs_paging_gprs_active.py: using RAC 150 07:03:14.015395 tst cs_paging_gprs_active.py: using CellId 26670 07:03:14.148684 tst cs_paging_gprs_active.py: using BVCI 26671 07:03:14.271173 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:14.282539 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:14.293751 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:14.305027 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:14.316305 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:14.327620 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:14.339101 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:14.351028 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:14.362826 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:03:14.482209 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:03:14.599581 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:03:14.810015 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:03:15.125629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8557): Launched 07:03:15.398927 run iperf3-srv_10.42.42.10(pid=8558): Launched 07:03:15.515588 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:03:15.725511 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:03:16.050334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8559): Launched 07:03:16.358144 run iperf3-srv_10.42.42.10(pid=8560): Launched 07:03:16.500569 tst cs_paging_gprs_active.py:38: start network... 07:03:16.735910 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:03:17.266491 run create_hlr_db(pid=8561): Launched 07:03:17.402822 bus /gobi_6: Setting Powered False 07:03:18.469403 run create_hlr_db(pid=8561): Terminated: ok {rc=0} 07:03:18.935461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8563): Launched 07:03:19.271696 run osmo-hlr_10.42.42.2(pid=8564): Launched 07:03:19.398533 run osmo-stp_10.42.42.5: Starting osmo-stp 07:03:19.971945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8566): Launched 07:03:20.307203 run osmo-stp_10.42.42.5(pid=8567): Launched 07:03:20.434970 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:03:21.013180 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8569): Launched 07:03:21.141076 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:03:21.425663 run patchelf(pid=8570): Launched 07:03:21.611248 run osmo-stp_10.42.42.5(pid=8567): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8567)] 07:03:21.752555 run osmo-stp_10.42.42.5(pid=8567): stdout: | (launched: 2022-12-10_07:03:20.244487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:21.895346 run osmo-stp_10.42.42.5(pid=8567): stderr: | [0;m[38;5;43m20221210070320440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070320441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070320441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070320442 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070320443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070320443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070320443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:22.037594 run osmo-stp_10.42.42.5(pid=8567): stdout: | (launched: 2022-12-10_07:03:20.244487) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:22.174481 run osmo-stp_10.42.42.5(pid=8567): stderr: | [0;m[38;5;43m20221210070320440 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070320441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070320441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070320442 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070320443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070320443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070320443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:22.335931 run patchelf(pid=8570): Terminating (SIGINT) 07:03:22.524177 run patchelf(pid=8570): Terminated: ok {rc=0} 07:03:22.659646 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8567): Process ended prematurely: osmo-stp_10.42.42.5(pid=8567) [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8567)] [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 07:03:22.669951 tst cs_paging_gprs_active.py:38: Test FAILED (9.0 sec) 07:03:22.698550 run osmo-hlr_10.42.42.2(pid=8564): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8564)] 07:03:22.749161 run osmo-hlr_10.42.42.2(pid=8564): stdout: | (launched: 2022-12-10_07:03:19.208784) 07:03:22.801563 run osmo-hlr_10.42.42.2(pid=8564): stderr: | [0;m[1;31m20221210070319410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070319410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070319410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070319410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070319410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070319411 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070319423 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:sysmo+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070319432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070319432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070319432 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:03:22.854505 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8557): Terminating (SIGTERM) 07:03:22.897156 run iperf3-srv_10.42.42.10(pid=8558): Terminating (SIGTERM) 07:03:22.939716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8559): Terminating (SIGTERM) 07:03:22.982685 run iperf3-srv_10.42.42.10(pid=8560): Terminating (SIGTERM) 07:03:23.025388 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8563): Terminating (SIGTERM) 07:03:23.067986 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8566): Terminating (SIGTERM) 07:03:23.110898 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8569): Terminating (SIGTERM) 07:03:23.153525 --- ParallelTerminationStrategy: PID 8557 died... 07:03:23.174143 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8557): Terminated: ok {rc=0} 07:03:23.221423 --- ParallelTerminationStrategy: PID 8558 died... 07:03:23.241402 run iperf3-srv_10.42.42.10(pid=8558): Terminated {rc=256} 07:03:23.288234 --- ParallelTerminationStrategy: PID 8559 died... 07:03:23.308298 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8559): Terminated: ok {rc=0} 07:03:23.355097 --- ParallelTerminationStrategy: PID 8560 died... 07:03:23.374904 run iperf3-srv_10.42.42.10(pid=8560): Terminated {rc=256} 07:03:23.421642 --- ParallelTerminationStrategy: PID 8563 died... 07:03:23.441734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8563): Terminated: ok {rc=0} 07:03:23.488397 --- ParallelTerminationStrategy: PID 8566 died... 07:03:23.508379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8566): Terminated: ok {rc=0} 07:03:23.555343 --- ParallelTerminationStrategy: PID 8569 died... 07:03:23.575295 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8569): Terminated: ok {rc=0} 07:03:23.665214 bus /gobi_0: Setting Powered False 07:03:24.766392 bus /gobi_0: Setting Powered False 07:03:25.883340 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:sysmo+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 07:03:27.035175 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:27.047454 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:03:27.110082 tst iperf3.py: using LAC 26671 07:03:27.236133 tst iperf3.py: using RAC 151 07:03:27.359498 tst iperf3.py: using CellId 26671 07:03:27.484457 tst iperf3.py: using BVCI 26672 07:03:27.607950 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:27.619635 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:27.631152 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:27.642867 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:27.654367 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:27.666083 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:27.677882 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:27.689411 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:27.700850 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:03:27.819637 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:03:28.030640 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:03:28.346259 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8571): Launched 07:03:28.622003 run iperf3-srv_10.42.42.10(pid=8572): Launched 07:03:28.739419 tst iperf3.py:8: start network... 07:03:28.950007 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:03:29.434791 run create_hlr_db(pid=8573): Launched 07:03:29.553911 bus /gobi_6: Setting Powered False 07:03:30.616497 run create_hlr_db(pid=8573): Terminated: ok {rc=0} 07:03:31.086295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8575): Launched 07:03:31.420923 run osmo-hlr_10.42.42.2(pid=8576): Launched 07:03:31.659878 run osmo-stp_10.42.42.5: Starting osmo-stp 07:03:32.344326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8578): Launched 07:03:32.659164 run osmo-stp_10.42.42.5(pid=8579): Launched 07:03:32.779822 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:03:33.318562 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8581): Launched 07:03:33.437942 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:03:33.703052 run patchelf(pid=8582): Launched 07:03:33.876701 run osmo-stp_10.42.42.5(pid=8579): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8579)] 07:03:34.008265 run osmo-stp_10.42.42.5(pid=8579): stdout: | (launched: 2022-12-10_07:03:32.599983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:34.141726 run osmo-stp_10.42.42.5(pid=8579): stderr: | [0;m[38;5;43m20221210070332774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070332774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070332774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070332774 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070332775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070332775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070332775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:34.275518 run osmo-stp_10.42.42.5(pid=8579): stdout: | (launched: 2022-12-10_07:03:32.599983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:34.402777 run osmo-stp_10.42.42.5(pid=8579): stderr: | [0;m[38;5;43m20221210070332774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070332774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070332774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070332774 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070332775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070332775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070332775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:34.554095 run patchelf(pid=8582): Terminating (SIGINT) 07:03:34.729777 run patchelf(pid=8582): Terminated: ok {rc=0} 07:03:34.856596 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8579): Process ended prematurely: osmo-stp_10.42.42.5(pid=8579) [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8579)] [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8] 07:03:34.866265 tst iperf3.py:8: Test FAILED (7.9 sec) 07:03:34.894149 run osmo-hlr_10.42.42.2(pid=8576): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8576)] 07:03:34.942650 run osmo-hlr_10.42.42.2(pid=8576): stdout: | (launched: 2022-12-10_07:03:31.358290) 07:03:34.993036 run osmo-hlr_10.42.42.2(pid=8576): stderr: | [0;m[1;31m20221210070331710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070331710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070331710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070331710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070331710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070331710 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070331731 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:sysmo+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070331750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070331750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070331750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:03:35.043581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8571): Terminating (SIGTERM) 07:03:35.084043 run iperf3-srv_10.42.42.10(pid=8572): Terminating (SIGTERM) 07:03:35.124498 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8575): Terminating (SIGTERM) 07:03:35.164905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8578): Terminating (SIGTERM) 07:03:35.205139 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8581): Terminating (SIGTERM) 07:03:35.246214 --- ParallelTerminationStrategy: PID 8571 died... 07:03:35.265585 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8571): Terminated: ok {rc=0} 07:03:35.310629 --- ParallelTerminationStrategy: PID 8572 died... 07:03:35.329341 run iperf3-srv_10.42.42.10(pid=8572): Terminated {rc=256} 07:03:35.374272 --- ParallelTerminationStrategy: PID 8575 died... 07:03:35.393248 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8575): Terminated: ok {rc=0} 07:03:35.438200 --- ParallelTerminationStrategy: PID 8578 died... 07:03:35.457205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8578): Terminated: ok {rc=0} 07:03:35.502344 --- ParallelTerminationStrategy: PID 8581 died... 07:03:35.521116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8581): Terminated: ok {rc=0} 07:03:35.608477 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:sysmo+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 07:03:36.759303 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:36.771323 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:03:36.829297 tst iperf3m4.py: using LAC 26672 07:03:36.952265 tst iperf3m4.py: using RAC 152 07:03:37.076440 tst iperf3m4.py: using CellId 26672 07:03:37.204776 tst iperf3m4.py: using BVCI 26673 07:03:37.318294 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:37.329362 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:37.340014 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:37.351165 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:37.362165 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:37.373206 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:37.384271 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:37.395289 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:37.406791 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:03:37.524436 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:03:37.648558 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:03:37.774223 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:03:37.895032 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:03:38.105509 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:03:38.420388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8583): Launched 07:03:38.693898 run iperf3-srv_10.42.42.10(pid=8584): Launched 07:03:38.810185 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:03:39.018524 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:03:39.332920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8585): Launched 07:03:39.605947 run iperf3-srv_10.42.42.10(pid=8586): Launched 07:03:39.722447 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:03:39.931047 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:03:40.245574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8587): Launched 07:03:40.518121 run iperf3-srv_10.42.42.10(pid=8588): Launched 07:03:40.634901 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:03:40.842878 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:03:41.157132 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8589): Launched 07:03:41.429625 run iperf3-srv_10.42.42.10(pid=8590): Launched 07:03:41.546052 tst iperf3m4.py:8: start network... 07:03:41.754094 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:03:42.238983 run create_hlr_db(pid=8591): Launched 07:03:42.358100 bus /gobi_6: Setting Powered False 07:03:43.423908 run create_hlr_db(pid=8591): Terminated: ok {rc=0} 07:03:43.870699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8593): Launched 07:03:44.184706 run osmo-hlr_10.42.42.2(pid=8594): Launched 07:03:44.303947 run osmo-stp_10.42.42.5: Starting osmo-stp 07:03:44.862310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8596): Launched 07:03:45.176202 run osmo-stp_10.42.42.5(pid=8597): Launched 07:03:45.295177 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:03:45.849910 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8599): Launched 07:03:45.989074 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:03:46.263019 run patchelf(pid=8600): Launched 07:03:46.455367 run osmo-stp_10.42.42.5(pid=8597): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8597)] 07:03:46.591891 run osmo-stp_10.42.42.5(pid=8597): stdout: | (launched: 2022-12-10_07:03:45.116539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:46.729358 run osmo-stp_10.42.42.5(pid=8597): stderr: | [0;m[38;5;43m20221210070345291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070345291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070345291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070345292 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070345292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070345292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070345292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:46.867228 run osmo-stp_10.42.42.5(pid=8597): stdout: | (launched: 2022-12-10_07:03:45.116539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:03:46.998695 run osmo-stp_10.42.42.5(pid=8597): stderr: | [0;m[38;5;43m20221210070345291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070345291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070345291 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070345292 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070345292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070345292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070345292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:03:47.154211 run patchelf(pid=8600): Terminating (SIGINT) 07:03:47.333249 run patchelf(pid=8600): Terminated: ok {rc=0} 07:03:47.460914 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8597): Process ended prematurely: osmo-stp_10.42.42.5(pid=8597) [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8597)] [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8] 07:03:47.470833 tst iperf3m4.py:8: Test FAILED (10.7 sec) 07:03:47.499534 run osmo-hlr_10.42.42.2(pid=8594): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8594)] 07:03:47.549213 run osmo-hlr_10.42.42.2(pid=8594): stdout: | (launched: 2022-12-10_07:03:44.125169) 07:03:47.600360 run osmo-hlr_10.42.42.2(pid=8594): stderr: | [0;m[1;31m20221210070344306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070344306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070344306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070344306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070344306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070344306 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070344318 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:sysmo+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070344329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070344329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070344329 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:03:47.651754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8583): Terminating (SIGTERM) 07:03:47.692816 run iperf3-srv_10.42.42.10(pid=8584): Terminating (SIGTERM) 07:03:47.734116 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8585): Terminating (SIGTERM) 07:03:47.775351 run iperf3-srv_10.42.42.10(pid=8586): Terminating (SIGTERM) 07:03:47.816471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8587): Terminating (SIGTERM) 07:03:47.857544 run iperf3-srv_10.42.42.10(pid=8588): Terminating (SIGTERM) 07:03:47.898425 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8589): Terminating (SIGTERM) 07:03:47.939387 run iperf3-srv_10.42.42.10(pid=8590): Terminating (SIGTERM) 07:03:47.980178 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8593): Terminating (SIGTERM) 07:03:48.021339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8596): Terminating (SIGTERM) 07:03:48.062136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8599): Terminating (SIGTERM) 07:03:48.103382 --- ParallelTerminationStrategy: PID 8583 died... 07:03:48.123194 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8583): Terminated: ok {rc=0} 07:03:48.169127 --- ParallelTerminationStrategy: PID 8584 died... 07:03:48.188340 run iperf3-srv_10.42.42.10(pid=8584): Terminated {rc=256} 07:03:48.233972 --- ParallelTerminationStrategy: PID 8585 died... 07:03:48.253270 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8585): Terminated: ok {rc=0} 07:03:48.298620 --- ParallelTerminationStrategy: PID 8586 died... 07:03:48.317779 run iperf3-srv_10.42.42.10(pid=8586): Terminated {rc=256} 07:03:48.363233 --- ParallelTerminationStrategy: PID 8587 died... 07:03:48.382466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8587): Terminated: ok {rc=0} 07:03:48.428083 --- ParallelTerminationStrategy: PID 8588 died... 07:03:48.447222 run iperf3-srv_10.42.42.10(pid=8588): Terminated {rc=256} 07:03:48.492505 --- ParallelTerminationStrategy: PID 8589 died... 07:03:48.511725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8589): Terminated: ok {rc=0} 07:03:48.557383 --- ParallelTerminationStrategy: PID 8590 died... 07:03:48.576449 run iperf3-srv_10.42.42.10(pid=8590): Terminated {rc=256} 07:03:48.622239 --- ParallelTerminationStrategy: PID 8593 died... 07:03:48.641593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8593): Terminated: ok {rc=0} 07:03:48.687118 --- ParallelTerminationStrategy: PID 8596 died... 07:03:48.706316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8596): Terminated: ok {rc=0} 07:03:48.751664 --- ParallelTerminationStrategy: PID 8599 died... 07:03:48.770938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8599): Terminated: ok {rc=0} 07:03:48.859229 bus /gobi_4: Setting Powered False 07:03:49.960655 bus /gobi_4: Setting Powered False 07:03:51.078664 bus /gobi_1: Setting Powered False 07:03:52.181658 bus /gobi_1: Setting Powered False 07:03:53.301462 bus /gobi_0: Setting Powered False 07:03:54.400832 bus /gobi_0: Setting Powered False 07:03:55.517599 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:sysmo+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 07:03:56.621468 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:56.632824 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:03:56.690548 tst ping.py: using LAC 26673 07:03:56.811084 tst ping.py: using RAC 153 07:03:56.932290 tst ping.py: using CellId 26673 07:03:57.057176 tst ping.py: using BVCI 26674 07:03:57.169321 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:57.180248 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:57.191018 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:57.202398 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:57.213326 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:57.224247 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:57.235374 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:03:57.246330 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:03:57.360778 tst ping.py:19: start network... 07:03:57.566040 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:03:58.040653 run create_hlr_db(pid=8601): Launched 07:03:58.157807 bus /gobi_6: Setting Powered False 07:03:59.218937 run create_hlr_db(pid=8601): Terminated: ok {rc=0} 07:03:59.648732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8603): Launched 07:03:59.956747 run osmo-hlr_10.42.42.2(pid=8604): Launched 07:04:00.073939 run osmo-stp_10.42.42.5: Starting osmo-stp 07:04:00.620021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8606): Launched 07:04:00.931946 run osmo-stp_10.42.42.5(pid=8607): Launched 07:04:01.061626 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:04:01.776892 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8609): Launched 07:04:01.909205 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:04:02.177191 run patchelf(pid=8610): Launched 07:04:02.364177 run osmo-stp_10.42.42.5(pid=8607): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8607)] 07:04:02.502053 run osmo-stp_10.42.42.5(pid=8607): stdout: | (launched: 2022-12-10_07:04:00.870928) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:02.643222 run osmo-stp_10.42.42.5(pid=8607): stderr: | [0;m[38;5;43m20221210070401172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070401172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070401172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070401172 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070401173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070401173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070401173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:02.784466 run osmo-stp_10.42.42.5(pid=8607): stdout: | (launched: 2022-12-10_07:04:00.870928) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:02.918778 run osmo-stp_10.42.42.5(pid=8607): stderr: | [0;m[38;5;43m20221210070401172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070401172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070401172 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070401172 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070401173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070401173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070401173 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:03.077822 run patchelf(pid=8610): Terminating (SIGINT) 07:04:03.262158 run patchelf(pid=8610): Terminated: ok {rc=0} 07:04:03.395065 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=8607): Process ended prematurely: osmo-stp_10.42.42.5(pid=8607) [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8607)] [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22] 07:04:03.404908 tst ping.py:22: Test FAILED (6.8 sec) 07:04:03.433949 run osmo-hlr_10.42.42.2(pid=8604): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8604)] 07:04:03.485138 run osmo-hlr_10.42.42.2(pid=8604): stdout: | (launched: 2022-12-10_07:03:59.898285) 07:04:03.537938 run osmo-hlr_10.42.42.2(pid=8604): stderr: | [0;m[1;31m20221210070400078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070400078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070400078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070400078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070400078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070400078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070400091 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:sysmo+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070400102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070400102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070400102 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:04:03.591399 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8603): Terminating (SIGTERM) 07:04:03.634386 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8606): Terminating (SIGTERM) 07:04:03.677089 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8609): Terminating (SIGTERM) 07:04:03.720233 --- ParallelTerminationStrategy: PID 8603 died... 07:04:03.740889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8603): Terminated: ok {rc=0} 07:04:03.788780 --- ParallelTerminationStrategy: PID 8606 died... 07:04:03.809352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8606): Terminated: ok {rc=0} 07:04:03.856912 --- ParallelTerminationStrategy: PID 8609 died... 07:04:03.877147 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8609): Terminated: ok {rc=0} 07:04:03.967268 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:sysmo+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 07:04:05.057110 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:05.069562 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:04:05.130163 tst ping_idle_ping.py: using LAC 26674 07:04:05.259937 tst ping_idle_ping.py: using RAC 154 07:04:05.390998 tst ping_idle_ping.py: using CellId 26674 07:04:05.521641 tst ping_idle_ping.py: using BVCI 26675 07:04:05.643092 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:05.654878 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:05.666205 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:05.677707 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:05.689029 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:05.700480 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:05.712151 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:04:05.723851 tst gprs:sysmo+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:04:05.843858 tst ping_idle_ping.py:24: start network... 07:04:06.065958 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:04:06.580365 run create_hlr_db(pid=8611): Launched 07:04:06.715538 bus /gobi_6: Setting Powered False 07:04:07.780717 run create_hlr_db(pid=8611): Terminated: ok {rc=0} 07:04:08.220654 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8613): Launched 07:04:08.529543 run osmo-hlr_10.42.42.2(pid=8614): Launched 07:04:08.647023 run osmo-stp_10.42.42.5: Starting osmo-stp 07:04:09.191313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8616): Launched 07:04:09.499184 run osmo-stp_10.42.42.5(pid=8617): Launched 07:04:09.617085 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:04:10.148202 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8619): Launched 07:04:10.265635 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:04:10.526892 run patchelf(pid=8620): Launched 07:04:10.698127 run osmo-stp_10.42.42.5(pid=8617): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8617)] 07:04:10.829129 run osmo-stp_10.42.42.5(pid=8617): stdout: | (launched: 2022-12-10_07:04:09.440916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:10.961182 run osmo-stp_10.42.42.5(pid=8617): stderr: | [0;m[38;5;43m20221210070409612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070409612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070409612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070409613 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070409613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070409613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070409614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:11.093370 run osmo-stp_10.42.42.5(pid=8617): stdout: | (launched: 2022-12-10_07:04:09.440916) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:11.219236 run osmo-stp_10.42.42.5(pid=8617): stderr: | [0;m[38;5;43m20221210070409612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070409612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070409612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070409613 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070409613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070409613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070409614 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:11.368091 run patchelf(pid=8620): Terminating (SIGINT) 07:04:11.541263 run patchelf(pid=8620): Terminated: ok {rc=0} 07:04:11.665987 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=8617): Process ended prematurely: osmo-stp_10.42.42.5(pid=8617) [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8617)] [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 07:04:11.674856 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 07:04:11.702089 run osmo-hlr_10.42.42.2(pid=8614): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8614)] 07:04:11.751295 run osmo-hlr_10.42.42.2(pid=8614): stdout: | (launched: 2022-12-10_07:04:08.471141) 07:04:11.802131 run osmo-hlr_10.42.42.2(pid=8614): stderr: | [0;m[1;31m20221210070408648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070408648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070408648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070408648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070408648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070408649 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070408661 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:sysmo+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070408670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070408671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070408671 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:04:11.853516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8613): Terminating (SIGTERM) 07:04:11.894517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8616): Terminating (SIGTERM) 07:04:11.935568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8619): Terminating (SIGTERM) 07:04:11.977284 --- ParallelTerminationStrategy: PID 8613 died... 07:04:11.996755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8613): Terminated: ok {rc=0} 07:04:12.042485 --- ParallelTerminationStrategy: PID 8616 died... 07:04:12.061563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8616): Terminated: ok {rc=0} 07:04:12.107116 --- ParallelTerminationStrategy: PID 8619 died... 07:04:12.126306 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8619): Terminated: ok {rc=0} 07:04:12.211642 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:sysmo+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:04:13.507408 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:04:13.515208 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:04:13.537337 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 07:04:13.572694 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:04:13.627801 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:04:13.649402 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 07:04:13.685451 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:04:14.244872 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2371 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 07:04:14.250591 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:04:14.262475 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:04:14.320807 tst switch_tch_pdch.py: using LAC 26675 07:04:14.450829 tst switch_tch_pdch.py: using RAC 155 07:04:14.578519 tst switch_tch_pdch.py: using CellId 26675 07:04:14.707785 tst switch_tch_pdch.py: using BVCI 26676 07:04:14.827121 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:04:14.838961 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:04:14.850537 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:04:14.862319 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:04:14.873990 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:04:14.885695 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:04:14.897623 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:04:14.909270 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:04:15.026818 tst dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:04:15.147920 tst switch_tch_pdch.py:51: start network... 07:04:15.368903 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:04:15.893993 run create_hlr_db(pid=8624): Launched 07:04:16.052715 bus /gobi_6: Setting Powered False 07:04:17.129820 run create_hlr_db(pid=8624): Terminated: ok {rc=0} 07:04:17.620666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8626): Launched 07:04:17.948753 run osmo-hlr_10.42.42.2(pid=8627): Launched 07:04:18.073370 run osmo-stp_10.42.42.5: Starting osmo-stp 07:04:18.641163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8629): Launched 07:04:18.969408 run osmo-stp_10.42.42.5(pid=8630): Launched 07:04:19.093654 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:04:19.659985 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8632): Launched 07:04:19.784739 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:04:20.062577 run patchelf(pid=8633): Launched 07:04:20.244797 run osmo-stp_10.42.42.5(pid=8630): ERR: Terminated: ERROR {rc=1} [trial-2371↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8630)] 07:04:20.383139 run osmo-stp_10.42.42.5(pid=8630): stdout: | (launched: 2022-12-10_07:04:18.907886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:20.523331 run osmo-stp_10.42.42.5(pid=8630): stderr: | [0;m[38;5;43m20221210070419105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070419105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070419105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070419106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070419106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070419106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070419106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:20.663385 run osmo-stp_10.42.42.5(pid=8630): stdout: | (launched: 2022-12-10_07:04:18.907886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:20.797411 run osmo-stp_10.42.42.5(pid=8630): stderr: | [0;m[38;5;43m20221210070419105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070419105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070419105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070419106 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070419106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070419106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070419106 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:20.956881 run patchelf(pid=8633): Terminating (SIGINT) 07:04:21.141937 run patchelf(pid=8633): Terminated: ok {rc=0} 07:04:21.274756 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8630): Process ended prematurely: osmo-stp_10.42.42.5(pid=8630) [trial-2371↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8630)] [trial-2371↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 07:04:21.284283 tst switch_tch_pdch.py:54: Test FAILED (7.0 sec) 07:04:21.312496 run osmo-hlr_10.42.42.2(pid=8627): ERR: Terminated: ERROR {rc=237} [trial-2371↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8627)] 07:04:21.363269 run osmo-hlr_10.42.42.2(pid=8627): stdout: | (launched: 2022-12-10_07:04:17.887218) 07:04:21.415758 run osmo-hlr_10.42.42.2(pid=8627): stderr: | [0;m[1;31m20221210070418090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070418090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070418090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070418090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070418090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070418090 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070418102 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070418110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070418111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070418111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:04:21.468535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8626): Terminating (SIGTERM) 07:04:21.511162 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8629): Terminating (SIGTERM) 07:04:21.553949 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8632): Terminating (SIGTERM) 07:04:21.596798 --- ParallelTerminationStrategy: PID 8626 died... 07:04:21.617431 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8626): Terminated: ok {rc=0} 07:04:21.664800 --- ParallelTerminationStrategy: PID 8629 died... 07:04:21.685412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8629): Terminated: ok {rc=0} 07:04:21.732542 --- ParallelTerminationStrategy: PID 8632 died... 07:04:21.752549 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8632): Terminated: ok {rc=0} 07:04:21.842585 bus /gobi_0: Setting Powered False 07:04:22.944089 bus /gobi_0: Setting Powered False 07:04:24.062101 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 dynts:sysmo+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 07:04:25.305729 tst dynts:sysmo+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:04:25.312231 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 07:04:25.334065 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 07:04:25.369593 tst dynts:sysmo+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 07:04:25.423852 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 07:04:25.445225 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 07:04:25.480575 tst dynts:sysmo+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 07:04:26.036707 tst dynts:sysmo+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2371 dynts:sysmo+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 07:04:26.042038 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:04:26.053513 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 07:04:26.111646 tst switch_tch_pdch.py: using LAC 26676 07:04:26.241885 tst switch_tch_pdch.py: using RAC 156 07:04:26.371535 tst switch_tch_pdch.py: using CellId 26676 07:04:26.493401 tst switch_tch_pdch.py: using BVCI 26677 07:04:26.607750 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:04:26.618935 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:04:26.630078 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:04:26.641510 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:04:26.652743 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:04:26.664164 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:04:26.675833 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:04:26.687175 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:04:26.807416 tst dynts:sysmo+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:04:26.928701 tst switch_tch_pdch.py:51: start network... 07:04:27.149982 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:04:27.630748 run create_hlr_db(pid=8637): Launched 07:04:27.763915 bus /gobi_6: Setting Powered False 07:04:28.828430 run create_hlr_db(pid=8637): Terminated: ok {rc=0} 07:04:29.243182 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8639): Launched 07:04:29.551520 run osmo-hlr_10.42.42.2(pid=8640): Launched 07:04:29.669432 run osmo-stp_10.42.42.5: Starting osmo-stp 07:04:30.187410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8642): Launched 07:04:30.495467 run osmo-stp_10.42.42.5(pid=8643): Launched 07:04:30.612795 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:04:31.146627 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8645): Launched 07:04:31.278150 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:04:31.545714 run patchelf(pid=8646): Launched 07:04:31.735999 run osmo-stp_10.42.42.5(pid=8643): ERR: Terminated: ERROR {rc=1} [trial-2371↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8643)] 07:04:31.869118 run osmo-stp_10.42.42.5(pid=8643): stdout: | (launched: 2022-12-10_07:04:30.437261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:32.004148 run osmo-stp_10.42.42.5(pid=8643): stderr: | [0;m[38;5;43m20221210070430609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070430609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070430610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070430610 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070430611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070430611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070430611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:32.139246 run osmo-stp_10.42.42.5(pid=8643): stdout: | (launched: 2022-12-10_07:04:30.437261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:32.267238 run osmo-stp_10.42.42.5(pid=8643): stderr: | [0;m[38;5;43m20221210070430609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070430609 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070430610 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070430610 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070430611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070430611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070430611 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:32.417290 run patchelf(pid=8646): Terminating (SIGINT) 07:04:32.589899 run patchelf(pid=8646): Terminated: ok {rc=0} 07:04:32.714514 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=8643): Process ended prematurely: osmo-stp_10.42.42.5(pid=8643) [trial-2371↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8643)] [trial-2371↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 07:04:32.723678 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 07:04:32.751137 run osmo-hlr_10.42.42.2(pid=8640): ERR: Terminated: ERROR {rc=237} [trial-2371↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8640)] 07:04:32.800549 run osmo-hlr_10.42.42.2(pid=8640): stdout: | (launched: 2022-12-10_07:04:29.493331) 07:04:32.851296 run osmo-hlr_10.42.42.2(pid=8640): stderr: | [0;m[1;31m20221210070429673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070429673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070429673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070429673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070429673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070429673 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070429685 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/dynts:sysmo+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070429694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070429694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070429694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:04:32.902220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8639): Terminating (SIGTERM) 07:04:32.943288 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8642): Terminating (SIGTERM) 07:04:32.984333 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8645): Terminating (SIGTERM) 07:04:33.025461 --- ParallelTerminationStrategy: PID 8639 died... 07:04:33.044874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8639): Terminated: ok {rc=0} 07:04:33.090731 --- ParallelTerminationStrategy: PID 8642 died... 07:04:33.109955 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8642): Terminated: ok {rc=0} 07:04:33.155287 --- ParallelTerminationStrategy: PID 8645 died... 07:04:33.174379 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8645): Terminated: ok {rc=0} 07:04:33.262070 bus /gobi_0: Setting Powered False 07:04:34.362947 bus /gobi_0: Setting Powered False 07:04:35.477775 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 dynts:sysmo+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 nitb_sms:oc2g --------------------------------------------------------------------- 07:04:36.726327 tst nitb_sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:04:36.730661 tst nitb_sms:oc2g: Verifying 1 x bts (candidates: 11) 07:04:36.752104 tst nitb_sms:oc2g: Verifying 1 x ip_address (candidates: 9) 07:04:36.759743 tst nitb_sms:oc2g: Verifying 2 x modem (candidates: 12) 07:04:36.810917 tst nitb_sms:oc2g: Reserving 1 x bts (candidates: 11) 07:04:36.832237 tst nitb_sms:oc2g: Reserving 1 x ip_address (candidates: 9) 07:04:36.839499 tst nitb_sms:oc2g: Reserving 2 x modem (candidates: 12) 07:04:37.380058 tst nitb_sms:oc2g: RESERVED RESOURCES for nitb_sms: bts OC-2G ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 nitb_sms:oc2g mo_mt_sms.py ---------------------------------------------- 07:04:37.385592 tst nitb_sms:oc2g: Using 1 x ip_address (candidates: 1) 07:04:37.396817 tst nitb_sms:oc2g: Using 1 x bts (candidates: 1) 07:04:37.432582 tst mo_mt_sms.py: using LAC 26677 07:04:37.560357 tst mo_mt_sms.py: using RAC 157 07:04:37.687334 tst mo_mt_sms.py: using CellId 26677 07:04:37.817223 tst mo_mt_sms.py: using BVCI 26678 07:04:37.936382 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 07:04:38.051422 tst nitb_sms:oc2g: Using 1 x modem (candidates: 2) 07:04:38.172020 tst mo_mt_sms.py:9: start nitb and bts... 07:04:38.394404 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:04:39.065594 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8650): Launched 07:04:39.396750 run osmo-nitb_10.42.42.2(pid=8651): Launched 07:04:39.578407 run osmo-nitb_10.42.42.2(pid=8651): ERR: Terminated: ERROR {rc=2} [trial-2371↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8651)] 07:04:39.724521 run osmo-nitb_10.42.42.2(pid=8651): stdout: | (launched: 2022-12-10_07:04:39.334950) 07:04:39.872623 run osmo-nitb_10.42.42.2(pid=8651): stderr: | (launched: 2022-12-10_07:04:39.383707) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:04:40.020663 run osmo-nitb_10.42.42.2(pid=8651): stdout: | (launched: 2022-12-10_07:04:39.334950) 07:04:40.163282 run osmo-nitb_10.42.42.2(pid=8651): stderr: | (launched: 2022-12-10_07:04:39.383707) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f5483dba268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8651): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8651) [trial-2371↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8651)] 07:04:40.520622 tst osmo-nitb_10.42.42.2(pid=8651): stdout: | (launched: 2022-12-10_07:04:39.334950) 07:04:40.652120 tst osmo-nitb_10.42.42.2(pid=8651): stderr: | (launched: 2022-12-10_07:04:39.383707) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:04:40.807412 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=8651): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8651) [trial-2371↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8651)] [trial-2371↪nitb_sms:oc2g↪mo_mt_sms.py:11] 07:04:40.816342 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 07:04:40.823359 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8650): Terminating (SIGTERM) 07:04:41.034695 --- ParallelTerminationStrategy: PID 8650 died... 07:04:41.056819 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8650): Terminated: ok {rc=0} 07:04:41.145969 bus /sierra_3: Setting Powered False 07:04:42.247098 bus /sierra_3: Setting Powered False 07:04:43.363128 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 nitb_sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 sms:oc2g --------------------------------------------------------------------- 07:04:44.547327 tst sms:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:04:44.551832 tst sms:oc2g: Verifying 1 x bts (candidates: 11) 07:04:44.573219 tst sms:oc2g: Verifying 6 x ip_address (candidates: 9) 07:04:44.601133 tst sms:oc2g: Verifying 2 x modem (candidates: 12) 07:04:44.655666 tst sms:oc2g: Reserving 1 x bts (candidates: 11) 07:04:44.677235 tst sms:oc2g: Reserving 6 x ip_address (candidates: 9) 07:04:44.704425 tst sms:oc2g: Reserving 2 x modem (candidates: 12) 07:04:45.250480 tst sms:oc2g: RESERVED RESOURCES for sms: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 sms:oc2g mo_mt_sms.py ---------------------------------------------- 07:04:45.255634 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 07:04:45.266602 tst sms:oc2g: Using 1 x bts (candidates: 1) 07:04:45.301146 tst mo_mt_sms.py: using LAC 26678 07:04:45.428551 tst mo_mt_sms.py: using RAC 158 07:04:45.557629 tst mo_mt_sms.py: using CellId 26678 07:04:45.686412 tst mo_mt_sms.py: using BVCI 26679 07:04:45.804445 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 07:04:45.815532 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 07:04:45.826475 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 07:04:45.844671 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 07:04:45.861699 tst sms:oc2g: Using 1 x ip_address (candidates: 6) 07:04:45.875123 tst sms:oc2g: Using 1 x modem (candidates: 2) 07:04:46.010014 tst sms:oc2g: Using 1 x modem (candidates: 2) 07:04:46.133879 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:04:46.657067 run create_hlr_db(pid=8656): Launched 07:04:46.824039 bus /sierra_2: Setting Powered False 07:04:47.888042 run create_hlr_db(pid=8656): Terminated: ok {rc=0} 07:04:48.344821 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8658): Launched 07:04:48.672821 run osmo-hlr_10.42.42.2(pid=8659): Launched 07:04:48.797520 run osmo-stp_10.42.42.5: Starting osmo-stp 07:04:49.366557 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8661): Launched 07:04:49.695329 run osmo-stp_10.42.42.5(pid=8662): Launched 07:04:49.819438 run osmo-msc_10.42.42.6: Starting osmo-msc 07:04:50.411732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8664): Launched 07:04:50.740148 run osmo-msc_10.42.42.6(pid=8665): Launched 07:04:50.921961 run osmo-stp_10.42.42.5(pid=8662): ERR: Terminated: ERROR {rc=1} [trial-2371↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8662)] 07:04:51.059354 run osmo-stp_10.42.42.5(pid=8662): stdout: | (launched: 2022-12-10_07:04:49.633455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:51.198732 run osmo-stp_10.42.42.5(pid=8662): stderr: | [0;m[38;5;43m20221210070449828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070449828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070449829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070449829 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070449830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070449830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070449830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:51.335763 run osmo-stp_10.42.42.5(pid=8662): stdout: | (launched: 2022-12-10_07:04:49.633455) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:04:51.465550 run osmo-stp_10.42.42.5(pid=8662): stderr: | [0;m[38;5;43m20221210070449828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070449828 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070449829 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070449829 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070449830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070449830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070449830 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:04:51.621125 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=8662): Process ended prematurely: osmo-stp_10.42.42.5(pid=8662) [trial-2371↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8662)] [trial-2371↪sms:oc2g↪mo_mt_sms.py:16] 07:04:51.629997 tst mo_mt_sms.py:16: Test FAILED (6.4 sec) 07:04:51.657529 run osmo-hlr_10.42.42.2(pid=8659): ERR: Terminated: ERROR {rc=237} [trial-2371↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8659)] 07:04:51.708326 run osmo-hlr_10.42.42.2(pid=8659): stdout: | (launched: 2022-12-10_07:04:48.611331) 07:04:51.761059 run osmo-hlr_10.42.42.2(pid=8659): stderr: | [0;m[1;31m20221210070448814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070448814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070448814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070448814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070448814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070448814 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070448826 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/sms:oc2g/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070448834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070448835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070448835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:04:51.834318 run osmo-msc_10.42.42.6(pid=8665): ERR: Terminated: ERROR {rc=2} [trial-2371↪sms:oc2g↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8665)] 07:04:51.885260 run osmo-msc_10.42.42.6(pid=8665): stdout: | (launched: 2022-12-10_07:04:50.678239) 07:04:51.937625 run osmo-msc_10.42.42.6(pid=8665): stderr: | [0;m[38;5;43m20221210070451003 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210070451003 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f823a551c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210070451003 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210070451003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210070451004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210070451004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210070451006 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210070451006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210070451006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210070451006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:04:51.990057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8658): Terminating (SIGTERM) 07:04:52.032158 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8661): Terminating (SIGTERM) 07:04:52.074752 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8664): Terminating (SIGTERM) 07:04:52.117548 --- ParallelTerminationStrategy: PID 8658 died... 07:04:52.137528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8658): Terminated: ok {rc=0} 07:04:52.185196 --- ParallelTerminationStrategy: PID 8661 died... 07:04:52.205284 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8661): Terminated: ok {rc=0} 07:04:52.252066 --- ParallelTerminationStrategy: PID 8664 died... 07:04:52.271962 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8664): Terminated: ok {rc=0} 07:04:52.362100 bus /sierra_3: Setting Powered False 07:04:53.463542 bus /sierra_3: Setting Powered False 07:04:54.583555 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 sms:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 nitb_ussd:oc2g --------------------------------------------------------------------- 07:04:55.803163 tst nitb_ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:04:55.806947 tst nitb_ussd:oc2g: Verifying 1 x bts (candidates: 11) 07:04:55.827821 tst nitb_ussd:oc2g: Verifying 1 x ip_address (candidates: 9) 07:04:55.835468 tst nitb_ussd:oc2g: Verifying 1 x modem (candidates: 12) 07:04:55.870564 tst nitb_ussd:oc2g: Reserving 1 x bts (candidates: 11) 07:04:55.891863 tst nitb_ussd:oc2g: Reserving 1 x ip_address (candidates: 9) 07:04:55.898911 tst nitb_ussd:oc2g: Reserving 1 x modem (candidates: 12) 07:04:56.418972 tst nitb_ussd:oc2g: RESERVED RESOURCES for nitb_ussd: bts OC-2G ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2371 nitb_ussd:oc2g assert_extension.py ---------------------------------------------- 07:04:56.424281 tst nitb_ussd:oc2g: Using 1 x ip_address (candidates: 1) 07:04:56.435119 tst nitb_ussd:oc2g: Using 1 x bts (candidates: 1) 07:04:56.469662 tst assert_extension.py: using LAC 26679 07:04:56.590407 tst assert_extension.py: using RAC 159 07:04:56.710130 tst assert_extension.py: using CellId 26679 07:04:56.828844 tst assert_extension.py: using BVCI 26680 07:04:56.939635 tst nitb_ussd:oc2g: Using 1 x modem (candidates: 1) 07:04:57.060612 tst assert_extension.py:10: start nitb and bts... 07:04:57.283761 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:04:57.953399 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8670): Launched 07:04:58.283072 run osmo-nitb_10.42.42.2(pid=8671): Launched 07:04:58.463757 run osmo-nitb_10.42.42.2(pid=8671): ERR: Terminated: ERROR {rc=2} [trial-2371↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8671)] 07:04:58.610127 run osmo-nitb_10.42.42.2(pid=8671): stdout: | (launched: 2022-12-10_07:04:58.221361) 07:04:58.757481 run osmo-nitb_10.42.42.2(pid=8671): stderr: | (launched: 2022-12-10_07:04:58.270120) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:04:58.904692 run osmo-nitb_10.42.42.2(pid=8671): stdout: | (launched: 2022-12-10_07:04:58.221361) 07:04:59.046966 run osmo-nitb_10.42.42.2(pid=8671): stderr: | (launched: 2022-12-10_07:04:58.270120) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f5483dba268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=8671): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8671) [trial-2371↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8671)] 07:04:59.406192 tst osmo-nitb_10.42.42.2(pid=8671): stdout: | (launched: 2022-12-10_07:04:58.221361) 07:04:59.538155 tst osmo-nitb_10.42.42.2(pid=8671): stderr: | (launched: 2022-12-10_07:04:58.270120) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:04:59.693807 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=8671): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8671) [trial-2371↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8671)] [trial-2371↪nitb_ussd:oc2g↪assert_extension.py:12] 07:04:59.702789 tst assert_extension.py:12: Test FAILED (3.3 sec) 07:04:59.709936 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8670): Terminating (SIGTERM) 07:04:59.920809 --- ParallelTerminationStrategy: PID 8670 died... 07:04:59.943273 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=8670): Terminated: ok {rc=0} 07:05:00.031622 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 nitb_ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 ussd:oc2g --------------------------------------------------------------------- 07:05:01.208263 tst ussd:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:05:01.213887 tst ussd:oc2g: Verifying 1 x bts (candidates: 11) 07:05:01.242880 tst ussd:oc2g: Verifying 6 x ip_address (candidates: 9) 07:05:01.282049 tst ussd:oc2g: Verifying 1 x modem (candidates: 12) 07:05:01.335579 tst ussd:oc2g: Reserving 1 x bts (candidates: 11) 07:05:01.372481 tst ussd:oc2g: Reserving 6 x ip_address (candidates: 9) 07:05:01.411321 tst ussd:oc2g: Reserving 1 x modem (candidates: 12) 07:05:01.911763 tst ussd:oc2g: RESERVED RESOURCES for ussd: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2371 ussd:oc2g assert_extension.py ---------------------------------------------- 07:05:01.918353 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 07:05:01.930294 tst ussd:oc2g: Using 1 x bts (candidates: 1) 07:05:01.974155 tst assert_extension.py: using LAC 26680 07:05:02.103815 tst assert_extension.py: using RAC 160 07:05:02.234554 tst assert_extension.py: using CellId 26680 07:05:02.364387 tst assert_extension.py: using BVCI 26681 07:05:02.483848 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 07:05:02.495079 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 07:05:02.506211 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 07:05:02.517826 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 07:05:02.529536 tst ussd:oc2g: Using 1 x ip_address (candidates: 6) 07:05:02.541383 tst ussd:oc2g: Using 1 x modem (candidates: 1) 07:05:02.660472 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:05:03.137429 run create_hlr_db(pid=8679): Launched 07:05:03.256035 bus /sierra_2: Setting Powered False 07:05:04.317354 run create_hlr_db(pid=8679): Terminated: ok {rc=0} 07:05:04.767232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8681): Launched 07:05:05.096317 run osmo-hlr_10.42.42.2(pid=8682): Launched 07:05:05.225201 run osmo-stp_10.42.42.5: Starting osmo-stp 07:05:05.797259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8684): Launched 07:05:06.125968 run osmo-stp_10.42.42.5(pid=8685): Launched 07:05:06.251547 run osmo-msc_10.42.42.6: Starting osmo-msc 07:05:06.844505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8687): Launched 07:05:07.173568 run osmo-msc_10.42.42.6(pid=8688): Launched 07:05:07.359104 run osmo-stp_10.42.42.5(pid=8685): ERR: Terminated: ERROR {rc=1} [trial-2371↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8685)] 07:05:07.497392 run osmo-stp_10.42.42.5(pid=8685): stdout: | (launched: 2022-12-10_07:05:06.063807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:07.635824 run osmo-stp_10.42.42.5(pid=8685): stderr: | [0;m[38;5;43m20221210070506261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070506261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070506261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070506262 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070506262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070506262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070506262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:07.773166 run osmo-stp_10.42.42.5(pid=8685): stdout: | (launched: 2022-12-10_07:05:06.063807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:07.903271 run osmo-stp_10.42.42.5(pid=8685): stderr: | [0;m[38;5;43m20221210070506261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070506261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070506261 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070506262 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070506262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070506262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070506262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:08.058828 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=8685): Process ended prematurely: osmo-stp_10.42.42.5(pid=8685) [trial-2371↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8685)] [trial-2371↪ussd:oc2g↪assert_extension.py:17] 07:05:08.068159 tst assert_extension.py:17: Test FAILED (6.1 sec) 07:05:08.096226 run osmo-hlr_10.42.42.2(pid=8682): ERR: Terminated: ERROR {rc=237} [trial-2371↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8682)] 07:05:08.147234 run osmo-hlr_10.42.42.2(pid=8682): stdout: | (launched: 2022-12-10_07:05:05.034487) 07:05:08.200057 run osmo-hlr_10.42.42.2(pid=8682): stderr: | [0;m[1;31m20221210070505236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070505236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070505236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070505236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070505236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070505236 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070505249 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/ussd:oc2g/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070505258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070505258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070505258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:05:08.273074 run osmo-msc_10.42.42.6(pid=8688): ERR: Terminated: ERROR {rc=2} [trial-2371↪ussd:oc2g↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8688)] 07:05:08.323835 run osmo-msc_10.42.42.6(pid=8688): stdout: | (launched: 2022-12-10_07:05:07.111275) 07:05:08.376275 run osmo-msc_10.42.42.6(pid=8688): stderr: | [0;m[38;5;43m20221210070507435 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210070507435 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4006e67c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210070507436 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210070507436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210070507436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210070507436 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210070507439 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210070507440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210070507440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210070507440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:05:08.428931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8681): Terminating (SIGTERM) 07:05:08.471393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8684): Terminating (SIGTERM) 07:05:08.513761 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8687): Terminating (SIGTERM) 07:05:08.556282 --- ParallelTerminationStrategy: PID 8681 died... 07:05:08.576650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8681): Terminated: ok {rc=0} 07:05:08.623816 --- ParallelTerminationStrategy: PID 8684 died... 07:05:08.643792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8684): Terminated: ok {rc=0} 07:05:08.690247 --- ParallelTerminationStrategy: PID 8687 died... 07:05:08.710143 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8687): Terminated: ok {rc=0} 07:05:08.798684 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 ussd:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 07:05:09.996413 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:05:10.003319 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 07:05:10.024806 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 07:05:10.052190 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 07:05:10.106083 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 07:05:10.127281 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 07:05:10.154408 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 07:05:10.703024 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 07:05:10.754804 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:05:10.766061 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:05:10.821872 tst mo_mt_call.py: using LAC 26681 07:05:10.946667 tst mo_mt_call.py: using RAC 161 07:05:11.069070 tst mo_mt_call.py: using CellId 26681 07:05:11.191326 tst mo_mt_call.py: using BVCI 26682 07:05:11.306285 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:05:11.317537 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:05:11.328398 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:05:11.339721 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:05:11.351173 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:05:11.362629 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:05:11.484132 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:05:11.604804 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:05:12.124334 run create_hlr_db(pid=8693): Launched 07:05:12.259804 bus /sierra_2: Setting Powered False 07:05:13.325804 run create_hlr_db(pid=8693): Terminated: ok {rc=0} 07:05:13.772622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8695): Launched 07:05:14.086767 run osmo-hlr_10.42.42.2(pid=8696): Launched 07:05:14.205725 run osmo-stp_10.42.42.5: Starting osmo-stp 07:05:14.748103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8698): Launched 07:05:15.063126 run osmo-stp_10.42.42.5(pid=8699): Launched 07:05:15.182971 run osmo-msc_10.42.42.6: Starting osmo-msc 07:05:15.749832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8701): Launched 07:05:16.108359 run osmo-msc_10.42.42.6(pid=8702): Launched 07:05:16.605912 run osmo-stp_10.42.42.5(pid=8699): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8699)] 07:05:16.793577 run osmo-stp_10.42.42.5(pid=8699): stdout: | (launched: 2022-12-10_07:05:15.003660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:16.936839 run osmo-stp_10.42.42.5(pid=8699): stderr: | [0;m[38;5;43m20221210070515178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070515178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070515178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070515179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070515179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070515179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070515179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:17.073460 run osmo-stp_10.42.42.5(pid=8699): stdout: | (launched: 2022-12-10_07:05:15.003660) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:17.200550 run osmo-stp_10.42.42.5(pid=8699): stderr: | [0;m[38;5;43m20221210070515178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070515178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070515178 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070515179 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070515179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070515179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070515179 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:17.353653 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8699): Process ended prematurely: osmo-stp_10.42.42.5(pid=8699) [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8699)] [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:05:17.363373 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 07:05:17.392634 run osmo-hlr_10.42.42.2(pid=8696): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8696)] 07:05:17.442641 run osmo-hlr_10.42.42.2(pid=8696): stdout: | (launched: 2022-12-10_07:05:14.027817) 07:05:17.494293 run osmo-hlr_10.42.42.2(pid=8696): stderr: | [0;m[1;31m20221210070514208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070514208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070514208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070514208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070514208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070514208 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070514224 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070514234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070514234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070514234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:05:17.565913 run osmo-msc_10.42.42.6(pid=8702): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8702)] 07:05:17.615875 run osmo-msc_10.42.42.6(pid=8702): stdout: | (launched: 2022-12-10_07:05:16.042859) 07:05:17.667636 run osmo-msc_10.42.42.6(pid=8702): stderr: | [0;m[38;5;43m20221210070516437 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210070516437 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f8bd357bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210070516438 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210070516438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210070516438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210070516438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210070516440 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210070516440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210070516440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210070516440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:05:17.719514 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8695): Terminating (SIGTERM) 07:05:17.760006 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8698): Terminating (SIGTERM) 07:05:17.802214 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8701): Terminating (SIGTERM) 07:05:17.844077 --- ParallelTerminationStrategy: PID 8695 died... 07:05:17.863819 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8695): Terminated: ok {rc=0} 07:05:17.910501 --- ParallelTerminationStrategy: PID 8698 died... 07:05:17.929795 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8698): Terminated: ok {rc=0} 07:05:17.976262 --- ParallelTerminationStrategy: PID 8701 died... 07:05:17.995517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8701): Terminated: ok {rc=0} 07:05:18.085197 bus /sierra_3: Setting Powered False 07:05:19.185406 bus /sierra_3: Setting Powered False 07:05:20.303179 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:05:21.455284 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:05:21.467349 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:05:21.524245 tst mo_mt_call_osmux.py: using LAC 26682 07:05:21.648527 tst mo_mt_call_osmux.py: using RAC 162 07:05:21.772229 tst mo_mt_call_osmux.py: using CellId 26682 07:05:21.896313 tst mo_mt_call_osmux.py: using BVCI 26683 07:05:22.010761 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:05:22.022009 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:05:22.032856 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:05:22.044159 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:05:22.055413 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:05:22.066728 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:05:22.190427 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:05:22.315329 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:05:22.834240 run create_hlr_db(pid=8704): Launched 07:05:22.969433 bus /sierra_2: Setting Powered False 07:05:24.035085 run create_hlr_db(pid=8704): Terminated: ok {rc=0} 07:05:24.481905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8706): Launched 07:05:24.795641 run osmo-hlr_10.42.42.2(pid=8707): Launched 07:05:24.914211 run osmo-stp_10.42.42.5: Starting osmo-stp 07:05:25.469539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8709): Launched 07:05:25.783471 run osmo-stp_10.42.42.5(pid=8710): Launched 07:05:25.902468 run osmo-msc_10.42.42.6: Starting osmo-msc 07:05:26.465949 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8712): Launched 07:05:26.778652 run osmo-msc_10.42.42.6(pid=8713): Launched 07:05:26.951981 run osmo-stp_10.42.42.5(pid=8710): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8710)] 07:05:27.083875 run osmo-stp_10.42.42.5(pid=8710): stdout: | (launched: 2022-12-10_07:05:25.724405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:27.215397 run osmo-stp_10.42.42.5(pid=8710): stderr: | [0;m[38;5;43m20221210070525897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070525897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070525898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070525898 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070525898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070525899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070525899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:27.344611 run osmo-stp_10.42.42.5(pid=8710): stdout: | (launched: 2022-12-10_07:05:25.724405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:27.469275 run osmo-stp_10.42.42.5(pid=8710): stderr: | [0;m[38;5;43m20221210070525897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070525897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070525898 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070525898 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070525898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070525899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070525899 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:27.617535 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8710): Process ended prematurely: osmo-stp_10.42.42.5(pid=8710) [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8710)] [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:05:27.626539 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:05:27.654241 run osmo-hlr_10.42.42.2(pid=8707): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8707)] 07:05:27.703642 run osmo-hlr_10.42.42.2(pid=8707): stdout: | (launched: 2022-12-10_07:05:24.736246) 07:05:27.754379 run osmo-hlr_10.42.42.2(pid=8707): stderr: | [0;m[1;31m20221210070524916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070524916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070524916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070524916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070524916 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070524917 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070524930 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070524939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070524939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070524939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:05:27.824811 run osmo-msc_10.42.42.6(pid=8713): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8713)] 07:05:27.874000 run osmo-msc_10.42.42.6(pid=8713): stdout: | (launched: 2022-12-10_07:05:26.719422) 07:05:27.924357 run osmo-msc_10.42.42.6(pid=8713): stderr: | [0;m[38;5;43m20221210070526993 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210070526994 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f120f81dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210070526994 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210070526994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210070526994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210070526994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210070526996 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210070526996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210070526996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210070526996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:05:27.975146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8706): Terminating (SIGTERM) 07:05:28.015651 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8709): Terminating (SIGTERM) 07:05:28.056199 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8712): Terminating (SIGTERM) 07:05:28.097392 --- ParallelTerminationStrategy: PID 8706 died... 07:05:28.116699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8706): Terminated: ok {rc=0} 07:05:28.162556 --- ParallelTerminationStrategy: PID 8709 died... 07:05:28.181461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8709): Terminated: ok {rc=0} 07:05:28.227091 --- ParallelTerminationStrategy: PID 8712 died... 07:05:28.246123 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8712): Terminated: ok {rc=0} 07:05:28.333665 bus /sierra_3: Setting Powered False 07:05:29.433831 bus /sierra_3: Setting Powered False 07:05:30.551410 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:05:31.824281 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:05:31.835577 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:05:31.863009 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:05:31.898499 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:05:31.964070 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:05:31.990025 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:05:32.022793 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:05:32.562678 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:05:32.615969 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:05:32.627564 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:05:32.685653 tst mo_mt_call.py: using LAC 26683 07:05:32.817169 tst mo_mt_call.py: using RAC 163 07:05:32.947688 tst mo_mt_call.py: using CellId 26683 07:05:33.080100 tst mo_mt_call.py: using BVCI 26684 07:05:33.201453 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:05:33.213092 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:05:33.224682 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:05:33.236138 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:05:33.247537 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:05:33.258970 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:05:33.377404 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:05:33.495029 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:05:33.982219 run create_hlr_db(pid=8718): Launched 07:05:34.101899 bus /sierra_2: Setting Powered False 07:05:35.164354 run create_hlr_db(pid=8718): Terminated: ok {rc=0} 07:05:35.623102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8720): Launched 07:05:35.958663 run osmo-hlr_10.42.42.2(pid=8721): Launched 07:05:36.086608 run osmo-stp_10.42.42.5: Starting osmo-stp 07:05:36.665975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8723): Launched 07:05:37.001391 run osmo-stp_10.42.42.5(pid=8724): Launched 07:05:37.128604 run osmo-msc_10.42.42.6: Starting osmo-msc 07:05:37.733681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8726): Launched 07:05:38.069209 run osmo-msc_10.42.42.6(pid=8727): Launched 07:05:38.255471 run osmo-stp_10.42.42.5(pid=8724): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8724)] 07:05:38.396403 run osmo-stp_10.42.42.5(pid=8724): stdout: | (launched: 2022-12-10_07:05:36.938756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:38.537547 run osmo-stp_10.42.42.5(pid=8724): stderr: | [0;m[38;5;43m20221210070537137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070537137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070537138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070537138 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070537138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070537138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070537138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:38.676520 run osmo-stp_10.42.42.5(pid=8724): stdout: | (launched: 2022-12-10_07:05:36.938756) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:38.809874 run osmo-stp_10.42.42.5(pid=8724): stderr: | [0;m[38;5;43m20221210070537137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070537137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070537138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070537138 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070537138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070537138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070537138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:38.969293 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8724): Process ended prematurely: osmo-stp_10.42.42.5(pid=8724) [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8724)] [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:05:38.978965 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 07:05:39.007360 run osmo-hlr_10.42.42.2(pid=8721): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8721)] 07:05:39.058655 run osmo-hlr_10.42.42.2(pid=8721): stdout: | (launched: 2022-12-10_07:05:35.895975) 07:05:39.111459 run osmo-hlr_10.42.42.2(pid=8721): stderr: | [0;m[1;31m20221210070536097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070536097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070536097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070536097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070536097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070536097 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070536110 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070536121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070536121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070536121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:05:39.185414 run osmo-msc_10.42.42.6(pid=8727): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8727)] 07:05:39.236346 run osmo-msc_10.42.42.6(pid=8727): stdout: | (launched: 2022-12-10_07:05:38.006458) 07:05:39.288772 run osmo-msc_10.42.42.6(pid=8727): stderr: | [0;m[38;5;43m20221210070538329 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210070538330 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1bb8e23c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210070538330 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210070538330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210070538330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210070538330 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210070538332 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210070538332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210070538332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210070538332 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:05:39.341810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8720): Terminating (SIGTERM) 07:05:39.384050 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8723): Terminating (SIGTERM) 07:05:39.426581 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8726): Terminating (SIGTERM) 07:05:39.469568 --- ParallelTerminationStrategy: PID 8720 died... 07:05:39.490057 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8720): Terminated: ok {rc=0} 07:05:39.537509 --- ParallelTerminationStrategy: PID 8723 died... 07:05:39.557488 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8723): Terminated: ok {rc=0} 07:05:39.604753 --- ParallelTerminationStrategy: PID 8726 died... 07:05:39.624783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8726): Terminated: ok {rc=0} 07:05:39.713454 bus /sierra_3: Setting Powered False 07:05:40.816429 bus /sierra_3: Setting Powered False 07:05:41.936302 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:05:43.086047 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:05:43.098089 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:05:43.157179 tst mo_mt_call_osmux.py: using LAC 26684 07:05:43.281711 tst mo_mt_call_osmux.py: using RAC 164 07:05:43.406383 tst mo_mt_call_osmux.py: using CellId 26684 07:05:43.527942 tst mo_mt_call_osmux.py: using BVCI 26685 07:05:43.642882 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:05:43.654131 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:05:43.665238 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:05:43.676482 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:05:43.687945 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:05:43.699349 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:05:43.823377 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:05:43.946229 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:05:44.467172 run create_hlr_db(pid=8729): Launched 07:05:44.603523 bus /sierra_2: Setting Powered False 07:05:45.669404 run create_hlr_db(pid=8729): Terminated: ok {rc=0} 07:05:46.173203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8731): Launched 07:05:46.547256 run osmo-hlr_10.42.42.2(pid=8732): Launched 07:05:46.773977 run osmo-stp_10.42.42.5: Starting osmo-stp 07:05:47.468444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8734): Launched 07:05:47.805144 run osmo-stp_10.42.42.5(pid=8735): Launched 07:05:47.931732 run osmo-msc_10.42.42.6: Starting osmo-msc 07:05:48.536644 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8737): Launched 07:05:48.873348 run osmo-msc_10.42.42.6(pid=8738): Launched 07:05:49.060225 run osmo-stp_10.42.42.5(pid=8735): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8735)] 07:05:49.201307 run osmo-stp_10.42.42.5(pid=8735): stdout: | (launched: 2022-12-10_07:05:47.742185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:49.342718 run osmo-stp_10.42.42.5(pid=8735): stderr: | [0;m[38;5;43m20221210070547939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070547939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070547939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070547940 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070547940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070547940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070547940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:49.482227 run osmo-stp_10.42.42.5(pid=8735): stdout: | (launched: 2022-12-10_07:05:47.742185) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:05:49.615705 run osmo-stp_10.42.42.5(pid=8735): stderr: | [0;m[38;5;43m20221210070547939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070547939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070547939 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070547940 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070547940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070547940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070547940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:05:49.774840 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8735): Process ended prematurely: osmo-stp_10.42.42.5(pid=8735) [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8735)] [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:05:49.784274 tst mo_mt_call_osmux.py:8: Test FAILED (6.7 sec) 07:05:49.812373 run osmo-hlr_10.42.42.2(pid=8732): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8732)] 07:05:49.863235 run osmo-hlr_10.42.42.2(pid=8732): stdout: | (launched: 2022-12-10_07:05:46.482400) 07:05:49.915873 run osmo-hlr_10.42.42.2(pid=8732): stderr: | [0;m[1;31m20221210070546813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070546813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070546813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070546813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070546813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070546813 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070546844 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070546860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070546860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070546860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:05:49.989381 run osmo-msc_10.42.42.6(pid=8738): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8738)] 07:05:50.040076 run osmo-msc_10.42.42.6(pid=8738): stdout: | (launched: 2022-12-10_07:05:48.809782) 07:05:50.092527 run osmo-msc_10.42.42.6(pid=8738): stderr: | [0;m[38;5;43m20221210070549134 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210070549135 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1684bdac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210070549135 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210070549135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210070549135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210070549135 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210070549137 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210070549137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210070549137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210070549137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:05:50.145635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8731): Terminating (SIGTERM) 07:05:50.187698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8734): Terminating (SIGTERM) 07:05:50.229528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8737): Terminating (SIGTERM) 07:05:50.271690 --- ParallelTerminationStrategy: PID 8731 died... 07:05:50.291993 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8731): Terminated: ok {rc=0} 07:05:50.338440 --- ParallelTerminationStrategy: PID 8734 died... 07:05:50.358165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8734): Terminated: ok {rc=0} 07:05:50.404513 --- ParallelTerminationStrategy: PID 8737 died... 07:05:50.424246 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8737): Terminated: ok {rc=0} 07:05:50.512626 bus /sierra_3: Setting Powered False 07:05:51.613395 bus /sierra_3: Setting Powered False 07:05:52.730503 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:05:53.968575 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:05:53.975594 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:05:53.997228 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:05:54.024799 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:05:54.080548 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:05:54.102311 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:05:54.129567 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:05:54.679072 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:05:54.730849 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:05:54.741995 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:05:54.798144 tst mo_mt_call.py: using LAC 26685 07:05:54.922435 tst mo_mt_call.py: using RAC 165 07:05:55.045964 tst mo_mt_call.py: using CellId 26685 07:05:55.170653 tst mo_mt_call.py: using BVCI 26686 07:05:55.286881 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:05:55.298095 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:05:55.308846 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:05:55.319944 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:05:55.331059 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:05:55.342240 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:05:55.458712 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:05:55.580552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:05:56.101334 run create_hlr_db(pid=8743): Launched 07:05:56.237112 bus /sierra_2: Setting Powered False 07:05:57.301524 run create_hlr_db(pid=8743): Terminated: ok {rc=0} 07:05:57.748186 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8745): Launched 07:05:58.062072 run osmo-hlr_10.42.42.2(pid=8746): Launched 07:05:58.180838 run osmo-stp_10.42.42.5: Starting osmo-stp 07:05:58.725500 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8748): Launched 07:05:59.038829 run osmo-stp_10.42.42.5(pid=8749): Launched 07:05:59.157243 run osmo-msc_10.42.42.6: Starting osmo-msc 07:05:59.723842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8751): Launched 07:06:00.038142 run osmo-msc_10.42.42.6(pid=8752): Launched 07:06:00.212287 run osmo-stp_10.42.42.5(pid=8749): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8749)] 07:06:00.344183 run osmo-stp_10.42.42.5(pid=8749): stdout: | (launched: 2022-12-10_07:05:58.979600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:00.475733 run osmo-stp_10.42.42.5(pid=8749): stderr: | [0;m[38;5;43m20221210070559154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070559154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070559154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070559155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070559155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070559155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070559155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:00.605253 run osmo-stp_10.42.42.5(pid=8749): stdout: | (launched: 2022-12-10_07:05:58.979600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:00.729337 run osmo-stp_10.42.42.5(pid=8749): stderr: | [0;m[38;5;43m20221210070559154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070559154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070559154 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070559155 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070559155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070559155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070559155 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:00.886874 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8749): Process ended prematurely: osmo-stp_10.42.42.5(pid=8749) [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8749)] [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:06:00.897439 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:06:00.928544 run osmo-hlr_10.42.42.2(pid=8746): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8746)] 07:06:00.981598 run osmo-hlr_10.42.42.2(pid=8746): stdout: | (launched: 2022-12-10_07:05:58.002829) 07:06:01.036074 run osmo-hlr_10.42.42.2(pid=8746): stderr: | [0;m[1;31m20221210070558182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070558182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070558182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070558182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070558182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070558182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070558194 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070558202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070558203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070558203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:06:01.112197 run osmo-msc_10.42.42.6(pid=8752): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8752)] 07:06:01.164226 run osmo-msc_10.42.42.6(pid=8752): stdout: | (launched: 2022-12-10_07:05:59.978654) 07:06:01.218397 run osmo-msc_10.42.42.6(pid=8752): stderr: | [0;m[38;5;43m20221210070600255 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210070600256 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f425f6e2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210070600256 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210070600256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210070600256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210070600256 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210070600258 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210070600258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210070600258 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210070600259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:06:01.276780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8745): Terminating (SIGTERM) 07:06:01.327746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8748): Terminating (SIGTERM) 07:06:01.380095 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8751): Terminating (SIGTERM) 07:06:01.433449 --- ParallelTerminationStrategy: PID 8745 died... 07:06:01.459849 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8745): Terminated: ok {rc=0} 07:06:01.517287 --- ParallelTerminationStrategy: PID 8748 died... 07:06:01.539866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8748): Terminated: ok {rc=0} 07:06:01.599178 --- ParallelTerminationStrategy: PID 8751 died... 07:06:01.623435 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8751): Terminated: ok {rc=0} 07:06:01.731993 bus /sierra_3: Setting Powered False 07:06:02.835615 bus /sierra_3: Setting Powered False 07:06:03.951524 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:06:05.102957 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:06:05.115294 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:06:05.173825 tst mo_mt_call_osmux.py: using LAC 26686 07:06:05.309879 tst mo_mt_call_osmux.py: using RAC 166 07:06:05.431227 tst mo_mt_call_osmux.py: using CellId 26686 07:06:05.553787 tst mo_mt_call_osmux.py: using BVCI 26687 07:06:05.675779 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:06:05.687645 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:06:05.699147 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:06:05.710607 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:06:05.722039 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:06:05.733480 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:06:05.855944 tst voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:06:05.975346 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:06:06.461146 run create_hlr_db(pid=8754): Launched 07:06:06.581475 bus /sierra_2: Setting Powered False 07:06:07.643337 run create_hlr_db(pid=8754): Terminated: ok {rc=0} 07:06:08.078430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8756): Launched 07:06:08.391967 run osmo-hlr_10.42.42.2(pid=8757): Launched 07:06:08.510558 run osmo-stp_10.42.42.5: Starting osmo-stp 07:06:09.059570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8759): Launched 07:06:09.373633 run osmo-stp_10.42.42.5(pid=8760): Launched 07:06:09.492770 run osmo-msc_10.42.42.6: Starting osmo-msc 07:06:10.055983 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8762): Launched 07:06:10.370095 run osmo-msc_10.42.42.6(pid=8763): Launched 07:06:10.543711 run osmo-stp_10.42.42.5(pid=8760): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8760)] 07:06:10.675801 run osmo-stp_10.42.42.5(pid=8760): stdout: | (launched: 2022-12-10_07:06:09.314639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:10.806659 run osmo-stp_10.42.42.5(pid=8760): stderr: | [0;m[38;5;43m20221210070609487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070609487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070609487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070609488 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070609488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070609488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070609488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:10.936177 run osmo-stp_10.42.42.5(pid=8760): stdout: | (launched: 2022-12-10_07:06:09.314639) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:11.060172 run osmo-stp_10.42.42.5(pid=8760): stderr: | [0;m[38;5;43m20221210070609487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070609487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070609487 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070609488 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070609488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070609488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070609488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:11.208710 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8760): Process ended prematurely: osmo-stp_10.42.42.5(pid=8760) [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8760)] [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:06:11.217900 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:06:11.245340 run osmo-hlr_10.42.42.2(pid=8757): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8757)] 07:06:11.294540 run osmo-hlr_10.42.42.2(pid=8757): stdout: | (launched: 2022-12-10_07:06:08.332729) 07:06:11.345143 run osmo-hlr_10.42.42.2(pid=8757): stderr: | [0;m[1;31m20221210070608511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070608511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070608511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070608511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070608511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070608511 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070608523 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070608531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070608531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070608531 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:06:11.415118 run osmo-msc_10.42.42.6(pid=8763): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8763)] 07:06:11.463765 run osmo-msc_10.42.42.6(pid=8763): stdout: | (launched: 2022-12-10_07:06:10.310982) 07:06:11.513869 run osmo-msc_10.42.42.6(pid=8763): stderr: | [0;m[38;5;43m20221210070610586 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210070610586 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7003bcbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210070610586 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210070610586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210070610586 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210070610587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210070610588 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210070610589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210070610589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210070610589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:06:11.564885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8756): Terminating (SIGTERM) 07:06:11.605260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8759): Terminating (SIGTERM) 07:06:11.645740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8762): Terminating (SIGTERM) 07:06:11.686521 --- ParallelTerminationStrategy: PID 8756 died... 07:06:11.705994 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8756): Terminated: ok {rc=0} 07:06:11.751707 --- ParallelTerminationStrategy: PID 8759 died... 07:06:11.770684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8759): Terminated: ok {rc=0} 07:06:11.816174 --- ParallelTerminationStrategy: PID 8762 died... 07:06:11.835292 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8762): Terminated: ok {rc=0} 07:06:11.922957 bus /sierra_3: Setting Powered False 07:06:13.024010 bus /sierra_3: Setting Powered False 07:06:14.141284 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 07:06:15.372048 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:06:15.378552 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 07:06:15.399529 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 07:06:15.426740 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 07:06:15.479086 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 07:06:15.500339 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 07:06:15.527107 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 07:06:16.077640 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 07:06:16.149755 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:06:16.166127 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:06:16.233942 tst mo_mt_call.py: using LAC 26687 07:06:16.353946 tst mo_mt_call.py: using RAC 167 07:06:16.476187 tst mo_mt_call.py: using CellId 26687 07:06:16.604447 tst mo_mt_call.py: using BVCI 26688 07:06:16.718321 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:06:16.730445 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:06:16.742292 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:06:16.754444 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:06:16.766736 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:06:16.779283 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:06:16.898129 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:06:17.025205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:06:17.533819 run create_hlr_db(pid=8768): Launched 07:06:17.649625 bus /sierra_2: Setting Powered False 07:06:18.710311 run create_hlr_db(pid=8768): Terminated: ok {rc=0} 07:06:19.151858 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8770): Launched 07:06:19.477965 run osmo-hlr_10.42.42.2(pid=8771): Launched 07:06:19.603842 run osmo-stp_10.42.42.5: Starting osmo-stp 07:06:20.160080 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8773): Launched 07:06:20.485614 run osmo-stp_10.42.42.5(pid=8774): Launched 07:06:20.609209 run osmo-msc_10.42.42.6: Starting osmo-msc 07:06:21.192571 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8776): Launched 07:06:21.515677 run osmo-msc_10.42.42.6(pid=8777): Launched 07:06:21.696151 run osmo-stp_10.42.42.5(pid=8774): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8774)] 07:06:21.831895 run osmo-stp_10.42.42.5(pid=8774): stdout: | (launched: 2022-12-10_07:06:20.425129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:22.006449 run osmo-stp_10.42.42.5(pid=8774): stderr: | [0;m[38;5;43m20221210070620618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070620619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070620619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070620619 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070620620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070620620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070620620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:22.141059 run osmo-stp_10.42.42.5(pid=8774): stdout: | (launched: 2022-12-10_07:06:20.425129) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:22.269927 run osmo-stp_10.42.42.5(pid=8774): stderr: | [0;m[38;5;43m20221210070620618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070620619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070620619 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070620619 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070620620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070620620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070620620 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:22.423543 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8774): Process ended prematurely: osmo-stp_10.42.42.5(pid=8774) [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8774)] [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 07:06:22.432836 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 07:06:22.460375 run osmo-hlr_10.42.42.2(pid=8771): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8771)] 07:06:22.510586 run osmo-hlr_10.42.42.2(pid=8771): stdout: | (launched: 2022-12-10_07:06:19.417641) 07:06:22.562556 run osmo-hlr_10.42.42.2(pid=8771): stderr: | [0;m[1;31m20221210070619618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070619618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070619618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070619618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070619618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070619618 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070619630 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070619640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070619640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070619640 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:06:22.634396 run osmo-msc_10.42.42.6(pid=8777): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8777)] 07:06:22.684397 run osmo-msc_10.42.42.6(pid=8777): stdout: | (launched: 2022-12-10_07:06:21.455445) 07:06:22.736056 run osmo-msc_10.42.42.6(pid=8777): stderr: | [0;m[38;5;43m20221210070621780 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210070621780 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f22e4bbdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210070621780 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210070621780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210070621780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210070621780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210070621782 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210070621783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210070621783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210070621783 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:06:22.787956 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8770): Terminating (SIGTERM) 07:06:22.829352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8773): Terminating (SIGTERM) 07:06:22.870871 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8776): Terminating (SIGTERM) 07:06:22.912514 --- ParallelTerminationStrategy: PID 8770 died... 07:06:22.932590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8770): Terminated: ok {rc=0} 07:06:22.978730 --- ParallelTerminationStrategy: PID 8773 died... 07:06:22.998493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8773): Terminated: ok {rc=0} 07:06:23.044398 --- ParallelTerminationStrategy: PID 8776 died... 07:06:23.064031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8776): Terminated: ok {rc=0} 07:06:23.151597 bus /sierra_3: Setting Powered False 07:06:24.249905 bus /sierra_3: Setting Powered False 07:06:25.367014 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 07:06:26.513644 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:06:26.525227 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:06:26.582786 tst mo_mt_call_osmux.py: using LAC 26688 07:06:26.702241 tst mo_mt_call_osmux.py: using RAC 168 07:06:26.821209 tst mo_mt_call_osmux.py: using CellId 26688 07:06:26.949099 tst mo_mt_call_osmux.py: using BVCI 26689 07:06:27.066605 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:06:27.078062 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:06:27.089228 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:06:27.100411 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:06:27.111775 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:06:27.123113 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:06:27.243145 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:06:27.359660 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:06:27.826895 run create_hlr_db(pid=8779): Launched 07:06:27.942523 bus /sierra_2: Setting Powered False 07:06:29.003275 run create_hlr_db(pid=8779): Terminated: ok {rc=0} 07:06:29.445546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8781): Launched 07:06:29.769616 run osmo-hlr_10.42.42.2(pid=8782): Launched 07:06:29.893916 run osmo-stp_10.42.42.5: Starting osmo-stp 07:06:30.448666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8784): Launched 07:06:30.770410 run osmo-stp_10.42.42.5(pid=8785): Launched 07:06:30.978077 run osmo-msc_10.42.42.6: Starting osmo-msc 07:06:31.624416 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8787): Launched 07:06:31.961657 run osmo-msc_10.42.42.6(pid=8788): Launched 07:06:32.415525 run osmo-stp_10.42.42.5(pid=8785): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8785)] 07:06:32.558329 run osmo-stp_10.42.42.5(pid=8785): stdout: | (launched: 2022-12-10_07:06:30.710264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:32.693416 run osmo-stp_10.42.42.5(pid=8785): stderr: | [0;m[38;5;43m20221210070630920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070630920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070630925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070630925 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070630926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070630926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070630926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:32.826985 run osmo-stp_10.42.42.5(pid=8785): stdout: | (launched: 2022-12-10_07:06:30.710264) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:32.954581 run osmo-stp_10.42.42.5(pid=8785): stderr: | [0;m[38;5;43m20221210070630920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070630920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070630925 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070630925 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070630926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070630926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070630926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:33.108079 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8785): Process ended prematurely: osmo-stp_10.42.42.5(pid=8785) [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8785)] [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 07:06:33.117517 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 07:06:33.145043 run osmo-hlr_10.42.42.2(pid=8782): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8782)] 07:06:33.194595 run osmo-hlr_10.42.42.2(pid=8782): stdout: | (launched: 2022-12-10_07:06:29.709368) 07:06:33.246127 run osmo-hlr_10.42.42.2(pid=8782): stderr: | [0;m[1;31m20221210070629910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070629910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070629910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070629910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070629910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070629911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070629922 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070629931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070629931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070629931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:06:33.317737 run osmo-msc_10.42.42.6(pid=8788): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8788)] 07:06:33.367193 run osmo-msc_10.42.42.6(pid=8788): stdout: | (launched: 2022-12-10_07:06:31.893407) 07:06:33.418442 run osmo-msc_10.42.42.6(pid=8788): stderr: | [0;m[38;5;43m20221210070632351 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210070632351 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f17c03b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210070632351 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210070632351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210070632351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210070632351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210070632353 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210070632354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210070632354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210070632354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:06:33.469704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8781): Terminating (SIGTERM) 07:06:33.510778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8784): Terminating (SIGTERM) 07:06:33.552007 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8787): Terminating (SIGTERM) 07:06:33.593478 --- ParallelTerminationStrategy: PID 8781 died... 07:06:33.613461 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8781): Terminated: ok {rc=0} 07:06:33.659291 --- ParallelTerminationStrategy: PID 8784 died... 07:06:33.678625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8784): Terminated: ok {rc=0} 07:06:33.724075 --- ParallelTerminationStrategy: PID 8787 died... 07:06:33.743379 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8787): Terminated: ok {rc=0} 07:06:33.830307 bus /sierra_3: Setting Powered False 07:06:34.928619 bus /sierra_3: Setting Powered False 07:06:36.043155 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:06:37.281338 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:06:37.288144 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:06:37.309152 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:06:37.336307 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:06:37.388738 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:06:37.409696 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:06:37.436549 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:06:37.988302 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:06:38.039762 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:06:38.051076 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:06:38.108468 tst mo_mt_call.py: using LAC 26689 07:06:38.236450 tst mo_mt_call.py: using RAC 169 07:06:38.362496 tst mo_mt_call.py: using CellId 26689 07:06:38.489687 tst mo_mt_call.py: using BVCI 26690 07:06:38.607960 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:06:38.619489 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:06:38.630692 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:06:38.641914 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:06:38.653189 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:06:38.664384 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:06:38.783293 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:06:38.898236 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:06:39.366541 run create_hlr_db(pid=8794): Launched 07:06:39.482455 bus /sierra_2: Setting Powered False 07:06:40.542540 run create_hlr_db(pid=8794): Terminated: ok {rc=0} 07:06:40.984621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8796): Launched 07:06:41.309686 run osmo-hlr_10.42.42.2(pid=8797): Launched 07:06:41.433719 run osmo-stp_10.42.42.5: Starting osmo-stp 07:06:41.996744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8799): Launched 07:06:42.322522 run osmo-stp_10.42.42.5(pid=8800): Launched 07:06:42.445495 run osmo-msc_10.42.42.6: Starting osmo-msc 07:06:43.030166 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8802): Launched 07:06:43.355339 run osmo-msc_10.42.42.6(pid=8803): Launched 07:06:43.536209 run osmo-stp_10.42.42.5(pid=8800): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8800)] 07:06:43.671894 run osmo-stp_10.42.42.5(pid=8800): stdout: | (launched: 2022-12-10_07:06:42.261623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:43.808072 run osmo-stp_10.42.42.5(pid=8800): stderr: | [0;m[38;5;43m20221210070642456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070642456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070642457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070642457 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070642458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070642458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070642458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:43.943294 run osmo-stp_10.42.42.5(pid=8800): stdout: | (launched: 2022-12-10_07:06:42.261623) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:44.072425 run osmo-stp_10.42.42.5(pid=8800): stderr: | [0;m[38;5;43m20221210070642456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070642456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070642457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070642457 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070642458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070642458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070642458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:44.226984 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8800): Process ended prematurely: osmo-stp_10.42.42.5(pid=8800) [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8800)] [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:06:44.236206 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:06:44.264224 run osmo-hlr_10.42.42.2(pid=8797): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8797)] 07:06:44.314340 run osmo-hlr_10.42.42.2(pid=8797): stdout: | (launched: 2022-12-10_07:06:41.248923) 07:06:44.365943 run osmo-hlr_10.42.42.2(pid=8797): stderr: | [0;m[1;31m20221210070641451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070641451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070641451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070641451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070641451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070641451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070641466 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070641476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070641477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070641477 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:06:44.438035 run osmo-msc_10.42.42.6(pid=8803): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8803)] 07:06:44.487817 run osmo-msc_10.42.42.6(pid=8803): stdout: | (launched: 2022-12-10_07:06:43.294666) 07:06:44.539282 run osmo-msc_10.42.42.6(pid=8803): stderr: | [0;m[38;5;43m20221210070643620 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210070643621 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f231f513c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210070643621 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210070643621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210070643621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210070643621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210070643623 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210070643623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210070643623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210070643623 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:06:44.591149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8796): Terminating (SIGTERM) 07:06:44.632426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8799): Terminating (SIGTERM) 07:06:44.674034 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8802): Terminating (SIGTERM) 07:06:44.716074 --- ParallelTerminationStrategy: PID 8796 died... 07:06:44.736177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8796): Terminated: ok {rc=0} 07:06:44.782572 --- ParallelTerminationStrategy: PID 8799 died... 07:06:44.802175 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8799): Terminated: ok {rc=0} 07:06:44.848667 --- ParallelTerminationStrategy: PID 8802 died... 07:06:44.868189 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8802): Terminated: ok {rc=0} 07:06:44.956201 bus /sierra_3: Setting Powered False 07:06:46.050944 bus /sierra_3: Setting Powered False 07:06:47.164726 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 07:06:48.318047 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:06:48.330109 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:06:48.387188 tst mo_mt_call_osmux.py: using LAC 26690 07:06:48.513214 tst mo_mt_call_osmux.py: using RAC 170 07:06:48.639253 tst mo_mt_call_osmux.py: using CellId 26690 07:06:48.763477 tst mo_mt_call_osmux.py: using BVCI 26691 07:06:48.880292 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:06:48.891695 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:06:48.902843 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:06:48.913989 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:06:48.925103 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:06:48.936268 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:06:49.050456 tst voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:06:49.165733 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:06:49.628161 run create_hlr_db(pid=8805): Launched 07:06:49.741399 bus /sierra_2: Setting Powered False 07:06:50.800338 run create_hlr_db(pid=8805): Terminated: ok {rc=0} 07:06:51.239117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8807): Launched 07:06:51.562476 run osmo-hlr_10.42.42.2(pid=8808): Launched 07:06:51.685105 run osmo-stp_10.42.42.5: Starting osmo-stp 07:06:52.235686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8810): Launched 07:06:52.557387 run osmo-stp_10.42.42.5(pid=8811): Launched 07:06:52.678666 run osmo-msc_10.42.42.6: Starting osmo-msc 07:06:53.260522 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8813): Launched 07:06:53.582237 run osmo-msc_10.42.42.6(pid=8814): Launched 07:06:53.758161 run osmo-stp_10.42.42.5(pid=8811): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8811)] 07:06:53.891183 run osmo-stp_10.42.42.5(pid=8811): stdout: | (launched: 2022-12-10_07:06:52.493991) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:54.024661 run osmo-stp_10.42.42.5(pid=8811): stderr: | [0;m[38;5;43m20221210070652693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070652693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070652693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070652693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070652694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070652694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070652694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:54.158830 run osmo-stp_10.42.42.5(pid=8811): stdout: | (launched: 2022-12-10_07:06:52.493991) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:06:54.285210 run osmo-stp_10.42.42.5(pid=8811): stderr: | [0;m[38;5;43m20221210070652693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070652693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070652693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070652693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070652694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070652694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070652694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:06:54.436218 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8811): Process ended prematurely: osmo-stp_10.42.42.5(pid=8811) [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8811)] [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 07:06:54.445508 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:06:54.473067 run osmo-hlr_10.42.42.2(pid=8808): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8808)] 07:06:54.522167 run osmo-hlr_10.42.42.2(pid=8808): stdout: | (launched: 2022-12-10_07:06:51.498248) 07:06:54.573297 run osmo-hlr_10.42.42.2(pid=8808): stderr: | [0;m[1;31m20221210070651703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070651703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070651703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070651703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070651703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070651703 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070651715 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070651723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070651723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070651724 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:06:54.644254 run osmo-msc_10.42.42.6(pid=8814): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8814)] 07:06:54.693876 run osmo-msc_10.42.42.6(pid=8814): stdout: | (launched: 2022-12-10_07:06:53.519547) 07:06:54.744747 run osmo-msc_10.42.42.6(pid=8814): stderr: | [0;m[38;5;43m20221210070653847 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210070653847 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc342cbec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210070653847 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210070653847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210070653848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210070653848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210070653850 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210070653850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210070653850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210070653850 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:06:54.796060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8807): Terminating (SIGTERM) 07:06:54.837193 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8810): Terminating (SIGTERM) 07:06:54.878300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8813): Terminating (SIGTERM) 07:06:54.919761 --- ParallelTerminationStrategy: PID 8807 died... 07:06:54.939739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8807): Terminated: ok {rc=0} 07:06:54.985735 --- ParallelTerminationStrategy: PID 8810 died... 07:06:55.005093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8810): Terminated: ok {rc=0} 07:06:55.050903 --- ParallelTerminationStrategy: PID 8813 died... 07:06:55.070444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8813): Terminated: ok {rc=0} 07:06:55.157546 bus /sierra_3: Setting Powered False 07:06:56.256507 bus /sierra_3: Setting Powered False 07:06:57.371563 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:06:58.615578 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:06:58.621858 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:06:58.642406 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 07:06:58.668737 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:06:58.720504 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:06:58.741563 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 07:06:58.769057 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:06:59.315966 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 07:06:59.369019 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:06:59.380524 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:06:59.444846 tst mo_mt_call.py: using LAC 26691 07:06:59.569490 tst mo_mt_call.py: using RAC 171 07:06:59.686855 tst mo_mt_call.py: using CellId 26691 07:06:59.801566 tst mo_mt_call.py: using BVCI 26692 07:06:59.918786 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:06:59.930493 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:06:59.941861 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:06:59.953865 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:06:59.965940 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:06:59.978049 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:07:00.094505 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:07:00.207992 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:07:00.668057 run create_hlr_db(pid=8819): Launched 07:07:00.783603 bus /sierra_2: Setting Powered False 07:07:01.848831 run create_hlr_db(pid=8819): Terminated: ok {rc=0} 07:07:02.301302 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8821): Launched 07:07:02.621888 run osmo-hlr_10.42.42.2(pid=8822): Launched 07:07:02.744840 run osmo-stp_10.42.42.5: Starting osmo-stp 07:07:03.294491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8824): Launched 07:07:03.596565 run osmo-stp_10.42.42.5(pid=8825): Launched 07:07:03.712032 run osmo-msc_10.42.42.6: Starting osmo-msc 07:07:04.249916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8827): Launched 07:07:04.547105 run osmo-msc_10.42.42.6(pid=8828): Launched 07:07:04.714148 run osmo-stp_10.42.42.5(pid=8825): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8825)] 07:07:04.840154 run osmo-stp_10.42.42.5(pid=8825): stdout: | (launched: 2022-12-10_07:07:03.542321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:04.966899 run osmo-stp_10.42.42.5(pid=8825): stderr: | [0;m[38;5;43m20221210070703713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070703713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070703714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070703714 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070703715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070703715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070703715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:05.090760 run osmo-stp_10.42.42.5(pid=8825): stdout: | (launched: 2022-12-10_07:07:03.542321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:05.209459 run osmo-stp_10.42.42.5(pid=8825): stderr: | [0;m[38;5;43m20221210070703713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070703713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070703714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070703714 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070703715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070703715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070703715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:05.351135 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8825): Process ended prematurely: osmo-stp_10.42.42.5(pid=8825) [trial-2371↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8825)] [trial-2371↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:07:05.359762 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 07:07:05.386701 run osmo-hlr_10.42.42.2(pid=8822): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8822)] 07:07:05.434367 run osmo-hlr_10.42.42.2(pid=8822): stdout: | (launched: 2022-12-10_07:07:02.564250) 07:07:05.483555 run osmo-hlr_10.42.42.2(pid=8822): stderr: | [0;m[1;31m20221210070702762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070702762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070702762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070702762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070702762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070702762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070702773 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070702782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070702782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070702782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:07:05.552224 run osmo-msc_10.42.42.6(pid=8828): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8828)] 07:07:05.600073 run osmo-msc_10.42.42.6(pid=8828): stdout: | (launched: 2022-12-10_07:07:04.493463) 07:07:05.649164 run osmo-msc_10.42.42.6(pid=8828): stderr: | [0;m[38;5;43m20221210070704766 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210070704766 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f24bdc26c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210070704766 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210070704766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210070704766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210070704767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210070704768 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210070704769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210070704769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210070704769 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:07:05.698998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8821): Terminating (SIGTERM) 07:07:05.738589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8824): Terminating (SIGTERM) 07:07:05.778326 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8827): Terminating (SIGTERM) 07:07:05.818439 --- ParallelTerminationStrategy: PID 8821 died... 07:07:05.837583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8821): Terminated: ok {rc=0} 07:07:05.881998 --- ParallelTerminationStrategy: PID 8824 died... 07:07:05.900503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8824): Terminated: ok {rc=0} 07:07:05.944689 --- ParallelTerminationStrategy: PID 8827 died... 07:07:05.963144 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8827): Terminated: ok {rc=0} 07:07:06.048684 bus /sierra_3: Setting Powered False 07:07:07.148202 bus /sierra_3: Setting Powered False 07:07:08.263891 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:07:09.409284 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:07:09.420829 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:07:09.477073 tst mo_mt_call_osmux.py: using LAC 26692 07:07:09.593999 tst mo_mt_call_osmux.py: using RAC 172 07:07:09.713768 tst mo_mt_call_osmux.py: using CellId 26692 07:07:09.840330 tst mo_mt_call_osmux.py: using BVCI 26693 07:07:09.956602 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:07:09.968194 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:07:09.979710 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:07:09.991289 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:07:10.002850 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:07:10.014494 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:07:10.135435 tst voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:07:10.252571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:07:10.711610 run create_hlr_db(pid=8830): Launched 07:07:10.825842 bus /sierra_2: Setting Powered False 07:07:11.886223 run create_hlr_db(pid=8830): Terminated: ok {rc=0} 07:07:12.322435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8832): Launched 07:07:12.641494 run osmo-hlr_10.42.42.2(pid=8833): Launched 07:07:12.775355 run osmo-stp_10.42.42.5: Starting osmo-stp 07:07:13.329123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8835): Launched 07:07:13.647986 run osmo-stp_10.42.42.5(pid=8836): Launched 07:07:13.770140 run osmo-msc_10.42.42.6: Starting osmo-msc 07:07:14.347683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8838): Launched 07:07:14.667564 run osmo-msc_10.42.42.6(pid=8839): Launched 07:07:14.846307 run osmo-stp_10.42.42.5(pid=8836): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8836)] 07:07:14.979747 run osmo-stp_10.42.42.5(pid=8836): stdout: | (launched: 2022-12-10_07:07:13.590500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:15.114032 run osmo-stp_10.42.42.5(pid=8836): stderr: | [0;m[38;5;43m20221210070713785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070713785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070713785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070713785 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070713786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070713786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070713786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:15.248395 run osmo-stp_10.42.42.5(pid=8836): stdout: | (launched: 2022-12-10_07:07:13.590500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:15.376035 run osmo-stp_10.42.42.5(pid=8836): stderr: | [0;m[38;5;43m20221210070713785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070713785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070713785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070713785 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070713786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070713786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070713786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:15.528531 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8836): Process ended prematurely: osmo-stp_10.42.42.5(pid=8836) [trial-2371↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8836)] [trial-2371↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:07:15.538141 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:07:15.566091 run osmo-hlr_10.42.42.2(pid=8833): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8833)] 07:07:15.616067 run osmo-hlr_10.42.42.2(pid=8833): stdout: | (launched: 2022-12-10_07:07:12.583936) 07:07:15.667559 run osmo-hlr_10.42.42.2(pid=8833): stderr: | [0;m[1;31m20221210070712794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070712794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070712794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070712794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070712794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070712794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070712806 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070712815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070712815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070712815 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:07:15.739405 run osmo-msc_10.42.42.6(pid=8839): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8839)] 07:07:15.788666 run osmo-msc_10.42.42.6(pid=8839): stdout: | (launched: 2022-12-10_07:07:14.609489) 07:07:15.839632 run osmo-msc_10.42.42.6(pid=8839): stderr: | [0;m[38;5;43m20221210070714934 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210070714934 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9c4e180c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210070714934 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210070714934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210070714934 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210070714935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210070714936 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210070714937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210070714937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210070714937 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:07:15.899261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8832): Terminating (SIGTERM) 07:07:15.946234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8835): Terminating (SIGTERM) 07:07:15.988369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8838): Terminating (SIGTERM) 07:07:16.031011 --- ParallelTerminationStrategy: PID 8832 died... 07:07:16.051115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8832): Terminated: ok {rc=0} 07:07:16.097988 --- ParallelTerminationStrategy: PID 8835 died... 07:07:16.118075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8835): Terminated: ok {rc=0} 07:07:16.165082 --- ParallelTerminationStrategy: PID 8838 died... 07:07:16.185116 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8838): Terminated: ok {rc=0} 07:07:16.275584 bus /sierra_3: Setting Powered False 07:07:17.373179 bus /sierra_3: Setting Powered False 07:07:18.487871 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:07:19.720275 tst voice:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:07:19.726125 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:07:19.747588 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 07:07:19.774245 tst voice:oc2g+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 07:07:19.826070 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:07:19.846338 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 07:07:19.873329 tst voice:oc2g+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 07:07:20.420097 tst voice:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 07:07:20.468202 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:07:20.479004 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:07:20.535606 tst mo_mt_call.py: using LAC 26693 07:07:20.654007 tst mo_mt_call.py: using RAC 173 07:07:20.770980 tst mo_mt_call.py: using CellId 26693 07:07:20.890157 tst mo_mt_call.py: using BVCI 26694 07:07:20.999626 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:07:21.010440 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:07:21.021045 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:07:21.031790 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:07:21.042584 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:07:21.053445 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:07:21.171319 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:07:21.287385 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:07:21.782701 run create_hlr_db(pid=8844): Launched 07:07:21.914250 bus /sierra_2: Setting Powered False 07:07:22.977578 run create_hlr_db(pid=8844): Terminated: ok {rc=0} 07:07:23.402386 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8846): Launched 07:07:23.699237 run osmo-hlr_10.42.42.2(pid=8847): Launched 07:07:23.813205 run osmo-stp_10.42.42.5: Starting osmo-stp 07:07:24.342879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8849): Launched 07:07:24.640257 run osmo-stp_10.42.42.5(pid=8850): Launched 07:07:24.753941 run osmo-msc_10.42.42.6: Starting osmo-msc 07:07:25.290503 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8852): Launched 07:07:25.587406 run osmo-msc_10.42.42.6(pid=8853): Launched 07:07:25.753718 run osmo-stp_10.42.42.5(pid=8850): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8850)] 07:07:25.879343 run osmo-stp_10.42.42.5(pid=8850): stdout: | (launched: 2022-12-10_07:07:24.585974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:26.005384 run osmo-stp_10.42.42.5(pid=8850): stderr: | [0;m[38;5;43m20221210070724757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070724757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070724757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070724758 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070724758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070724758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070724758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:26.128893 run osmo-stp_10.42.42.5(pid=8850): stdout: | (launched: 2022-12-10_07:07:24.585974) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:26.247275 run osmo-stp_10.42.42.5(pid=8850): stderr: | [0;m[38;5;43m20221210070724757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070724757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070724757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070724758 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070724758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070724758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070724758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:26.389690 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8850): Process ended prematurely: osmo-stp_10.42.42.5(pid=8850) [trial-2371↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8850)] [trial-2371↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 07:07:26.398437 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 07:07:26.425449 run osmo-hlr_10.42.42.2(pid=8847): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8847)] 07:07:26.473153 run osmo-hlr_10.42.42.2(pid=8847): stdout: | (launched: 2022-12-10_07:07:23.645315) 07:07:26.522634 run osmo-hlr_10.42.42.2(pid=8847): stderr: | [0;m[1;31m20221210070723821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070723821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070723821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070723821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070723821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070723821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070723834 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070723843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070723843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070723843 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:07:26.591578 run osmo-msc_10.42.42.6(pid=8853): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8853)] 07:07:26.639834 run osmo-msc_10.42.42.6(pid=8853): stdout: | (launched: 2022-12-10_07:07:25.533620) 07:07:26.689364 run osmo-msc_10.42.42.6(pid=8853): stderr: | [0;m[38;5;43m20221210070725806 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210070725806 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f902ba62c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210070725806 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210070725806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210070725806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210070725806 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210070725808 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210070725808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210070725809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210070725809 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:07:26.739175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8846): Terminating (SIGTERM) 07:07:26.778642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8849): Terminating (SIGTERM) 07:07:26.818526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8852): Terminating (SIGTERM) 07:07:26.858699 --- ParallelTerminationStrategy: PID 8846 died... 07:07:26.877980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8846): Terminated: ok {rc=0} 07:07:26.922626 --- ParallelTerminationStrategy: PID 8849 died... 07:07:26.941331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8849): Terminated: ok {rc=0} 07:07:26.985474 --- ParallelTerminationStrategy: PID 8852 died... 07:07:27.004220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8852): Terminated: ok {rc=0} 07:07:27.090522 bus /sierra_3: Setting Powered False 07:07:28.188777 bus /sierra_3: Setting Powered False 07:07:29.303265 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:oc2g+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 07:07:30.448353 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:07:30.459854 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:07:30.516798 tst mo_mt_call_osmux.py: using LAC 26694 07:07:30.634242 tst mo_mt_call_osmux.py: using RAC 174 07:07:30.752113 tst mo_mt_call_osmux.py: using CellId 26694 07:07:30.887467 tst mo_mt_call_osmux.py: using BVCI 26695 07:07:30.997383 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:07:31.009229 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:07:31.020775 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:07:31.033702 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:07:31.047020 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:07:31.058665 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:07:31.176904 tst voice:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:07:31.323641 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:07:31.859092 run create_hlr_db(pid=8855): Launched 07:07:32.013395 bus /sierra_2: Setting Powered False 07:07:33.076638 run create_hlr_db(pid=8855): Terminated: ok {rc=0} 07:07:33.503756 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8857): Launched 07:07:33.801337 run osmo-hlr_10.42.42.2(pid=8858): Launched 07:07:33.915621 run osmo-stp_10.42.42.5: Starting osmo-stp 07:07:34.425219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8860): Launched 07:07:34.720940 run osmo-stp_10.42.42.5(pid=8861): Launched 07:07:34.834934 run osmo-msc_10.42.42.6: Starting osmo-msc 07:07:35.374663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8863): Launched 07:07:35.671550 run osmo-msc_10.42.42.6(pid=8864): Launched 07:07:35.852716 run osmo-stp_10.42.42.5(pid=8861): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8861)] 07:07:35.992037 run osmo-stp_10.42.42.5(pid=8861): stdout: | (launched: 2022-12-10_07:07:34.667291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:36.128175 run osmo-stp_10.42.42.5(pid=8861): stderr: | [0;m[38;5;43m20221210070734833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070734834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070734834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070734834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070734837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070734837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070734837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:36.262726 run osmo-stp_10.42.42.5(pid=8861): stdout: | (launched: 2022-12-10_07:07:34.667291) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:36.390848 run osmo-stp_10.42.42.5(pid=8861): stderr: | [0;m[38;5;43m20221210070734833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070734834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070734834 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070734834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070734837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070734837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070734837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:36.543873 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=8861): Process ended prematurely: osmo-stp_10.42.42.5(pid=8861) [trial-2371↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8861)] [trial-2371↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 07:07:36.553546 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 07:07:36.581983 run osmo-hlr_10.42.42.2(pid=8858): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8858)] 07:07:36.632488 run osmo-hlr_10.42.42.2(pid=8858): stdout: | (launched: 2022-12-10_07:07:33.746827) 07:07:36.684585 run osmo-hlr_10.42.42.2(pid=8858): stderr: | [0;m[1;31m20221210070733920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070733921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070733921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070733921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070733921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070733921 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070733933 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:oc2g+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070733942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070733942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070733942 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:07:36.757080 run osmo-msc_10.42.42.6(pid=8864): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8864)] 07:07:36.807101 run osmo-msc_10.42.42.6(pid=8864): stdout: | (launched: 2022-12-10_07:07:35.617744) 07:07:36.858446 run osmo-msc_10.42.42.6(pid=8864): stderr: | [0;m[38;5;43m20221210070735936 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210070735936 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdfd0ce7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210070735936 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210070735936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210070735936 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210070735937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210070735938 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210070735939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210070735939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210070735939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:07:36.910191 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8857): Terminating (SIGTERM) 07:07:36.951788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8860): Terminating (SIGTERM) 07:07:36.993695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8863): Terminating (SIGTERM) 07:07:37.035795 --- ParallelTerminationStrategy: PID 8857 died... 07:07:37.056107 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8857): Terminated: ok {rc=0} 07:07:37.102766 --- ParallelTerminationStrategy: PID 8860 died... 07:07:37.122576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8860): Terminated: ok {rc=0} 07:07:37.169103 --- ParallelTerminationStrategy: PID 8863 died... 07:07:37.188854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8863): Terminated: ok {rc=0} 07:07:37.277041 bus /sierra_3: Setting Powered False 07:07:38.375337 bus /sierra_3: Setting Powered False 07:07:39.491170 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 emergency:oc2g --------------------------------------------------------------------- 07:07:40.724225 tst emergency:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:07:40.728759 tst emergency:oc2g: Verifying 1 x bts (candidates: 11) 07:07:40.749730 tst emergency:oc2g: Verifying 6 x ip_address (candidates: 9) 07:07:40.777124 tst emergency:oc2g: Verifying 4 x modem (candidates: 12) 07:07:40.863465 tst emergency:oc2g: Reserving 1 x bts (candidates: 11) 07:07:40.884378 tst emergency:oc2g: Reserving 6 x ip_address (candidates: 9) 07:07:40.911361 tst emergency:oc2g: Reserving 4 x modem (candidates: 12) 07:07:41.494916 tst emergency:oc2g: RESERVED RESOURCES for emergency: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2371 emergency:oc2g emergency_mo_mt_call.py ---------------------------------------------- 07:07:41.500105 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:07:41.511017 tst emergency:oc2g: Using 1 x bts (candidates: 1) 07:07:41.547730 tst emergency_mo_mt_call.py: using LAC 26695 07:07:41.669686 tst emergency_mo_mt_call.py: using RAC 175 07:07:41.795551 tst emergency_mo_mt_call.py: using CellId 26695 07:07:41.924104 tst emergency_mo_mt_call.py: using BVCI 26696 07:07:42.038606 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:07:42.049724 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:07:42.060682 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:07:42.071630 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:07:42.082388 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:07:42.093169 tst emergency:oc2g: Using 1 x modem (candidates: 4) 07:07:42.208064 tst emergency:oc2g: Using 1 x modem (candidates: 4) 07:07:42.326770 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:07:42.813965 run create_hlr_db(pid=8870): Launched 07:07:42.941959 bus /sierra_2: Setting Powered False 07:07:44.004207 run create_hlr_db(pid=8870): Terminated: ok {rc=0} 07:07:44.421409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8872): Launched 07:07:44.713148 run osmo-hlr_10.42.42.2(pid=8873): Launched 07:07:44.825537 run osmo-stp_10.42.42.5: Starting osmo-stp 07:07:45.340720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8875): Launched 07:07:45.632703 run osmo-stp_10.42.42.5(pid=8876): Launched 07:07:45.755231 tst emergency_mo_mt_call.py: using MSISDN 7609 07:07:45.933226 run osmo-msc_10.42.42.6: Starting osmo-msc 07:07:46.530491 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8878): Launched 07:07:46.855258 run osmo-msc_10.42.42.6(pid=8879): Launched 07:07:47.135095 run osmo-stp_10.42.42.5(pid=8876): ERR: Terminated: ERROR {rc=1} [trial-2371↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8876)] 07:07:47.412403 run osmo-stp_10.42.42.5(pid=8876): stdout: | (launched: 2022-12-10_07:07:45.579684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:47.544193 run osmo-stp_10.42.42.5(pid=8876): stderr: | [0;m[38;5;43m20221210070745750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070745751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070745751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070745751 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070745752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070745752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070745752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:47.674830 run osmo-stp_10.42.42.5(pid=8876): stdout: | (launched: 2022-12-10_07:07:45.579684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:47.800021 run osmo-stp_10.42.42.5(pid=8876): stderr: | [0;m[38;5;43m20221210070745750 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070745751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070745751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070745751 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070745752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070745752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070745752 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:47.949916 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=8876): Process ended prematurely: osmo-stp_10.42.42.5(pid=8876) [trial-2371↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8876)] [trial-2371↪emergency:oc2g↪emergency_mo_mt_call.py:19] 07:07:47.958943 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 07:07:47.986332 run osmo-hlr_10.42.42.2(pid=8873): ERR: Terminated: ERROR {rc=237} [trial-2371↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8873)] 07:07:48.036255 run osmo-hlr_10.42.42.2(pid=8873): stdout: | (launched: 2022-12-10_07:07:44.660163) 07:07:48.088055 run osmo-hlr_10.42.42.2(pid=8873): stderr: | [0;m[1;31m20221210070744834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070744834 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070744835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070744835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070744835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070744835 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070744848 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/emergency:oc2g/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070744858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070744858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070744858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:07:48.160151 run osmo-msc_10.42.42.6(pid=8879): ERR: Terminated: ERROR {rc=2} [trial-2371↪emergency:oc2g↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8879)] 07:07:48.209954 run osmo-msc_10.42.42.6(pid=8879): stdout: | (launched: 2022-12-10_07:07:46.794450) 07:07:48.261723 run osmo-msc_10.42.42.6(pid=8879): stderr: | [0;m[38;5;43m20221210070747343 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210070747343 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f28f6f9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210070747343 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210070747343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210070747344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210070747344 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210070747349 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210070747350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210070747350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210070747350 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:07:48.313590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8872): Terminating (SIGTERM) 07:07:48.354913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8875): Terminating (SIGTERM) 07:07:48.396065 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8878): Terminating (SIGTERM) 07:07:48.437929 --- ParallelTerminationStrategy: PID 8872 died... 07:07:48.458001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8872): Terminated: ok {rc=0} 07:07:48.504478 --- ParallelTerminationStrategy: PID 8875 died... 07:07:48.524148 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8875): Terminated: ok {rc=0} 07:07:48.570374 --- ParallelTerminationStrategy: PID 8878 died... 07:07:48.590163 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8878): Terminated: ok {rc=0} 07:07:48.677330 bus /sierra_3: Setting Powered False 07:07:49.773399 bus /sierra_3: Setting Powered False 07:07:50.888405 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 emergency:oc2g emergency_preemptive_call.py ---------------------------------------------- 07:07:51.976150 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:07:51.987447 tst emergency:oc2g: Using 1 x bts (candidates: 1) 07:07:52.032545 tst emergency_preemptive_call.py: using LAC 26696 07:07:52.151735 tst emergency_preemptive_call.py: using RAC 176 07:07:52.264455 tst emergency_preemptive_call.py: using CellId 26696 07:07:52.377467 tst emergency_preemptive_call.py: using BVCI 26697 07:07:52.491859 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:07:52.502939 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:07:52.514274 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:07:52.525444 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:07:52.536520 tst emergency:oc2g: Using 1 x ip_address (candidates: 6) 07:07:52.547328 tst emergency:oc2g: Using 1 x modem (candidates: 4) 07:07:52.661659 tst emergency:oc2g: Using 1 x modem (candidates: 4) 07:07:52.780532 tst emergency:oc2g: Using 1 x modem (candidates: 4) 07:07:52.898293 tst emergency:oc2g: Using 1 x modem (candidates: 4) 07:07:53.011772 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:07:53.463202 run create_hlr_db(pid=8881): Launched 07:07:53.574982 bus /sierra_2: Setting Powered False 07:07:54.633963 run create_hlr_db(pid=8881): Terminated: ok {rc=0} 07:07:55.062323 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8883): Launched 07:07:55.376535 run osmo-hlr_10.42.42.2(pid=8884): Launched 07:07:55.497286 run osmo-stp_10.42.42.5: Starting osmo-stp 07:07:56.041579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8886): Launched 07:07:56.355370 run osmo-stp_10.42.42.5(pid=8887): Launched 07:07:56.485860 tst emergency_preemptive_call.py: using MSISDN 7610 07:07:56.648545 run osmo-msc_10.42.42.6: Starting osmo-msc 07:07:57.209625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8889): Launched 07:07:57.522440 run osmo-msc_10.42.42.6(pid=8890): Launched 07:07:57.697747 run osmo-stp_10.42.42.5(pid=8887): ERR: Terminated: ERROR {rc=1} [trial-2371↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8887)] 07:07:57.829075 run osmo-stp_10.42.42.5(pid=8887): stdout: | (launched: 2022-12-10_07:07:56.298336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:57.960796 run osmo-stp_10.42.42.5(pid=8887): stderr: | [0;m[38;5;43m20221210070756488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070756488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070756488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070756489 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070756491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070756491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070756491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:58.092118 run osmo-stp_10.42.42.5(pid=8887): stdout: | (launched: 2022-12-10_07:07:56.298336) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:07:58.216899 run osmo-stp_10.42.42.5(pid=8887): stderr: | [0;m[38;5;43m20221210070756488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070756488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070756488 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070756489 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070756491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070756491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070756491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:07:58.366493 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=8887): Process ended prematurely: osmo-stp_10.42.42.5(pid=8887) [trial-2371↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8887)] [trial-2371↪emergency:oc2g↪emergency_preemptive_call.py:32] 07:07:58.375230 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 07:07:58.402676 run osmo-hlr_10.42.42.2(pid=8884): ERR: Terminated: ERROR {rc=237} [trial-2371↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8884)] 07:07:58.452627 run osmo-hlr_10.42.42.2(pid=8884): stdout: | (launched: 2022-12-10_07:07:55.319697) 07:07:58.504285 run osmo-hlr_10.42.42.2(pid=8884): stderr: | [0;m[1;31m20221210070755517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070755517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070755517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070755517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070755517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070755517 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070755530 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/emergency:oc2g/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070755538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070755538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070755538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:07:58.576864 run osmo-msc_10.42.42.6(pid=8890): ERR: Terminated: ERROR {rc=2} [trial-2371↪emergency:oc2g↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=8890)] 07:07:58.627141 run osmo-msc_10.42.42.6(pid=8890): stdout: | (launched: 2022-12-10_07:07:57.465694) 07:07:58.678630 run osmo-msc_10.42.42.6(pid=8890): stderr: | [0;m[38;5;43m20221210070757787 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210070757787 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3253e4ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210070757787 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210070757787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210070757787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210070757787 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210070757789 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210070757790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210070757790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210070757790 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:07:58.730368 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8883): Terminating (SIGTERM) 07:07:58.771867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8886): Terminating (SIGTERM) 07:07:58.813510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8889): Terminating (SIGTERM) 07:07:58.855333 --- ParallelTerminationStrategy: PID 8883 died... 07:07:58.875301 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8883): Terminated: ok {rc=0} 07:07:58.921273 --- ParallelTerminationStrategy: PID 8886 died... 07:07:58.940750 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8886): Terminated: ok {rc=0} 07:07:58.986591 --- ParallelTerminationStrategy: PID 8889 died... 07:07:59.006300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=8889): Terminated: ok {rc=0} 07:07:59.094262 bus /sierra_9: Setting Powered False 07:08:00.191843 bus /sierra_9: Setting Powered False 07:08:01.317139 bus /sierra_8: Setting Powered False 07:08:02.415282 bus /sierra_8: Setting Powered False 07:08:03.530855 bus /sierra_3: Setting Powered False 07:08:04.627889 bus /sierra_3: Setting Powered False 07:08:05.745781 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 emergency:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:oc2g --------------------------------------------------------------------- 07:08:07.001308 tst gprs:oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:08:07.005526 tst gprs:oc2g: Verifying 1 x bts (candidates: 11) 07:08:07.025972 tst gprs:oc2g: Verifying 9 x ip_address (candidates: 9) 07:08:07.064544 tst gprs:oc2g: Verifying 4 x modem (candidates: 12) 07:08:07.149867 tst gprs:oc2g: Reserving 1 x bts (candidates: 11) 07:08:07.170173 tst gprs:oc2g: Reserving 9 x ip_address (candidates: 9) 07:08:07.208375 tst gprs:oc2g: Reserving 4 x modem (candidates: 12) 07:08:07.794867 tst gprs:oc2g: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:oc2g cs_paging_gprs_active.py ---------------------------------------------- 07:08:07.843798 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:07.854444 tst gprs:oc2g: Using 1 x bts (candidates: 1) 07:08:07.888821 tst cs_paging_gprs_active.py: using LAC 26697 07:08:08.005375 tst cs_paging_gprs_active.py: using RAC 177 07:08:08.121976 tst cs_paging_gprs_active.py: using CellId 26697 07:08:08.240492 tst cs_paging_gprs_active.py: using BVCI 26698 07:08:08.348771 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:08.359274 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:08.369528 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:08.380569 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:08.391681 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:08.402681 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:08.413996 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:08.425043 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:08.436263 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:08:08.556082 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:08:08.675281 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:08:08.892410 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:08:09.212737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8897): Launched 07:08:09.491704 run iperf3-srv_10.42.42.10(pid=8898): Launched 07:08:09.612194 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:08:09.827787 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:08:10.147365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8899): Launched 07:08:10.425981 run iperf3-srv_10.42.42.10(pid=8900): Launched 07:08:10.546278 tst cs_paging_gprs_active.py:38: start network... 07:08:10.762897 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:08:11.255948 run create_hlr_db(pid=8901): Launched 07:08:11.377899 bus /sierra_2: Setting Powered False 07:08:12.437466 run create_hlr_db(pid=8901): Terminated: ok {rc=0} 07:08:12.851094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8903): Launched 07:08:13.148602 run osmo-hlr_10.42.42.2(pid=8904): Launched 07:08:13.262665 run osmo-stp_10.42.42.5: Starting osmo-stp 07:08:13.783249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8906): Launched 07:08:14.080427 run osmo-stp_10.42.42.5(pid=8907): Launched 07:08:14.195674 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:08:14.707481 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8909): Launched 07:08:14.822615 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:08:15.072782 run patchelf(pid=8910): Launched 07:08:15.239340 run osmo-stp_10.42.42.5(pid=8907): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8907)] 07:08:15.365421 run osmo-stp_10.42.42.5(pid=8907): stdout: | (launched: 2022-12-10_07:08:14.025830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:15.493169 run osmo-stp_10.42.42.5(pid=8907): stderr: | [0;m[38;5;43m20221210070814193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070814193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070814193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070814193 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070814194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070814194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070814194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:15.621427 run osmo-stp_10.42.42.5(pid=8907): stdout: | (launched: 2022-12-10_07:08:14.025830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:15.742976 run osmo-stp_10.42.42.5(pid=8907): stderr: | [0;m[38;5;43m20221210070814193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070814193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070814193 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070814193 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070814194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070814194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070814194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:15.895604 run patchelf(pid=8910): Terminating (SIGINT) 07:08:16.082155 run patchelf(pid=8910): Terminated: ok {rc=0} 07:08:16.206918 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=8907): Process ended prematurely: osmo-stp_10.42.42.5(pid=8907) [trial-2371↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8907)] [trial-2371↪gprs:oc2g↪cs_paging_gprs_active.py:38] 07:08:16.217081 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 07:08:16.246579 run osmo-hlr_10.42.42.2(pid=8904): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:oc2g↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=8904)] 07:08:16.300049 run osmo-hlr_10.42.42.2(pid=8904): stdout: | (launched: 2022-12-10_07:08:13.094230) 07:08:16.360861 run osmo-hlr_10.42.42.2(pid=8904): stderr: | [0;m[1;31m20221210070813271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070813271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070813271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070813271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070813271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070813271 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070813283 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:oc2g/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070813292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070813292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070813293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:08:16.421895 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8897): Terminating (SIGTERM) 07:08:16.475243 run iperf3-srv_10.42.42.10(pid=8898): Terminating (SIGTERM) 07:08:16.528340 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8899): Terminating (SIGTERM) 07:08:16.584733 run iperf3-srv_10.42.42.10(pid=8900): Terminating (SIGTERM) 07:08:16.634820 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8903): Terminating (SIGTERM) 07:08:16.679985 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8906): Terminating (SIGTERM) 07:08:16.726349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8909): Terminating (SIGTERM) 07:08:16.781853 --- ParallelTerminationStrategy: PID 8897 died... 07:08:16.805875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8897): Terminated: ok {rc=0} 07:08:16.862887 --- ParallelTerminationStrategy: PID 8898 died... 07:08:16.891801 run iperf3-srv_10.42.42.10(pid=8898): Terminated {rc=256} 07:08:16.945428 --- ParallelTerminationStrategy: PID 8899 died... 07:08:16.964857 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=8899): Terminated: ok {rc=0} 07:08:17.011096 --- ParallelTerminationStrategy: PID 8900 died... 07:08:17.030406 run iperf3-srv_10.42.42.10(pid=8900): Terminated {rc=256} 07:08:17.076431 --- ParallelTerminationStrategy: PID 8903 died... 07:08:17.095861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=8903): Terminated: ok {rc=0} 07:08:17.149759 --- ParallelTerminationStrategy: PID 8906 died... 07:08:17.171852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=8906): Terminated: ok {rc=0} 07:08:17.223239 --- ParallelTerminationStrategy: PID 8909 died... 07:08:17.242944 run pcap-recorder_any(filters='host 10.42.42.6')(pid=8909): Terminated: ok {rc=0} 07:08:17.347755 bus /gobi_0: Setting Powered False 07:08:18.472915 bus /gobi_0: Setting Powered False 07:08:19.608047 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:oc2g iperf3.py ---------------------------------------------- 07:08:20.757012 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:20.768807 tst gprs:oc2g: Using 1 x bts (candidates: 1) 07:08:20.806500 tst iperf3.py: using LAC 26698 07:08:20.923880 tst iperf3.py: using RAC 178 07:08:21.042806 tst iperf3.py: using CellId 26698 07:08:21.164584 tst iperf3.py: using BVCI 26699 07:08:21.276038 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:21.287336 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:21.298604 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:21.310802 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:21.323083 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:21.335339 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:21.348617 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:21.360829 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:21.371970 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:08:21.494140 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:08:21.699351 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:08:22.007162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9182): Launched 07:08:22.293788 run iperf3-srv_10.42.42.10(pid=9183): Launched 07:08:22.427991 tst iperf3.py:8: start network... 07:08:22.647547 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:08:23.159846 run create_hlr_db(pid=9184): Launched 07:08:23.323693 bus /gobi_6: Setting Powered False 07:08:24.388732 run create_hlr_db(pid=9184): Terminated: ok {rc=0} 07:08:24.861828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9186): Launched 07:08:25.205712 run osmo-hlr_10.42.42.2(pid=9187): Launched 07:08:25.457123 run osmo-stp_10.42.42.5: Starting osmo-stp 07:08:26.120082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9189): Launched 07:08:26.473694 run osmo-stp_10.42.42.5(pid=9190): Launched 07:08:26.720528 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:08:27.377727 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9192): Launched 07:08:27.508787 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:08:27.795859 run patchelf(pid=9193): Launched 07:08:27.992386 run osmo-stp_10.42.42.5(pid=9190): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9190)] 07:08:28.131929 run osmo-stp_10.42.42.5(pid=9190): stdout: | (launched: 2022-12-10_07:08:26.400826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:28.273284 run osmo-stp_10.42.42.5(pid=9190): stderr: | [0;m[38;5;43m20221210070826700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070826705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070826705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070826706 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070826706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070826706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070826706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:28.415466 run osmo-stp_10.42.42.5(pid=9190): stdout: | (launched: 2022-12-10_07:08:26.400826) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:28.551120 run osmo-stp_10.42.42.5(pid=9190): stderr: | [0;m[38;5;43m20221210070826700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070826705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070826705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070826706 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070826706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070826706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070826706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:28.713668 run patchelf(pid=9193): Terminating (SIGINT) 07:08:28.902480 run patchelf(pid=9193): Terminated: ok {rc=0} 07:08:29.035374 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9190): Process ended prematurely: osmo-stp_10.42.42.5(pid=9190) [trial-2371↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9190)] [trial-2371↪gprs:oc2g↪iperf3.py:8] 07:08:29.046105 tst iperf3.py:8: Test FAILED (8.3 sec) 07:08:29.075352 run osmo-hlr_10.42.42.2(pid=9187): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:oc2g↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9187)] 07:08:29.127426 run osmo-hlr_10.42.42.2(pid=9187): stdout: | (launched: 2022-12-10_07:08:25.134714) 07:08:29.180132 run osmo-hlr_10.42.42.2(pid=9187): stderr: | [0;m[1;31m20221210070825452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070825452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070825452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070825452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070825452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070825452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070825472 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:oc2g/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070825485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070825485 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070825486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:08:29.233547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9182): Terminating (SIGTERM) 07:08:29.277677 run iperf3-srv_10.42.42.10(pid=9183): Terminating (SIGTERM) 07:08:29.321758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9186): Terminating (SIGTERM) 07:08:29.365843 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9189): Terminating (SIGTERM) 07:08:29.410718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9192): Terminating (SIGTERM) 07:08:29.455604 --- ParallelTerminationStrategy: PID 9182 died... 07:08:29.476045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9182): Terminated: ok {rc=0} 07:08:29.526319 --- ParallelTerminationStrategy: PID 9183 died... 07:08:29.546622 run iperf3-srv_10.42.42.10(pid=9183): Terminated {rc=256} 07:08:29.594288 --- ParallelTerminationStrategy: PID 9186 died... 07:08:29.615032 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9186): Terminated: ok {rc=0} 07:08:29.662405 --- ParallelTerminationStrategy: PID 9189 died... 07:08:29.684891 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9189): Terminated: ok {rc=0} 07:08:29.733873 --- ParallelTerminationStrategy: PID 9192 died... 07:08:29.754599 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9192): Terminated: ok {rc=0} 07:08:29.845025 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:oc2g iperf3m4.py ---------------------------------------------- 07:08:31.046604 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:31.058876 tst gprs:oc2g: Using 1 x bts (candidates: 1) 07:08:31.099448 tst iperf3m4.py: using LAC 26699 07:08:31.271656 tst iperf3m4.py: using RAC 179 07:08:31.408002 tst iperf3m4.py: using CellId 26699 07:08:31.593104 tst iperf3m4.py: using BVCI 26700 07:08:31.731926 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:31.743250 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:31.754606 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:31.766055 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:31.777316 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:31.788667 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:31.800008 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:31.811577 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:31.822998 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:08:31.957869 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:08:32.121374 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:08:32.269647 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:08:32.440146 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:08:32.688453 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:08:33.031056 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9194): Launched 07:08:33.335213 run iperf3-srv_10.42.42.10(pid=9195): Launched 07:08:33.495504 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:08:33.720191 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:08:34.056252 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9196): Launched 07:08:34.359872 run iperf3-srv_10.42.42.10(pid=9197): Launched 07:08:34.496368 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:08:34.722298 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:08:35.061724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9198): Launched 07:08:35.363207 run iperf3-srv_10.42.42.10(pid=9199): Launched 07:08:35.499596 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:08:35.723838 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:08:36.061725 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9200): Launched 07:08:36.365720 run iperf3-srv_10.42.42.10(pid=9201): Launched 07:08:36.502999 tst iperf3m4.py:8: start network... 07:08:36.731321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:08:37.246754 run create_hlr_db(pid=9202): Launched 07:08:37.412275 bus /gobi_6: Setting Powered False 07:08:38.478837 run create_hlr_db(pid=9202): Terminated: ok {rc=0} 07:08:38.948640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9204): Launched 07:08:39.299568 run osmo-hlr_10.42.42.2(pid=9205): Launched 07:08:39.556448 run osmo-stp_10.42.42.5: Starting osmo-stp 07:08:40.199112 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9207): Launched 07:08:40.521172 run osmo-stp_10.42.42.5(pid=9208): Launched 07:08:40.644457 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:08:41.199544 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9210): Launched 07:08:41.323290 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:08:41.593366 run patchelf(pid=9211): Launched 07:08:41.772688 run osmo-stp_10.42.42.5(pid=9208): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9208)] 07:08:41.908044 run osmo-stp_10.42.42.5(pid=9208): stdout: | (launched: 2022-12-10_07:08:40.463211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:42.045486 run osmo-stp_10.42.42.5(pid=9208): stderr: | [0;m[38;5;43m20221210070840654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070840654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070840655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070840655 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070840655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070840655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070840656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:42.182741 run osmo-stp_10.42.42.5(pid=9208): stdout: | (launched: 2022-12-10_07:08:40.463211) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:42.314456 run osmo-stp_10.42.42.5(pid=9208): stderr: | [0;m[38;5;43m20221210070840654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070840654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070840655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070840655 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070840655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070840655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070840656 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:42.470048 run patchelf(pid=9211): Terminating (SIGINT) 07:08:42.650514 run patchelf(pid=9211): Terminated: ok {rc=0} 07:08:42.780718 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9208): Process ended prematurely: osmo-stp_10.42.42.5(pid=9208) [trial-2371↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9208)] [trial-2371↪gprs:oc2g↪iperf3m4.py:8] 07:08:42.790769 tst iperf3m4.py:8: Test FAILED (11.8 sec) 07:08:42.819422 run osmo-hlr_10.42.42.2(pid=9205): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:oc2g↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9205)] 07:08:42.869115 run osmo-hlr_10.42.42.2(pid=9205): stdout: | (launched: 2022-12-10_07:08:39.231356) 07:08:42.920487 run osmo-hlr_10.42.42.2(pid=9205): stderr: | [0;m[1;31m20221210070839548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070839548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070839548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070839548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070839548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070839548 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070839563 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:oc2g/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070839580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070839581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070839581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:08:42.972576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9194): Terminating (SIGTERM) 07:08:43.014150 run iperf3-srv_10.42.42.10(pid=9195): Terminating (SIGTERM) 07:08:43.055933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9196): Terminating (SIGTERM) 07:08:43.097756 run iperf3-srv_10.42.42.10(pid=9197): Terminating (SIGTERM) 07:08:43.139424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9198): Terminating (SIGTERM) 07:08:43.181662 run iperf3-srv_10.42.42.10(pid=9199): Terminating (SIGTERM) 07:08:43.223293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9200): Terminating (SIGTERM) 07:08:43.264893 run iperf3-srv_10.42.42.10(pid=9201): Terminating (SIGTERM) 07:08:43.306862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9204): Terminating (SIGTERM) 07:08:43.348555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9207): Terminating (SIGTERM) 07:08:43.390153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9210): Terminating (SIGTERM) 07:08:43.431791 --- ParallelTerminationStrategy: PID 9194 died... 07:08:43.451925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9194): Terminated: ok {rc=0} 07:08:43.498423 --- ParallelTerminationStrategy: PID 9195 died... 07:08:43.518064 run iperf3-srv_10.42.42.10(pid=9195): Terminated {rc=256} 07:08:43.564114 --- ParallelTerminationStrategy: PID 9196 died... 07:08:43.583869 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9196): Terminated: ok {rc=0} 07:08:43.630038 --- ParallelTerminationStrategy: PID 9197 died... 07:08:43.649552 run iperf3-srv_10.42.42.10(pid=9197): Terminated {rc=256} 07:08:43.695441 --- ParallelTerminationStrategy: PID 9198 died... 07:08:43.715114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9198): Terminated: ok {rc=0} 07:08:43.761059 --- ParallelTerminationStrategy: PID 9199 died... 07:08:43.780652 run iperf3-srv_10.42.42.10(pid=9199): Terminated {rc=256} 07:08:43.826628 --- ParallelTerminationStrategy: PID 9200 died... 07:08:43.846309 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9200): Terminated: ok {rc=0} 07:08:43.892282 --- ParallelTerminationStrategy: PID 9201 died... 07:08:43.911774 run iperf3-srv_10.42.42.10(pid=9201): Terminated {rc=256} 07:08:43.957651 --- ParallelTerminationStrategy: PID 9204 died... 07:08:43.977442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9204): Terminated: ok {rc=0} 07:08:44.023322 --- ParallelTerminationStrategy: PID 9207 died... 07:08:44.042928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9207): Terminated: ok {rc=0} 07:08:44.089101 --- ParallelTerminationStrategy: PID 9210 died... 07:08:44.108802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9210): Terminated: ok {rc=0} 07:08:44.195733 bus /gobi_4: Setting Powered False 07:08:45.294715 bus /gobi_4: Setting Powered False 07:08:46.408792 bus /gobi_1: Setting Powered False 07:08:47.506780 bus /gobi_1: Setting Powered False 07:08:48.622363 bus /gobi_0: Setting Powered False 07:08:49.719737 bus /gobi_0: Setting Powered False 07:08:50.837152 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:oc2g ping.py ---------------------------------------------- 07:08:51.940632 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:51.952087 tst gprs:oc2g: Using 1 x bts (candidates: 1) 07:08:51.989831 tst ping.py: using LAC 26700 07:08:52.115903 tst ping.py: using RAC 180 07:08:52.239064 tst ping.py: using CellId 26700 07:08:52.363132 tst ping.py: using BVCI 26701 07:08:52.477271 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:52.488111 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:52.498868 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:52.510100 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:52.521249 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:52.532371 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:52.543678 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:08:52.554955 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:08:52.671331 tst ping.py:19: start network... 07:08:52.867560 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:08:53.317945 run create_hlr_db(pid=9212): Launched 07:08:53.430593 bus /gobi_6: Setting Powered False 07:08:54.488905 run create_hlr_db(pid=9212): Terminated: ok {rc=0} 07:08:54.915502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9214): Launched 07:08:55.230006 run osmo-hlr_10.42.42.2(pid=9215): Launched 07:08:55.351931 run osmo-stp_10.42.42.5: Starting osmo-stp 07:08:55.893464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9217): Launched 07:08:56.207605 run osmo-stp_10.42.42.5(pid=9218): Launched 07:08:56.328627 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:08:56.870606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9220): Launched 07:08:56.991170 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:08:57.256789 run patchelf(pid=9221): Launched 07:08:57.432337 run osmo-stp_10.42.42.5(pid=9218): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9218)] 07:08:57.565616 run osmo-stp_10.42.42.5(pid=9218): stdout: | (launched: 2022-12-10_07:08:56.150546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:57.700449 run osmo-stp_10.42.42.5(pid=9218): stderr: | [0;m[38;5;43m20221210070856343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070856343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070856343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070856344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070856344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070856344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070856344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:57.835145 run osmo-stp_10.42.42.5(pid=9218): stdout: | (launched: 2022-12-10_07:08:56.150546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:08:57.964039 run osmo-stp_10.42.42.5(pid=9218): stderr: | [0;m[38;5;43m20221210070856343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070856343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070856343 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070856344 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070856344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070856344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070856344 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:08:58.116680 run patchelf(pid=9221): Terminating (SIGINT) 07:08:58.294286 run patchelf(pid=9221): Terminated: ok {rc=0} 07:08:58.422133 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9218): Process ended prematurely: osmo-stp_10.42.42.5(pid=9218) [trial-2371↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9218)] [trial-2371↪gprs:oc2g↪ping.py:22] 07:08:58.431490 tst ping.py:22: Test FAILED (6.5 sec) 07:08:58.459713 run osmo-hlr_10.42.42.2(pid=9215): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:oc2g↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9215)] 07:08:58.509808 run osmo-hlr_10.42.42.2(pid=9215): stdout: | (launched: 2022-12-10_07:08:55.173213) 07:08:58.561732 run osmo-hlr_10.42.42.2(pid=9215): stderr: | [0;m[1;31m20221210070855368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070855368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070855368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070855368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070855368 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070855369 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070855379 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:oc2g/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070855387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070855387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070855387 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:08:58.613801 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9214): Terminating (SIGTERM) 07:08:58.655779 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9217): Terminating (SIGTERM) 07:08:58.697747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9220): Terminating (SIGTERM) 07:08:58.740033 --- ParallelTerminationStrategy: PID 9214 died... 07:08:58.760209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9214): Terminated: ok {rc=0} 07:08:58.806702 --- ParallelTerminationStrategy: PID 9217 died... 07:08:58.826444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9217): Terminated: ok {rc=0} 07:08:58.872459 --- ParallelTerminationStrategy: PID 9220 died... 07:08:58.892145 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9220): Terminated: ok {rc=0} 07:08:58.980070 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:oc2g ping_idle_ping.py ---------------------------------------------- 07:09:00.066998 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:00.078536 tst gprs:oc2g: Using 1 x bts (candidates: 1) 07:09:00.116544 tst ping_idle_ping.py: using LAC 26701 07:09:00.239482 tst ping_idle_ping.py: using RAC 181 07:09:00.363385 tst ping_idle_ping.py: using CellId 26701 07:09:00.488602 tst ping_idle_ping.py: using BVCI 26702 07:09:00.603988 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:00.614853 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:00.625672 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:00.636339 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:00.647056 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:00.657712 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:00.668424 tst gprs:oc2g: Using 1 x ip_address (candidates: 9) 07:09:00.679282 tst gprs:oc2g: Using 1 x modem (candidates: 4) 07:09:00.796924 tst ping_idle_ping.py:24: start network... 07:09:01.016358 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:09:01.520457 run create_hlr_db(pid=9222): Launched 07:09:01.674310 bus /gobi_6: Setting Powered False 07:09:02.738113 run create_hlr_db(pid=9222): Terminated: ok {rc=0} 07:09:03.191666 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9224): Launched 07:09:03.485358 run osmo-hlr_10.42.42.2(pid=9225): Launched 07:09:03.599451 run osmo-stp_10.42.42.5: Starting osmo-stp 07:09:04.107073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9227): Launched 07:09:04.400117 run osmo-stp_10.42.42.5(pid=9228): Launched 07:09:04.512454 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:09:05.018718 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9230): Launched 07:09:05.132308 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:09:05.379686 run patchelf(pid=9231): Launched 07:09:05.543737 run osmo-stp_10.42.42.5(pid=9228): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9228)] 07:09:05.668090 run osmo-stp_10.42.42.5(pid=9228): stdout: | (launched: 2022-12-10_07:09:04.346506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:05.794428 run osmo-stp_10.42.42.5(pid=9228): stderr: | [0;m[38;5;43m20221210070904515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070904515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070904515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070904516 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070904516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070904516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070904516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:05.920665 run osmo-stp_10.42.42.5(pid=9228): stdout: | (launched: 2022-12-10_07:09:04.346506) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:06.040533 run osmo-stp_10.42.42.5(pid=9228): stderr: | [0;m[38;5;43m20221210070904515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070904515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070904515 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070904516 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070904516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070904516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070904516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:06.183182 run patchelf(pid=9231): Terminating (SIGINT) 07:09:06.348923 run patchelf(pid=9231): Terminated: ok {rc=0} 07:09:06.468348 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9228): Process ended prematurely: osmo-stp_10.42.42.5(pid=9228) [trial-2371↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9228)] [trial-2371↪gprs:oc2g↪ping_idle_ping.py:27] 07:09:06.477054 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 07:09:06.504462 run osmo-hlr_10.42.42.2(pid=9225): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:oc2g↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9225)] 07:09:06.552546 run osmo-hlr_10.42.42.2(pid=9225): stdout: | (launched: 2022-12-10_07:09:03.431315) 07:09:06.602047 run osmo-hlr_10.42.42.2(pid=9225): stderr: | [0;m[1;31m20221210070903604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070903604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070903604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070903604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070903604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070903604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070903616 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:oc2g/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070903626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070903626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070903627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:09:06.651790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9224): Terminating (SIGTERM) 07:09:06.691632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9227): Terminating (SIGTERM) 07:09:06.731903 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9230): Terminating (SIGTERM) 07:09:06.772270 --- ParallelTerminationStrategy: PID 9224 died... 07:09:06.791443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9224): Terminated: ok {rc=0} 07:09:06.836049 --- ParallelTerminationStrategy: PID 9227 died... 07:09:06.854960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9227): Terminated: ok {rc=0} 07:09:06.899422 --- ParallelTerminationStrategy: PID 9230 died... 07:09:06.918065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9230): Terminated: ok {rc=0} 07:09:07.003881 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:oc2g+mod-bts0-egprs --------------------------------------------------------------------- 07:09:08.293341 tst gprs:oc2g+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:09:08.298788 tst gprs:oc2g+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:09:08.319731 tst gprs:oc2g+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:09:08.357976 tst gprs:oc2g+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:09:08.443586 tst gprs:oc2g+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:09:08.463722 tst gprs:oc2g+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:09:08.501703 tst gprs:oc2g+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:09:09.092520 tst gprs:oc2g+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:oc2g+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:09:09.145922 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:09.157052 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:09:09.195844 tst cs_paging_gprs_active.py: using LAC 26702 07:09:09.320636 tst cs_paging_gprs_active.py: using RAC 182 07:09:09.444142 tst cs_paging_gprs_active.py: using CellId 26702 07:09:09.568265 tst cs_paging_gprs_active.py: using BVCI 26703 07:09:09.675537 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:09.686175 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:09.696522 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:09.707214 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:09.717931 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:09.728640 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:09.739322 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:09.749753 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:09.760478 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:09:09.878626 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:09:09.995280 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:09:10.207205 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:09:10.521677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9236): Launched 07:09:10.793080 run iperf3-srv_10.42.42.10(pid=9237): Launched 07:09:10.910458 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:09:11.121472 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:09:11.435224 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9238): Launched 07:09:11.706992 run iperf3-srv_10.42.42.10(pid=9239): Launched 07:09:11.824306 tst cs_paging_gprs_active.py:38: start network... 07:09:12.035224 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:09:12.520055 run create_hlr_db(pid=9240): Launched 07:09:12.648803 bus /gobi_6: Setting Powered False 07:09:13.711645 run create_hlr_db(pid=9240): Terminated: ok {rc=0} 07:09:14.147782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9242): Launched 07:09:14.461064 run osmo-hlr_10.42.42.2(pid=9243): Launched 07:09:14.581604 run osmo-stp_10.42.42.5: Starting osmo-stp 07:09:15.127033 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9245): Launched 07:09:15.440627 run osmo-stp_10.42.42.5(pid=9246): Launched 07:09:15.560715 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:09:16.108450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9248): Launched 07:09:16.231693 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:09:16.497848 run patchelf(pid=9249): Launched 07:09:16.679691 run osmo-stp_10.42.42.5(pid=9246): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9246)] 07:09:16.814386 run osmo-stp_10.42.42.5(pid=9246): stdout: | (launched: 2022-12-10_07:09:15.384327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:16.950709 run osmo-stp_10.42.42.5(pid=9246): stderr: | [0;m[38;5;43m20221210070915573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070915573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070915574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070915574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070915574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070915575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070915575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:17.087142 run osmo-stp_10.42.42.5(pid=9246): stdout: | (launched: 2022-12-10_07:09:15.384327) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:17.217170 run osmo-stp_10.42.42.5(pid=9246): stderr: | [0;m[38;5;43m20221210070915573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070915573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070915574 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070915574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070915574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070915575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070915575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:17.369918 run patchelf(pid=9249): Terminating (SIGINT) 07:09:17.546003 run patchelf(pid=9249): Terminated: ok {rc=0} 07:09:17.673275 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9246): Process ended prematurely: osmo-stp_10.42.42.5(pid=9246) [trial-2371↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9246)] [trial-2371↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:09:17.683291 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 07:09:17.711397 run osmo-hlr_10.42.42.2(pid=9243): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9243)] 07:09:17.761092 run osmo-hlr_10.42.42.2(pid=9243): stdout: | (launched: 2022-12-10_07:09:14.404231) 07:09:17.812256 run osmo-hlr_10.42.42.2(pid=9243): stderr: | [0;m[1;31m20221210070914601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070914601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070914601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070914601 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070914602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070914602 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070914614 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:oc2g+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070914622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070914622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070914622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:09:17.863908 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9236): Terminating (SIGTERM) 07:09:17.905234 run iperf3-srv_10.42.42.10(pid=9237): Terminating (SIGTERM) 07:09:17.946574 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9238): Terminating (SIGTERM) 07:09:17.987883 run iperf3-srv_10.42.42.10(pid=9239): Terminating (SIGTERM) 07:09:18.029026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9242): Terminating (SIGTERM) 07:09:18.070291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9245): Terminating (SIGTERM) 07:09:18.112085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9248): Terminating (SIGTERM) 07:09:18.153641 --- ParallelTerminationStrategy: PID 9236 died... 07:09:18.173374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9236): Terminated: ok {rc=0} 07:09:18.219008 --- ParallelTerminationStrategy: PID 9237 died... 07:09:18.238168 run iperf3-srv_10.42.42.10(pid=9237): Terminated {rc=256} 07:09:18.283345 --- ParallelTerminationStrategy: PID 9238 died... 07:09:18.302853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9238): Terminated: ok {rc=0} 07:09:18.348368 --- ParallelTerminationStrategy: PID 9239 died... 07:09:18.367674 run iperf3-srv_10.42.42.10(pid=9239): Terminated {rc=256} 07:09:18.412848 --- ParallelTerminationStrategy: PID 9242 died... 07:09:18.432455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9242): Terminated: ok {rc=0} 07:09:18.477704 --- ParallelTerminationStrategy: PID 9245 died... 07:09:18.496902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9245): Terminated: ok {rc=0} 07:09:18.542081 --- ParallelTerminationStrategy: PID 9248 died... 07:09:18.561484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9248): Terminated: ok {rc=0} 07:09:18.649189 bus /gobi_0: Setting Powered False 07:09:19.749225 bus /gobi_0: Setting Powered False 07:09:20.867190 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:oc2g+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:09:22.011976 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:22.023452 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:09:22.061632 tst iperf3.py: using LAC 26703 07:09:22.184702 tst iperf3.py: using RAC 183 07:09:22.307764 tst iperf3.py: using CellId 26703 07:09:22.431640 tst iperf3.py: using BVCI 26704 07:09:22.544844 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:22.555891 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:22.566861 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:22.577813 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:22.588579 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:22.599508 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:22.610540 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:22.621477 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:22.632428 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:09:22.750999 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:09:22.962515 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:09:23.276210 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9250): Launched 07:09:23.548454 run iperf3-srv_10.42.42.10(pid=9251): Launched 07:09:23.666323 tst iperf3.py:8: start network... 07:09:23.876926 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:09:24.360652 run create_hlr_db(pid=9252): Launched 07:09:24.487404 bus /gobi_6: Setting Powered False 07:09:25.548891 run create_hlr_db(pid=9252): Terminated: ok {rc=0} 07:09:25.982974 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9254): Launched 07:09:26.294325 run osmo-hlr_10.42.42.2(pid=9255): Launched 07:09:26.414287 run osmo-stp_10.42.42.5: Starting osmo-stp 07:09:26.950923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9257): Launched 07:09:27.263146 run osmo-stp_10.42.42.5(pid=9258): Launched 07:09:27.384088 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:09:27.921230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9260): Launched 07:09:28.041102 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:09:28.304365 run patchelf(pid=9261): Launched 07:09:28.478979 run osmo-stp_10.42.42.5(pid=9258): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9258)] 07:09:28.611313 run osmo-stp_10.42.42.5(pid=9258): stdout: | (launched: 2022-12-10_07:09:27.206861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:28.745405 run osmo-stp_10.42.42.5(pid=9258): stderr: | [0;m[38;5;43m20221210070927397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070927397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070927397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070927398 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070927398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070927398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070927398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:28.879636 run osmo-stp_10.42.42.5(pid=9258): stdout: | (launched: 2022-12-10_07:09:27.206861) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:29.007731 run osmo-stp_10.42.42.5(pid=9258): stderr: | [0;m[38;5;43m20221210070927397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070927397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070927397 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070927398 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070927398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070927398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070927398 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:29.159612 run patchelf(pid=9261): Terminating (SIGINT) 07:09:29.336722 run patchelf(pid=9261): Terminated: ok {rc=0} 07:09:29.464160 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9258): Process ended prematurely: osmo-stp_10.42.42.5(pid=9258) [trial-2371↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9258)] [trial-2371↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8] 07:09:29.474047 tst iperf3.py:8: Test FAILED (7.5 sec) 07:09:29.501908 run osmo-hlr_10.42.42.2(pid=9255): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:oc2g+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9255)] 07:09:29.551162 run osmo-hlr_10.42.42.2(pid=9255): stdout: | (launched: 2022-12-10_07:09:26.238052) 07:09:29.602298 run osmo-hlr_10.42.42.2(pid=9255): stderr: | [0;m[1;31m20221210070926434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070926434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070926434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070926434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070926434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070926434 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070926446 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:oc2g+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070926455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070926455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070926455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:09:29.653829 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9250): Terminating (SIGTERM) 07:09:29.695077 run iperf3-srv_10.42.42.10(pid=9251): Terminating (SIGTERM) 07:09:29.736285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9254): Terminating (SIGTERM) 07:09:29.777717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9257): Terminating (SIGTERM) 07:09:29.818880 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9260): Terminating (SIGTERM) 07:09:29.860138 --- ParallelTerminationStrategy: PID 9250 died... 07:09:29.879893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9250): Terminated: ok {rc=0} 07:09:29.926176 --- ParallelTerminationStrategy: PID 9251 died... 07:09:29.945505 run iperf3-srv_10.42.42.10(pid=9251): Terminated {rc=256} 07:09:29.991082 --- ParallelTerminationStrategy: PID 9254 died... 07:09:30.010377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9254): Terminated: ok {rc=0} 07:09:30.055765 --- ParallelTerminationStrategy: PID 9257 died... 07:09:30.075093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9257): Terminated: ok {rc=0} 07:09:30.120747 --- ParallelTerminationStrategy: PID 9260 died... 07:09:30.140174 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9260): Terminated: ok {rc=0} 07:09:30.226830 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:oc2g+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:09:31.372738 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:31.385099 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:09:31.425424 tst iperf3m4.py: using LAC 26704 07:09:31.543332 tst iperf3m4.py: using RAC 184 07:09:31.663044 tst iperf3m4.py: using CellId 26704 07:09:31.783467 tst iperf3m4.py: using BVCI 26705 07:09:31.893739 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:31.905436 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:31.916930 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:31.929574 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:31.942134 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:31.955616 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:31.968411 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:31.979811 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:31.992396 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:09:32.113422 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:09:32.228471 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:09:32.346401 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:09:32.464545 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:09:32.676242 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:09:32.991387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9263): Launched 07:09:33.263602 run iperf3-srv_10.42.42.10(pid=9264): Launched 07:09:33.382274 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:09:33.591989 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:09:33.905576 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9265): Launched 07:09:34.177205 run iperf3-srv_10.42.42.10(pid=9266): Launched 07:09:34.294814 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:09:34.505310 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:09:34.818801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9267): Launched 07:09:35.091210 run iperf3-srv_10.42.42.10(pid=9268): Launched 07:09:35.209283 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:09:35.420830 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:09:35.734612 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9269): Launched 07:09:36.006526 run iperf3-srv_10.42.42.10(pid=9270): Launched 07:09:36.124210 tst iperf3m4.py:8: start network... 07:09:36.335606 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:09:36.820304 run create_hlr_db(pid=9271): Launched 07:09:36.947798 bus /gobi_6: Setting Powered False 07:09:38.009885 run create_hlr_db(pid=9271): Terminated: ok {rc=0} 07:09:38.427458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9273): Launched 07:09:38.719185 run osmo-hlr_10.42.42.2(pid=9274): Launched 07:09:38.831691 run osmo-stp_10.42.42.5: Starting osmo-stp 07:09:39.346259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9276): Launched 07:09:39.639366 run osmo-stp_10.42.42.5(pid=9277): Launched 07:09:39.751333 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:09:40.254496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9279): Launched 07:09:40.368492 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:09:40.615252 run patchelf(pid=9280): Launched 07:09:40.778643 run osmo-stp_10.42.42.5(pid=9277): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9277)] 07:09:40.902809 run osmo-stp_10.42.42.5(pid=9277): stdout: | (launched: 2022-12-10_07:09:39.586382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:41.028686 run osmo-stp_10.42.42.5(pid=9277): stderr: | [0;m[38;5;43m20221210070939757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070939757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070939758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070939758 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070939759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070939759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070939759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:41.155169 run osmo-stp_10.42.42.5(pid=9277): stdout: | (launched: 2022-12-10_07:09:39.586382) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:41.275138 run osmo-stp_10.42.42.5(pid=9277): stderr: | [0;m[38;5;43m20221210070939757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070939757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070939758 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070939758 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070939759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070939759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070939759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:41.418289 run patchelf(pid=9280): Terminating (SIGINT) 07:09:41.584165 run patchelf(pid=9280): Terminated: ok {rc=0} 07:09:41.703901 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9277): Process ended prematurely: osmo-stp_10.42.42.5(pid=9277) [trial-2371↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9277)] [trial-2371↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8] 07:09:41.713520 tst iperf3m4.py:8: Test FAILED (10.4 sec) 07:09:41.741497 run osmo-hlr_10.42.42.2(pid=9274): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9274)] 07:09:41.789371 run osmo-hlr_10.42.42.2(pid=9274): stdout: | (launched: 2022-12-10_07:09:38.665909) 07:09:41.838651 run osmo-hlr_10.42.42.2(pid=9274): stderr: | [0;m[1;31m20221210070938838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070938838 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070938839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070938839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070938839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070938839 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070938850 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:oc2g+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070938859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070938860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070938860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:09:41.888624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9263): Terminating (SIGTERM) 07:09:41.928675 run iperf3-srv_10.42.42.10(pid=9264): Terminating (SIGTERM) 07:09:41.968524 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9265): Terminating (SIGTERM) 07:09:42.008546 run iperf3-srv_10.42.42.10(pid=9266): Terminating (SIGTERM) 07:09:42.048513 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9267): Terminating (SIGTERM) 07:09:42.088495 run iperf3-srv_10.42.42.10(pid=9268): Terminating (SIGTERM) 07:09:42.128484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9269): Terminating (SIGTERM) 07:09:42.167852 run iperf3-srv_10.42.42.10(pid=9270): Terminating (SIGTERM) 07:09:42.208010 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9273): Terminating (SIGTERM) 07:09:42.247745 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9276): Terminating (SIGTERM) 07:09:42.287486 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9279): Terminating (SIGTERM) 07:09:42.327668 --- ParallelTerminationStrategy: PID 9263 died... 07:09:42.346583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9263): Terminated: ok {rc=0} 07:09:42.391197 --- ParallelTerminationStrategy: PID 9264 died... 07:09:42.409772 run iperf3-srv_10.42.42.10(pid=9264): Terminated {rc=256} 07:09:42.454011 --- ParallelTerminationStrategy: PID 9265 died... 07:09:42.472638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9265): Terminated: ok {rc=0} 07:09:42.517067 --- ParallelTerminationStrategy: PID 9266 died... 07:09:42.535575 run iperf3-srv_10.42.42.10(pid=9266): Terminated {rc=256} 07:09:42.579695 --- ParallelTerminationStrategy: PID 9267 died... 07:09:42.598231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9267): Terminated: ok {rc=0} 07:09:42.642243 --- ParallelTerminationStrategy: PID 9268 died... 07:09:42.660724 run iperf3-srv_10.42.42.10(pid=9268): Terminated {rc=256} 07:09:42.704844 --- ParallelTerminationStrategy: PID 9269 died... 07:09:42.723709 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9269): Terminated: ok {rc=0} 07:09:42.768033 --- ParallelTerminationStrategy: PID 9270 died... 07:09:42.786604 run iperf3-srv_10.42.42.10(pid=9270): Terminated {rc=256} 07:09:42.830953 --- ParallelTerminationStrategy: PID 9273 died... 07:09:42.849550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9273): Terminated: ok {rc=0} 07:09:42.893700 --- ParallelTerminationStrategy: PID 9276 died... 07:09:42.912204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9276): Terminated: ok {rc=0} 07:09:42.956530 --- ParallelTerminationStrategy: PID 9279 died... 07:09:42.975150 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9279): Terminated: ok {rc=0} 07:09:43.059318 bus /gobi_4: Setting Powered False 07:09:44.156711 bus /gobi_4: Setting Powered False 07:09:45.272799 bus /gobi_1: Setting Powered False 07:09:46.376083 bus /gobi_1: Setting Powered False 07:09:47.494944 bus /gobi_0: Setting Powered False 07:09:48.592705 bus /gobi_0: Setting Powered False 07:09:49.707089 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:oc2g+mod-bts0-egprs ping.py ---------------------------------------------- 07:09:50.807141 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:50.818499 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:09:50.861288 tst ping.py: using LAC 26705 07:09:50.977885 tst ping.py: using RAC 185 07:09:51.088764 tst ping.py: using CellId 26705 07:09:51.199355 tst ping.py: using BVCI 26706 07:09:51.302714 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:51.313361 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:51.323832 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:51.334572 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:51.345272 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:51.355794 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:51.366596 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:51.377484 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:09:51.493269 tst ping.py:19: start network... 07:09:51.700554 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:09:52.175702 run create_hlr_db(pid=9281): Launched 07:09:52.301281 bus /gobi_6: Setting Powered False 07:09:53.363023 run create_hlr_db(pid=9281): Terminated: ok {rc=0} 07:09:53.773679 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9283): Launched 07:09:54.061166 run osmo-hlr_10.42.42.2(pid=9284): Launched 07:09:54.170995 run osmo-stp_10.42.42.5: Starting osmo-stp 07:09:54.675782 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9286): Launched 07:09:54.962195 run osmo-stp_10.42.42.5(pid=9287): Launched 07:09:55.071676 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:09:55.565447 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9289): Launched 07:09:55.675272 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:09:55.916909 run patchelf(pid=9290): Launched 07:09:56.077444 run osmo-stp_10.42.42.5(pid=9287): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9287)] 07:09:56.199289 run osmo-stp_10.42.42.5(pid=9287): stdout: | (launched: 2022-12-10_07:09:54.910033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:56.323085 run osmo-stp_10.42.42.5(pid=9287): stderr: | [0;m[38;5;43m20221210070955080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070955080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070955080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070955081 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070955081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070955081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070955082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:56.447110 run osmo-stp_10.42.42.5(pid=9287): stdout: | (launched: 2022-12-10_07:09:54.910033) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:09:56.565573 run osmo-stp_10.42.42.5(pid=9287): stderr: | [0;m[38;5;43m20221210070955080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210070955080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210070955080 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210070955081 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210070955081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210070955081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210070955082 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:09:56.705391 run patchelf(pid=9290): Terminating (SIGINT) 07:09:56.868687 run patchelf(pid=9290): Terminated: ok {rc=0} 07:09:56.986502 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9287): Process ended prematurely: osmo-stp_10.42.42.5(pid=9287) [trial-2371↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9287)] [trial-2371↪gprs:oc2g+mod-bts0-egprs↪ping.py:22] 07:09:56.995095 tst ping.py:22: Test FAILED (6.2 sec) 07:09:57.022031 run osmo-hlr_10.42.42.2(pid=9284): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:oc2g+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9284)] 07:09:57.069744 run osmo-hlr_10.42.42.2(pid=9284): stdout: | (launched: 2022-12-10_07:09:54.008723) 07:09:57.119187 run osmo-hlr_10.42.42.2(pid=9284): stderr: | [0;m[1;31m20221210070954182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210070954182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210070954182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210070954182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210070954182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210070954182 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210070954194 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:oc2g+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210070954203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210070954203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210070954203 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:09:57.169111 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9283): Terminating (SIGTERM) 07:09:57.209510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9286): Terminating (SIGTERM) 07:09:57.249456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9289): Terminating (SIGTERM) 07:09:57.289749 --- ParallelTerminationStrategy: PID 9283 died... 07:09:57.308775 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9283): Terminated: ok {rc=0} 07:09:57.353025 --- ParallelTerminationStrategy: PID 9286 died... 07:09:57.371756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9286): Terminated: ok {rc=0} 07:09:57.415860 --- ParallelTerminationStrategy: PID 9289 died... 07:09:57.434515 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9289): Terminated: ok {rc=0} 07:09:57.521785 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:oc2g+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:09:58.610500 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:58.622299 tst gprs:oc2g+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:09:58.660936 tst ping_idle_ping.py: using LAC 26706 07:09:58.774196 tst ping_idle_ping.py: using RAC 186 07:09:58.889531 tst ping_idle_ping.py: using CellId 26706 07:09:59.012825 tst ping_idle_ping.py: using BVCI 26707 07:09:59.126767 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:59.138078 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:59.149313 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:59.160601 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:59.171865 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:59.183065 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:59.194325 tst gprs:oc2g+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:09:59.205496 tst gprs:oc2g+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:09:59.318918 tst ping_idle_ping.py:24: start network... 07:09:59.510791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:09:59.959097 run create_hlr_db(pid=9291): Launched 07:10:00.070759 bus /gobi_6: Setting Powered False 07:10:01.129787 run create_hlr_db(pid=9291): Terminated: ok {rc=0} 07:10:01.553747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9293): Launched 07:10:01.869776 run osmo-hlr_10.42.42.2(pid=9297): Launched 07:10:02.019645 run osmo-stp_10.42.42.5: Starting osmo-stp 07:10:02.667805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9299): Launched 07:10:02.976848 run osmo-stp_10.42.42.5(pid=9300): Launched 07:10:03.095728 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:10:03.631740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9302): Launched 07:10:03.750786 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:10:04.012226 run patchelf(pid=9303): Launched 07:10:04.185354 run osmo-stp_10.42.42.5(pid=9300): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9300)] 07:10:04.317376 run osmo-stp_10.42.42.5(pid=9300): stdout: | (launched: 2022-12-10_07:10:02.920841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:04.450747 run osmo-stp_10.42.42.5(pid=9300): stderr: | [0;m[38;5;43m20221210071003110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071003110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071003111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071003111 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071003113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071003113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071003114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:04.583903 run osmo-stp_10.42.42.5(pid=9300): stdout: | (launched: 2022-12-10_07:10:02.920841) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:04.711123 run osmo-stp_10.42.42.5(pid=9300): stderr: | [0;m[38;5;43m20221210071003110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071003110 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071003111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071003111 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071003113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071003113 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071003114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:04.862098 run patchelf(pid=9303): Terminating (SIGINT) 07:10:05.036243 run patchelf(pid=9303): Terminated: ok {rc=0} 07:10:05.162341 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9300): Process ended prematurely: osmo-stp_10.42.42.5(pid=9300) [trial-2371↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9300)] [trial-2371↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27] 07:10:05.171714 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 07:10:05.199704 run osmo-hlr_10.42.42.2(pid=9297): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9297)] 07:10:05.249457 run osmo-hlr_10.42.42.2(pid=9297): stdout: | (launched: 2022-12-10_07:10:01.796909) 07:10:05.301327 run osmo-hlr_10.42.42.2(pid=9297): stderr: | [0;m[1;31m20221210071002151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071002151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071002152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071002152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071002152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071002152 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071002170 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:oc2g+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071002178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071002178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071002178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:10:05.354029 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9293): Terminating (SIGTERM) 07:10:05.396269 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9299): Terminating (SIGTERM) 07:10:05.438603 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9302): Terminating (SIGTERM) 07:10:05.481003 --- ParallelTerminationStrategy: PID 9293 died... 07:10:05.501018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9293): Terminated: ok {rc=0} 07:10:05.547682 --- ParallelTerminationStrategy: PID 9299 died... 07:10:05.567526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9299): Terminated: ok {rc=0} 07:10:05.614654 --- ParallelTerminationStrategy: PID 9302 died... 07:10:05.634561 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9302): Terminated: ok {rc=0} 07:10:05.723234 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:oc2g+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:oc2g+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:10:07.021341 tst gprs:oc2g+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:10:07.027792 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:10:07.049043 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:10:07.088413 tst gprs:oc2g+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:10:07.178951 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:10:07.200300 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:10:07.239288 tst gprs:oc2g+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:10:07.830734 tst gprs:oc2g+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:oc2g+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:10:07.881788 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:07.893060 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:10:07.950412 tst cs_paging_gprs_active.py: using LAC 26707 07:10:08.079253 tst cs_paging_gprs_active.py: using RAC 187 07:10:08.201200 tst cs_paging_gprs_active.py: using CellId 26707 07:10:08.322980 tst cs_paging_gprs_active.py: using BVCI 26708 07:10:08.438656 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:08.449911 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:08.460771 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:08.471928 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:08.482891 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:08.493913 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:08.505072 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:08.515974 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:08.527217 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:10:08.644722 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:10:08.763802 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:10:08.976776 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:10:09.291267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9307): Launched 07:10:09.566289 run iperf3-srv_10.42.42.10(pid=9308): Launched 07:10:09.685703 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:10:09.898446 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:10:10.213492 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9309): Launched 07:10:10.488305 run iperf3-srv_10.42.42.10(pid=9310): Launched 07:10:10.607043 tst cs_paging_gprs_active.py:38: start network... 07:10:10.819528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:10:11.306390 run create_hlr_db(pid=9311): Launched 07:10:11.435860 bus /gobi_6: Setting Powered False 07:10:12.499219 run create_hlr_db(pid=9311): Terminated: ok {rc=0} 07:10:12.919023 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9313): Launched 07:10:13.212364 run osmo-hlr_10.42.42.2(pid=9314): Launched 07:10:13.326307 run osmo-stp_10.42.42.5: Starting osmo-stp 07:10:13.846840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9316): Launched 07:10:14.138792 run osmo-stp_10.42.42.5(pid=9317): Launched 07:10:14.250936 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:10:14.754875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9319): Launched 07:10:14.867533 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:10:15.115042 run patchelf(pid=9320): Launched 07:10:15.279475 run osmo-stp_10.42.42.5(pid=9317): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9317)] 07:10:15.404213 run osmo-stp_10.42.42.5(pid=9317): stdout: | (launched: 2022-12-10_07:10:14.085853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:15.530360 run osmo-stp_10.42.42.5(pid=9317): stderr: | [0;m[38;5;43m20221210071014253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071014253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071014254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071014254 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071014255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071014255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071014255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:15.656717 run osmo-stp_10.42.42.5(pid=9317): stdout: | (launched: 2022-12-10_07:10:14.085853) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:15.777454 run osmo-stp_10.42.42.5(pid=9317): stderr: | [0;m[38;5;43m20221210071014253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071014253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071014254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071014254 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071014255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071014255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071014255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:15.926949 run patchelf(pid=9320): Terminating (SIGINT) 07:10:16.096606 run patchelf(pid=9320): Terminated: ok {rc=0} 07:10:16.220439 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9317): Process ended prematurely: osmo-stp_10.42.42.5(pid=9317) [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9317)] [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:10:16.230727 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 07:10:16.259936 run osmo-hlr_10.42.42.2(pid=9314): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9314)] 07:10:16.309260 run osmo-hlr_10.42.42.2(pid=9314): stdout: | (launched: 2022-12-10_07:10:13.159307) 07:10:16.359726 run osmo-hlr_10.42.42.2(pid=9314): stderr: | [0;m[1;31m20221210071013334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071013334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071013334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071013334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071013334 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071013335 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071013350 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:oc2g+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071013360 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071013361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071013361 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:10:16.412187 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9307): Terminating (SIGTERM) 07:10:16.454201 run iperf3-srv_10.42.42.10(pid=9308): Terminating (SIGTERM) 07:10:16.498269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9309): Terminating (SIGTERM) 07:10:16.540461 run iperf3-srv_10.42.42.10(pid=9310): Terminating (SIGTERM) 07:10:16.585200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9313): Terminating (SIGTERM) 07:10:16.626694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9316): Terminating (SIGTERM) 07:10:16.668215 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9319): Terminating (SIGTERM) 07:10:16.711041 --- ParallelTerminationStrategy: PID 9307 died... 07:10:16.730581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9307): Terminated: ok {rc=0} 07:10:16.776398 --- ParallelTerminationStrategy: PID 9308 died... 07:10:16.795544 run iperf3-srv_10.42.42.10(pid=9308): Terminated {rc=256} 07:10:16.841335 --- ParallelTerminationStrategy: PID 9309 died... 07:10:16.860503 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9309): Terminated: ok {rc=0} 07:10:16.906164 --- ParallelTerminationStrategy: PID 9310 died... 07:10:16.925241 run iperf3-srv_10.42.42.10(pid=9310): Terminated {rc=256} 07:10:16.970820 --- ParallelTerminationStrategy: PID 9313 died... 07:10:16.990134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9313): Terminated: ok {rc=0} 07:10:17.036125 --- ParallelTerminationStrategy: PID 9316 died... 07:10:17.055470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9316): Terminated: ok {rc=0} 07:10:17.102110 --- ParallelTerminationStrategy: PID 9319 died... 07:10:17.121229 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9319): Terminated: ok {rc=0} 07:10:17.207951 bus /gobi_0: Setting Powered False 07:10:18.307569 bus /gobi_0: Setting Powered False 07:10:19.423378 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:oc2g+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:10:20.570340 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:20.582196 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:10:20.646271 tst iperf3.py: using LAC 26708 07:10:20.769954 tst iperf3.py: using RAC 188 07:10:20.891934 tst iperf3.py: using CellId 26708 07:10:21.007218 tst iperf3.py: using BVCI 26709 07:10:21.113527 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:21.124340 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:21.134950 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:21.145932 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:21.156657 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:21.167267 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:21.178060 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:21.188595 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:21.199545 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:10:21.313763 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:10:21.511925 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:10:21.808542 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9322): Launched 07:10:22.065079 run iperf3-srv_10.42.42.10(pid=9323): Launched 07:10:22.176162 tst iperf3.py:8: start network... 07:10:22.372921 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:10:22.825141 run create_hlr_db(pid=9324): Launched 07:10:22.936688 bus /gobi_6: Setting Powered False 07:10:23.995191 run create_hlr_db(pid=9324): Terminated: ok {rc=0} 07:10:24.424905 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9326): Launched 07:10:24.739186 run osmo-hlr_10.42.42.2(pid=9327): Launched 07:10:24.858922 run osmo-stp_10.42.42.5: Starting osmo-stp 07:10:25.407032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9329): Launched 07:10:25.721311 run osmo-stp_10.42.42.5(pid=9330): Launched 07:10:25.843086 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:10:26.384930 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9332): Launched 07:10:26.505709 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:10:26.770381 run patchelf(pid=9333): Launched 07:10:26.946076 run osmo-stp_10.42.42.5(pid=9330): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9330)] 07:10:27.079457 run osmo-stp_10.42.42.5(pid=9330): stdout: | (launched: 2022-12-10_07:10:25.664554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:27.214552 run osmo-stp_10.42.42.5(pid=9330): stderr: | [0;m[38;5;43m20221210071025857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071025857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071025857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071025858 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071025858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071025858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071025858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:27.349923 run osmo-stp_10.42.42.5(pid=9330): stdout: | (launched: 2022-12-10_07:10:25.664554) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:27.478985 run osmo-stp_10.42.42.5(pid=9330): stderr: | [0;m[38;5;43m20221210071025857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071025857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071025857 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071025858 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071025858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071025858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071025858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:27.631788 run patchelf(pid=9333): Terminating (SIGINT) 07:10:27.808495 run patchelf(pid=9333): Terminated: ok {rc=0} 07:10:27.935905 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9330): Process ended prematurely: osmo-stp_10.42.42.5(pid=9330) [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9330)] [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8] 07:10:27.945981 tst iperf3.py:8: Test FAILED (7.4 sec) 07:10:27.973915 run osmo-hlr_10.42.42.2(pid=9327): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9327)] 07:10:28.023269 run osmo-hlr_10.42.42.2(pid=9327): stdout: | (launched: 2022-12-10_07:10:24.682681) 07:10:28.074504 run osmo-hlr_10.42.42.2(pid=9327): stderr: | [0;m[1;31m20221210071024880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071024880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071024880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071024880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071024880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071024880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071024894 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:oc2g+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071024902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071024902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071024902 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:10:28.126136 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9322): Terminating (SIGTERM) 07:10:28.167414 run iperf3-srv_10.42.42.10(pid=9323): Terminating (SIGTERM) 07:10:28.208765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9326): Terminating (SIGTERM) 07:10:28.250775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9329): Terminating (SIGTERM) 07:10:28.292110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9332): Terminating (SIGTERM) 07:10:28.334169 --- ParallelTerminationStrategy: PID 9322 died... 07:10:28.354141 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9322): Terminated: ok {rc=0} 07:10:28.400280 --- ParallelTerminationStrategy: PID 9323 died... 07:10:28.419812 run iperf3-srv_10.42.42.10(pid=9323): Terminated {rc=256} 07:10:28.465680 --- ParallelTerminationStrategy: PID 9326 died... 07:10:28.485145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9326): Terminated: ok {rc=0} 07:10:28.530612 --- ParallelTerminationStrategy: PID 9329 died... 07:10:28.549824 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9329): Terminated: ok {rc=0} 07:10:28.595297 --- ParallelTerminationStrategy: PID 9332 died... 07:10:28.614957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9332): Terminated: ok {rc=0} 07:10:28.701892 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:oc2g+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:10:29.846430 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:29.857851 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:10:29.914352 tst iperf3m4.py: using LAC 26709 07:10:30.030941 tst iperf3m4.py: using RAC 189 07:10:30.145640 tst iperf3m4.py: using CellId 26709 07:10:30.270240 tst iperf3m4.py: using BVCI 26710 07:10:30.386250 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:30.397720 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:30.409052 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:30.420237 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:30.431253 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:30.442388 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:30.453627 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:30.464425 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:30.475870 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:10:30.589649 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:10:30.710123 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:10:30.824817 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:10:30.959206 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:10:31.179558 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:10:31.509700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9334): Launched 07:10:31.795564 run iperf3-srv_10.42.42.10(pid=9335): Launched 07:10:31.925241 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:10:32.140124 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:10:32.457467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9336): Launched 07:10:32.731819 run iperf3-srv_10.42.42.10(pid=9337): Launched 07:10:32.850821 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:10:33.063626 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:10:33.380140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9338): Launched 07:10:33.653880 run iperf3-srv_10.42.42.10(pid=9339): Launched 07:10:33.772224 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:10:33.984935 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:10:34.300633 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9340): Launched 07:10:34.574582 run iperf3-srv_10.42.42.10(pid=9341): Launched 07:10:34.692872 tst iperf3m4.py:8: start network... 07:10:34.904726 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:10:35.395332 run create_hlr_db(pid=9342): Launched 07:10:35.523066 bus /gobi_6: Setting Powered False 07:10:36.585502 run create_hlr_db(pid=9342): Terminated: ok {rc=0} 07:10:37.005972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9344): Launched 07:10:37.299934 run osmo-hlr_10.42.42.2(pid=9345): Launched 07:10:37.413378 run osmo-stp_10.42.42.5: Starting osmo-stp 07:10:37.935493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9347): Launched 07:10:38.228889 run osmo-stp_10.42.42.5(pid=9348): Launched 07:10:38.341644 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:10:38.849026 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9350): Launched 07:10:38.962478 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:10:39.210391 run patchelf(pid=9351): Launched 07:10:39.374786 run osmo-stp_10.42.42.5(pid=9348): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9348)] 07:10:39.500050 run osmo-stp_10.42.42.5(pid=9348): stdout: | (launched: 2022-12-10_07:10:38.175699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:39.626516 run osmo-stp_10.42.42.5(pid=9348): stderr: | [0;m[38;5;43m20221210071038345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071038345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071038346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071038346 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071038346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071038346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071038347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:39.753430 run osmo-stp_10.42.42.5(pid=9348): stdout: | (launched: 2022-12-10_07:10:38.175699) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:39.874970 run osmo-stp_10.42.42.5(pid=9348): stderr: | [0;m[38;5;43m20221210071038345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071038345 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071038346 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071038346 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071038346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071038346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071038347 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:40.026136 run patchelf(pid=9351): Terminating (SIGINT) 07:10:40.204533 run patchelf(pid=9351): Terminated: ok {rc=0} 07:10:40.334130 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9348): Process ended prematurely: osmo-stp_10.42.42.5(pid=9348) [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9348)] [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:10:40.344318 tst iperf3m4.py:8: Test FAILED (10.5 sec) 07:10:40.373690 run osmo-hlr_10.42.42.2(pid=9345): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9345)] 07:10:40.423525 run osmo-hlr_10.42.42.2(pid=9345): stdout: | (launched: 2022-12-10_07:10:37.246379) 07:10:40.475170 run osmo-hlr_10.42.42.2(pid=9345): stderr: | [0;m[1;31m20221210071037421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071037421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071037421 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071037422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071037422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071037422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071037433 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:oc2g+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071037443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071037443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071037443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:10:40.527042 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9334): Terminating (SIGTERM) 07:10:40.568407 run iperf3-srv_10.42.42.10(pid=9335): Terminating (SIGTERM) 07:10:40.610018 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9336): Terminating (SIGTERM) 07:10:40.651274 run iperf3-srv_10.42.42.10(pid=9337): Terminating (SIGTERM) 07:10:40.692629 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9338): Terminating (SIGTERM) 07:10:40.734297 run iperf3-srv_10.42.42.10(pid=9339): Terminating (SIGTERM) 07:10:40.775466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9340): Terminating (SIGTERM) 07:10:40.817216 run iperf3-srv_10.42.42.10(pid=9341): Terminating (SIGTERM) 07:10:40.858639 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9344): Terminating (SIGTERM) 07:10:40.900163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9347): Terminating (SIGTERM) 07:10:40.941762 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9350): Terminating (SIGTERM) 07:10:40.983471 --- ParallelTerminationStrategy: PID 9334 died... 07:10:41.003302 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9334): Terminated: ok {rc=0} 07:10:41.049690 --- ParallelTerminationStrategy: PID 9335 died... 07:10:41.069214 run iperf3-srv_10.42.42.10(pid=9335): Terminated {rc=256} 07:10:41.115163 --- ParallelTerminationStrategy: PID 9336 died... 07:10:41.134758 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9336): Terminated: ok {rc=0} 07:10:41.180810 --- ParallelTerminationStrategy: PID 9337 died... 07:10:41.200578 run iperf3-srv_10.42.42.10(pid=9337): Terminated {rc=256} 07:10:41.246631 --- ParallelTerminationStrategy: PID 9338 died... 07:10:41.266206 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9338): Terminated: ok {rc=0} 07:10:41.312073 --- ParallelTerminationStrategy: PID 9339 died... 07:10:41.331811 run iperf3-srv_10.42.42.10(pid=9339): Terminated {rc=256} 07:10:41.378322 --- ParallelTerminationStrategy: PID 9340 died... 07:10:41.397853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9340): Terminated: ok {rc=0} 07:10:41.443867 --- ParallelTerminationStrategy: PID 9341 died... 07:10:41.463365 run iperf3-srv_10.42.42.10(pid=9341): Terminated {rc=256} 07:10:41.509295 --- ParallelTerminationStrategy: PID 9344 died... 07:10:41.528708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9344): Terminated: ok {rc=0} 07:10:41.574837 --- ParallelTerminationStrategy: PID 9347 died... 07:10:41.594473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9347): Terminated: ok {rc=0} 07:10:41.640525 --- ParallelTerminationStrategy: PID 9350 died... 07:10:41.660066 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9350): Terminated: ok {rc=0} 07:10:41.748050 bus /gobi_4: Setting Powered False 07:10:42.842486 bus /gobi_4: Setting Powered False 07:10:43.958534 bus /gobi_1: Setting Powered False 07:10:45.055908 bus /gobi_1: Setting Powered False 07:10:46.181819 bus /gobi_0: Setting Powered False 07:10:47.291988 bus /gobi_0: Setting Powered False 07:10:48.407506 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:oc2g+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:10:49.510237 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:49.521627 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:10:49.578192 tst ping.py: using LAC 26710 07:10:49.690505 tst ping.py: using RAC 190 07:10:49.803964 tst ping.py: using CellId 26710 07:10:49.920544 tst ping.py: using BVCI 26711 07:10:50.035334 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:50.046983 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:50.058349 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:50.069831 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:50.081235 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:50.093519 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:50.105192 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:50.116552 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:10:50.230622 tst ping.py:19: start network... 07:10:50.422865 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:10:50.866964 run create_hlr_db(pid=9352): Launched 07:10:50.978470 bus /gobi_6: Setting Powered False 07:10:52.037354 run create_hlr_db(pid=9352): Terminated: ok {rc=0} 07:10:52.459975 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9354): Launched 07:10:52.768412 run osmo-hlr_10.42.42.2(pid=9355): Launched 07:10:52.881044 run osmo-stp_10.42.42.5: Starting osmo-stp 07:10:53.391903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9357): Launched 07:10:53.679179 run osmo-stp_10.42.42.5(pid=9358): Launched 07:10:53.789575 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:10:54.287906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9360): Launched 07:10:54.398964 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:10:54.641745 run patchelf(pid=9361): Launched 07:10:54.803492 run osmo-stp_10.42.42.5(pid=9358): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9358)] 07:10:54.926409 run osmo-stp_10.42.42.5(pid=9358): stdout: | (launched: 2022-12-10_07:10:53.626657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:55.051036 run osmo-stp_10.42.42.5(pid=9358): stderr: | [0;m[38;5;43m20221210071053796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071053796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071053796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071053797 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071053797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071053797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071053797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:55.175939 run osmo-stp_10.42.42.5(pid=9358): stdout: | (launched: 2022-12-10_07:10:53.626657) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:10:55.294752 run osmo-stp_10.42.42.5(pid=9358): stderr: | [0;m[38;5;43m20221210071053796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071053796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071053796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071053797 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071053797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071053797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071053797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:10:55.435860 run patchelf(pid=9361): Terminating (SIGINT) 07:10:55.599222 run patchelf(pid=9361): Terminated: ok {rc=0} 07:10:55.716761 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9358): Process ended prematurely: osmo-stp_10.42.42.5(pid=9358) [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9358)] [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22] 07:10:55.725605 tst ping.py:22: Test FAILED (6.2 sec) 07:10:55.752344 run osmo-hlr_10.42.42.2(pid=9355): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9355)] 07:10:55.801171 run osmo-hlr_10.42.42.2(pid=9355): stdout: | (launched: 2022-12-10_07:10:52.712530) 07:10:55.850757 run osmo-hlr_10.42.42.2(pid=9355): stderr: | [0;m[1;31m20221210071052889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071052889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071052889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071052889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071052889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071052889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071052901 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:oc2g+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071052909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071052909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071052909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:10:55.900470 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9354): Terminating (SIGTERM) 07:10:55.940413 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9357): Terminating (SIGTERM) 07:10:55.980685 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9360): Terminating (SIGTERM) 07:10:56.021096 --- ParallelTerminationStrategy: PID 9354 died... 07:10:56.040224 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9354): Terminated: ok {rc=0} 07:10:56.085117 --- ParallelTerminationStrategy: PID 9357 died... 07:10:56.103773 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9357): Terminated: ok {rc=0} 07:10:56.148248 --- ParallelTerminationStrategy: PID 9360 died... 07:10:56.166961 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9360): Terminated: ok {rc=0} 07:10:56.250513 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:oc2g+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:10:57.337447 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:57.349669 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:10:57.409662 tst ping_idle_ping.py: using LAC 26711 07:10:57.526174 tst ping_idle_ping.py: using RAC 191 07:10:57.644829 tst ping_idle_ping.py: using CellId 26711 07:10:57.759061 tst ping_idle_ping.py: using BVCI 26712 07:10:57.864210 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:57.875277 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:57.886055 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:57.897367 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:57.908285 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:57.919175 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:57.930271 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:10:57.941201 tst gprs:oc2g+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:10:58.059440 tst ping_idle_ping.py:24: start network... 07:10:58.269341 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:10:58.750852 run create_hlr_db(pid=9362): Launched 07:10:58.877742 bus /gobi_6: Setting Powered False 07:10:59.939603 run create_hlr_db(pid=9362): Terminated: ok {rc=0} 07:11:00.354082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9364): Launched 07:11:00.643412 run osmo-hlr_10.42.42.2(pid=9365): Launched 07:11:00.755965 run osmo-stp_10.42.42.5: Starting osmo-stp 07:11:01.330168 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9367): Launched 07:11:01.632692 run osmo-stp_10.42.42.5(pid=9368): Launched 07:11:01.934534 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:11:02.517348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9370): Launched 07:11:02.636117 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:11:02.896806 run patchelf(pid=9371): Launched 07:11:03.069997 run osmo-stp_10.42.42.5(pid=9368): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9368)] 07:11:03.201394 run osmo-stp_10.42.42.5(pid=9368): stdout: | (launched: 2022-12-10_07:11:01.573445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:03.334682 run osmo-stp_10.42.42.5(pid=9368): stderr: | [0;m[38;5;43m20221210071101816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071101816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071101817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071101817 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071101818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071101818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071101818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:03.468722 run osmo-stp_10.42.42.5(pid=9368): stdout: | (launched: 2022-12-10_07:11:01.573445) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:03.596075 run osmo-stp_10.42.42.5(pid=9368): stderr: | [0;m[38;5;43m20221210071101816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071101816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071101817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071101817 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071101818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071101818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071101818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:03.746949 run patchelf(pid=9371): Terminating (SIGINT) 07:11:03.921847 run patchelf(pid=9371): Terminated: ok {rc=0} 07:11:04.047936 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9368): Process ended prematurely: osmo-stp_10.42.42.5(pid=9368) [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9368)] [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 07:11:04.057449 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 07:11:04.085488 run osmo-hlr_10.42.42.2(pid=9365): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9365)] 07:11:04.135446 run osmo-hlr_10.42.42.2(pid=9365): stdout: | (launched: 2022-12-10_07:11:00.590681) 07:11:04.187044 run osmo-hlr_10.42.42.2(pid=9365): stderr: | [0;m[1;31m20221210071100765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071100765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071100765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071100765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071100765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071100765 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071100777 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:oc2g+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071100786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071100786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071100786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:11:04.239145 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9364): Terminating (SIGTERM) 07:11:04.281092 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9367): Terminating (SIGTERM) 07:11:04.323157 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9370): Terminating (SIGTERM) 07:11:04.365863 --- ParallelTerminationStrategy: PID 9364 died... 07:11:04.385897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9364): Terminated: ok {rc=0} 07:11:04.432240 --- ParallelTerminationStrategy: PID 9367 died... 07:11:04.452031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9367): Terminated: ok {rc=0} 07:11:04.498073 --- ParallelTerminationStrategy: PID 9370 died... 07:11:04.517823 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9370): Terminated: ok {rc=0} 07:11:04.605680 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:oc2g+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:oc2g+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:11:05.896818 tst gprs:oc2g+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:11:05.902876 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:11:05.923597 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 07:11:05.962087 tst gprs:oc2g+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 07:11:06.047688 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:11:06.068082 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 07:11:06.106565 tst gprs:oc2g+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 07:11:06.696401 tst gprs:oc2g+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:oc2g+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 07:11:06.744884 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:06.755690 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:11:06.811983 tst cs_paging_gprs_active.py: using LAC 26712 07:11:06.936107 tst cs_paging_gprs_active.py: using RAC 192 07:11:07.052093 tst cs_paging_gprs_active.py: using CellId 26712 07:11:07.167332 tst cs_paging_gprs_active.py: using BVCI 26713 07:11:07.276275 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:07.287132 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:07.297788 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:07.308485 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:07.319142 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:07.329875 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:07.340651 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:07.351371 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:07.362250 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:11:07.479880 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:11:07.596049 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:11:07.794206 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:11:08.089760 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9375): Launched 07:11:08.346374 run iperf3-srv_10.42.42.10(pid=9376): Launched 07:11:08.457423 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:11:08.654405 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:11:08.948854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9377): Launched 07:11:09.204782 run iperf3-srv_10.42.42.10(pid=9378): Launched 07:11:09.315747 tst cs_paging_gprs_active.py:38: start network... 07:11:09.512917 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:11:09.966318 run create_hlr_db(pid=9379): Launched 07:11:10.079474 bus /gobi_6: Setting Powered False 07:11:11.139016 run create_hlr_db(pid=9379): Terminated: ok {rc=0} 07:11:11.570168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9381): Launched 07:11:11.886783 run osmo-hlr_10.42.42.2(pid=9382): Launched 07:11:12.007496 run osmo-stp_10.42.42.5: Starting osmo-stp 07:11:12.549718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9384): Launched 07:11:12.865572 run osmo-stp_10.42.42.5(pid=9385): Launched 07:11:12.986770 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:11:13.550015 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9387): Launched 07:11:13.671070 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:11:13.937237 run patchelf(pid=9388): Launched 07:11:14.113780 run osmo-stp_10.42.42.5(pid=9385): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9385)] 07:11:14.248517 run osmo-stp_10.42.42.5(pid=9385): stdout: | (launched: 2022-12-10_07:11:12.808482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:14.384697 run osmo-stp_10.42.42.5(pid=9385): stderr: | [0;m[38;5;43m20221210071112998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071112998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071112998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071112999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071112999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071112999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071112999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:14.520594 run osmo-stp_10.42.42.5(pid=9385): stdout: | (launched: 2022-12-10_07:11:12.808482) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:14.649788 run osmo-stp_10.42.42.5(pid=9385): stderr: | [0;m[38;5;43m20221210071112998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071112998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071112998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071112999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071112999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071112999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071112999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:14.803185 run patchelf(pid=9388): Terminating (SIGINT) 07:11:14.980733 run patchelf(pid=9388): Terminated: ok {rc=0} 07:11:15.109481 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9385): Process ended prematurely: osmo-stp_10.42.42.5(pid=9385) [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9385)] [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 07:11:15.119394 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 07:11:15.147570 run osmo-hlr_10.42.42.2(pid=9382): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9382)] 07:11:15.196841 run osmo-hlr_10.42.42.2(pid=9382): stdout: | (launched: 2022-12-10_07:11:11.829262) 07:11:15.248317 run osmo-hlr_10.42.42.2(pid=9382): stderr: | [0;m[1;31m20221210071112024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071112024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071112024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071112024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071112024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071112024 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071112036 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:oc2g+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071112044 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071112045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071112045 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:11:15.300179 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9375): Terminating (SIGTERM) 07:11:15.341978 run iperf3-srv_10.42.42.10(pid=9376): Terminating (SIGTERM) 07:11:15.384095 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9377): Terminating (SIGTERM) 07:11:15.425880 run iperf3-srv_10.42.42.10(pid=9378): Terminating (SIGTERM) 07:11:15.467536 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9381): Terminating (SIGTERM) 07:11:15.509159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9384): Terminating (SIGTERM) 07:11:15.550784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9387): Terminating (SIGTERM) 07:11:15.592717 --- ParallelTerminationStrategy: PID 9375 died... 07:11:15.612598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9375): Terminated: ok {rc=0} 07:11:15.658644 --- ParallelTerminationStrategy: PID 9376 died... 07:11:15.677935 run iperf3-srv_10.42.42.10(pid=9376): Terminated {rc=256} 07:11:15.723446 --- ParallelTerminationStrategy: PID 9377 died... 07:11:15.742871 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9377): Terminated: ok {rc=0} 07:11:15.788340 --- ParallelTerminationStrategy: PID 9378 died... 07:11:15.808018 run iperf3-srv_10.42.42.10(pid=9378): Terminated {rc=256} 07:11:15.861659 --- ParallelTerminationStrategy: PID 9381 died... 07:11:15.881576 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9381): Terminated: ok {rc=0} 07:11:15.928190 --- ParallelTerminationStrategy: PID 9384 died... 07:11:15.948130 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9384): Terminated: ok {rc=0} 07:11:15.994532 --- ParallelTerminationStrategy: PID 9387 died... 07:11:16.014437 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9387): Terminated: ok {rc=0} 07:11:16.108202 bus /gobi_0: Setting Powered False 07:11:17.217183 bus /gobi_0: Setting Powered False 07:11:18.334703 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:oc2g+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 07:11:19.481510 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:19.493472 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:11:19.554501 tst iperf3.py: using LAC 26713 07:11:19.678591 tst iperf3.py: using RAC 193 07:11:19.795471 tst iperf3.py: using CellId 26713 07:11:19.911503 tst iperf3.py: using BVCI 26714 07:11:20.026189 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:20.037593 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:20.048640 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:20.060001 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:20.071333 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:20.082624 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:20.094169 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:20.105242 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:20.116484 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:11:20.231420 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:11:20.428892 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:11:20.723539 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9389): Launched 07:11:20.978125 run iperf3-srv_10.42.42.10(pid=9390): Launched 07:11:21.088435 tst iperf3.py:8: start network... 07:11:21.284440 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:11:21.736866 run create_hlr_db(pid=9391): Launched 07:11:21.849901 bus /gobi_6: Setting Powered False 07:11:22.908578 run create_hlr_db(pid=9391): Terminated: ok {rc=0} 07:11:23.338267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9393): Launched 07:11:23.654045 run osmo-hlr_10.42.42.2(pid=9394): Launched 07:11:23.776510 run osmo-stp_10.42.42.5: Starting osmo-stp 07:11:24.318752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9396): Launched 07:11:24.632651 run osmo-stp_10.42.42.5(pid=9397): Launched 07:11:24.755646 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:11:25.298916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9399): Launched 07:11:25.420242 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:11:25.684916 run patchelf(pid=9400): Launched 07:11:25.860239 run osmo-stp_10.42.42.5(pid=9397): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9397)] 07:11:25.993485 run osmo-stp_10.42.42.5(pid=9397): stdout: | (launched: 2022-12-10_07:11:24.576059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:26.128682 run osmo-stp_10.42.42.5(pid=9397): stderr: | [0;m[38;5;43m20221210071124766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071124766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071124767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071124767 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071124768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071124768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071124768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:26.264500 run osmo-stp_10.42.42.5(pid=9397): stdout: | (launched: 2022-12-10_07:11:24.576059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:26.394116 run osmo-stp_10.42.42.5(pid=9397): stderr: | [0;m[38;5;43m20221210071124766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071124766 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071124767 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071124767 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071124768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071124768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071124768 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:26.547361 run patchelf(pid=9400): Terminating (SIGINT) 07:11:26.724302 run patchelf(pid=9400): Terminated: ok {rc=0} 07:11:26.852842 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9397): Process ended prematurely: osmo-stp_10.42.42.5(pid=9397) [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9397)] [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8] 07:11:26.862740 tst iperf3.py:8: Test FAILED (7.4 sec) 07:11:26.891218 run osmo-hlr_10.42.42.2(pid=9394): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9394)] 07:11:26.940900 run osmo-hlr_10.42.42.2(pid=9394): stdout: | (launched: 2022-12-10_07:11:23.597508) 07:11:26.992555 run osmo-hlr_10.42.42.2(pid=9394): stderr: | [0;m[1;31m20221210071123793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071123793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071123793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071123793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071123793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071123793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071123805 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:oc2g+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071123816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071123816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071123816 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:11:27.044428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9389): Terminating (SIGTERM) 07:11:27.086337 run iperf3-srv_10.42.42.10(pid=9390): Terminating (SIGTERM) 07:11:27.128261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9393): Terminating (SIGTERM) 07:11:27.170194 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9396): Terminating (SIGTERM) 07:11:27.212219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9399): Terminating (SIGTERM) 07:11:27.254366 --- ParallelTerminationStrategy: PID 9389 died... 07:11:27.274330 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9389): Terminated: ok {rc=0} 07:11:27.320728 --- ParallelTerminationStrategy: PID 9390 died... 07:11:27.340331 run iperf3-srv_10.42.42.10(pid=9390): Terminated {rc=256} 07:11:27.386694 --- ParallelTerminationStrategy: PID 9393 died... 07:11:27.406319 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9393): Terminated: ok {rc=0} 07:11:27.452486 --- ParallelTerminationStrategy: PID 9396 died... 07:11:27.471953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9396): Terminated: ok {rc=0} 07:11:27.518386 --- ParallelTerminationStrategy: PID 9399 died... 07:11:27.537978 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9399): Terminated: ok {rc=0} 07:11:27.625288 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:oc2g+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 07:11:28.771954 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:28.783876 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:11:28.844712 tst iperf3m4.py: using LAC 26714 07:11:28.968221 tst iperf3m4.py: using RAC 194 07:11:29.083900 tst iperf3m4.py: using CellId 26714 07:11:29.198702 tst iperf3m4.py: using BVCI 26715 07:11:29.304851 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:29.315648 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:29.326291 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:29.337178 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:29.347942 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:29.358806 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:29.369752 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:29.380356 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:29.391204 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:11:29.509299 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:11:29.625838 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:11:29.743899 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:11:29.858196 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:11:30.055047 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:11:30.350370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9401): Launched 07:11:30.606470 run iperf3-srv_10.42.42.10(pid=9402): Launched 07:11:30.716773 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:11:30.940560 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:11:31.274934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9403): Launched 07:11:31.581607 run iperf3-srv_10.42.42.10(pid=9404): Launched 07:11:31.702965 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:11:31.903505 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:11:32.217784 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9405): Launched 07:11:32.480651 run iperf3-srv_10.42.42.10(pid=9406): Launched 07:11:32.591350 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:11:32.787435 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:11:33.081864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9407): Launched 07:11:33.337050 run iperf3-srv_10.42.42.10(pid=9408): Launched 07:11:33.447540 tst iperf3m4.py:8: start network... 07:11:33.643686 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:11:34.097343 run create_hlr_db(pid=9409): Launched 07:11:34.209790 bus /gobi_6: Setting Powered False 07:11:35.268332 run create_hlr_db(pid=9409): Terminated: ok {rc=0} 07:11:35.677683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9411): Launched 07:11:35.971216 run osmo-hlr_10.42.42.2(pid=9412): Launched 07:11:36.084807 run osmo-stp_10.42.42.5: Starting osmo-stp 07:11:36.603077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9414): Launched 07:11:36.896519 run osmo-stp_10.42.42.5(pid=9415): Launched 07:11:37.009553 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:11:37.515615 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9417): Launched 07:11:37.628778 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:11:37.876353 run patchelf(pid=9418): Launched 07:11:38.040878 run osmo-stp_10.42.42.5(pid=9415): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9415)] 07:11:38.165873 run osmo-stp_10.42.42.5(pid=9415): stdout: | (launched: 2022-12-10_07:11:36.842990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:38.292537 run osmo-stp_10.42.42.5(pid=9415): stderr: | [0;m[38;5;43m20221210071137010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071137010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071137010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071137011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071137011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071137011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071137011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:38.419849 run osmo-stp_10.42.42.5(pid=9415): stdout: | (launched: 2022-12-10_07:11:36.842990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:38.540270 run osmo-stp_10.42.42.5(pid=9415): stderr: | [0;m[38;5;43m20221210071137010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071137010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071137010 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071137011 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071137011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071137011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071137011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:38.683014 run patchelf(pid=9418): Terminating (SIGINT) 07:11:38.849233 run patchelf(pid=9418): Terminated: ok {rc=0} 07:11:38.969193 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9415): Process ended prematurely: osmo-stp_10.42.42.5(pid=9415) [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9415)] [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8] 07:11:38.978478 tst iperf3m4.py:8: Test FAILED (10.2 sec) 07:11:39.006105 run osmo-hlr_10.42.42.2(pid=9412): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9412)] 07:11:39.053920 run osmo-hlr_10.42.42.2(pid=9412): stdout: | (launched: 2022-12-10_07:11:35.917705) 07:11:39.103221 run osmo-hlr_10.42.42.2(pid=9412): stderr: | [0;m[1;31m20221210071136092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071136092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071136092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071136092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071136092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071136092 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071136108 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:oc2g+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071136118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071136118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071136118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:11:39.153314 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9401): Terminating (SIGTERM) 07:11:39.193138 run iperf3-srv_10.42.42.10(pid=9402): Terminating (SIGTERM) 07:11:39.232638 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9403): Terminating (SIGTERM) 07:11:39.272322 run iperf3-srv_10.42.42.10(pid=9404): Terminating (SIGTERM) 07:11:39.311935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9405): Terminating (SIGTERM) 07:11:39.351564 run iperf3-srv_10.42.42.10(pid=9406): Terminating (SIGTERM) 07:11:39.390996 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9407): Terminating (SIGTERM) 07:11:39.430557 run iperf3-srv_10.42.42.10(pid=9408): Terminating (SIGTERM) 07:11:39.470051 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9411): Terminating (SIGTERM) 07:11:39.509563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9414): Terminating (SIGTERM) 07:11:39.549043 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9417): Terminating (SIGTERM) 07:11:39.588813 --- ParallelTerminationStrategy: PID 9401 died... 07:11:39.607771 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9401): Terminated: ok {rc=0} 07:11:39.652513 --- ParallelTerminationStrategy: PID 9402 died... 07:11:39.670981 run iperf3-srv_10.42.42.10(pid=9402): Terminated {rc=256} 07:11:39.715024 --- ParallelTerminationStrategy: PID 9403 died... 07:11:39.733599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9403): Terminated: ok {rc=0} 07:11:39.777682 --- ParallelTerminationStrategy: PID 9404 died... 07:11:39.795998 run iperf3-srv_10.42.42.10(pid=9404): Terminated {rc=256} 07:11:39.839924 --- ParallelTerminationStrategy: PID 9405 died... 07:11:39.858411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9405): Terminated: ok {rc=0} 07:11:39.902450 --- ParallelTerminationStrategy: PID 9406 died... 07:11:39.920784 run iperf3-srv_10.42.42.10(pid=9406): Terminated {rc=256} 07:11:39.964706 --- ParallelTerminationStrategy: PID 9407 died... 07:11:39.983170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9407): Terminated: ok {rc=0} 07:11:40.027268 --- ParallelTerminationStrategy: PID 9408 died... 07:11:40.045728 run iperf3-srv_10.42.42.10(pid=9408): Terminated {rc=256} 07:11:40.090694 --- ParallelTerminationStrategy: PID 9411 died... 07:11:40.109205 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9411): Terminated: ok {rc=0} 07:11:40.153214 --- ParallelTerminationStrategy: PID 9414 died... 07:11:40.171565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9414): Terminated: ok {rc=0} 07:11:40.216157 --- ParallelTerminationStrategy: PID 9417 died... 07:11:40.234649 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9417): Terminated: ok {rc=0} 07:11:40.320174 bus /gobi_4: Setting Powered False 07:11:41.423410 bus /gobi_4: Setting Powered False 07:11:42.542768 bus /gobi_1: Setting Powered False 07:11:43.640808 bus /gobi_1: Setting Powered False 07:11:44.756114 bus /gobi_0: Setting Powered False 07:11:45.856730 bus /gobi_0: Setting Powered False 07:11:46.991541 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:oc2g+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 07:11:48.111267 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:48.122845 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:11:48.182650 tst ping.py: using LAC 26715 07:11:48.298407 tst ping.py: using RAC 195 07:11:48.414658 tst ping.py: using CellId 26715 07:11:48.531912 tst ping.py: using BVCI 26716 07:11:48.636645 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:48.647459 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:48.658122 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:48.669141 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:48.680002 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:48.690849 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:48.702004 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:48.713224 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:11:48.830164 tst ping.py:19: start network... 07:11:49.038691 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:11:49.517292 run create_hlr_db(pid=9420): Launched 07:11:49.644152 bus /gobi_6: Setting Powered False 07:11:50.702843 run create_hlr_db(pid=9420): Terminated: ok {rc=0} 07:11:51.133164 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9422): Launched 07:11:51.442133 run osmo-hlr_10.42.42.2(pid=9423): Launched 07:11:51.559873 run osmo-stp_10.42.42.5: Starting osmo-stp 07:11:52.095947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9425): Launched 07:11:52.404845 run osmo-stp_10.42.42.5(pid=9426): Launched 07:11:52.523900 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:11:53.057210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9428): Launched 07:11:53.175650 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:11:53.436246 run patchelf(pid=9429): Launched 07:11:53.608141 run osmo-stp_10.42.42.5(pid=9426): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9426)] 07:11:53.739122 run osmo-stp_10.42.42.5(pid=9426): stdout: | (launched: 2022-12-10_07:11:52.348539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:53.871406 run osmo-stp_10.42.42.5(pid=9426): stderr: | [0;m[38;5;43m20221210071152539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071152539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071152539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071152539 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071152542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071152542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071152542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:54.003965 run osmo-stp_10.42.42.5(pid=9426): stdout: | (launched: 2022-12-10_07:11:52.348539) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:11:54.130723 run osmo-stp_10.42.42.5(pid=9426): stderr: | [0;m[38;5;43m20221210071152539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071152539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071152539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071152539 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071152542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071152542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071152542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:11:54.280900 run patchelf(pid=9429): Terminating (SIGINT) 07:11:54.455871 run patchelf(pid=9429): Terminated: ok {rc=0} 07:11:54.581567 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9426): Process ended prematurely: osmo-stp_10.42.42.5(pid=9426) [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9426)] [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22] 07:11:54.590906 tst ping.py:22: Test FAILED (6.5 sec) 07:11:54.618638 run osmo-hlr_10.42.42.2(pid=9423): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9423)] 07:11:54.668509 run osmo-hlr_10.42.42.2(pid=9423): stdout: | (launched: 2022-12-10_07:11:51.385877) 07:11:54.720040 run osmo-hlr_10.42.42.2(pid=9423): stderr: | [0;m[1;31m20221210071151583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071151583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071151583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071151583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071151583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071151583 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071151595 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:oc2g+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071151603 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071151604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071151604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:11:54.771804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9422): Terminating (SIGTERM) 07:11:54.813811 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9425): Terminating (SIGTERM) 07:11:54.855742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9428): Terminating (SIGTERM) 07:11:54.897912 --- ParallelTerminationStrategy: PID 9422 died... 07:11:54.917969 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9422): Terminated: ok {rc=0} 07:11:54.964148 --- ParallelTerminationStrategy: PID 9425 died... 07:11:54.983799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9425): Terminated: ok {rc=0} 07:11:55.029855 --- ParallelTerminationStrategy: PID 9428 died... 07:11:55.049520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9428): Terminated: ok {rc=0} 07:11:55.138045 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:oc2g+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 07:11:56.226869 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:56.239229 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:11:56.299176 tst ping_idle_ping.py: using LAC 26716 07:11:56.420557 tst ping_idle_ping.py: using RAC 196 07:11:56.542076 tst ping_idle_ping.py: using CellId 26716 07:11:56.664548 tst ping_idle_ping.py: using BVCI 26717 07:11:56.776319 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:56.787586 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:56.798744 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:56.809924 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:56.820863 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:56.831877 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:56.843151 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:11:56.854157 tst gprs:oc2g+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:11:56.967737 tst ping_idle_ping.py:24: start network... 07:11:57.162643 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:11:57.617902 run create_hlr_db(pid=9430): Launched 07:11:57.747168 bus /gobi_6: Setting Powered False 07:11:58.809207 run create_hlr_db(pid=9430): Terminated: ok {rc=0} 07:11:59.240442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9432): Launched 07:11:59.550338 run osmo-hlr_10.42.42.2(pid=9433): Launched 07:11:59.669397 run osmo-stp_10.42.42.5: Starting osmo-stp 07:12:00.200867 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9435): Launched 07:12:00.510036 run osmo-stp_10.42.42.5(pid=9436): Launched 07:12:00.629638 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:12:01.203149 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9438): Launched 07:12:01.331573 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:12:01.594887 run patchelf(pid=9439): Launched 07:12:01.775368 run osmo-stp_10.42.42.5(pid=9436): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9436)] 07:12:01.906394 run osmo-stp_10.42.42.5(pid=9436): stdout: | (launched: 2022-12-10_07:12:00.454049) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:02.035212 run osmo-stp_10.42.42.5(pid=9436): stderr: | [0;m[38;5;43m20221210071200644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071200644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071200644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071200645 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071200645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071200645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071200645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:02.164567 run osmo-stp_10.42.42.5(pid=9436): stdout: | (launched: 2022-12-10_07:12:00.454049) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:02.285660 run osmo-stp_10.42.42.5(pid=9436): stderr: | [0;m[38;5;43m20221210071200644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071200644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071200644 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071200645 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071200645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071200645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071200645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:02.426748 run patchelf(pid=9439): Terminating (SIGINT) 07:12:02.591373 run patchelf(pid=9439): Terminated: ok {rc=0} 07:12:02.710400 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9436): Process ended prematurely: osmo-stp_10.42.42.5(pid=9436) [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9436)] [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 07:12:02.719426 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 07:12:02.746668 run osmo-hlr_10.42.42.2(pid=9433): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9433)] 07:12:02.794903 run osmo-hlr_10.42.42.2(pid=9433): stdout: | (launched: 2022-12-10_07:11:59.494387) 07:12:02.844577 run osmo-hlr_10.42.42.2(pid=9433): stderr: | [0;m[1;31m20221210071159689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071159689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071159689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071159689 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071159690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071159690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071159701 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:oc2g+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071159709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071159709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071159709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:12:02.894606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9432): Terminating (SIGTERM) 07:12:02.934840 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9435): Terminating (SIGTERM) 07:12:02.974783 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9438): Terminating (SIGTERM) 07:12:03.015053 --- ParallelTerminationStrategy: PID 9432 died... 07:12:03.034589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9432): Terminated: ok {rc=0} 07:12:03.079138 --- ParallelTerminationStrategy: PID 9435 died... 07:12:03.097639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9435): Terminated: ok {rc=0} 07:12:03.141936 --- ParallelTerminationStrategy: PID 9438 died... 07:12:03.160707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9438): Terminated: ok {rc=0} 07:12:03.247360 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:oc2g+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:12:04.533125 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:12:04.539949 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:12:04.561563 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 07:12:04.595606 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:12:04.648799 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:12:04.669667 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 07:12:04.703736 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:12:05.261959 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2371 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 07:12:05.268119 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:12:05.280088 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:12:05.338653 tst switch_tch_pdch.py: using LAC 26717 07:12:05.459890 tst switch_tch_pdch.py: using RAC 197 07:12:05.582437 tst switch_tch_pdch.py: using CellId 26717 07:12:05.702892 tst switch_tch_pdch.py: using BVCI 26718 07:12:05.815121 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:12:05.826576 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:12:05.837830 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:12:05.849062 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:12:05.860252 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:12:05.871547 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:12:05.882918 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:12:05.894155 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:12:06.007778 tst dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:12:06.122329 tst switch_tch_pdch.py:51: start network... 07:12:06.314487 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:12:06.761699 run create_hlr_db(pid=9443): Launched 07:12:06.873264 bus /gobi_6: Setting Powered False 07:12:07.931266 run create_hlr_db(pid=9443): Terminated: ok {rc=0} 07:12:08.354394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9445): Launched 07:12:08.664573 run osmo-hlr_10.42.42.2(pid=9446): Launched 07:12:08.783289 run osmo-stp_10.42.42.5: Starting osmo-stp 07:12:09.316806 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9448): Launched 07:12:09.625137 run osmo-stp_10.42.42.5(pid=9449): Launched 07:12:09.743769 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:12:10.276260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9451): Launched 07:12:10.394638 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:12:10.655270 run patchelf(pid=9452): Launched 07:12:10.827081 run osmo-stp_10.42.42.5(pid=9449): ERR: Terminated: ERROR {rc=1} [trial-2371↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9449)] 07:12:10.957383 run osmo-stp_10.42.42.5(pid=9449): stdout: | (launched: 2022-12-10_07:12:09.569380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:11.089737 run osmo-stp_10.42.42.5(pid=9449): stderr: | [0;m[38;5;43m20221210071209759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071209759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071209759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071209760 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071209760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071209760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071209760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:11.221790 run osmo-stp_10.42.42.5(pid=9449): stdout: | (launched: 2022-12-10_07:12:09.569380) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:11.347859 run osmo-stp_10.42.42.5(pid=9449): stderr: | [0;m[38;5;43m20221210071209759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071209759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071209759 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071209760 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071209760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071209760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071209760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:11.498058 run patchelf(pid=9452): Terminating (SIGINT) 07:12:11.671574 run patchelf(pid=9452): Terminated: ok {rc=0} 07:12:11.796476 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9449): Process ended prematurely: osmo-stp_10.42.42.5(pid=9449) [trial-2371↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9449)] [trial-2371↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 07:12:11.805917 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 07:12:11.833396 run osmo-hlr_10.42.42.2(pid=9446): ERR: Terminated: ERROR {rc=237} [trial-2371↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9446)] 07:12:11.882723 run osmo-hlr_10.42.42.2(pid=9446): stdout: | (launched: 2022-12-10_07:12:08.608478) 07:12:11.933916 run osmo-hlr_10.42.42.2(pid=9446): stderr: | [0;m[1;31m20221210071208804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071208804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071208804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071208804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071208804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071208804 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071208816 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071208825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071208825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071208825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:12:11.985413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9445): Terminating (SIGTERM) 07:12:12.026568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9448): Terminating (SIGTERM) 07:12:12.068023 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9451): Terminating (SIGTERM) 07:12:12.109598 --- ParallelTerminationStrategy: PID 9445 died... 07:12:12.128918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9445): Terminated: ok {rc=0} 07:12:12.174524 --- ParallelTerminationStrategy: PID 9448 died... 07:12:12.193682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9448): Terminated: ok {rc=0} 07:12:12.238972 --- ParallelTerminationStrategy: PID 9451 died... 07:12:12.258143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9451): Terminated: ok {rc=0} 07:12:12.345032 bus /gobi_0: Setting Powered False 07:12:13.442243 bus /gobi_0: Setting Powered False 07:12:14.557944 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 dynts:oc2g+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 07:12:15.796487 tst dynts:oc2g+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:12:15.802653 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 07:12:15.823565 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 07:12:15.873532 tst dynts:oc2g+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 07:12:15.941841 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 07:12:15.963615 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 07:12:15.999626 tst dynts:oc2g+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 07:12:16.566798 tst dynts:oc2g+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2371 dynts:oc2g+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 07:12:16.573560 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:12:16.588463 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 07:12:16.659103 tst switch_tch_pdch.py: using LAC 26718 07:12:16.781849 tst switch_tch_pdch.py: using RAC 198 07:12:16.900329 tst switch_tch_pdch.py: using CellId 26718 07:12:17.017307 tst switch_tch_pdch.py: using BVCI 26719 07:12:17.127363 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:12:17.139255 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:12:17.151008 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:12:17.163890 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:12:17.176130 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:12:17.188360 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:12:17.201404 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:12:17.214203 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:12:17.341809 tst dynts:oc2g+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:12:17.455806 tst switch_tch_pdch.py:51: start network... 07:12:17.649953 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:12:18.073480 run create_hlr_db(pid=9458): Launched 07:12:18.184518 bus /gobi_6: Setting Powered False 07:12:19.243353 run create_hlr_db(pid=9458): Terminated: ok {rc=0} 07:12:19.639980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9460): Launched 07:12:19.949220 run osmo-hlr_10.42.42.2(pid=9461): Launched 07:12:20.067719 run osmo-stp_10.42.42.5: Starting osmo-stp 07:12:20.576777 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9463): Launched 07:12:20.885504 run osmo-stp_10.42.42.5(pid=9464): Launched 07:12:21.003027 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:12:21.509121 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9466): Launched 07:12:21.627017 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:12:21.887028 run patchelf(pid=9467): Launched 07:12:22.058405 run osmo-stp_10.42.42.5(pid=9464): ERR: Terminated: ERROR {rc=1} [trial-2371↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9464)] 07:12:22.188809 run osmo-stp_10.42.42.5(pid=9464): stdout: | (launched: 2022-12-10_07:12:20.829768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:22.321362 run osmo-stp_10.42.42.5(pid=9464): stderr: | [0;m[38;5;43m20221210071221018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071221018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071221018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071221018 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071221021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071221021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071221021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:22.454748 run osmo-stp_10.42.42.5(pid=9464): stdout: | (launched: 2022-12-10_07:12:20.829768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:22.581145 run osmo-stp_10.42.42.5(pid=9464): stderr: | [0;m[38;5;43m20221210071221018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071221018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071221018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071221018 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071221021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071221021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071221021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:22.731813 run patchelf(pid=9467): Terminating (SIGINT) 07:12:22.904895 run patchelf(pid=9467): Terminated: ok {rc=0} 07:12:23.030011 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=9464): Process ended prematurely: osmo-stp_10.42.42.5(pid=9464) [trial-2371↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9464)] [trial-2371↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 07:12:23.039303 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 07:12:23.066814 run osmo-hlr_10.42.42.2(pid=9461): ERR: Terminated: ERROR {rc=237} [trial-2371↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9461)] 07:12:23.116239 run osmo-hlr_10.42.42.2(pid=9461): stdout: | (launched: 2022-12-10_07:12:19.893369) 07:12:23.167377 run osmo-hlr_10.42.42.2(pid=9461): stderr: | [0;m[1;31m20221210071220089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071220089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071220089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071220089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071220089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071220089 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071220101 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/dynts:oc2g+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071220111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071220111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071220111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:12:23.219018 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9460): Terminating (SIGTERM) 07:12:23.260472 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9463): Terminating (SIGTERM) 07:12:23.301886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9466): Terminating (SIGTERM) 07:12:23.343416 --- ParallelTerminationStrategy: PID 9460 died... 07:12:23.363097 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9460): Terminated: ok {rc=0} 07:12:23.409089 --- ParallelTerminationStrategy: PID 9463 died... 07:12:23.428350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9463): Terminated: ok {rc=0} 07:12:23.473967 --- ParallelTerminationStrategy: PID 9466 died... 07:12:23.493281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9466): Terminated: ok {rc=0} 07:12:23.580586 bus /gobi_0: Setting Powered False 07:12:24.678823 bus /gobi_0: Setting Powered False 07:12:25.795023 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 dynts:oc2g+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 nitb_sms:trx-b200 --------------------------------------------------------------------- 07:12:27.022732 tst nitb_sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:12:27.026492 tst nitb_sms:trx-b200: Verifying 1 x bts (candidates: 11) 07:12:27.060098 tst nitb_sms:trx-b200: Verifying 1 x ip_address (candidates: 9) 07:12:27.066777 tst nitb_sms:trx-b200: Verifying 2 x modem (candidates: 12) 07:12:27.118534 tst nitb_sms:trx-b200: Reserving 1 x bts (candidates: 11) 07:12:27.152331 tst nitb_sms:trx-b200: Reserving 1 x ip_address (candidates: 9) 07:12:27.158874 tst nitb_sms:trx-b200: Reserving 2 x modem (candidates: 12) 07:12:27.698201 tst nitb_sms:trx-b200: RESERVED RESOURCES for nitb_sms: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 nitb_sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 07:12:27.703060 tst nitb_sms:trx-b200: Using 1 x ip_address (candidates: 1) 07:12:27.713576 tst nitb_sms:trx-b200: Using 1 x bts (candidates: 1) 07:12:27.761295 tst mo_mt_sms.py: using LAC 26719 07:12:27.875434 tst mo_mt_sms.py: using RAC 199 07:12:27.988177 tst mo_mt_sms.py: using CellId 26719 07:12:28.101094 tst mo_mt_sms.py: using BVCI 26720 07:12:28.205440 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 07:12:28.321630 tst nitb_sms:trx-b200: Using 1 x modem (candidates: 2) 07:12:28.434409 tst mo_mt_sms.py:9: start nitb and bts... 07:12:28.628695 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:12:29.218986 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9471): Launched 07:12:29.507402 run osmo-nitb_10.42.42.2(pid=9472): Launched 07:12:29.667624 run osmo-nitb_10.42.42.2(pid=9472): ERR: Terminated: ERROR {rc=2} [trial-2371↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9472)] 07:12:29.797639 run osmo-nitb_10.42.42.2(pid=9472): stdout: | (launched: 2022-12-10_07:12:29.454916) 07:12:29.928848 run osmo-nitb_10.42.42.2(pid=9472): stderr: | (launched: 2022-12-10_07:12:29.497898) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:12:30.060501 run osmo-nitb_10.42.42.2(pid=9472): stdout: | (launched: 2022-12-10_07:12:29.454916) 07:12:30.186572 run osmo-nitb_10.42.42.2(pid=9472): stderr: | (launched: 2022-12-10_07:12:29.497898) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f5483dba268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9472): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9472) [trial-2371↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9472)] 07:12:30.617057 tst osmo-nitb_10.42.42.2(pid=9472): stdout: | (launched: 2022-12-10_07:12:29.454916) 07:12:30.734517 tst osmo-nitb_10.42.42.2(pid=9472): stderr: | (launched: 2022-12-10_07:12:29.497898) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:12:30.883281 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=9472): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9472) [trial-2371↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9472)] [trial-2371↪nitb_sms:trx-b200↪mo_mt_sms.py:11] 07:12:30.892099 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 07:12:30.899174 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9471): Terminating (SIGTERM) 07:12:31.110631 --- ParallelTerminationStrategy: PID 9471 died... 07:12:31.130005 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9471): Terminated: ok {rc=0} 07:12:31.218544 bus /sierra_3: Setting Powered False 07:12:32.314317 bus /sierra_3: Setting Powered False 07:12:33.427833 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 nitb_sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 sms:trx-b200 --------------------------------------------------------------------- 07:12:34.627017 tst sms:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:12:34.630974 tst sms:trx-b200: Verifying 1 x bts (candidates: 11) 07:12:34.664189 tst sms:trx-b200: Verifying 6 x ip_address (candidates: 9) 07:12:34.690357 tst sms:trx-b200: Verifying 2 x modem (candidates: 12) 07:12:34.741271 tst sms:trx-b200: Reserving 1 x bts (candidates: 11) 07:12:34.775367 tst sms:trx-b200: Reserving 6 x ip_address (candidates: 9) 07:12:34.802700 tst sms:trx-b200: Reserving 2 x modem (candidates: 12) 07:12:35.348234 tst sms:trx-b200: RESERVED RESOURCES for sms: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 sms:trx-b200 mo_mt_sms.py ---------------------------------------------- 07:12:35.353639 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 07:12:35.364407 tst sms:trx-b200: Using 1 x bts (candidates: 1) 07:12:35.412458 tst mo_mt_sms.py: using LAC 26720 07:12:35.531504 tst mo_mt_sms.py: using RAC 200 07:12:35.644519 tst mo_mt_sms.py: using CellId 26720 07:12:35.756077 tst mo_mt_sms.py: using BVCI 26721 07:12:35.859795 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 07:12:35.870366 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 07:12:35.880697 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 07:12:35.891296 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 07:12:35.901473 tst sms:trx-b200: Using 1 x ip_address (candidates: 6) 07:12:35.913746 tst sms:trx-b200: Using 1 x modem (candidates: 2) 07:12:36.029084 tst sms:trx-b200: Using 1 x modem (candidates: 2) 07:12:36.141437 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:12:36.586536 run create_hlr_db(pid=9476): Launched 07:12:36.696649 bus /sierra_2: Setting Powered False 07:12:37.754938 run create_hlr_db(pid=9476): Terminated: ok {rc=0} 07:12:38.177096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9478): Launched 07:12:38.485267 run osmo-hlr_10.42.42.2(pid=9479): Launched 07:12:38.605077 run osmo-stp_10.42.42.5: Starting osmo-stp 07:12:39.143714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9481): Launched 07:12:39.451718 run osmo-stp_10.42.42.5(pid=9482): Launched 07:12:39.570075 run osmo-msc_10.42.42.6: Starting osmo-msc 07:12:40.131393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9484): Launched 07:12:40.440474 run osmo-msc_10.42.42.6(pid=9485): Launched 07:12:40.613633 run osmo-stp_10.42.42.5(pid=9482): ERR: Terminated: ERROR {rc=1} [trial-2371↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9482)] 07:12:40.743397 run osmo-stp_10.42.42.5(pid=9482): stdout: | (launched: 2022-12-10_07:12:39.395986) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:40.874819 run osmo-stp_10.42.42.5(pid=9482): stderr: | [0;m[38;5;43m20221210071239585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071239585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071239585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071239586 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071239586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071239586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071239586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:41.004779 run osmo-stp_10.42.42.5(pid=9482): stdout: | (launched: 2022-12-10_07:12:39.395986) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:41.127616 run osmo-stp_10.42.42.5(pid=9482): stderr: | [0;m[38;5;43m20221210071239585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071239585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071239585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071239586 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071239586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071239586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071239586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:41.274518 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=9482): Process ended prematurely: osmo-stp_10.42.42.5(pid=9482) [trial-2371↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9482)] [trial-2371↪sms:trx-b200↪mo_mt_sms.py:16] 07:12:41.283320 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 07:12:41.310433 run osmo-hlr_10.42.42.2(pid=9479): ERR: Terminated: ERROR {rc=237} [trial-2371↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9479)] 07:12:41.359994 run osmo-hlr_10.42.42.2(pid=9479): stdout: | (launched: 2022-12-10_07:12:38.429478) 07:12:41.411693 run osmo-hlr_10.42.42.2(pid=9479): stderr: | [0;m[1;31m20221210071238626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071238626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071238626 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071238627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071238627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071238627 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071238639 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/sms:trx-b200/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071238647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071238647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071238647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:12:41.483318 run osmo-msc_10.42.42.6(pid=9485): ERR: Terminated: ERROR {rc=2} [trial-2371↪sms:trx-b200↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9485)] 07:12:41.533060 run osmo-msc_10.42.42.6(pid=9485): stdout: | (launched: 2022-12-10_07:12:40.384141) 07:12:41.584145 run osmo-msc_10.42.42.6(pid=9485): stderr: | [0;m[38;5;43m20221210071240704 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071240704 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0f372c1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071240705 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071240705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071240705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071240705 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071240707 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071240707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071240707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071240707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:12:41.635671 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9478): Terminating (SIGTERM) 07:12:41.676922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9481): Terminating (SIGTERM) 07:12:41.718239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9484): Terminating (SIGTERM) 07:12:41.759740 --- ParallelTerminationStrategy: PID 9478 died... 07:12:41.779663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9478): Terminated: ok {rc=0} 07:12:41.825522 --- ParallelTerminationStrategy: PID 9481 died... 07:12:41.845365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9481): Terminated: ok {rc=0} 07:12:41.891141 --- ParallelTerminationStrategy: PID 9484 died... 07:12:41.910547 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9484): Terminated: ok {rc=0} 07:12:41.998270 bus /sierra_3: Setting Powered False 07:12:43.096662 bus /sierra_3: Setting Powered False 07:12:44.212880 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 sms:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 nitb_ussd:trx-b200 --------------------------------------------------------------------- 07:12:45.437315 tst nitb_ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:12:45.440837 tst nitb_ussd:trx-b200: Verifying 1 x bts (candidates: 11) 07:12:45.474302 tst nitb_ussd:trx-b200: Verifying 1 x ip_address (candidates: 9) 07:12:45.480815 tst nitb_ussd:trx-b200: Verifying 1 x modem (candidates: 12) 07:12:45.515870 tst nitb_ussd:trx-b200: Reserving 1 x bts (candidates: 11) 07:12:45.549805 tst nitb_ussd:trx-b200: Reserving 1 x ip_address (candidates: 9) 07:12:45.556860 tst nitb_ussd:trx-b200: Reserving 1 x modem (candidates: 12) 07:12:46.074540 tst nitb_ussd:trx-b200: RESERVED RESOURCES for nitb_ussd: bts Ettus B200 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2371 nitb_ussd:trx-b200 assert_extension.py ---------------------------------------------- 07:12:46.080508 tst nitb_ussd:trx-b200: Using 1 x ip_address (candidates: 1) 07:12:46.093244 tst nitb_ussd:trx-b200: Using 1 x bts (candidates: 1) 07:12:46.145126 tst assert_extension.py: using LAC 26721 07:12:46.292796 tst assert_extension.py: using RAC 201 07:12:46.451557 tst assert_extension.py: using CellId 26721 07:12:46.581643 tst assert_extension.py: using BVCI 26722 07:12:46.689935 tst nitb_ussd:trx-b200: Using 1 x modem (candidates: 1) 07:12:46.807716 tst assert_extension.py:10: start nitb and bts... 07:12:47.035902 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:12:47.672415 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9490): Launched 07:12:47.980447 run osmo-nitb_10.42.42.2(pid=9491): Launched 07:12:48.151660 run osmo-nitb_10.42.42.2(pid=9491): ERR: Terminated: ERROR {rc=2} [trial-2371↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9491)] 07:12:48.289961 run osmo-nitb_10.42.42.2(pid=9491): stdout: | (launched: 2022-12-10_07:12:47.924734) 07:12:48.430113 run osmo-nitb_10.42.42.2(pid=9491): stderr: | (launched: 2022-12-10_07:12:47.970684) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:12:48.570383 run osmo-nitb_10.42.42.2(pid=9491): stdout: | (launched: 2022-12-10_07:12:47.924734) 07:12:48.704665 run osmo-nitb_10.42.42.2(pid=9491): stderr: | (launched: 2022-12-10_07:12:47.970684) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f5483dba268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=9491): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9491) [trial-2371↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9491)] 07:12:49.097858 tst osmo-nitb_10.42.42.2(pid=9491): stdout: | (launched: 2022-12-10_07:12:47.924734) 07:12:49.221878 tst osmo-nitb_10.42.42.2(pid=9491): stderr: | (launched: 2022-12-10_07:12:47.970684) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:12:49.368604 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=9491): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9491) [trial-2371↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9491)] [trial-2371↪nitb_ussd:trx-b200↪assert_extension.py:12] 07:12:49.377432 tst assert_extension.py:12: Test FAILED (3.3 sec) 07:12:49.384231 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9490): Terminating (SIGTERM) 07:12:49.594732 --- ParallelTerminationStrategy: PID 9490 died... 07:12:49.616215 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=9490): Terminated: ok {rc=0} 07:12:49.702505 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 nitb_ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 ussd:trx-b200 --------------------------------------------------------------------- 07:12:50.876892 tst ussd:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:12:50.880740 tst ussd:trx-b200: Verifying 1 x bts (candidates: 11) 07:12:50.917793 tst ussd:trx-b200: Verifying 6 x ip_address (candidates: 9) 07:12:50.945033 tst ussd:trx-b200: Verifying 1 x modem (candidates: 12) 07:12:50.981550 tst ussd:trx-b200: Reserving 1 x bts (candidates: 11) 07:12:51.014771 tst ussd:trx-b200: Reserving 6 x ip_address (candidates: 9) 07:12:51.041010 tst ussd:trx-b200: Reserving 1 x modem (candidates: 12) 07:12:51.570417 tst ussd:trx-b200: RESERVED RESOURCES for ussd: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2371 ussd:trx-b200 assert_extension.py ---------------------------------------------- 07:12:51.576445 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 07:12:51.587764 tst ussd:trx-b200: Using 1 x bts (candidates: 1) 07:12:51.639484 tst assert_extension.py: using LAC 26722 07:12:51.760008 tst assert_extension.py: using RAC 202 07:12:51.878751 tst assert_extension.py: using CellId 26722 07:12:51.997854 tst assert_extension.py: using BVCI 26723 07:12:52.109096 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 07:12:52.119890 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 07:12:52.130688 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 07:12:52.141451 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 07:12:52.152173 tst ussd:trx-b200: Using 1 x ip_address (candidates: 6) 07:12:52.162862 tst ussd:trx-b200: Using 1 x modem (candidates: 1) 07:12:52.276044 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:12:52.722110 run create_hlr_db(pid=9495): Launched 07:12:52.833280 bus /sierra_2: Setting Powered False 07:12:53.890767 run create_hlr_db(pid=9495): Terminated: ok {rc=0} 07:12:54.313298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9497): Launched 07:12:54.622529 run osmo-hlr_10.42.42.2(pid=9498): Launched 07:12:54.742321 run osmo-stp_10.42.42.5: Starting osmo-stp 07:12:55.277701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9500): Launched 07:12:55.587007 run osmo-stp_10.42.42.5(pid=9501): Launched 07:12:55.705604 run osmo-msc_10.42.42.6: Starting osmo-msc 07:12:56.262476 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9503): Launched 07:12:56.569735 run osmo-msc_10.42.42.6(pid=9504): Launched 07:12:56.742194 run osmo-stp_10.42.42.5(pid=9501): ERR: Terminated: ERROR {rc=1} [trial-2371↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9501)] 07:12:56.871780 run osmo-stp_10.42.42.5(pid=9501): stdout: | (launched: 2022-12-10_07:12:55.530830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:57.002454 run osmo-stp_10.42.42.5(pid=9501): stderr: | [0;m[38;5;43m20221210071255719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071255719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071255720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071255720 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071255722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071255723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071255723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:57.132214 run osmo-stp_10.42.42.5(pid=9501): stdout: | (launched: 2022-12-10_07:12:55.530830) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:12:57.255113 run osmo-stp_10.42.42.5(pid=9501): stderr: | [0;m[38;5;43m20221210071255719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071255719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071255720 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071255720 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071255722 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071255723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071255723 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:12:57.402436 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=9501): Process ended prematurely: osmo-stp_10.42.42.5(pid=9501) [trial-2371↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9501)] [trial-2371↪ussd:trx-b200↪assert_extension.py:17] 07:12:57.411352 tst assert_extension.py:17: Test FAILED (5.8 sec) 07:12:57.438737 run osmo-hlr_10.42.42.2(pid=9498): ERR: Terminated: ERROR {rc=237} [trial-2371↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9498)] 07:12:57.489081 run osmo-hlr_10.42.42.2(pid=9498): stdout: | (launched: 2022-12-10_07:12:54.566723) 07:12:57.540569 run osmo-hlr_10.42.42.2(pid=9498): stderr: | [0;m[1;31m20221210071254761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071254761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071254761 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071254762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071254762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071254762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071254785 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/ussd:trx-b200/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071254796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071254796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071254796 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:12:57.612298 run osmo-msc_10.42.42.6(pid=9504): ERR: Terminated: ERROR {rc=2} [trial-2371↪ussd:trx-b200↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9504)] 07:12:57.661848 run osmo-msc_10.42.42.6(pid=9504): stdout: | (launched: 2022-12-10_07:12:56.513965) 07:12:57.713235 run osmo-msc_10.42.42.6(pid=9504): stderr: | [0;m[38;5;43m20221210071256832 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071256832 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f10a0c81c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071256832 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071256832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071256832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071256832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071256836 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071256836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071256836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071256837 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:12:57.764867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9497): Terminating (SIGTERM) 07:12:57.806199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9500): Terminating (SIGTERM) 07:12:57.848027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9503): Terminating (SIGTERM) 07:12:57.889873 --- ParallelTerminationStrategy: PID 9497 died... 07:12:57.909861 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9497): Terminated: ok {rc=0} 07:12:57.956070 --- ParallelTerminationStrategy: PID 9500 died... 07:12:57.975508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9500): Terminated: ok {rc=0} 07:12:58.021699 --- ParallelTerminationStrategy: PID 9503 died... 07:12:58.041311 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9503): Terminated: ok {rc=0} 07:12:58.129871 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 ussd:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 07:12:59.347329 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:12:59.354835 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 07:12:59.389193 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 07:12:59.416826 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 07:12:59.470080 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 07:12:59.504252 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 07:12:59.531058 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 07:13:00.081198 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 07:13:00.132858 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:13:00.144384 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:13:00.213746 tst mo_mt_call.py: using LAC 26723 07:13:00.339485 tst mo_mt_call.py: using RAC 203 07:13:00.463555 tst mo_mt_call.py: using CellId 26723 07:13:00.587917 tst mo_mt_call.py: using BVCI 26724 07:13:00.703370 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:13:00.714768 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:13:00.725975 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:13:00.737477 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:13:00.748847 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:13:00.760196 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:13:00.877980 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:13:01.002590 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:13:01.526829 run create_hlr_db(pid=9509): Launched 07:13:01.691840 bus /sierra_2: Setting Powered False 07:13:02.753187 run create_hlr_db(pid=9509): Terminated: ok {rc=0} 07:13:03.173370 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9511): Launched 07:13:03.466273 run osmo-hlr_10.42.42.2(pid=9512): Launched 07:13:03.578979 run osmo-stp_10.42.42.5: Starting osmo-stp 07:13:04.098108 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9514): Launched 07:13:04.390529 run osmo-stp_10.42.42.5(pid=9515): Launched 07:13:04.502867 run osmo-msc_10.42.42.6: Starting osmo-msc 07:13:05.033024 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9517): Launched 07:13:05.326438 run osmo-msc_10.42.42.6(pid=9518): Launched 07:13:05.491726 run osmo-stp_10.42.42.5(pid=9515): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9515)] 07:13:05.616908 run osmo-stp_10.42.42.5(pid=9515): stdout: | (launched: 2022-12-10_07:13:04.337688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:05.741299 run osmo-stp_10.42.42.5(pid=9515): stderr: | [0;m[38;5;43m20221210071304508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071304508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071304508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071304508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071304509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071304509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071304509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:05.863586 run osmo-stp_10.42.42.5(pid=9515): stdout: | (launched: 2022-12-10_07:13:04.337688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:05.980563 run osmo-stp_10.42.42.5(pid=9515): stderr: | [0;m[38;5;43m20221210071304508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071304508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071304508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071304508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071304509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071304509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071304509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:06.120890 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9515): Process ended prematurely: osmo-stp_10.42.42.5(pid=9515) [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9515)] [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:13:06.129868 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 07:13:06.156139 run osmo-hlr_10.42.42.2(pid=9512): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9512)] 07:13:06.203836 run osmo-hlr_10.42.42.2(pid=9512): stdout: | (launched: 2022-12-10_07:13:03.413542) 07:13:06.252932 run osmo-hlr_10.42.42.2(pid=9512): stderr: | [0;m[1;31m20221210071303588 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071303589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071303589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071303589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071303589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071303589 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071303601 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071303609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071303610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071303610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:13:06.321356 run osmo-msc_10.42.42.6(pid=9518): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9518)] 07:13:06.368632 run osmo-msc_10.42.42.6(pid=9518): stdout: | (launched: 2022-12-10_07:13:05.273251) 07:13:06.417539 run osmo-msc_10.42.42.6(pid=9518): stderr: | [0;m[38;5;43m20221210071305544 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071305544 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f56f15c4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071305544 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071305544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071305544 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071305545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071305546 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071305547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071305547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071305547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:13:06.466972 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9511): Terminating (SIGTERM) 07:13:06.506418 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9514): Terminating (SIGTERM) 07:13:06.545805 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9517): Terminating (SIGTERM) 07:13:06.585511 --- ParallelTerminationStrategy: PID 9511 died... 07:13:06.604168 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9511): Terminated: ok {rc=0} 07:13:06.648628 --- ParallelTerminationStrategy: PID 9514 died... 07:13:06.667147 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9514): Terminated: ok {rc=0} 07:13:06.711317 --- ParallelTerminationStrategy: PID 9517 died... 07:13:06.729882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9517): Terminated: ok {rc=0} 07:13:06.813704 bus /sierra_3: Setting Powered False 07:13:07.911403 bus /sierra_3: Setting Powered False 07:13:09.026752 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:13:10.173663 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:13:10.185649 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:13:10.266756 tst mo_mt_call_osmux.py: using LAC 26724 07:13:10.392456 tst mo_mt_call_osmux.py: using RAC 204 07:13:10.517746 tst mo_mt_call_osmux.py: using CellId 26724 07:13:10.636027 tst mo_mt_call_osmux.py: using BVCI 26725 07:13:10.744645 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:13:10.755798 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:13:10.766701 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:13:10.778140 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:13:10.789656 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:13:10.800708 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:13:10.915407 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:13:11.033787 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:13:11.520915 run create_hlr_db(pid=9520): Launched 07:13:11.649596 bus /sierra_2: Setting Powered False 07:13:12.711985 run create_hlr_db(pid=9520): Terminated: ok {rc=0} 07:13:13.132147 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9522): Launched 07:13:13.428646 run osmo-hlr_10.42.42.2(pid=9523): Launched 07:13:13.541405 run osmo-stp_10.42.42.5: Starting osmo-stp 07:13:14.046459 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9525): Launched 07:13:14.340457 run osmo-stp_10.42.42.5(pid=9526): Launched 07:13:14.454061 run osmo-msc_10.42.42.6: Starting osmo-msc 07:13:14.986556 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9528): Launched 07:13:15.279547 run osmo-msc_10.42.42.6(pid=9529): Launched 07:13:15.445127 run osmo-stp_10.42.42.5(pid=9526): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9526)] 07:13:15.570388 run osmo-stp_10.42.42.5(pid=9526): stdout: | (launched: 2022-12-10_07:13:14.286709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:15.695133 run osmo-stp_10.42.42.5(pid=9526): stderr: | [0;m[38;5;43m20221210071314456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071314456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071314456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071314457 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071314457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071314457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071314457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:15.817256 run osmo-stp_10.42.42.5(pid=9526): stdout: | (launched: 2022-12-10_07:13:14.286709) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:15.951068 run osmo-stp_10.42.42.5(pid=9526): stderr: | [0;m[38;5;43m20221210071314456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071314456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071314456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071314457 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071314457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071314457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071314457 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:16.094497 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9526): Process ended prematurely: osmo-stp_10.42.42.5(pid=9526) [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9526)] [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:13:16.104110 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 07:13:16.132840 run osmo-hlr_10.42.42.2(pid=9523): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9523)] 07:13:16.182041 run osmo-hlr_10.42.42.2(pid=9523): stdout: | (launched: 2022-12-10_07:13:13.375117) 07:13:16.232818 run osmo-hlr_10.42.42.2(pid=9523): stderr: | [0;m[1;31m20221210071313552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071313552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071313552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071313552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071313553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071313553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071313564 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071313574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071313575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071313575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:13:16.363969 run osmo-msc_10.42.42.6(pid=9529): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9529)] 07:13:16.415284 run osmo-msc_10.42.42.6(pid=9529): stdout: | (launched: 2022-12-10_07:13:15.226189) 07:13:16.464766 run osmo-msc_10.42.42.6(pid=9529): stderr: | [0;m[38;5;43m20221210071315497 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071315497 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fbb74fa9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071315497 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071315497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071315498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071315498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071315499 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071315500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071315500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071315500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:13:16.571928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9522): Terminating (SIGTERM) 07:13:16.614236 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9525): Terminating (SIGTERM) 07:13:16.655995 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9528): Terminating (SIGTERM) 07:13:16.697970 --- ParallelTerminationStrategy: PID 9522 died... 07:13:16.718465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9522): Terminated: ok {rc=0} 07:13:16.765389 --- ParallelTerminationStrategy: PID 9525 died... 07:13:16.784705 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9525): Terminated: ok {rc=0} 07:13:16.831718 --- ParallelTerminationStrategy: PID 9528 died... 07:13:16.851195 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9528): Terminated: ok {rc=0} 07:13:16.940896 bus /sierra_3: Setting Powered False 07:13:18.037540 bus /sierra_3: Setting Powered False 07:13:19.150711 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:13:20.404315 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:13:20.411949 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:13:20.445585 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:13:20.472670 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:13:20.525723 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:13:20.560120 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:13:20.587190 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:13:21.138166 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:13:21.188505 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:13:21.199937 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:13:21.270670 tst mo_mt_call.py: using LAC 26725 07:13:21.396017 tst mo_mt_call.py: using RAC 205 07:13:21.521370 tst mo_mt_call.py: using CellId 26725 07:13:21.649367 tst mo_mt_call.py: using BVCI 26726 07:13:21.763618 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:13:21.774968 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:13:21.786219 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:13:21.797496 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:13:21.808713 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:13:21.819944 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:13:21.939255 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:13:22.052888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:13:22.508302 run create_hlr_db(pid=9535): Launched 07:13:22.622029 bus /sierra_2: Setting Powered False 07:13:23.681182 run create_hlr_db(pid=9535): Terminated: ok {rc=0} 07:13:24.110268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9537): Launched 07:13:24.425388 run osmo-hlr_10.42.42.2(pid=9538): Launched 07:13:24.546480 run osmo-stp_10.42.42.5: Starting osmo-stp 07:13:25.087433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9540): Launched 07:13:25.402412 run osmo-stp_10.42.42.5(pid=9541): Launched 07:13:25.524158 run osmo-msc_10.42.42.6: Starting osmo-msc 07:13:26.093500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9543): Launched 07:13:26.407458 run osmo-msc_10.42.42.6(pid=9544): Launched 07:13:26.584676 run osmo-stp_10.42.42.5(pid=9541): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9541)] 07:13:26.717232 run osmo-stp_10.42.42.5(pid=9541): stdout: | (launched: 2022-12-10_07:13:25.345777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:26.849918 run osmo-stp_10.42.42.5(pid=9541): stderr: | [0;m[38;5;43m20221210071325537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071325537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071325538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071325538 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071325538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071325538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071325538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:26.982000 run osmo-stp_10.42.42.5(pid=9541): stdout: | (launched: 2022-12-10_07:13:25.345777) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:27.107430 run osmo-stp_10.42.42.5(pid=9541): stderr: | [0;m[38;5;43m20221210071325537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071325537 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071325538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071325538 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071325538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071325538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071325538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:27.257953 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9541): Process ended prematurely: osmo-stp_10.42.42.5(pid=9541) [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9541)] [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:13:27.267582 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:13:27.295346 run osmo-hlr_10.42.42.2(pid=9538): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9538)] 07:13:27.345452 run osmo-hlr_10.42.42.2(pid=9538): stdout: | (launched: 2022-12-10_07:13:24.368032) 07:13:27.396662 run osmo-hlr_10.42.42.2(pid=9538): stderr: | [0;m[1;31m20221210071324566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071324566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071324566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071324566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071324566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071324566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071324581 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071324589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071324590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071324590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:13:27.468854 run osmo-msc_10.42.42.6(pid=9544): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9544)] 07:13:27.518718 run osmo-msc_10.42.42.6(pid=9544): stdout: | (launched: 2022-12-10_07:13:26.350706) 07:13:27.570201 run osmo-msc_10.42.42.6(pid=9544): stderr: | [0;m[38;5;43m20221210071326671 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071326671 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6c68f86c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071326671 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071326671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071326672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071326672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071326674 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071326674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071326674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071326674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:13:27.621953 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9537): Terminating (SIGTERM) 07:13:27.663364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9540): Terminating (SIGTERM) 07:13:27.704756 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9543): Terminating (SIGTERM) 07:13:27.746562 --- ParallelTerminationStrategy: PID 9537 died... 07:13:27.766570 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9537): Terminated: ok {rc=0} 07:13:27.812735 --- ParallelTerminationStrategy: PID 9540 died... 07:13:27.832120 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9540): Terminated: ok {rc=0} 07:13:27.878382 --- ParallelTerminationStrategy: PID 9543 died... 07:13:27.898036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9543): Terminated: ok {rc=0} 07:13:27.986381 bus /sierra_3: Setting Powered False 07:13:29.086327 bus /sierra_3: Setting Powered False 07:13:30.203807 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:13:31.348510 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:13:31.361178 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:13:31.433782 tst mo_mt_call_osmux.py: using LAC 26726 07:13:31.582853 tst mo_mt_call_osmux.py: using RAC 206 07:13:31.738240 tst mo_mt_call_osmux.py: using CellId 26726 07:13:31.901792 tst mo_mt_call_osmux.py: using BVCI 26727 07:13:32.010917 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:13:32.022896 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:13:32.035740 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:13:32.048710 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:13:32.060605 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:13:32.073345 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:13:32.192490 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:13:32.314673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:13:32.769024 run create_hlr_db(pid=9546): Launched 07:13:32.883025 bus /sierra_2: Setting Powered False 07:13:33.946606 run create_hlr_db(pid=9546): Terminated: ok {rc=0} 07:13:34.384422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9548): Launched 07:13:34.700628 run osmo-hlr_10.42.42.2(pid=9549): Launched 07:13:34.820868 run osmo-stp_10.42.42.5: Starting osmo-stp 07:13:35.366339 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9551): Launched 07:13:35.681261 run osmo-stp_10.42.42.5(pid=9552): Launched 07:13:35.801817 run osmo-msc_10.42.42.6: Starting osmo-msc 07:13:36.377316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9554): Launched 07:13:36.692155 run osmo-msc_10.42.42.6(pid=9555): Launched 07:13:36.868309 run osmo-stp_10.42.42.5(pid=9552): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9552)] 07:13:37.000390 run osmo-stp_10.42.42.5(pid=9552): stdout: | (launched: 2022-12-10_07:13:35.624241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:37.133383 run osmo-stp_10.42.42.5(pid=9552): stderr: | [0;m[38;5;43m20221210071335815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071335815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071335816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071335816 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071335818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071335819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071335819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:37.265862 run osmo-stp_10.42.42.5(pid=9552): stdout: | (launched: 2022-12-10_07:13:35.624241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:37.391797 run osmo-stp_10.42.42.5(pid=9552): stderr: | [0;m[38;5;43m20221210071335815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071335815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071335816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071335816 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071335818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071335819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071335819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:37.542626 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9552): Process ended prematurely: osmo-stp_10.42.42.5(pid=9552) [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9552)] [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:13:37.551854 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:13:37.579450 run osmo-hlr_10.42.42.2(pid=9549): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9549)] 07:13:37.629455 run osmo-hlr_10.42.42.2(pid=9549): stdout: | (launched: 2022-12-10_07:13:34.642921) 07:13:37.681409 run osmo-hlr_10.42.42.2(pid=9549): stderr: | [0;m[1;31m20221210071334842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071334842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071334842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071334842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071334842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071334842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071334855 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071334863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071334863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071334863 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:13:37.753257 run osmo-msc_10.42.42.6(pid=9555): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9555)] 07:13:37.803029 run osmo-msc_10.42.42.6(pid=9555): stdout: | (launched: 2022-12-10_07:13:36.635467) 07:13:37.854385 run osmo-msc_10.42.42.6(pid=9555): stderr: | [0;m[38;5;43m20221210071336959 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071336959 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f88be04dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071336959 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071336959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071336959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071336960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071336961 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071336962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071336962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071336962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:13:37.906146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9548): Terminating (SIGTERM) 07:13:37.947267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9551): Terminating (SIGTERM) 07:13:37.988546 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9554): Terminating (SIGTERM) 07:13:38.030052 --- ParallelTerminationStrategy: PID 9548 died... 07:13:38.049866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9548): Terminated: ok {rc=0} 07:13:38.095933 --- ParallelTerminationStrategy: PID 9551 died... 07:13:38.115349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9551): Terminated: ok {rc=0} 07:13:38.160886 --- ParallelTerminationStrategy: PID 9554 died... 07:13:38.180633 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9554): Terminated: ok {rc=0} 07:13:38.266867 bus /sierra_3: Setting Powered False 07:13:39.364327 bus /sierra_3: Setting Powered False 07:13:40.480039 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:13:41.732166 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:13:41.739120 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:13:41.772677 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:13:41.799673 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:13:41.853449 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:13:41.887422 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:13:41.914140 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:13:42.464874 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:13:42.515446 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:13:42.526872 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:13:42.599803 tst mo_mt_call.py: using LAC 26727 07:13:42.721750 tst mo_mt_call.py: using RAC 207 07:13:42.843742 tst mo_mt_call.py: using CellId 26727 07:13:42.965395 tst mo_mt_call.py: using BVCI 26728 07:13:43.079141 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:13:43.090605 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:13:43.101878 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:13:43.113091 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:13:43.124342 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:13:43.135716 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:13:43.250218 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:13:43.369939 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:13:43.858980 run create_hlr_db(pid=9560): Launched 07:13:43.986953 bus /sierra_2: Setting Powered False 07:13:45.049595 run create_hlr_db(pid=9560): Terminated: ok {rc=0} 07:13:45.489257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9562): Launched 07:13:45.803648 run osmo-hlr_10.42.42.2(pid=9563): Launched 07:13:46.024527 run osmo-stp_10.42.42.5: Starting osmo-stp 07:13:46.663904 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9565): Launched 07:13:46.998443 run osmo-stp_10.42.42.5(pid=9566): Launched 07:13:47.294603 run osmo-msc_10.42.42.6: Starting osmo-msc 07:13:47.830505 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9568): Launched 07:13:48.124299 run osmo-msc_10.42.42.6(pid=9569): Launched 07:13:48.289191 run osmo-stp_10.42.42.5(pid=9566): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9566)] 07:13:48.414587 run osmo-stp_10.42.42.5(pid=9566): stdout: | (launched: 2022-12-10_07:13:46.936729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:48.540114 run osmo-stp_10.42.42.5(pid=9566): stderr: | [0;m[38;5;43m20221210071347147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071347147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071347147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071347147 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071347148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071347148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071347148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:48.662742 run osmo-stp_10.42.42.5(pid=9566): stdout: | (launched: 2022-12-10_07:13:46.936729) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:48.779795 run osmo-stp_10.42.42.5(pid=9566): stderr: | [0;m[38;5;43m20221210071347147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071347147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071347147 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071347147 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071347148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071347148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071347148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:48.920544 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9566): Process ended prematurely: osmo-stp_10.42.42.5(pid=9566) [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9566)] [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:13:48.929463 tst mo_mt_call.py:8: Test FAILED (6.5 sec) 07:13:48.955919 run osmo-hlr_10.42.42.2(pid=9563): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9563)] 07:13:49.003897 run osmo-hlr_10.42.42.2(pid=9563): stdout: | (launched: 2022-12-10_07:13:45.746917) 07:13:49.053182 run osmo-hlr_10.42.42.2(pid=9563): stderr: | [0;m[1;31m20221210071345967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071345967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071345967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071345967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071345967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071345967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071345983 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071345999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071345999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071346000 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:13:49.121572 run osmo-msc_10.42.42.6(pid=9569): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9569)] 07:13:49.169172 run osmo-msc_10.42.42.6(pid=9569): stdout: | (launched: 2022-12-10_07:13:48.070854) 07:13:49.218010 run osmo-msc_10.42.42.6(pid=9569): stderr: | [0;m[38;5;43m20221210071348341 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071348341 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdc09e93c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071348341 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071348341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071348342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071348342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071348345 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071348346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071348346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071348346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:13:49.267353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9562): Terminating (SIGTERM) 07:13:49.307043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9565): Terminating (SIGTERM) 07:13:49.346975 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9568): Terminating (SIGTERM) 07:13:49.387129 --- ParallelTerminationStrategy: PID 9562 died... 07:13:49.406117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9562): Terminated: ok {rc=0} 07:13:49.450213 --- ParallelTerminationStrategy: PID 9565 died... 07:13:49.468639 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9565): Terminated: ok {rc=0} 07:13:49.513388 --- ParallelTerminationStrategy: PID 9568 died... 07:13:49.532064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9568): Terminated: ok {rc=0} 07:13:49.616323 bus /sierra_3: Setting Powered False 07:13:50.713838 bus /sierra_3: Setting Powered False 07:13:51.830964 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:13:52.974857 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:13:52.986518 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:13:53.055609 tst mo_mt_call_osmux.py: using LAC 26728 07:13:53.170566 tst mo_mt_call_osmux.py: using RAC 208 07:13:53.287568 tst mo_mt_call_osmux.py: using CellId 26728 07:13:53.404845 tst mo_mt_call_osmux.py: using BVCI 26729 07:13:53.511144 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:13:53.522146 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:13:53.532817 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:13:53.543871 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:13:53.554875 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:13:53.565966 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:13:53.685461 tst voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:13:53.805129 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:13:54.292072 run create_hlr_db(pid=9571): Launched 07:13:54.421452 bus /sierra_2: Setting Powered False 07:13:55.484153 run create_hlr_db(pid=9571): Terminated: ok {rc=0} 07:13:55.903491 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9573): Launched 07:13:56.197074 run osmo-hlr_10.42.42.2(pid=9574): Launched 07:13:56.309090 run osmo-stp_10.42.42.5: Starting osmo-stp 07:13:56.825772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9576): Launched 07:13:57.119791 run osmo-stp_10.42.42.5(pid=9577): Launched 07:13:57.232455 run osmo-msc_10.42.42.6: Starting osmo-msc 07:13:57.765099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9579): Launched 07:13:58.059287 run osmo-msc_10.42.42.6(pid=9580): Launched 07:13:58.224624 run osmo-stp_10.42.42.5(pid=9577): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9577)] 07:13:58.349240 run osmo-stp_10.42.42.5(pid=9577): stdout: | (launched: 2022-12-10_07:13:57.066325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:58.474172 run osmo-stp_10.42.42.5(pid=9577): stderr: | [0;m[38;5;43m20221210071357235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071357235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071357235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071357235 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071357236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071357236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071357236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:58.596537 run osmo-stp_10.42.42.5(pid=9577): stdout: | (launched: 2022-12-10_07:13:57.066325) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:13:58.713616 run osmo-stp_10.42.42.5(pid=9577): stderr: | [0;m[38;5;43m20221210071357235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071357235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071357235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071357235 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071357236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071357236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071357236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:13:58.854061 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9577): Process ended prematurely: osmo-stp_10.42.42.5(pid=9577) [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9577)] [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:13:58.863039 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 07:13:58.889737 run osmo-hlr_10.42.42.2(pid=9574): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9574)] 07:13:58.937306 run osmo-hlr_10.42.42.2(pid=9574): stdout: | (launched: 2022-12-10_07:13:56.143947) 07:13:58.986779 run osmo-hlr_10.42.42.2(pid=9574): stderr: | [0;m[1;31m20221210071356316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071356316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071356316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071356316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071356316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071356316 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071356328 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071356337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071356338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071356338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:13:59.055288 run osmo-msc_10.42.42.6(pid=9580): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9580)] 07:13:59.102917 run osmo-msc_10.42.42.6(pid=9580): stdout: | (launched: 2022-12-10_07:13:58.005852) 07:13:59.152129 run osmo-msc_10.42.42.6(pid=9580): stderr: | [0;m[38;5;43m20221210071358277 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071358278 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f118631ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071358278 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071358278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071358278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071358278 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071358280 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071358280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071358280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071358280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:13:59.201634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9573): Terminating (SIGTERM) 07:13:59.241316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9576): Terminating (SIGTERM) 07:13:59.281196 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9579): Terminating (SIGTERM) 07:13:59.321150 --- ParallelTerminationStrategy: PID 9573 died... 07:13:59.340124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9573): Terminated: ok {rc=0} 07:13:59.384448 --- ParallelTerminationStrategy: PID 9576 died... 07:13:59.402943 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9576): Terminated: ok {rc=0} 07:13:59.447143 --- ParallelTerminationStrategy: PID 9579 died... 07:13:59.465647 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9579): Terminated: ok {rc=0} 07:13:59.551654 bus /sierra_3: Setting Powered False 07:14:00.649201 bus /sierra_3: Setting Powered False 07:14:01.760262 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 07:14:03.012846 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:14:03.019807 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 07:14:03.053319 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 07:14:03.080201 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 07:14:03.134427 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 07:14:03.168433 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 07:14:03.195464 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 07:14:03.745806 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 07:14:03.795874 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:14:03.807235 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:14:03.880776 tst mo_mt_call.py: using LAC 26729 07:14:04.004787 tst mo_mt_call.py: using RAC 209 07:14:04.126949 tst mo_mt_call.py: using CellId 26729 07:14:04.248441 tst mo_mt_call.py: using BVCI 26730 07:14:04.362505 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:14:04.373922 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:14:04.385080 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:14:04.396202 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:14:04.407551 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:14:04.418773 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:14:04.533485 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:14:04.653182 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:14:05.140504 run create_hlr_db(pid=9585): Launched 07:14:05.268864 bus /sierra_2: Setting Powered False 07:14:06.332288 run create_hlr_db(pid=9585): Terminated: ok {rc=0} 07:14:06.753533 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9587): Launched 07:14:07.070889 run osmo-hlr_10.42.42.2(pid=9588): Launched 07:14:07.190915 run osmo-stp_10.42.42.5: Starting osmo-stp 07:14:07.732825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9590): Launched 07:14:08.047344 run osmo-stp_10.42.42.5(pid=9591): Launched 07:14:08.167201 run osmo-msc_10.42.42.6: Starting osmo-msc 07:14:08.739778 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9593): Launched 07:14:09.055567 run osmo-msc_10.42.42.6(pid=9594): Launched 07:14:09.231746 run osmo-stp_10.42.42.5(pid=9591): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9591)] 07:14:09.369165 run osmo-stp_10.42.42.5(pid=9591): stdout: | (launched: 2022-12-10_07:14:07.990549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:09.501033 run osmo-stp_10.42.42.5(pid=9591): stderr: | [0;m[38;5;43m20221210071408180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071408180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071408180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071408181 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071408183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071408183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071408183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:09.632123 run osmo-stp_10.42.42.5(pid=9591): stdout: | (launched: 2022-12-10_07:14:07.990549) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:09.757436 run osmo-stp_10.42.42.5(pid=9591): stderr: | [0;m[38;5;43m20221210071408180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071408180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071408180 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071408181 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071408183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071408183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071408183 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:09.906953 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9591): Process ended prematurely: osmo-stp_10.42.42.5(pid=9591) [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9591)] [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 07:14:09.916166 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:14:09.943526 run osmo-hlr_10.42.42.2(pid=9588): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9588)] 07:14:09.993214 run osmo-hlr_10.42.42.2(pid=9588): stdout: | (launched: 2022-12-10_07:14:07.013814) 07:14:10.044342 run osmo-hlr_10.42.42.2(pid=9588): stderr: | [0;m[1;31m20221210071407212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071407212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071407212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071407212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071407212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071407212 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071407225 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071407233 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071407234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071407234 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:14:10.115330 run osmo-msc_10.42.42.6(pid=9594): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9594)] 07:14:10.164814 run osmo-msc_10.42.42.6(pid=9594): stdout: | (launched: 2022-12-10_07:14:08.998669) 07:14:10.215919 run osmo-msc_10.42.42.6(pid=9594): stderr: | [0;m[38;5;43m20221210071409323 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071409323 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb2f9bc6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071409323 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071409323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071409323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071409324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071409325 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071409326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071409326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071409326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:14:10.267021 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9587): Terminating (SIGTERM) 07:14:10.307909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9590): Terminating (SIGTERM) 07:14:10.349366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9593): Terminating (SIGTERM) 07:14:10.390855 --- ParallelTerminationStrategy: PID 9587 died... 07:14:10.410677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9587): Terminated: ok {rc=0} 07:14:10.456689 --- ParallelTerminationStrategy: PID 9590 died... 07:14:10.476318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9590): Terminated: ok {rc=0} 07:14:10.522042 --- ParallelTerminationStrategy: PID 9593 died... 07:14:10.541432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9593): Terminated: ok {rc=0} 07:14:10.628830 bus /sierra_3: Setting Powered False 07:14:11.729806 bus /sierra_3: Setting Powered False 07:14:12.844888 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 07:14:13.992232 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:14:14.004148 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:14:14.074586 tst mo_mt_call_osmux.py: using LAC 26730 07:14:14.198163 tst mo_mt_call_osmux.py: using RAC 210 07:14:14.322969 tst mo_mt_call_osmux.py: using CellId 26730 07:14:14.446631 tst mo_mt_call_osmux.py: using BVCI 26731 07:14:14.562129 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:14:14.573520 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:14:14.584693 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:14:14.595961 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:14:14.607275 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:14:14.618589 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:14:14.733830 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:14:14.851869 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:14:15.307994 run create_hlr_db(pid=9596): Launched 07:14:15.422136 bus /sierra_2: Setting Powered False 07:14:16.483962 run create_hlr_db(pid=9596): Terminated: ok {rc=0} 07:14:16.909730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9598): Launched 07:14:17.228792 run osmo-hlr_10.42.42.2(pid=9599): Launched 07:14:17.344573 run osmo-stp_10.42.42.5: Starting osmo-stp 07:14:17.855131 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9601): Launched 07:14:18.147946 run osmo-stp_10.42.42.5(pid=9602): Launched 07:14:18.260310 run osmo-msc_10.42.42.6: Starting osmo-msc 07:14:18.788683 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9604): Launched 07:14:19.081928 run osmo-msc_10.42.42.6(pid=9605): Launched 07:14:19.246208 run osmo-stp_10.42.42.5(pid=9602): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9602)] 07:14:19.377733 run osmo-stp_10.42.42.5(pid=9602): stdout: | (launched: 2022-12-10_07:14:18.094904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:19.513436 run osmo-stp_10.42.42.5(pid=9602): stderr: | [0;m[38;5;43m20221210071418262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071418263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071418263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071418263 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071418264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071418264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071418264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:19.646333 run osmo-stp_10.42.42.5(pid=9602): stdout: | (launched: 2022-12-10_07:14:18.094904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:19.772186 run osmo-stp_10.42.42.5(pid=9602): stderr: | [0;m[38;5;43m20221210071418262 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071418263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071418263 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071418263 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071418264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071418264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071418264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:19.922605 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9602): Process ended prematurely: osmo-stp_10.42.42.5(pid=9602) [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9602)] [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 07:14:19.932022 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 07:14:19.960325 run osmo-hlr_10.42.42.2(pid=9599): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9599)] 07:14:20.010064 run osmo-hlr_10.42.42.2(pid=9599): stdout: | (launched: 2022-12-10_07:14:17.168061) 07:14:20.061553 run osmo-hlr_10.42.42.2(pid=9599): stderr: | [0;m[1;31m20221210071417348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071417348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071417348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071417348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071417348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071417348 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071417360 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071417369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071417369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071417369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:14:20.133185 run osmo-msc_10.42.42.6(pid=9605): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9605)] 07:14:20.182858 run osmo-msc_10.42.42.6(pid=9605): stdout: | (launched: 2022-12-10_07:14:19.028331) 07:14:20.234634 run osmo-msc_10.42.42.6(pid=9605): stderr: | [0;m[38;5;43m20221210071419297 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071419297 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc91c602c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071419297 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071419297 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071419298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071419298 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071419299 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071419300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071419300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071419300 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:14:20.286223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9598): Terminating (SIGTERM) 07:14:20.327979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9601): Terminating (SIGTERM) 07:14:20.369998 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9604): Terminating (SIGTERM) 07:14:20.411676 --- ParallelTerminationStrategy: PID 9598 died... 07:14:20.432071 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9598): Terminated: ok {rc=0} 07:14:20.479415 --- ParallelTerminationStrategy: PID 9601 died... 07:14:20.498953 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9601): Terminated: ok {rc=0} 07:14:20.545817 --- ParallelTerminationStrategy: PID 9604 died... 07:14:20.565291 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9604): Terminated: ok {rc=0} 07:14:20.654643 bus /sierra_3: Setting Powered False 07:14:21.751012 bus /sierra_3: Setting Powered False 07:14:22.868283 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:14:24.120813 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:14:24.128056 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:14:24.162104 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:14:24.189262 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:14:24.241344 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:14:24.274979 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:14:24.302083 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:14:24.854024 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:14:24.903355 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:14:24.915487 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:14:24.983825 tst mo_mt_call.py: using LAC 26731 07:14:25.099095 tst mo_mt_call.py: using RAC 211 07:14:25.215362 tst mo_mt_call.py: using CellId 26731 07:14:25.340506 tst mo_mt_call.py: using BVCI 26732 07:14:25.454693 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:14:25.466265 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:14:25.477653 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:14:25.489163 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:14:25.500754 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:14:25.512175 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:14:25.628908 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:14:25.746446 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:14:26.234322 run create_hlr_db(pid=9612): Launched 07:14:26.362687 bus /sierra_2: Setting Powered False 07:14:27.425072 run create_hlr_db(pid=9612): Terminated: ok {rc=0} 07:14:27.865634 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9614): Launched 07:14:28.178771 run osmo-hlr_10.42.42.2(pid=9615): Launched 07:14:28.298757 run osmo-stp_10.42.42.5: Starting osmo-stp 07:14:28.843309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9617): Launched 07:14:29.157224 run osmo-stp_10.42.42.5(pid=9618): Launched 07:14:29.277702 run osmo-msc_10.42.42.6: Starting osmo-msc 07:14:29.845781 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9620): Launched 07:14:30.158970 run osmo-msc_10.42.42.6(pid=9621): Launched 07:14:30.334680 run osmo-stp_10.42.42.5(pid=9618): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9618)] 07:14:30.467827 run osmo-stp_10.42.42.5(pid=9618): stdout: | (launched: 2022-12-10_07:14:29.100359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:30.601110 run osmo-stp_10.42.42.5(pid=9618): stderr: | [0;m[38;5;43m20221210071429292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071429292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071429292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071429293 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071429293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071429293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071429293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:30.733699 run osmo-stp_10.42.42.5(pid=9618): stdout: | (launched: 2022-12-10_07:14:29.100359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:30.884189 run osmo-stp_10.42.42.5(pid=9618): stderr: | [0;m[38;5;43m20221210071429292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071429292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071429292 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071429293 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071429293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071429293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071429293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:31.036688 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9618): Process ended prematurely: osmo-stp_10.42.42.5(pid=9618) [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9618)] [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:14:31.047092 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:14:31.075415 run osmo-hlr_10.42.42.2(pid=9615): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9615)] 07:14:31.126401 run osmo-hlr_10.42.42.2(pid=9615): stdout: | (launched: 2022-12-10_07:14:28.122199) 07:14:31.178379 run osmo-hlr_10.42.42.2(pid=9615): stderr: | [0;m[1;31m20221210071428322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071428322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071428322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071428322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071428322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071428322 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071428334 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071428342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071428343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071428343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:14:31.250536 run osmo-msc_10.42.42.6(pid=9621): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9621)] 07:14:31.301186 run osmo-msc_10.42.42.6(pid=9621): stdout: | (launched: 2022-12-10_07:14:30.102329) 07:14:31.353157 run osmo-msc_10.42.42.6(pid=9621): stderr: | [0;m[38;5;43m20221210071430423 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071430423 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7c28accc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071430423 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071430423 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071430424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071430424 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071430425 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071430426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071430426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071430426 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:14:31.405419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9614): Terminating (SIGTERM) 07:14:31.447547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9617): Terminating (SIGTERM) 07:14:31.489882 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9620): Terminating (SIGTERM) 07:14:31.533610 --- ParallelTerminationStrategy: PID 9614 died... 07:14:31.553788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9614): Terminated: ok {rc=0} 07:14:31.600029 --- ParallelTerminationStrategy: PID 9617 died... 07:14:31.619800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9617): Terminated: ok {rc=0} 07:14:31.666387 --- ParallelTerminationStrategy: PID 9620 died... 07:14:31.686398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9620): Terminated: ok {rc=0} 07:14:31.775587 bus /sierra_3: Setting Powered False 07:14:32.873425 bus /sierra_3: Setting Powered False 07:14:33.990453 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 07:14:35.134786 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:14:35.146327 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:14:35.214577 tst mo_mt_call_osmux.py: using LAC 26732 07:14:35.329725 tst mo_mt_call_osmux.py: using RAC 212 07:14:35.446316 tst mo_mt_call_osmux.py: using CellId 26732 07:14:35.562760 tst mo_mt_call_osmux.py: using BVCI 26733 07:14:35.668771 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:14:35.679683 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:14:35.690455 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:14:35.701363 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:14:35.712372 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:14:35.723511 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:14:35.839572 tst voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:14:35.952890 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:14:36.408049 run create_hlr_db(pid=9623): Launched 07:14:36.520323 bus /sierra_2: Setting Powered False 07:14:37.578668 run create_hlr_db(pid=9623): Terminated: ok {rc=0} 07:14:37.990627 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9625): Launched 07:14:38.284659 run osmo-hlr_10.42.42.2(pid=9626): Launched 07:14:38.397411 run osmo-stp_10.42.42.5: Starting osmo-stp 07:14:38.914613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9628): Launched 07:14:39.208474 run osmo-stp_10.42.42.5(pid=9629): Launched 07:14:39.321839 run osmo-msc_10.42.42.6: Starting osmo-msc 07:14:39.854085 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9631): Launched 07:14:40.164814 run osmo-msc_10.42.42.6(pid=9632): Launched 07:14:40.342522 run osmo-stp_10.42.42.5(pid=9629): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9629)] 07:14:40.476686 run osmo-stp_10.42.42.5(pid=9629): stdout: | (launched: 2022-12-10_07:14:39.155081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:40.611261 run osmo-stp_10.42.42.5(pid=9629): stderr: | [0;m[38;5;43m20221210071439323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071439324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071439324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071439324 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071439325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071439325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071439325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:40.745322 run osmo-stp_10.42.42.5(pid=9629): stdout: | (launched: 2022-12-10_07:14:39.155081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:40.870994 run osmo-stp_10.42.42.5(pid=9629): stderr: | [0;m[38;5;43m20221210071439323 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071439324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071439324 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071439324 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071439325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071439325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071439325 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:41.021651 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9629): Process ended prematurely: osmo-stp_10.42.42.5(pid=9629) [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9629)] [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 07:14:41.031191 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 07:14:41.058802 run osmo-hlr_10.42.42.2(pid=9626): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9626)] 07:14:41.108388 run osmo-hlr_10.42.42.2(pid=9626): stdout: | (launched: 2022-12-10_07:14:38.231424) 07:14:41.159746 run osmo-hlr_10.42.42.2(pid=9626): stderr: | [0;m[1;31m20221210071438407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071438407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071438407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071438407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071438407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071438407 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071438419 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071438428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071438428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071438428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:14:41.231342 run osmo-msc_10.42.42.6(pid=9632): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9632)] 07:14:41.281116 run osmo-msc_10.42.42.6(pid=9632): stdout: | (launched: 2022-12-10_07:14:40.107868) 07:14:41.332407 run osmo-msc_10.42.42.6(pid=9632): stderr: | [0;m[38;5;43m20221210071440426 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071440426 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f41b9051c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071440426 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071440426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071440426 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071440427 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071440428 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071440429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071440429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071440429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:14:41.384041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9625): Terminating (SIGTERM) 07:14:41.425313 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9628): Terminating (SIGTERM) 07:14:41.466854 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9631): Terminating (SIGTERM) 07:14:41.508892 --- ParallelTerminationStrategy: PID 9625 died... 07:14:41.528911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9625): Terminated: ok {rc=0} 07:14:41.575052 --- ParallelTerminationStrategy: PID 9628 died... 07:14:41.594626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9628): Terminated: ok {rc=0} 07:14:41.640338 --- ParallelTerminationStrategy: PID 9631 died... 07:14:41.659958 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9631): Terminated: ok {rc=0} 07:14:41.746636 bus /sierra_3: Setting Powered False 07:14:42.844756 bus /sierra_3: Setting Powered False 07:14:43.959257 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:14:45.206794 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:14:45.213074 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:14:45.246221 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 07:14:45.272644 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:14:45.325105 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:14:45.359078 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 07:14:45.386452 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:14:45.947371 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 07:14:45.998609 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:14:46.010620 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:14:46.081681 tst mo_mt_call.py: using LAC 26733 07:14:46.209288 tst mo_mt_call.py: using RAC 213 07:14:46.336149 tst mo_mt_call.py: using CellId 26733 07:14:46.454589 tst mo_mt_call.py: using BVCI 26734 07:14:46.565714 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:14:46.577974 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:14:46.590101 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:14:46.604022 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:14:46.617230 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:14:46.628905 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:14:46.748872 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:14:46.892192 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:14:47.409043 run create_hlr_db(pid=9637): Launched 07:14:47.538355 bus /sierra_2: Setting Powered False 07:14:48.600930 run create_hlr_db(pid=9637): Terminated: ok {rc=0} 07:14:49.039651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9639): Launched 07:14:49.354397 run osmo-hlr_10.42.42.2(pid=9640): Launched 07:14:49.474598 run osmo-stp_10.42.42.5: Starting osmo-stp 07:14:50.013113 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9642): Launched 07:14:50.327494 run osmo-stp_10.42.42.5(pid=9643): Launched 07:14:50.447238 run osmo-msc_10.42.42.6: Starting osmo-msc 07:14:51.014328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9645): Launched 07:14:51.328304 run osmo-msc_10.42.42.6(pid=9646): Launched 07:14:51.504422 run osmo-stp_10.42.42.5(pid=9643): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9643)] 07:14:51.636809 run osmo-stp_10.42.42.5(pid=9643): stdout: | (launched: 2022-12-10_07:14:50.270542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:51.769304 run osmo-stp_10.42.42.5(pid=9643): stderr: | [0;m[38;5;43m20221210071450463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071450464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071450464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071450464 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071450465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071450465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071450465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:51.902147 run osmo-stp_10.42.42.5(pid=9643): stdout: | (launched: 2022-12-10_07:14:50.270542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:14:52.027579 run osmo-stp_10.42.42.5(pid=9643): stderr: | [0;m[38;5;43m20221210071450463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071450464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071450464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071450464 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071450465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071450465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071450465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:14:52.177890 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9643): Process ended prematurely: osmo-stp_10.42.42.5(pid=9643) [trial-2371↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9643)] [trial-2371↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:14:52.187389 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:14:52.215088 run osmo-hlr_10.42.42.2(pid=9640): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9640)] 07:14:52.265157 run osmo-hlr_10.42.42.2(pid=9640): stdout: | (launched: 2022-12-10_07:14:49.297430) 07:14:52.316693 run osmo-hlr_10.42.42.2(pid=9640): stderr: | [0;m[1;31m20221210071449495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071449495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071449495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071449495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071449495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071449495 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071449509 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071449519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071449519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071449519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:14:52.388409 run osmo-msc_10.42.42.6(pid=9646): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9646)] 07:14:52.438150 run osmo-msc_10.42.42.6(pid=9646): stdout: | (launched: 2022-12-10_07:14:51.271491) 07:14:52.489993 run osmo-msc_10.42.42.6(pid=9646): stderr: | [0;m[38;5;43m20221210071451592 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071451592 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f991c644c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071451593 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071451593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071451593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071451593 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071451595 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071451595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071451595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071451595 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:14:52.541930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9639): Terminating (SIGTERM) 07:14:52.583464 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9642): Terminating (SIGTERM) 07:14:52.625183 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9645): Terminating (SIGTERM) 07:14:52.667130 --- ParallelTerminationStrategy: PID 9639 died... 07:14:52.686695 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9639): Terminated: ok {rc=0} 07:14:52.732721 --- ParallelTerminationStrategy: PID 9642 died... 07:14:52.752197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9642): Terminated: ok {rc=0} 07:14:52.798199 --- ParallelTerminationStrategy: PID 9645 died... 07:14:52.817801 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9645): Terminated: ok {rc=0} 07:14:52.905876 bus /sierra_3: Setting Powered False 07:14:54.004356 bus /sierra_3: Setting Powered False 07:14:55.120077 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:14:56.267864 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:14:56.280126 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:14:56.353167 tst mo_mt_call_osmux.py: using LAC 26734 07:14:56.478475 tst mo_mt_call_osmux.py: using RAC 214 07:14:56.603012 tst mo_mt_call_osmux.py: using CellId 26734 07:14:56.728600 tst mo_mt_call_osmux.py: using BVCI 26735 07:14:56.843140 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:14:56.854806 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:14:56.866337 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:14:56.878415 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:14:56.890379 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:14:56.902165 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:14:57.015849 tst voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:14:57.135049 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:14:57.623829 run create_hlr_db(pid=9648): Launched 07:14:57.752546 bus /sierra_2: Setting Powered False 07:14:58.815388 run create_hlr_db(pid=9648): Terminated: ok {rc=0} 07:14:59.235955 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9650): Launched 07:14:59.531227 run osmo-hlr_10.42.42.2(pid=9651): Launched 07:14:59.645076 run osmo-stp_10.42.42.5: Starting osmo-stp 07:15:00.152783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9653): Launched 07:15:00.448191 run osmo-stp_10.42.42.5(pid=9654): Launched 07:15:00.561077 run osmo-msc_10.42.42.6: Starting osmo-msc 07:15:01.149773 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9656): Launched 07:15:01.463016 run osmo-msc_10.42.42.6(pid=9657): Launched 07:15:01.772235 run osmo-stp_10.42.42.5(pid=9654): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9654)] 07:15:02.071200 run osmo-stp_10.42.42.5(pid=9654): stdout: | (launched: 2022-12-10_07:15:00.394661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:02.319193 run osmo-stp_10.42.42.5(pid=9654): stderr: | [0;m[38;5;43m20221210071500565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071500565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071500566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071500566 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071500566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071500567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071500567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:02.444547 run osmo-stp_10.42.42.5(pid=9654): stdout: | (launched: 2022-12-10_07:15:00.394661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:02.563294 run osmo-stp_10.42.42.5(pid=9654): stderr: | [0;m[38;5;43m20221210071500565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071500565 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071500566 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071500566 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071500566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071500567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071500567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:02.704500 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9654): Process ended prematurely: osmo-stp_10.42.42.5(pid=9654) [trial-2371↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9654)] [trial-2371↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:15:02.713550 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 07:15:02.740562 run osmo-hlr_10.42.42.2(pid=9651): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9651)] 07:15:02.789468 run osmo-hlr_10.42.42.2(pid=9651): stdout: | (launched: 2022-12-10_07:14:59.477918) 07:15:02.839434 run osmo-hlr_10.42.42.2(pid=9651): stderr: | [0;m[1;31m20221210071459652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071459652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071459652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071459652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071459652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071459652 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071459664 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071459673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071459673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071459673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:15:02.908859 run osmo-msc_10.42.42.6(pid=9657): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9657)] 07:15:02.957234 run osmo-msc_10.42.42.6(pid=9657): stdout: | (launched: 2022-12-10_07:15:01.402127) 07:15:03.007165 run osmo-msc_10.42.42.6(pid=9657): stderr: | [0;m[38;5;43m20221210071501974 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071501974 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd645209c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071501974 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071501974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071501974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071501974 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071501976 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071501977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071501977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071501977 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:15:03.057590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9650): Terminating (SIGTERM) 07:15:03.097495 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9653): Terminating (SIGTERM) 07:15:03.137677 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9656): Terminating (SIGTERM) 07:15:03.178051 --- ParallelTerminationStrategy: PID 9650 died... 07:15:03.197230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9650): Terminated: ok {rc=0} 07:15:03.242137 --- ParallelTerminationStrategy: PID 9653 died... 07:15:03.260713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9653): Terminated: ok {rc=0} 07:15:03.305376 --- ParallelTerminationStrategy: PID 9656 died... 07:15:03.324036 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9656): Terminated: ok {rc=0} 07:15:03.411009 bus /sierra_3: Setting Powered False 07:15:04.509785 bus /sierra_3: Setting Powered False 07:15:05.625622 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:15:06.877855 tst voice:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:15:06.883414 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:15:06.916873 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 07:15:06.943367 tst voice:trx-b200+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 07:15:06.992942 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:15:07.025651 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 07:15:07.051665 tst voice:trx-b200+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 07:15:07.601534 tst voice:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 07:15:07.649670 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:15:07.660500 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:15:07.728681 tst mo_mt_call.py: using LAC 26735 07:15:07.842733 tst mo_mt_call.py: using RAC 215 07:15:07.956890 tst mo_mt_call.py: using CellId 26735 07:15:08.073736 tst mo_mt_call.py: using BVCI 26736 07:15:08.181437 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:15:08.192024 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:15:08.202560 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:15:08.213485 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:15:08.224471 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:15:08.235425 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:15:08.352928 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:15:08.468732 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:15:08.922430 run create_hlr_db(pid=9666): Launched 07:15:09.034934 bus /sierra_2: Setting Powered False 07:15:10.094525 run create_hlr_db(pid=9666): Terminated: ok {rc=0} 07:15:10.504188 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9668): Launched 07:15:10.797974 run osmo-hlr_10.42.42.2(pid=9669): Launched 07:15:10.910333 run osmo-stp_10.42.42.5: Starting osmo-stp 07:15:11.412878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9671): Launched 07:15:11.706178 run osmo-stp_10.42.42.5(pid=9672): Launched 07:15:11.819164 run osmo-msc_10.42.42.6: Starting osmo-msc 07:15:12.361624 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9674): Launched 07:15:12.655963 run osmo-msc_10.42.42.6(pid=9675): Launched 07:15:12.822211 run osmo-stp_10.42.42.5(pid=9672): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9672)] 07:15:12.947392 run osmo-stp_10.42.42.5(pid=9672): stdout: | (launched: 2022-12-10_07:15:11.652925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:13.072919 run osmo-stp_10.42.42.5(pid=9672): stderr: | [0;m[38;5;43m20221210071511822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071511822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071511822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071511823 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071511823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071511823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071511823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:13.195549 run osmo-stp_10.42.42.5(pid=9672): stdout: | (launched: 2022-12-10_07:15:11.652925) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:13.312749 run osmo-stp_10.42.42.5(pid=9672): stderr: | [0;m[38;5;43m20221210071511822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071511822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071511822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071511823 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071511823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071511823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071511823 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:13.454006 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9672): Process ended prematurely: osmo-stp_10.42.42.5(pid=9672) [trial-2371↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9672)] [trial-2371↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 07:15:13.463139 tst mo_mt_call.py:8: Test FAILED (5.8 sec) 07:15:13.490018 run osmo-hlr_10.42.42.2(pid=9669): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9669)] 07:15:13.538173 run osmo-hlr_10.42.42.2(pid=9669): stdout: | (launched: 2022-12-10_07:15:10.744600) 07:15:13.587429 run osmo-hlr_10.42.42.2(pid=9669): stderr: | [0;m[1;31m20221210071510919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071510919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071510919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071510919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071510919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071510919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071510931 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071510939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071510939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071510939 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:15:13.656201 run osmo-msc_10.42.42.6(pid=9675): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9675)] 07:15:13.703949 run osmo-msc_10.42.42.6(pid=9675): stdout: | (launched: 2022-12-10_07:15:12.602665) 07:15:13.753241 run osmo-msc_10.42.42.6(pid=9675): stderr: | [0;m[38;5;43m20221210071512875 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071512875 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe06413fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071512875 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071512875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071512875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071512875 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071512877 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071512877 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071512878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071512878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:15:13.802751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9668): Terminating (SIGTERM) 07:15:13.842221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9671): Terminating (SIGTERM) 07:15:13.881635 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9674): Terminating (SIGTERM) 07:15:13.921249 --- ParallelTerminationStrategy: PID 9668 died... 07:15:13.940094 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9668): Terminated: ok {rc=0} 07:15:13.984189 --- ParallelTerminationStrategy: PID 9671 died... 07:15:14.002758 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9671): Terminated: ok {rc=0} 07:15:14.046939 --- ParallelTerminationStrategy: PID 9674 died... 07:15:14.065528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9674): Terminated: ok {rc=0} 07:15:14.148571 bus /sierra_3: Setting Powered False 07:15:15.245999 bus /sierra_3: Setting Powered False 07:15:16.370765 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 07:15:17.529830 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:15:17.541657 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:15:17.613439 tst mo_mt_call_osmux.py: using LAC 26736 07:15:17.729743 tst mo_mt_call_osmux.py: using RAC 216 07:15:17.845395 tst mo_mt_call_osmux.py: using CellId 26736 07:15:17.962690 tst mo_mt_call_osmux.py: using BVCI 26737 07:15:18.069777 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:15:18.080675 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:15:18.091407 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:15:18.102555 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:15:18.113401 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:15:18.124160 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:15:18.236562 tst voice:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:15:18.355742 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:15:18.847270 run create_hlr_db(pid=9677): Launched 07:15:18.976313 bus /sierra_2: Setting Powered False 07:15:20.039661 run create_hlr_db(pid=9677): Terminated: ok {rc=0} 07:15:20.462376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9679): Launched 07:15:20.756908 run osmo-hlr_10.42.42.2(pid=9680): Launched 07:15:20.869546 run osmo-stp_10.42.42.5: Starting osmo-stp 07:15:21.392190 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9682): Launched 07:15:21.687290 run osmo-stp_10.42.42.5(pid=9683): Launched 07:15:21.800461 run osmo-msc_10.42.42.6: Starting osmo-msc 07:15:22.332436 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9685): Launched 07:15:22.627964 run osmo-msc_10.42.42.6(pid=9686): Launched 07:15:22.793198 run osmo-stp_10.42.42.5(pid=9683): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9683)] 07:15:22.917557 run osmo-stp_10.42.42.5(pid=9683): stdout: | (launched: 2022-12-10_07:15:21.633944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:23.041974 run osmo-stp_10.42.42.5(pid=9683): stderr: | [0;m[38;5;43m20221210071521805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071521805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071521805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071521806 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071521806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071521806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071521806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:23.164386 run osmo-stp_10.42.42.5(pid=9683): stdout: | (launched: 2022-12-10_07:15:21.633944) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:23.281614 run osmo-stp_10.42.42.5(pid=9683): stderr: | [0;m[38;5;43m20221210071521805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071521805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071521805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071521806 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071521806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071521806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071521806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:23.421738 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9683): Process ended prematurely: osmo-stp_10.42.42.5(pid=9683) [trial-2371↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9683)] [trial-2371↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 07:15:23.430500 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 07:15:23.457416 run osmo-hlr_10.42.42.2(pid=9680): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9680)] 07:15:23.504701 run osmo-hlr_10.42.42.2(pid=9680): stdout: | (launched: 2022-12-10_07:15:20.703547) 07:15:23.553895 run osmo-hlr_10.42.42.2(pid=9680): stderr: | [0;m[1;31m20221210071520879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071520879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071520879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071520879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071520879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071520879 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071520892 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-b200+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071520900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071520901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071520901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:15:23.622417 run osmo-msc_10.42.42.6(pid=9686): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9686)] 07:15:23.669715 run osmo-msc_10.42.42.6(pid=9686): stdout: | (launched: 2022-12-10_07:15:22.574065) 07:15:23.718527 run osmo-msc_10.42.42.6(pid=9686): stderr: | [0;m[38;5;43m20221210071522844 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071522844 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f30a177ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071522844 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071522844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071522845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071522845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071522846 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071522847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071522847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071522847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:15:23.767578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9679): Terminating (SIGTERM) 07:15:23.806944 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9682): Terminating (SIGTERM) 07:15:23.846584 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9685): Terminating (SIGTERM) 07:15:23.886266 --- ParallelTerminationStrategy: PID 9679 died... 07:15:23.905313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9679): Terminated: ok {rc=0} 07:15:23.949492 --- ParallelTerminationStrategy: PID 9682 died... 07:15:23.968189 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9682): Terminated: ok {rc=0} 07:15:24.012562 --- ParallelTerminationStrategy: PID 9685 died... 07:15:24.031243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9685): Terminated: ok {rc=0} 07:15:24.118784 bus /sierra_3: Setting Powered False 07:15:25.218157 bus /sierra_3: Setting Powered False 07:15:26.332904 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-trxdversion0 --------------------------------------------------------------------- 07:15:27.584935 tst voice:trx-b200+mod-bts0-trxdversion0: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:15:27.590187 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 1 x bts (candidates: 11) 07:15:27.624072 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 6 x ip_address (candidates: 9) 07:15:27.650157 tst voice:trx-b200+mod-bts0-trxdversion0: Verifying 2 x modem (candidates: 12) 07:15:27.701455 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 1 x bts (candidates: 11) 07:15:27.733936 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 6 x ip_address (candidates: 9) 07:15:27.759931 tst voice:trx-b200+mod-bts0-trxdversion0: Reserving 2 x modem (candidates: 12) 07:15:28.308623 tst voice:trx-b200+mod-bts0-trxdversion0: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call.py ---------------------------------------------- 07:15:28.356306 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:15:28.367187 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 07:15:28.417739 tst mo_mt_call.py: using LAC 26737 07:15:28.535421 tst mo_mt_call.py: using RAC 217 07:15:28.650556 tst mo_mt_call.py: using CellId 26737 07:15:28.768047 tst mo_mt_call.py: using BVCI 26738 07:15:28.874540 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:15:28.885431 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:15:28.895921 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:15:28.906792 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:15:28.917539 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:15:28.928578 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 07:15:29.041312 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 07:15:29.155414 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:15:29.610240 run create_hlr_db(pid=9693): Launched 07:15:29.722579 bus /sierra_2: Setting Powered False 07:15:30.781135 run create_hlr_db(pid=9693): Terminated: ok {rc=0} 07:15:31.220119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9695): Launched 07:15:31.643027 run osmo-hlr_10.42.42.2(pid=9696): Launched 07:15:31.883170 run osmo-stp_10.42.42.5: Starting osmo-stp 07:15:32.435204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9698): Launched 07:15:32.739410 run osmo-stp_10.42.42.5(pid=9699): Launched 07:15:32.852863 run osmo-msc_10.42.42.6: Starting osmo-msc 07:15:33.400220 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9701): Launched 07:15:33.694390 run osmo-msc_10.42.42.6(pid=9702): Launched 07:15:33.859806 run osmo-stp_10.42.42.5(pid=9699): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9699)] 07:15:33.984103 run osmo-stp_10.42.42.5(pid=9699): stdout: | (launched: 2022-12-10_07:15:32.686139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:34.109450 run osmo-stp_10.42.42.5(pid=9699): stderr: | [0;m[38;5;43m20221210071532854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071532854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071532855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071532855 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071532857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071532857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071532858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:34.231605 run osmo-stp_10.42.42.5(pid=9699): stdout: | (launched: 2022-12-10_07:15:32.686139) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:34.348262 run osmo-stp_10.42.42.5(pid=9699): stderr: | [0;m[38;5;43m20221210071532854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071532854 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071532855 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071532855 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071532857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071532857 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071532858 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:34.487816 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9699): Process ended prematurely: osmo-stp_10.42.42.5(pid=9699) [trial-2371↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9699)] [trial-2371↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8] 07:15:34.496570 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:15:34.523030 run osmo-hlr_10.42.42.2(pid=9696): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9696)] 07:15:34.570175 run osmo-hlr_10.42.42.2(pid=9696): stdout: | (launched: 2022-12-10_07:15:31.568069) 07:15:34.619159 run osmo-hlr_10.42.42.2(pid=9696): stderr: | [0;m[1;31m20221210071531801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071531801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071531801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071531801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071531801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071531802 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071531822 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071531840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071531840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071531840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:15:34.687314 run osmo-msc_10.42.42.6(pid=9702): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9702)] 07:15:34.734816 run osmo-msc_10.42.42.6(pid=9702): stdout: | (launched: 2022-12-10_07:15:33.640683) 07:15:34.783641 run osmo-msc_10.42.42.6(pid=9702): stderr: | [0;m[38;5;43m20221210071533914 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071533914 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f002e10dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071533914 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071533914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071533914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071533914 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071533916 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071533916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071533917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071533917 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:15:34.832828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9695): Terminating (SIGTERM) 07:15:34.872332 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9698): Terminating (SIGTERM) 07:15:34.911816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9701): Terminating (SIGTERM) 07:15:34.951441 --- ParallelTerminationStrategy: PID 9695 died... 07:15:34.970230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9695): Terminated: ok {rc=0} 07:15:35.014112 --- ParallelTerminationStrategy: PID 9698 died... 07:15:35.032348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9698): Terminated: ok {rc=0} 07:15:35.076014 --- ParallelTerminationStrategy: PID 9701 died... 07:15:35.094388 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9701): Terminated: ok {rc=0} 07:15:35.178835 bus /sierra_3: Setting Powered False 07:15:36.278795 bus /sierra_3: Setting Powered False 07:15:37.393856 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-trxdversion0 mo_mt_call_osmux.py ---------------------------------------------- 07:15:38.537795 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:15:38.549137 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x bts (candidates: 1) 07:15:38.599985 tst mo_mt_call_osmux.py: using LAC 26738 07:15:38.716856 tst mo_mt_call_osmux.py: using RAC 218 07:15:38.831686 tst mo_mt_call_osmux.py: using CellId 26738 07:15:38.948431 tst mo_mt_call_osmux.py: using BVCI 26739 07:15:39.055900 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:15:39.066936 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:15:39.077593 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:15:39.088155 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:15:39.099303 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x ip_address (candidates: 6) 07:15:39.110315 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 07:15:39.229720 tst voice:trx-b200+mod-bts0-trxdversion0: Using 1 x modem (candidates: 2) 07:15:39.350041 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:15:39.838246 run create_hlr_db(pid=9704): Launched 07:15:39.967197 bus /sierra_2: Setting Powered False 07:15:41.029950 run create_hlr_db(pid=9704): Terminated: ok {rc=0} 07:15:41.451553 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9706): Launched 07:15:41.746544 run osmo-hlr_10.42.42.2(pid=9707): Launched 07:15:41.859012 run osmo-stp_10.42.42.5: Starting osmo-stp 07:15:42.380663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9709): Launched 07:15:42.675686 run osmo-stp_10.42.42.5(pid=9710): Launched 07:15:42.788693 run osmo-msc_10.42.42.6: Starting osmo-msc 07:15:43.321639 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9712): Launched 07:15:43.616228 run osmo-msc_10.42.42.6(pid=9713): Launched 07:15:43.782569 run osmo-stp_10.42.42.5(pid=9710): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9710)] 07:15:43.908606 run osmo-stp_10.42.42.5(pid=9710): stdout: | (launched: 2022-12-10_07:15:42.622339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:44.034195 run osmo-stp_10.42.42.5(pid=9710): stderr: | [0;m[38;5;43m20221210071542790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071542790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071542790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071542790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071542791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071542791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071542791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:44.157442 run osmo-stp_10.42.42.5(pid=9710): stdout: | (launched: 2022-12-10_07:15:42.622339) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:44.275104 run osmo-stp_10.42.42.5(pid=9710): stderr: | [0;m[38;5;43m20221210071542790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071542790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071542790 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071542790 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071542791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071542791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071542791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:44.416063 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9710): Process ended prematurely: osmo-stp_10.42.42.5(pid=9710) [trial-2371↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9710)] [trial-2371↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8] 07:15:44.424803 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 07:15:44.451087 run osmo-hlr_10.42.42.2(pid=9707): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9707)] 07:15:44.498679 run osmo-hlr_10.42.42.2(pid=9707): stdout: | (launched: 2022-12-10_07:15:41.692507) 07:15:44.547760 run osmo-hlr_10.42.42.2(pid=9707): stderr: | [0;m[1;31m20221210071541865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071541865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071541865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071541865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071541865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071541865 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071541878 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-b200+mod-bts0-trxdversion0/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071541887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071541887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071541887 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:15:44.616083 run osmo-msc_10.42.42.6(pid=9713): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9713)] 07:15:44.663832 run osmo-msc_10.42.42.6(pid=9713): stdout: | (launched: 2022-12-10_07:15:43.562498) 07:15:44.712773 run osmo-msc_10.42.42.6(pid=9713): stderr: | [0;m[38;5;43m20221210071543837 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071543837 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f03bc46fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071543837 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071543837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071543837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071543837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071543839 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071543839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071543840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071543840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:15:44.762079 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9706): Terminating (SIGTERM) 07:15:44.801137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9709): Terminating (SIGTERM) 07:15:44.840301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9712): Terminating (SIGTERM) 07:15:44.879798 --- ParallelTerminationStrategy: PID 9706 died... 07:15:44.898829 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9706): Terminated: ok {rc=0} 07:15:44.943058 --- ParallelTerminationStrategy: PID 9709 died... 07:15:44.961477 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9709): Terminated: ok {rc=0} 07:15:45.005281 --- ParallelTerminationStrategy: PID 9712 died... 07:15:45.023506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9712): Terminated: ok {rc=0} 07:15:45.109946 bus /sierra_3: Setting Powered False 07:15:46.212015 bus /sierra_3: Setting Powered False 07:15:47.341607 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-trxdversion0 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 07:15:48.594739 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:15:48.601076 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 07:15:48.634744 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 07:15:48.661736 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 07:15:48.715398 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 07:15:48.749116 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 07:15:48.776020 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 07:15:49.328319 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 07:15:49.378809 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:15:49.390444 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:15:49.443266 tst mo_mt_call.py: using LAC 26739 07:15:49.567915 tst mo_mt_call.py: using RAC 219 07:15:49.692484 tst mo_mt_call.py: using CellId 26739 07:15:49.816248 tst mo_mt_call.py: using BVCI 26740 07:15:49.930116 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:15:49.941694 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:15:49.953092 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:15:49.964451 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:15:49.976031 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:15:49.987452 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:15:50.101373 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:15:50.221024 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:15:50.677413 run create_hlr_db(pid=9719): Launched 07:15:50.790896 bus /sierra_2: Setting Powered False 07:15:51.849633 run create_hlr_db(pid=9719): Terminated: ok {rc=0} 07:15:52.261471 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9721): Launched 07:15:52.557093 run osmo-hlr_10.42.42.2(pid=9722): Launched 07:15:52.671447 run osmo-stp_10.42.42.5: Starting osmo-stp 07:15:53.193776 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9724): Launched 07:15:53.488925 run osmo-stp_10.42.42.5(pid=9725): Launched 07:15:53.602929 run osmo-msc_10.42.42.6: Starting osmo-msc 07:15:54.136855 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9727): Launched 07:15:54.432697 run osmo-msc_10.42.42.6(pid=9728): Launched 07:15:54.599103 run osmo-stp_10.42.42.5(pid=9725): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9725)] 07:15:54.725790 run osmo-stp_10.42.42.5(pid=9725): stdout: | (launched: 2022-12-10_07:15:53.435372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:54.851830 run osmo-stp_10.42.42.5(pid=9725): stderr: | [0;m[38;5;43m20221210071553606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071553606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071553607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071553607 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071553608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071553608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071553608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:54.974858 run osmo-stp_10.42.42.5(pid=9725): stdout: | (launched: 2022-12-10_07:15:53.435372) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:15:55.092498 run osmo-stp_10.42.42.5(pid=9725): stderr: | [0;m[38;5;43m20221210071553606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071553606 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071553607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071553607 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071553608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071553608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071553608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:15:55.233410 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9725): Process ended prematurely: osmo-stp_10.42.42.5(pid=9725) [trial-2371↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9725)] [trial-2371↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 07:15:55.242315 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 07:15:55.269175 run osmo-hlr_10.42.42.2(pid=9722): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9722)] 07:15:55.317276 run osmo-hlr_10.42.42.2(pid=9722): stdout: | (launched: 2022-12-10_07:15:52.503108) 07:15:55.366968 run osmo-hlr_10.42.42.2(pid=9722): stderr: | [0;m[1;31m20221210071552675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071552675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071552675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071552675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071552675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071552675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071552687 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071552696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071552696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071552696 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:15:55.436314 run osmo-msc_10.42.42.6(pid=9728): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9728)] 07:15:55.483962 run osmo-msc_10.42.42.6(pid=9728): stdout: | (launched: 2022-12-10_07:15:54.379121) 07:15:55.533464 run osmo-msc_10.42.42.6(pid=9728): stderr: | [0;m[38;5;43m20221210071554652 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071554652 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0035b7cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071554652 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071554652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071554652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071554652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071554654 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071554655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071554655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071554655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:15:55.583300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9721): Terminating (SIGTERM) 07:15:55.623117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9724): Terminating (SIGTERM) 07:15:55.663517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9727): Terminating (SIGTERM) 07:15:55.703675 --- ParallelTerminationStrategy: PID 9721 died... 07:15:55.722712 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9721): Terminated: ok {rc=0} 07:15:55.767790 --- ParallelTerminationStrategy: PID 9724 died... 07:15:55.786563 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9724): Terminated: ok {rc=0} 07:15:55.830900 --- ParallelTerminationStrategy: PID 9727 died... 07:15:55.849687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9727): Terminated: ok {rc=0} 07:15:55.933701 bus /sierra_3: Setting Powered False 07:15:57.031740 bus /sierra_3: Setting Powered False 07:15:58.147635 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 07:15:59.288692 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:15:59.300505 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:15:59.352224 tst mo_mt_call_osmux.py: using LAC 26740 07:15:59.467842 tst mo_mt_call_osmux.py: using RAC 220 07:15:59.582780 tst mo_mt_call_osmux.py: using CellId 26740 07:15:59.696929 tst mo_mt_call_osmux.py: using BVCI 26741 07:15:59.803228 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:15:59.814540 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:15:59.825528 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:15:59.836795 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:15:59.848338 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:15:59.859687 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:15:59.974852 tst voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:16:00.100611 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:16:00.590749 run create_hlr_db(pid=9730): Launched 07:16:00.719410 bus /sierra_2: Setting Powered False 07:16:01.784761 run create_hlr_db(pid=9730): Terminated: ok {rc=0} 07:16:02.233068 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9732): Launched 07:16:02.548386 run osmo-hlr_10.42.42.2(pid=9733): Launched 07:16:02.668230 run osmo-stp_10.42.42.5: Starting osmo-stp 07:16:03.213455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9735): Launched 07:16:03.528537 run osmo-stp_10.42.42.5(pid=9736): Launched 07:16:03.648815 run osmo-msc_10.42.42.6: Starting osmo-msc 07:16:04.216622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9738): Launched 07:16:04.532437 run osmo-msc_10.42.42.6(pid=9739): Launched 07:16:04.708305 run osmo-stp_10.42.42.5(pid=9736): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9736)] 07:16:04.841588 run osmo-stp_10.42.42.5(pid=9736): stdout: | (launched: 2022-12-10_07:16:03.471183) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:04.974908 run osmo-stp_10.42.42.5(pid=9736): stderr: | [0;m[38;5;43m20221210071603661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071603661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071603662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071603663 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071603663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071603663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071603663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:05.107565 run osmo-stp_10.42.42.5(pid=9736): stdout: | (launched: 2022-12-10_07:16:03.471183) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:05.233182 run osmo-stp_10.42.42.5(pid=9736): stderr: | [0;m[38;5;43m20221210071603661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071603661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071603662 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071603663 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071603663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071603663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071603663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:05.383431 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9736): Process ended prematurely: osmo-stp_10.42.42.5(pid=9736) [trial-2371↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9736)] [trial-2371↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 07:16:05.392783 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 07:16:05.420062 run osmo-hlr_10.42.42.2(pid=9733): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9733)] 07:16:05.469263 run osmo-hlr_10.42.42.2(pid=9733): stdout: | (launched: 2022-12-10_07:16:02.491156) 07:16:05.520664 run osmo-hlr_10.42.42.2(pid=9733): stderr: | [0;m[1;31m20221210071602687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071602687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071602688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071602688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071602688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071602688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071602701 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071602709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071602709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071602709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:16:05.591907 run osmo-msc_10.42.42.6(pid=9739): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9739)] 07:16:05.641138 run osmo-msc_10.42.42.6(pid=9739): stdout: | (launched: 2022-12-10_07:16:04.474933) 07:16:05.692236 run osmo-msc_10.42.42.6(pid=9739): stderr: | [0;m[38;5;43m20221210071604797 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071604798 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0ab10b5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071604798 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071604798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071604798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071604798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071604800 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071604800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071604800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071604800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:16:05.743701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9732): Terminating (SIGTERM) 07:16:05.784769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9735): Terminating (SIGTERM) 07:16:05.826033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9738): Terminating (SIGTERM) 07:16:05.867240 --- ParallelTerminationStrategy: PID 9732 died... 07:16:05.886887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9732): Terminated: ok {rc=0} 07:16:05.932432 --- ParallelTerminationStrategy: PID 9735 died... 07:16:05.951640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9735): Terminated: ok {rc=0} 07:16:05.996751 --- ParallelTerminationStrategy: PID 9738 died... 07:16:06.015946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9738): Terminated: ok {rc=0} 07:16:06.102828 bus /sierra_3: Setting Powered False 07:16:07.202430 bus /sierra_3: Setting Powered False 07:16:08.316562 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 emergency:trx-b200 --------------------------------------------------------------------- 07:16:09.564091 tst emergency:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:16:09.568507 tst emergency:trx-b200: Verifying 1 x bts (candidates: 11) 07:16:09.601426 tst emergency:trx-b200: Verifying 6 x ip_address (candidates: 9) 07:16:09.627362 tst emergency:trx-b200: Verifying 4 x modem (candidates: 12) 07:16:09.713960 tst emergency:trx-b200: Reserving 1 x bts (candidates: 11) 07:16:09.748592 tst emergency:trx-b200: Reserving 6 x ip_address (candidates: 9) 07:16:09.775808 tst emergency:trx-b200: Reserving 4 x modem (candidates: 12) 07:16:10.355592 tst emergency:trx-b200: RESERVED RESOURCES for emergency: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2371 emergency:trx-b200 emergency_mo_mt_call.py ---------------------------------------------- 07:16:10.360925 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:16:10.371826 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 07:16:10.421634 tst emergency_mo_mt_call.py: using LAC 26741 07:16:10.542426 tst emergency_mo_mt_call.py: using RAC 221 07:16:10.662640 tst emergency_mo_mt_call.py: using CellId 26741 07:16:10.784439 tst emergency_mo_mt_call.py: using BVCI 26742 07:16:10.896606 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:16:10.907645 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:16:10.918475 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:16:10.929362 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:16:10.940116 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:16:10.950846 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 07:16:11.064497 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 07:16:11.182717 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:16:11.663019 run create_hlr_db(pid=9744): Launched 07:16:11.789586 bus /sierra_2: Setting Powered False 07:16:12.851409 run create_hlr_db(pid=9744): Terminated: ok {rc=0} 07:16:13.265064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9746): Launched 07:16:13.554490 run osmo-hlr_10.42.42.2(pid=9747): Launched 07:16:13.666636 run osmo-stp_10.42.42.5: Starting osmo-stp 07:16:14.177669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9749): Launched 07:16:14.467641 run osmo-stp_10.42.42.5(pid=9750): Launched 07:16:14.590461 tst emergency_mo_mt_call.py: using MSISDN 7611 07:16:14.740747 run osmo-msc_10.42.42.6: Starting osmo-msc 07:16:15.261842 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9752): Launched 07:16:15.550927 run osmo-msc_10.42.42.6(pid=9753): Launched 07:16:15.712653 run osmo-stp_10.42.42.5(pid=9750): ERR: Terminated: ERROR {rc=1} [trial-2371↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9750)] 07:16:15.844711 run osmo-stp_10.42.42.5(pid=9750): stdout: | (launched: 2022-12-10_07:16:14.414836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:16.026369 run osmo-stp_10.42.42.5(pid=9750): stderr: | [0;m[38;5;43m20221210071614584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071614585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071614585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071614586 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071614586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071614586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071614586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:16.160824 run osmo-stp_10.42.42.5(pid=9750): stdout: | (launched: 2022-12-10_07:16:14.414836) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:16.288170 run osmo-stp_10.42.42.5(pid=9750): stderr: | [0;m[38;5;43m20221210071614584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071614585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071614585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071614586 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071614586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071614586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071614586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:16.441536 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=9750): Process ended prematurely: osmo-stp_10.42.42.5(pid=9750) [trial-2371↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9750)] [trial-2371↪emergency:trx-b200↪emergency_mo_mt_call.py:19] 07:16:16.451425 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 07:16:16.480987 run osmo-hlr_10.42.42.2(pid=9747): ERR: Terminated: ERROR {rc=237} [trial-2371↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9747)] 07:16:16.534829 run osmo-hlr_10.42.42.2(pid=9747): stdout: | (launched: 2022-12-10_07:16:13.501411) 07:16:16.588536 run osmo-hlr_10.42.42.2(pid=9747): stderr: | [0;m[1;31m20221210071613674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071613674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071613674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071613674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071613674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071613675 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071613686 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/emergency:trx-b200/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071613695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071613695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071613695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:16:16.663224 run osmo-msc_10.42.42.6(pid=9753): ERR: Terminated: ERROR {rc=2} [trial-2371↪emergency:trx-b200↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9753)] 07:16:16.715762 run osmo-msc_10.42.42.6(pid=9753): stdout: | (launched: 2022-12-10_07:16:15.498111) 07:16:16.769992 run osmo-msc_10.42.42.6(pid=9753): stderr: | [0;m[38;5;43m20221210071615771 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071615771 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6800ef9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071615771 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071615771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071615771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071615771 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071615773 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071615774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071615774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071615774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:16:16.823725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9746): Terminating (SIGTERM) 07:16:16.866892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9749): Terminating (SIGTERM) 07:16:16.913734 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9752): Terminating (SIGTERM) 07:16:16.959335 --- ParallelTerminationStrategy: PID 9746 died... 07:16:16.979843 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9746): Terminated: ok {rc=0} 07:16:17.030587 --- ParallelTerminationStrategy: PID 9749 died... 07:16:17.050832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9749): Terminated: ok {rc=0} 07:16:17.099518 --- ParallelTerminationStrategy: PID 9752 died... 07:16:17.120663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9752): Terminated: ok {rc=0} 07:16:17.212288 bus /sierra_3: Setting Powered False 07:16:18.311606 bus /sierra_3: Setting Powered False 07:16:19.427312 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 emergency:trx-b200 emergency_preemptive_call.py ---------------------------------------------- 07:16:20.516675 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:16:20.528522 tst emergency:trx-b200: Using 1 x bts (candidates: 1) 07:16:20.581316 tst emergency_preemptive_call.py: using LAC 26742 07:16:20.697123 tst emergency_preemptive_call.py: using RAC 222 07:16:20.810251 tst emergency_preemptive_call.py: using CellId 26742 07:16:20.926875 tst emergency_preemptive_call.py: using BVCI 26743 07:16:21.031236 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:16:21.041865 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:16:21.052171 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:16:21.062859 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:16:21.073526 tst emergency:trx-b200: Using 1 x ip_address (candidates: 6) 07:16:21.083948 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 07:16:21.201325 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 07:16:21.315506 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 07:16:21.427977 tst emergency:trx-b200: Using 1 x modem (candidates: 4) 07:16:21.539673 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:16:21.990372 run create_hlr_db(pid=9755): Launched 07:16:22.101340 bus /sierra_2: Setting Powered False 07:16:23.159893 run create_hlr_db(pid=9755): Terminated: ok {rc=0} 07:16:23.586462 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9757): Launched 07:16:23.896738 run osmo-hlr_10.42.42.2(pid=9758): Launched 07:16:24.016026 run osmo-stp_10.42.42.5: Starting osmo-stp 07:16:24.555597 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9760): Launched 07:16:24.866111 run osmo-stp_10.42.42.5(pid=9761): Launched 07:16:24.995372 tst emergency_preemptive_call.py: using MSISDN 7612 07:16:25.156553 run osmo-msc_10.42.42.6: Starting osmo-msc 07:16:25.713982 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9763): Launched 07:16:26.024169 run osmo-msc_10.42.42.6(pid=9764): Launched 07:16:26.198337 run osmo-stp_10.42.42.5(pid=9761): ERR: Terminated: ERROR {rc=1} [trial-2371↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9761)] 07:16:26.328929 run osmo-stp_10.42.42.5(pid=9761): stdout: | (launched: 2022-12-10_07:16:24.809990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:26.463714 run osmo-stp_10.42.42.5(pid=9761): stderr: | [0;m[38;5;43m20221210071624999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071624999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071625000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071625000 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071625001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071625001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071625001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:26.593426 run osmo-stp_10.42.42.5(pid=9761): stdout: | (launched: 2022-12-10_07:16:24.809990) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:26.717302 run osmo-stp_10.42.42.5(pid=9761): stderr: | [0;m[38;5;43m20221210071624999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071624999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071625000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071625000 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071625001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071625001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071625001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:26.864727 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=9761): Process ended prematurely: osmo-stp_10.42.42.5(pid=9761) [trial-2371↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9761)] [trial-2371↪emergency:trx-b200↪emergency_preemptive_call.py:32] 07:16:26.873768 tst emergency_preemptive_call.py:32: Test FAILED (6.4 sec) 07:16:26.900891 run osmo-hlr_10.42.42.2(pid=9758): ERR: Terminated: ERROR {rc=237} [trial-2371↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9758)] 07:16:26.950850 run osmo-hlr_10.42.42.2(pid=9758): stdout: | (launched: 2022-12-10_07:16:23.840579) 07:16:27.003088 run osmo-hlr_10.42.42.2(pid=9758): stderr: | [0;m[1;31m20221210071624037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071624037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071624037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071624037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071624037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071624037 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071624050 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/emergency:trx-b200/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071624058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071624058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071624058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:16:27.075216 run osmo-msc_10.42.42.6(pid=9764): ERR: Terminated: ERROR {rc=2} [trial-2371↪emergency:trx-b200↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=9764)] 07:16:27.125358 run osmo-msc_10.42.42.6(pid=9764): stdout: | (launched: 2022-12-10_07:16:25.967704) 07:16:27.177070 run osmo-msc_10.42.42.6(pid=9764): stderr: | [0;m[38;5;43m20221210071626288 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210071626289 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3265145c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210071626289 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210071626289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210071626289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210071626289 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210071626291 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210071626291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210071626291 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210071626292 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:16:27.228841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9757): Terminating (SIGTERM) 07:16:27.270601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9760): Terminating (SIGTERM) 07:16:27.312302 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9763): Terminating (SIGTERM) 07:16:27.354379 --- ParallelTerminationStrategy: PID 9757 died... 07:16:27.374452 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9757): Terminated: ok {rc=0} 07:16:27.420641 --- ParallelTerminationStrategy: PID 9760 died... 07:16:27.440217 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9760): Terminated: ok {rc=0} 07:16:27.486033 --- ParallelTerminationStrategy: PID 9763 died... 07:16:27.505682 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=9763): Terminated: ok {rc=0} 07:16:27.592740 bus /sierra_9: Setting Powered False 07:16:28.689700 bus /sierra_9: Setting Powered False 07:16:29.805106 bus /sierra_8: Setting Powered False 07:16:30.909790 bus /sierra_8: Setting Powered False 07:16:32.041877 bus /sierra_3: Setting Powered False 07:16:33.147361 bus /sierra_3: Setting Powered False 07:16:34.260531 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 emergency:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-b200 --------------------------------------------------------------------- 07:16:35.540286 tst gprs:trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:16:35.545440 tst gprs:trx-b200: Verifying 1 x bts (candidates: 11) 07:16:35.579159 tst gprs:trx-b200: Verifying 9 x ip_address (candidates: 9) 07:16:35.617178 tst gprs:trx-b200: Verifying 4 x modem (candidates: 12) 07:16:35.702179 tst gprs:trx-b200: Reserving 1 x bts (candidates: 11) 07:16:35.735404 tst gprs:trx-b200: Reserving 9 x ip_address (candidates: 9) 07:16:35.774230 tst gprs:trx-b200: Reserving 4 x modem (candidates: 12) 07:16:36.365700 tst gprs:trx-b200: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-b200 cs_paging_gprs_active.py ---------------------------------------------- 07:16:36.417305 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:36.428352 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 07:16:36.476382 tst cs_paging_gprs_active.py: using LAC 26743 07:16:36.598847 tst cs_paging_gprs_active.py: using RAC 223 07:16:36.721358 tst cs_paging_gprs_active.py: using CellId 26743 07:16:36.845375 tst cs_paging_gprs_active.py: using BVCI 26744 07:16:36.959564 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:36.970478 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:36.981222 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:36.991946 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:37.002583 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:37.013229 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:37.024020 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:37.034791 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:37.045885 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:16:37.161838 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:16:37.281707 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:16:37.496400 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:16:37.813353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9769): Launched 07:16:38.088075 run iperf3-srv_10.42.42.10(pid=9770): Launched 07:16:38.206999 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:16:38.419914 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:16:38.737549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9771): Launched 07:16:39.012099 run iperf3-srv_10.42.42.10(pid=9772): Launched 07:16:39.130910 tst cs_paging_gprs_active.py:38: start network... 07:16:39.343894 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:16:39.832672 run create_hlr_db(pid=9773): Launched 07:16:39.962442 bus /sierra_2: Setting Powered False 07:16:41.024670 run create_hlr_db(pid=9773): Terminated: ok {rc=0} 07:16:41.465922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9775): Launched 07:16:41.781724 run osmo-hlr_10.42.42.2(pid=9776): Launched 07:16:41.902671 run osmo-stp_10.42.42.5: Starting osmo-stp 07:16:42.445303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9778): Launched 07:16:42.762113 run osmo-stp_10.42.42.5(pid=9779): Launched 07:16:42.883071 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:16:43.429524 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9781): Launched 07:16:43.551401 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:16:43.818030 run patchelf(pid=9782): Launched 07:16:43.994200 run osmo-stp_10.42.42.5(pid=9779): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9779)] 07:16:44.128643 run osmo-stp_10.42.42.5(pid=9779): stdout: | (launched: 2022-12-10_07:16:42.704601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:44.265147 run osmo-stp_10.42.42.5(pid=9779): stderr: | [0;m[38;5;43m20221210071642893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071642894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071642894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071642894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071642895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071642895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071642895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:44.401320 run osmo-stp_10.42.42.5(pid=9779): stdout: | (launched: 2022-12-10_07:16:42.704601) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:44.531922 run osmo-stp_10.42.42.5(pid=9779): stderr: | [0;m[38;5;43m20221210071642893 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071642894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071642894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071642894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071642895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071642895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071642895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:44.686556 run patchelf(pid=9782): Terminating (SIGINT) 07:16:44.865974 run patchelf(pid=9782): Terminated: ok {rc=0} 07:16:44.995324 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9779): Process ended prematurely: osmo-stp_10.42.42.5(pid=9779) [trial-2371↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9779)] [trial-2371↪gprs:trx-b200↪cs_paging_gprs_active.py:38] 07:16:45.005407 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 07:16:45.033655 run osmo-hlr_10.42.42.2(pid=9776): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9776)] 07:16:45.083544 run osmo-hlr_10.42.42.2(pid=9776): stdout: | (launched: 2022-12-10_07:16:41.724374) 07:16:45.135208 run osmo-hlr_10.42.42.2(pid=9776): stderr: | [0;m[1;31m20221210071641924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071641924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071641924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071641924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071641924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071641924 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071641935 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071641944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071641944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071641944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:16:45.186931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9769): Terminating (SIGTERM) 07:16:45.229107 run iperf3-srv_10.42.42.10(pid=9770): Terminating (SIGTERM) 07:16:45.271057 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9771): Terminating (SIGTERM) 07:16:45.313131 run iperf3-srv_10.42.42.10(pid=9772): Terminating (SIGTERM) 07:16:45.355096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9775): Terminating (SIGTERM) 07:16:45.396913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9778): Terminating (SIGTERM) 07:16:45.438812 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9781): Terminating (SIGTERM) 07:16:45.481927 --- ParallelTerminationStrategy: PID 9769 died... 07:16:45.503528 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9769): Terminated: ok {rc=0} 07:16:45.549172 --- ParallelTerminationStrategy: PID 9770 died... 07:16:45.567544 run iperf3-srv_10.42.42.10(pid=9770): Terminated {rc=256} 07:16:45.612759 --- ParallelTerminationStrategy: PID 9771 died... 07:16:45.631219 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9771): Terminated: ok {rc=0} 07:16:45.676596 --- ParallelTerminationStrategy: PID 9772 died... 07:16:45.695076 run iperf3-srv_10.42.42.10(pid=9772): Terminated {rc=256} 07:16:45.740209 --- ParallelTerminationStrategy: PID 9775 died... 07:16:45.758715 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9775): Terminated: ok {rc=0} 07:16:45.803884 --- ParallelTerminationStrategy: PID 9778 died... 07:16:45.822401 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9778): Terminated: ok {rc=0} 07:16:45.882589 --- ParallelTerminationStrategy: PID 9781 died... 07:16:45.914813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9781): Terminated: ok {rc=0} 07:16:46.003955 bus /gobi_0: Setting Powered False 07:16:47.107364 bus /gobi_0: Setting Powered False 07:16:48.232389 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-b200 iperf3.py ---------------------------------------------- 07:16:49.376707 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:49.387779 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 07:16:49.441383 tst iperf3.py: using LAC 26744 07:16:49.558233 tst iperf3.py: using RAC 224 07:16:49.674877 tst iperf3.py: using CellId 26744 07:16:49.792183 tst iperf3.py: using BVCI 26745 07:16:49.900131 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:49.910632 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:49.920891 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:49.931445 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:49.941891 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:49.952274 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:49.962855 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:49.973327 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:49.983890 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:16:50.100382 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:16:50.314931 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:16:50.633450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9783): Launched 07:16:50.908612 run iperf3-srv_10.42.42.10(pid=9784): Launched 07:16:51.027322 tst iperf3.py:8: start network... 07:16:51.240522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:16:51.728563 run create_hlr_db(pid=9785): Launched 07:16:51.857549 bus /gobi_6: Setting Powered False 07:16:52.920304 run create_hlr_db(pid=9785): Terminated: ok {rc=0} 07:16:53.340175 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9787): Launched 07:16:53.658286 run osmo-hlr_10.42.42.2(pid=9788): Launched 07:16:53.778185 run osmo-stp_10.42.42.5: Starting osmo-stp 07:16:54.320927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9790): Launched 07:16:54.637043 run osmo-stp_10.42.42.5(pid=9791): Launched 07:16:54.757586 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:16:55.301935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9793): Launched 07:16:55.423007 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:16:55.689121 run patchelf(pid=9794): Launched 07:16:55.865459 run osmo-stp_10.42.42.5(pid=9791): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9791)] 07:16:55.999068 run osmo-stp_10.42.42.5(pid=9791): stdout: | (launched: 2022-12-10_07:16:54.579599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:56.134356 run osmo-stp_10.42.42.5(pid=9791): stderr: | [0;m[38;5;43m20221210071654774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071654774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071654775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071654775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071654776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071654776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071654776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:56.270023 run osmo-stp_10.42.42.5(pid=9791): stdout: | (launched: 2022-12-10_07:16:54.579599) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:16:56.399275 run osmo-stp_10.42.42.5(pid=9791): stderr: | [0;m[38;5;43m20221210071654774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071654774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071654775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071654775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071654776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071654776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071654776 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:16:56.552890 run patchelf(pid=9794): Terminating (SIGINT) 07:16:56.731017 run patchelf(pid=9794): Terminated: ok {rc=0} 07:16:56.859775 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9791): Process ended prematurely: osmo-stp_10.42.42.5(pid=9791) [trial-2371↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9791)] [trial-2371↪gprs:trx-b200↪iperf3.py:8] 07:16:56.869779 tst iperf3.py:8: Test FAILED (7.5 sec) 07:16:56.897974 run osmo-hlr_10.42.42.2(pid=9788): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9788)] 07:16:56.947366 run osmo-hlr_10.42.42.2(pid=9788): stdout: | (launched: 2022-12-10_07:16:53.601194) 07:16:56.998440 run osmo-hlr_10.42.42.2(pid=9788): stderr: | [0;m[1;31m20221210071653800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071653800 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071653801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071653801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071653801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071653801 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071653825 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071653836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071653836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071653836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:16:57.049810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9783): Terminating (SIGTERM) 07:16:57.091041 run iperf3-srv_10.42.42.10(pid=9784): Terminating (SIGTERM) 07:16:57.132315 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9787): Terminating (SIGTERM) 07:16:57.173612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9790): Terminating (SIGTERM) 07:16:57.214705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9793): Terminating (SIGTERM) 07:16:57.256011 --- ParallelTerminationStrategy: PID 9783 died... 07:16:57.275732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9783): Terminated: ok {rc=0} 07:16:57.321363 --- ParallelTerminationStrategy: PID 9784 died... 07:16:57.340525 run iperf3-srv_10.42.42.10(pid=9784): Terminated {rc=256} 07:16:57.385753 --- ParallelTerminationStrategy: PID 9787 died... 07:16:57.404809 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9787): Terminated: ok {rc=0} 07:16:57.450535 --- ParallelTerminationStrategy: PID 9790 died... 07:16:57.469870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9790): Terminated: ok {rc=0} 07:16:57.515224 --- ParallelTerminationStrategy: PID 9793 died... 07:16:57.534889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9793): Terminated: ok {rc=0} 07:16:57.622555 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-b200 iperf3m4.py ---------------------------------------------- 07:16:58.770324 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:58.781898 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 07:16:58.833464 tst iperf3m4.py: using LAC 26745 07:16:58.957028 tst iperf3m4.py: using RAC 225 07:16:59.080580 tst iperf3m4.py: using CellId 26745 07:16:59.205470 tst iperf3m4.py: using BVCI 26746 07:16:59.320640 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:59.331685 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:59.342702 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:59.353573 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:59.364355 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:59.375131 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:59.386076 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:59.396860 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:16:59.407908 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:16:59.525449 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:16:59.645136 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:16:59.759756 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:16:59.874723 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:17:00.072652 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:17:00.368140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9795): Launched 07:17:00.625135 run iperf3-srv_10.42.42.10(pid=9796): Launched 07:17:00.736354 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:17:00.953255 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:17:01.284372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9800): Launched 07:17:01.552704 run iperf3-srv_10.42.42.10(pid=9801): Launched 07:17:01.667134 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:17:01.870676 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:17:02.189417 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9802): Launched 07:17:02.449779 run iperf3-srv_10.42.42.10(pid=9803): Launched 07:17:02.560884 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:17:02.775401 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:17:03.070877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9804): Launched 07:17:03.327236 run iperf3-srv_10.42.42.10(pid=9805): Launched 07:17:03.438375 tst iperf3m4.py:8: start network... 07:17:03.635288 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:17:04.091277 run create_hlr_db(pid=9806): Launched 07:17:04.205719 bus /gobi_6: Setting Powered False 07:17:05.264546 run create_hlr_db(pid=9806): Terminated: ok {rc=0} 07:17:05.697328 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9808): Launched 07:17:06.014727 run osmo-hlr_10.42.42.2(pid=9809): Launched 07:17:06.136529 run osmo-stp_10.42.42.5: Starting osmo-stp 07:17:06.685822 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9811): Launched 07:17:07.002144 run osmo-stp_10.42.42.5(pid=9812): Launched 07:17:07.122619 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:17:07.666385 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9814): Launched 07:17:07.788154 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:17:08.054341 run patchelf(pid=9815): Launched 07:17:08.230731 run osmo-stp_10.42.42.5(pid=9812): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9812)] 07:17:08.364838 run osmo-stp_10.42.42.5(pid=9812): stdout: | (launched: 2022-12-10_07:17:06.944618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:08.501060 run osmo-stp_10.42.42.5(pid=9812): stderr: | [0;m[38;5;43m20221210071707136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071707137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071707137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071707137 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071707139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071707140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071707140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:08.637721 run osmo-stp_10.42.42.5(pid=9812): stdout: | (launched: 2022-12-10_07:17:06.944618) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:08.768024 run osmo-stp_10.42.42.5(pid=9812): stderr: | [0;m[38;5;43m20221210071707136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071707137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071707137 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071707137 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071707139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071707140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071707140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:08.922138 run patchelf(pid=9815): Terminating (SIGINT) 07:17:09.100636 run patchelf(pid=9815): Terminated: ok {rc=0} 07:17:09.229180 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9812): Process ended prematurely: osmo-stp_10.42.42.5(pid=9812) [trial-2371↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9812)] [trial-2371↪gprs:trx-b200↪iperf3m4.py:8] 07:17:09.239142 tst iperf3m4.py:8: Test FAILED (10.5 sec) 07:17:09.267590 run osmo-hlr_10.42.42.2(pid=9809): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9809)] 07:17:09.317072 run osmo-hlr_10.42.42.2(pid=9809): stdout: | (launched: 2022-12-10_07:17:05.957438) 07:17:09.368028 run osmo-hlr_10.42.42.2(pid=9809): stderr: | [0;m[1;31m20221210071706156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071706156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071706156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071706156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071706156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071706156 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071706169 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071706178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071706178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071706178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:17:09.419533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9795): Terminating (SIGTERM) 07:17:09.460570 run iperf3-srv_10.42.42.10(pid=9796): Terminating (SIGTERM) 07:17:09.501729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9800): Terminating (SIGTERM) 07:17:09.543329 run iperf3-srv_10.42.42.10(pid=9801): Terminating (SIGTERM) 07:17:09.584836 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9802): Terminating (SIGTERM) 07:17:09.626154 run iperf3-srv_10.42.42.10(pid=9803): Terminating (SIGTERM) 07:17:09.667404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9804): Terminating (SIGTERM) 07:17:09.708689 run iperf3-srv_10.42.42.10(pid=9805): Terminating (SIGTERM) 07:17:09.750039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9808): Terminating (SIGTERM) 07:17:09.791225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9811): Terminating (SIGTERM) 07:17:09.832508 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9814): Terminating (SIGTERM) 07:17:09.874028 --- ParallelTerminationStrategy: PID 9795 died... 07:17:09.893867 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9795): Terminated: ok {rc=0} 07:17:09.939558 --- ParallelTerminationStrategy: PID 9796 died... 07:17:09.958977 run iperf3-srv_10.42.42.10(pid=9796): Terminated {rc=256} 07:17:10.004110 --- ParallelTerminationStrategy: PID 9800 died... 07:17:10.023471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9800): Terminated: ok {rc=0} 07:17:10.068789 --- ParallelTerminationStrategy: PID 9801 died... 07:17:10.088470 run iperf3-srv_10.42.42.10(pid=9801): Terminated {rc=256} 07:17:10.134046 --- ParallelTerminationStrategy: PID 9802 died... 07:17:10.153471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9802): Terminated: ok {rc=0} 07:17:10.198931 --- ParallelTerminationStrategy: PID 9803 died... 07:17:10.218365 run iperf3-srv_10.42.42.10(pid=9803): Terminated {rc=256} 07:17:10.263489 --- ParallelTerminationStrategy: PID 9804 died... 07:17:10.282711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9804): Terminated: ok {rc=0} 07:17:10.328250 --- ParallelTerminationStrategy: PID 9805 died... 07:17:10.347648 run iperf3-srv_10.42.42.10(pid=9805): Terminated {rc=256} 07:17:10.392760 --- ParallelTerminationStrategy: PID 9808 died... 07:17:10.412336 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9808): Terminated: ok {rc=0} 07:17:10.457677 --- ParallelTerminationStrategy: PID 9811 died... 07:17:10.477216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9811): Terminated: ok {rc=0} 07:17:10.522748 --- ParallelTerminationStrategy: PID 9814 died... 07:17:10.542374 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9814): Terminated: ok {rc=0} 07:17:10.629578 bus /gobi_4: Setting Powered False 07:17:11.728935 bus /gobi_4: Setting Powered False 07:17:12.844691 bus /gobi_1: Setting Powered False 07:17:13.938395 bus /gobi_1: Setting Powered False 07:17:15.052797 bus /gobi_0: Setting Powered False 07:17:16.150615 bus /gobi_0: Setting Powered False 07:17:17.267590 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-b200 ping.py ---------------------------------------------- 07:17:18.372475 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:18.384177 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 07:17:18.434717 tst ping.py: using LAC 26746 07:17:18.558628 tst ping.py: using RAC 226 07:17:18.682020 tst ping.py: using CellId 26746 07:17:18.806369 tst ping.py: using BVCI 26747 07:17:18.920041 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:18.930970 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:18.941900 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:18.952677 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:18.963406 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:18.974161 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:18.985023 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:18.995912 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:17:19.109715 tst ping.py:19: start network... 07:17:19.305149 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:17:19.752617 run create_hlr_db(pid=9816): Launched 07:17:19.863977 bus /gobi_6: Setting Powered False 07:17:20.926289 run create_hlr_db(pid=9816): Terminated: ok {rc=0} 07:17:21.359254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9818): Launched 07:17:21.669950 run osmo-hlr_10.42.42.2(pid=9819): Launched 07:17:21.788819 run osmo-stp_10.42.42.5: Starting osmo-stp 07:17:22.325171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9821): Launched 07:17:22.636281 run osmo-stp_10.42.42.5(pid=9822): Launched 07:17:22.754894 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:17:23.290337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9824): Launched 07:17:23.408538 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:17:23.670523 run patchelf(pid=9825): Launched 07:17:23.843614 run osmo-stp_10.42.42.5(pid=9822): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9822)] 07:17:23.975359 run osmo-stp_10.42.42.5(pid=9822): stdout: | (launched: 2022-12-10_07:17:22.579794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:24.108841 run osmo-stp_10.42.42.5(pid=9822): stderr: | [0;m[38;5;43m20221210071722772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071722772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071722772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071722772 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071722773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071722773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071722773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:24.242700 run osmo-stp_10.42.42.5(pid=9822): stdout: | (launched: 2022-12-10_07:17:22.579794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:24.370268 run osmo-stp_10.42.42.5(pid=9822): stderr: | [0;m[38;5;43m20221210071722772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071722772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071722772 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071722772 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071722773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071722773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071722773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:24.521516 run patchelf(pid=9825): Terminating (SIGINT) 07:17:24.696264 run patchelf(pid=9825): Terminated: ok {rc=0} 07:17:24.822359 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9822): Process ended prematurely: osmo-stp_10.42.42.5(pid=9822) [trial-2371↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9822)] [trial-2371↪gprs:trx-b200↪ping.py:22] 07:17:24.831673 tst ping.py:22: Test FAILED (6.5 sec) 07:17:24.859569 run osmo-hlr_10.42.42.2(pid=9819): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9819)] 07:17:24.909422 run osmo-hlr_10.42.42.2(pid=9819): stdout: | (launched: 2022-12-10_07:17:21.613729) 07:17:24.961165 run osmo-hlr_10.42.42.2(pid=9819): stderr: | [0;m[1;31m20221210071721812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071721812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071721812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071721812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071721812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071721812 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071721825 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071721833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071721833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071721833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:17:25.013453 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9818): Terminating (SIGTERM) 07:17:25.055410 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9821): Terminating (SIGTERM) 07:17:25.098037 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9824): Terminating (SIGTERM) 07:17:25.140241 --- ParallelTerminationStrategy: PID 9818 died... 07:17:25.160350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9818): Terminated: ok {rc=0} 07:17:25.206882 --- ParallelTerminationStrategy: PID 9821 died... 07:17:25.226601 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9821): Terminated: ok {rc=0} 07:17:25.272681 --- ParallelTerminationStrategy: PID 9824 died... 07:17:25.292376 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9824): Terminated: ok {rc=0} 07:17:25.379839 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-b200 ping_idle_ping.py ---------------------------------------------- 07:17:26.467225 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:26.478773 tst gprs:trx-b200: Using 1 x bts (candidates: 1) 07:17:26.533716 tst ping_idle_ping.py: using LAC 26747 07:17:26.656655 tst ping_idle_ping.py: using RAC 227 07:17:26.777142 tst ping_idle_ping.py: using CellId 26747 07:17:26.897542 tst ping_idle_ping.py: using BVCI 26748 07:17:27.006215 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:27.016595 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:27.026945 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:27.038241 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:27.049283 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:27.060240 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:27.071417 tst gprs:trx-b200: Using 1 x ip_address (candidates: 9) 07:17:27.082864 tst gprs:trx-b200: Using 1 x modem (candidates: 4) 07:17:27.200472 tst ping_idle_ping.py:24: start network... 07:17:27.410743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:17:27.895082 run create_hlr_db(pid=9826): Launched 07:17:28.022357 bus /gobi_6: Setting Powered False 07:17:29.084226 run create_hlr_db(pid=9826): Terminated: ok {rc=0} 07:17:29.500543 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9828): Launched 07:17:29.791614 run osmo-hlr_10.42.42.2(pid=9829): Launched 07:17:29.903337 run osmo-stp_10.42.42.5: Starting osmo-stp 07:17:30.401769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9831): Launched 07:17:30.691339 run osmo-stp_10.42.42.5(pid=9832): Launched 07:17:30.802537 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:17:31.442310 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9834): Launched 07:17:31.593646 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:17:31.879222 run patchelf(pid=9835): Launched 07:17:32.069360 run osmo-stp_10.42.42.5(pid=9832): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9832)] 07:17:32.206228 run osmo-stp_10.42.42.5(pid=9832): stdout: | (launched: 2022-12-10_07:17:30.638111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:32.341317 run osmo-stp_10.42.42.5(pid=9832): stderr: | [0;m[38;5;43m20221210071730807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071730807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071730807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071730808 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071730808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071730808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071730808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:32.475453 run osmo-stp_10.42.42.5(pid=9832): stdout: | (launched: 2022-12-10_07:17:30.638111) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:32.604170 run osmo-stp_10.42.42.5(pid=9832): stderr: | [0;m[38;5;43m20221210071730807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071730807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071730807 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071730808 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071730808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071730808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071730808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:32.755797 run patchelf(pid=9835): Terminating (SIGINT) 07:17:32.931205 run patchelf(pid=9835): Terminated: ok {rc=0} 07:17:33.057741 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9832): Process ended prematurely: osmo-stp_10.42.42.5(pid=9832) [trial-2371↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9832)] [trial-2371↪gprs:trx-b200↪ping_idle_ping.py:27] 07:17:33.067194 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 07:17:33.095219 run osmo-hlr_10.42.42.2(pid=9829): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9829)] 07:17:33.145344 run osmo-hlr_10.42.42.2(pid=9829): stdout: | (launched: 2022-12-10_07:17:29.738558) 07:17:33.197208 run osmo-hlr_10.42.42.2(pid=9829): stderr: | [0;m[1;31m20221210071729910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071729911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071729911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071729911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071729911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071729911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071729924 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071729934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071729934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071729934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:17:33.249403 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9828): Terminating (SIGTERM) 07:17:33.291260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9831): Terminating (SIGTERM) 07:17:33.333394 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9834): Terminating (SIGTERM) 07:17:33.375646 --- ParallelTerminationStrategy: PID 9828 died... 07:17:33.395684 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9828): Terminated: ok {rc=0} 07:17:33.442409 --- ParallelTerminationStrategy: PID 9831 died... 07:17:33.461974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9831): Terminated: ok {rc=0} 07:17:33.507717 --- ParallelTerminationStrategy: PID 9834 died... 07:17:33.527342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9834): Terminated: ok {rc=0} 07:17:33.614262 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-egprs --------------------------------------------------------------------- 07:17:34.916137 tst gprs:trx-b200+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:17:34.921400 tst gprs:trx-b200+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:17:34.954179 tst gprs:trx-b200+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:17:34.991800 tst gprs:trx-b200+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:17:35.077547 tst gprs:trx-b200+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:17:35.109806 tst gprs:trx-b200+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:17:35.147627 tst gprs:trx-b200+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:17:35.738014 tst gprs:trx-b200+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:17:35.786230 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:35.796802 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:17:35.846239 tst cs_paging_gprs_active.py: using LAC 26748 07:17:35.962690 tst cs_paging_gprs_active.py: using RAC 228 07:17:36.078796 tst cs_paging_gprs_active.py: using CellId 26748 07:17:36.197733 tst cs_paging_gprs_active.py: using BVCI 26749 07:17:36.304893 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:36.315643 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:36.326139 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:36.336933 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:36.347653 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:36.358691 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:36.370113 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:36.380360 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:36.391148 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:17:36.510206 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:17:36.627188 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:17:36.827393 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:17:37.124479 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9843): Launched 07:17:37.383521 run iperf3-srv_10.42.42.10(pid=9844): Launched 07:17:37.494786 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:17:37.693096 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:17:37.989547 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9845): Launched 07:17:38.246958 run iperf3-srv_10.42.42.10(pid=9846): Launched 07:17:38.358287 tst cs_paging_gprs_active.py:38: start network... 07:17:38.556433 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:17:39.012422 run create_hlr_db(pid=9847): Launched 07:17:39.125778 bus /gobi_6: Setting Powered False 07:17:40.187815 run create_hlr_db(pid=9847): Terminated: ok {rc=0} 07:17:40.629499 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9849): Launched 07:17:40.945352 run osmo-hlr_10.42.42.2(pid=9850): Launched 07:17:41.066565 run osmo-stp_10.42.42.5: Starting osmo-stp 07:17:41.611832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9852): Launched 07:17:41.928798 run osmo-stp_10.42.42.5(pid=9853): Launched 07:17:42.050417 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:17:42.596305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9855): Launched 07:17:42.717846 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:17:42.984571 run patchelf(pid=9856): Launched 07:17:43.161211 run osmo-stp_10.42.42.5(pid=9853): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9853)] 07:17:43.295749 run osmo-stp_10.42.42.5(pid=9853): stdout: | (launched: 2022-12-10_07:17:41.871273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:43.431575 run osmo-stp_10.42.42.5(pid=9853): stderr: | [0;m[38;5;43m20221210071742060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071742061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071742061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071742061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071742062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071742062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071742062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:43.567333 run osmo-stp_10.42.42.5(pid=9853): stdout: | (launched: 2022-12-10_07:17:41.871273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:43.696676 run osmo-stp_10.42.42.5(pid=9853): stderr: | [0;m[38;5;43m20221210071742060 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071742061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071742061 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071742061 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071742062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071742062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071742062 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:43.850222 run patchelf(pid=9856): Terminating (SIGINT) 07:17:44.028143 run patchelf(pid=9856): Terminated: ok {rc=0} 07:17:44.156897 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9853): Process ended prematurely: osmo-stp_10.42.42.5(pid=9853) [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9853)] [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:17:44.166798 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 07:17:44.194890 run osmo-hlr_10.42.42.2(pid=9850): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9850)] 07:17:44.244372 run osmo-hlr_10.42.42.2(pid=9850): stdout: | (launched: 2022-12-10_07:17:40.888331) 07:17:44.295471 run osmo-hlr_10.42.42.2(pid=9850): stderr: | [0;m[1;31m20221210071741085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071741085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071741085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071741085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071741085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071741085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071741101 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071741111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071741111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071741111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:17:44.347096 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9843): Terminating (SIGTERM) 07:17:44.388427 run iperf3-srv_10.42.42.10(pid=9844): Terminating (SIGTERM) 07:17:44.429712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9845): Terminating (SIGTERM) 07:17:44.471123 run iperf3-srv_10.42.42.10(pid=9846): Terminating (SIGTERM) 07:17:44.512243 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9849): Terminating (SIGTERM) 07:17:44.553964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9852): Terminating (SIGTERM) 07:17:44.595652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9855): Terminating (SIGTERM) 07:17:44.637315 --- ParallelTerminationStrategy: PID 9843 died... 07:17:44.657119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9843): Terminated: ok {rc=0} 07:17:44.702695 --- ParallelTerminationStrategy: PID 9844 died... 07:17:44.721937 run iperf3-srv_10.42.42.10(pid=9844): Terminated {rc=256} 07:17:44.767150 --- ParallelTerminationStrategy: PID 9845 died... 07:17:44.786367 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9845): Terminated: ok {rc=0} 07:17:44.831525 --- ParallelTerminationStrategy: PID 9846 died... 07:17:44.850732 run iperf3-srv_10.42.42.10(pid=9846): Terminated {rc=256} 07:17:44.895886 --- ParallelTerminationStrategy: PID 9849 died... 07:17:44.915081 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9849): Terminated: ok {rc=0} 07:17:44.960475 --- ParallelTerminationStrategy: PID 9852 died... 07:17:44.979812 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9852): Terminated: ok {rc=0} 07:17:45.025248 --- ParallelTerminationStrategy: PID 9855 died... 07:17:45.044513 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9855): Terminated: ok {rc=0} 07:17:45.131211 bus /gobi_0: Setting Powered False 07:17:46.231222 bus /gobi_0: Setting Powered False 07:17:47.348086 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:17:48.491830 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:48.503033 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:17:48.555659 tst iperf3.py: using LAC 26749 07:17:48.673872 tst iperf3.py: using RAC 229 07:17:48.790163 tst iperf3.py: using CellId 26749 07:17:48.907420 tst iperf3.py: using BVCI 26750 07:17:49.014427 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:49.025181 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:49.035526 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:49.046074 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:49.056632 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:49.067466 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:49.078498 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:49.088917 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:49.099765 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:17:49.213175 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:17:49.412243 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:17:49.709171 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9857): Launched 07:17:49.966287 run iperf3-srv_10.42.42.10(pid=9858): Launched 07:17:50.077359 tst iperf3.py:8: start network... 07:17:50.275118 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:17:50.730658 run create_hlr_db(pid=9859): Launched 07:17:50.843055 bus /gobi_6: Setting Powered False 07:17:51.902760 run create_hlr_db(pid=9859): Terminated: ok {rc=0} 07:17:52.335345 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9861): Launched 07:17:52.652516 run osmo-hlr_10.42.42.2(pid=9862): Launched 07:17:52.774145 run osmo-stp_10.42.42.5: Starting osmo-stp 07:17:53.320421 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9864): Launched 07:17:53.636672 run osmo-stp_10.42.42.5(pid=9865): Launched 07:17:53.758188 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:17:54.302822 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9867): Launched 07:17:54.424873 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:17:54.692699 run patchelf(pid=9868): Launched 07:17:54.869205 run osmo-stp_10.42.42.5(pid=9865): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9865)] 07:17:55.003407 run osmo-stp_10.42.42.5(pid=9865): stdout: | (launched: 2022-12-10_07:17:53.579551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:55.139345 run osmo-stp_10.42.42.5(pid=9865): stderr: | [0;m[38;5;43m20221210071753770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071753770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071753770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071753771 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071753773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071753773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071753773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:55.275539 run osmo-stp_10.42.42.5(pid=9865): stdout: | (launched: 2022-12-10_07:17:53.579551) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:17:55.405746 run osmo-stp_10.42.42.5(pid=9865): stderr: | [0;m[38;5;43m20221210071753770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071753770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071753770 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071753771 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071753773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071753773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071753773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:17:55.559610 run patchelf(pid=9868): Terminating (SIGINT) 07:17:55.737555 run patchelf(pid=9868): Terminated: ok {rc=0} 07:17:55.865969 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9865): Process ended prematurely: osmo-stp_10.42.42.5(pid=9865) [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9865)] [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8] 07:17:55.875844 tst iperf3.py:8: Test FAILED (7.4 sec) 07:17:55.904063 run osmo-hlr_10.42.42.2(pid=9862): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9862)] 07:17:55.953558 run osmo-hlr_10.42.42.2(pid=9862): stdout: | (launched: 2022-12-10_07:17:52.595573) 07:17:56.005222 run osmo-hlr_10.42.42.2(pid=9862): stderr: | [0;m[1;31m20221210071752793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071752793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071752793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071752793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071752793 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071752794 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071752804 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071752813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071752813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071752813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:17:56.057140 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9857): Terminating (SIGTERM) 07:17:56.098644 run iperf3-srv_10.42.42.10(pid=9858): Terminating (SIGTERM) 07:17:56.140005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9861): Terminating (SIGTERM) 07:17:56.181280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9864): Terminating (SIGTERM) 07:17:56.222613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9867): Terminating (SIGTERM) 07:17:56.264371 --- ParallelTerminationStrategy: PID 9857 died... 07:17:56.284229 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9857): Terminated: ok {rc=0} 07:17:56.330138 --- ParallelTerminationStrategy: PID 9858 died... 07:17:56.349432 run iperf3-srv_10.42.42.10(pid=9858): Terminated {rc=256} 07:17:56.395514 --- ParallelTerminationStrategy: PID 9861 died... 07:17:56.414952 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9861): Terminated: ok {rc=0} 07:17:56.460503 --- ParallelTerminationStrategy: PID 9864 died... 07:17:56.479879 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9864): Terminated: ok {rc=0} 07:17:56.525712 --- ParallelTerminationStrategy: PID 9867 died... 07:17:56.545093 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9867): Terminated: ok {rc=0} 07:17:56.632509 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:17:57.777797 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:57.789067 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:17:57.841173 tst iperf3m4.py: using LAC 26750 07:17:57.958707 tst iperf3m4.py: using RAC 230 07:17:58.078353 tst iperf3m4.py: using CellId 26750 07:17:58.207467 tst iperf3m4.py: using BVCI 26751 07:17:58.324020 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:58.335476 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:58.346565 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:58.357635 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:58.368596 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:58.379607 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:58.390841 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:58.401884 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:17:58.413013 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:17:58.528051 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:17:58.645508 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:17:58.763888 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:17:58.881088 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:17:59.078960 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:17:59.374940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9869): Launched 07:17:59.631661 run iperf3-srv_10.42.42.10(pid=9870): Launched 07:17:59.742608 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:17:59.939950 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:18:00.235363 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9871): Launched 07:18:00.491855 run iperf3-srv_10.42.42.10(pid=9872): Launched 07:18:00.603425 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:18:00.800431 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:18:01.145671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9873): Launched 07:18:01.450571 run iperf3-srv_10.42.42.10(pid=9874): Launched 07:18:01.580021 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:18:01.800660 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:18:02.134631 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9875): Launched 07:18:02.409948 run iperf3-srv_10.42.42.10(pid=9876): Launched 07:18:02.528587 tst iperf3m4.py:8: start network... 07:18:02.741744 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:18:03.230834 run create_hlr_db(pid=9877): Launched 07:18:03.360140 bus /gobi_6: Setting Powered False 07:18:04.419010 run create_hlr_db(pid=9877): Terminated: ok {rc=0} 07:18:04.859954 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9879): Launched 07:18:05.176757 run osmo-hlr_10.42.42.2(pid=9880): Launched 07:18:05.298004 run osmo-stp_10.42.42.5: Starting osmo-stp 07:18:05.845154 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9882): Launched 07:18:06.161271 run osmo-stp_10.42.42.5(pid=9883): Launched 07:18:06.282149 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:18:06.826454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9885): Launched 07:18:06.947939 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:18:07.214669 run patchelf(pid=9886): Launched 07:18:07.391295 run osmo-stp_10.42.42.5(pid=9883): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9883)] 07:18:07.526805 run osmo-stp_10.42.42.5(pid=9883): stdout: | (launched: 2022-12-10_07:18:06.103851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:07.663182 run osmo-stp_10.42.42.5(pid=9883): stderr: | [0;m[38;5;43m20221210071806295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071806295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071806296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071806296 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071806296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071806297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071806297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:07.798868 run osmo-stp_10.42.42.5(pid=9883): stdout: | (launched: 2022-12-10_07:18:06.103851) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:07.928347 run osmo-stp_10.42.42.5(pid=9883): stderr: | [0;m[38;5;43m20221210071806295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071806295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071806296 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071806296 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071806296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071806297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071806297 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:08.082616 run patchelf(pid=9886): Terminating (SIGINT) 07:18:08.260806 run patchelf(pid=9886): Terminated: ok {rc=0} 07:18:08.389709 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9883): Process ended prematurely: osmo-stp_10.42.42.5(pid=9883) [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9883)] [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8] 07:18:08.399691 tst iperf3m4.py:8: Test FAILED (10.7 sec) 07:18:08.428356 run osmo-hlr_10.42.42.2(pid=9880): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9880)] 07:18:08.477766 run osmo-hlr_10.42.42.2(pid=9880): stdout: | (launched: 2022-12-10_07:18:05.119542) 07:18:08.528841 run osmo-hlr_10.42.42.2(pid=9880): stderr: | [0;m[1;31m20221210071805319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071805319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071805319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071805319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071805319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071805319 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071805418 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071805427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071805427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071805427 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:18:08.580729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9869): Terminating (SIGTERM) 07:18:08.622206 run iperf3-srv_10.42.42.10(pid=9870): Terminating (SIGTERM) 07:18:08.663819 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9871): Terminating (SIGTERM) 07:18:08.705679 run iperf3-srv_10.42.42.10(pid=9872): Terminating (SIGTERM) 07:18:08.747342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9873): Terminating (SIGTERM) 07:18:08.789107 run iperf3-srv_10.42.42.10(pid=9874): Terminating (SIGTERM) 07:18:08.830736 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9875): Terminating (SIGTERM) 07:18:08.872541 run iperf3-srv_10.42.42.10(pid=9876): Terminating (SIGTERM) 07:18:08.914187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9879): Terminating (SIGTERM) 07:18:08.955578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9882): Terminating (SIGTERM) 07:18:08.997131 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9885): Terminating (SIGTERM) 07:18:09.038797 --- ParallelTerminationStrategy: PID 9869 died... 07:18:09.058732 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9869): Terminated: ok {rc=0} 07:18:09.105158 --- ParallelTerminationStrategy: PID 9870 died... 07:18:09.124645 run iperf3-srv_10.42.42.10(pid=9870): Terminated {rc=256} 07:18:09.170362 --- ParallelTerminationStrategy: PID 9871 died... 07:18:09.189832 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9871): Terminated: ok {rc=0} 07:18:09.235391 --- ParallelTerminationStrategy: PID 9872 died... 07:18:09.254784 run iperf3-srv_10.42.42.10(pid=9872): Terminated {rc=256} 07:18:09.300365 --- ParallelTerminationStrategy: PID 9873 died... 07:18:09.319940 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9873): Terminated: ok {rc=0} 07:18:09.365556 --- ParallelTerminationStrategy: PID 9874 died... 07:18:09.384855 run iperf3-srv_10.42.42.10(pid=9874): Terminated {rc=256} 07:18:09.430559 --- ParallelTerminationStrategy: PID 9875 died... 07:18:09.450170 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9875): Terminated: ok {rc=0} 07:18:09.495623 --- ParallelTerminationStrategy: PID 9876 died... 07:18:09.515193 run iperf3-srv_10.42.42.10(pid=9876): Terminated {rc=256} 07:18:09.560879 --- ParallelTerminationStrategy: PID 9879 died... 07:18:09.580419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9879): Terminated: ok {rc=0} 07:18:09.626303 --- ParallelTerminationStrategy: PID 9882 died... 07:18:09.645912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9882): Terminated: ok {rc=0} 07:18:09.691496 --- ParallelTerminationStrategy: PID 9885 died... 07:18:09.711078 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9885): Terminated: ok {rc=0} 07:18:09.798102 bus /gobi_4: Setting Powered False 07:18:10.896514 bus /gobi_4: Setting Powered False 07:18:12.012326 bus /gobi_1: Setting Powered False 07:18:13.112691 bus /gobi_1: Setting Powered False 07:18:14.226931 bus /gobi_0: Setting Powered False 07:18:15.324256 bus /gobi_0: Setting Powered False 07:18:16.440480 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-egprs ping.py ---------------------------------------------- 07:18:17.543795 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:17.555916 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:18:17.608160 tst ping.py: using LAC 26751 07:18:17.733148 tst ping.py: using RAC 231 07:18:17.856806 tst ping.py: using CellId 26751 07:18:17.978282 tst ping.py: using BVCI 26752 07:18:18.091054 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:18.102372 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:18.113473 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:18.124514 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:18.135475 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:18.146543 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:18.158176 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:18.169151 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:18:18.282633 tst ping.py:19: start network... 07:18:18.477579 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:18:18.927294 run create_hlr_db(pid=9887): Launched 07:18:19.040263 bus /gobi_6: Setting Powered False 07:18:20.099412 run create_hlr_db(pid=9887): Terminated: ok {rc=0} 07:18:20.526552 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9889): Launched 07:18:20.838439 run osmo-hlr_10.42.42.2(pid=9890): Launched 07:18:20.957342 run osmo-stp_10.42.42.5: Starting osmo-stp 07:18:21.497596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9892): Launched 07:18:21.808510 run osmo-stp_10.42.42.5(pid=9893): Launched 07:18:21.927677 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:18:22.462102 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9895): Launched 07:18:22.581701 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:18:22.844221 run patchelf(pid=9896): Launched 07:18:23.017404 run osmo-stp_10.42.42.5(pid=9893): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9893)] 07:18:23.148898 run osmo-stp_10.42.42.5(pid=9893): stdout: | (launched: 2022-12-10_07:18:21.752101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:23.282486 run osmo-stp_10.42.42.5(pid=9893): stderr: | [0;m[38;5;43m20221210071821942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071821942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071821942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071821943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071821945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071821945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071821945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:23.415793 run osmo-stp_10.42.42.5(pid=9893): stdout: | (launched: 2022-12-10_07:18:21.752101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:23.543927 run osmo-stp_10.42.42.5(pid=9893): stderr: | [0;m[38;5;43m20221210071821942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071821942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071821942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071821943 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071821945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071821945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071821945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:23.695707 run patchelf(pid=9896): Terminating (SIGINT) 07:18:23.870652 run patchelf(pid=9896): Terminated: ok {rc=0} 07:18:23.996571 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9893): Process ended prematurely: osmo-stp_10.42.42.5(pid=9893) [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9893)] [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22] 07:18:24.005988 tst ping.py:22: Test FAILED (6.5 sec) 07:18:24.033814 run osmo-hlr_10.42.42.2(pid=9890): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9890)] 07:18:24.083807 run osmo-hlr_10.42.42.2(pid=9890): stdout: | (launched: 2022-12-10_07:18:20.782160) 07:18:24.135287 run osmo-hlr_10.42.42.2(pid=9890): stderr: | [0;m[1;31m20221210071820977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071820977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071820977 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071820978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071820978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071820978 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071820990 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071820998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071820998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071820998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:18:24.187093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9889): Terminating (SIGTERM) 07:18:24.228503 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9892): Terminating (SIGTERM) 07:18:24.270153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9895): Terminating (SIGTERM) 07:18:24.311774 --- ParallelTerminationStrategy: PID 9889 died... 07:18:24.331827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9889): Terminated: ok {rc=0} 07:18:24.378049 --- ParallelTerminationStrategy: PID 9892 died... 07:18:24.397584 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9892): Terminated: ok {rc=0} 07:18:24.443070 --- ParallelTerminationStrategy: PID 9895 died... 07:18:24.462629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9895): Terminated: ok {rc=0} 07:18:24.550085 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:18:25.637839 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:25.649719 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:18:25.702131 tst ping_idle_ping.py: using LAC 26752 07:18:25.817968 tst ping_idle_ping.py: using RAC 232 07:18:25.932936 tst ping_idle_ping.py: using CellId 26752 07:18:26.057140 tst ping_idle_ping.py: using BVCI 26753 07:18:26.170909 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:26.182473 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:26.193845 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:26.205592 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:26.217312 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:26.229503 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:26.240833 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:18:26.252370 tst gprs:trx-b200+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:18:26.368658 tst ping_idle_ping.py:24: start network... 07:18:26.564156 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:18:27.014595 run create_hlr_db(pid=9897): Launched 07:18:27.126651 bus /gobi_6: Setting Powered False 07:18:28.185393 run create_hlr_db(pid=9897): Terminated: ok {rc=0} 07:18:28.591563 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9899): Launched 07:18:28.882385 run osmo-hlr_10.42.42.2(pid=9900): Launched 07:18:28.994069 run osmo-stp_10.42.42.5: Starting osmo-stp 07:18:29.492456 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9902): Launched 07:18:29.785022 run osmo-stp_10.42.42.5(pid=9903): Launched 07:18:29.897265 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:18:30.399642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9905): Launched 07:18:30.511241 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:18:30.756565 run patchelf(pid=9906): Launched 07:18:30.929118 run osmo-stp_10.42.42.5(pid=9903): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9903)] 07:18:31.055760 run osmo-stp_10.42.42.5(pid=9903): stdout: | (launched: 2022-12-10_07:18:29.731545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:31.185201 run osmo-stp_10.42.42.5(pid=9903): stderr: | [0;m[38;5;43m20221210071829899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071829900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071829900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071829900 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071829901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071829901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071829901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:31.314891 run osmo-stp_10.42.42.5(pid=9903): stdout: | (launched: 2022-12-10_07:18:29.731545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:31.437985 run osmo-stp_10.42.42.5(pid=9903): stderr: | [0;m[38;5;43m20221210071829899 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071829900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071829900 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071829900 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071829901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071829901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071829901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:31.583670 run patchelf(pid=9906): Terminating (SIGINT) 07:18:31.754012 run patchelf(pid=9906): Terminated: ok {rc=0} 07:18:31.876469 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9903): Process ended prematurely: osmo-stp_10.42.42.5(pid=9903) [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9903)] [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27] 07:18:31.886395 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 07:18:31.916587 run osmo-hlr_10.42.42.2(pid=9900): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9900)] 07:18:31.966672 run osmo-hlr_10.42.42.2(pid=9900): stdout: | (launched: 2022-12-10_07:18:28.829215) 07:18:32.018362 run osmo-hlr_10.42.42.2(pid=9900): stderr: | [0;m[1;31m20221210071829006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071829006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071829006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071829006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071829006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071829006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071829018 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071829026 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071829027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071829027 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:18:32.070792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9899): Terminating (SIGTERM) 07:18:32.112729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9902): Terminating (SIGTERM) 07:18:32.154703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9905): Terminating (SIGTERM) 07:18:32.197154 --- ParallelTerminationStrategy: PID 9899 died... 07:18:32.216747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9899): Terminated: ok {rc=0} 07:18:32.263623 --- ParallelTerminationStrategy: PID 9902 died... 07:18:32.282321 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9902): Terminated: ok {rc=0} 07:18:32.327331 --- ParallelTerminationStrategy: PID 9905 died... 07:18:32.345977 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9905): Terminated: ok {rc=0} 07:18:32.433119 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:18:33.738028 tst gprs:trx-b200+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:18:33.744176 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:18:33.778575 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:18:33.816414 tst gprs:trx-b200+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:18:33.902062 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:18:33.934659 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:18:33.972329 tst gprs:trx-b200+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:18:34.563885 tst gprs:trx-b200+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:18:34.611861 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:34.622610 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:18:34.691123 tst cs_paging_gprs_active.py: using LAC 26753 07:18:34.812567 tst cs_paging_gprs_active.py: using RAC 233 07:18:34.937564 tst cs_paging_gprs_active.py: using CellId 26753 07:18:35.063751 tst cs_paging_gprs_active.py: using BVCI 26754 07:18:35.179284 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:35.190654 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:35.201932 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:35.213805 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:35.225298 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:35.237073 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:35.248862 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:35.261873 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:35.272640 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:18:35.390190 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:18:35.506277 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:18:35.705057 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:18:36.002119 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9910): Launched 07:18:36.259277 run iperf3-srv_10.42.42.10(pid=9911): Launched 07:18:36.370973 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:18:36.568424 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:18:36.864395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9912): Launched 07:18:37.121967 run iperf3-srv_10.42.42.10(pid=9913): Launched 07:18:37.232801 tst cs_paging_gprs_active.py:38: start network... 07:18:37.430101 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:18:37.885952 run create_hlr_db(pid=9914): Launched 07:18:37.999809 bus /gobi_6: Setting Powered False 07:18:39.058617 run create_hlr_db(pid=9914): Terminated: ok {rc=0} 07:18:39.469827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9916): Launched 07:18:39.764570 run osmo-hlr_10.42.42.2(pid=9917): Launched 07:18:39.878334 run osmo-stp_10.42.42.5: Starting osmo-stp 07:18:40.387200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9919): Launched 07:18:40.682276 run osmo-stp_10.42.42.5(pid=9920): Launched 07:18:40.797943 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:18:41.306274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9923): Launched 07:18:41.419905 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:18:41.669095 run patchelf(pid=9924): Launched 07:18:41.834477 run osmo-stp_10.42.42.5(pid=9920): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9920)] 07:18:41.959849 run osmo-stp_10.42.42.5(pid=9920): stdout: | (launched: 2022-12-10_07:18:40.628770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:42.086822 run osmo-stp_10.42.42.5(pid=9920): stderr: | [0;m[38;5;43m20221210071840798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071840798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071840798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071840799 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071840799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071840799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071840799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:42.214193 run osmo-stp_10.42.42.5(pid=9920): stdout: | (launched: 2022-12-10_07:18:40.628770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:42.335787 run osmo-stp_10.42.42.5(pid=9920): stderr: | [0;m[38;5;43m20221210071840798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071840798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071840798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071840799 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071840799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071840799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071840799 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:42.479397 run patchelf(pid=9924): Terminating (SIGINT) 07:18:42.646705 run patchelf(pid=9924): Terminated: ok {rc=0} 07:18:42.767810 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9920): Process ended prematurely: osmo-stp_10.42.42.5(pid=9920) [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9920)] [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:18:42.777102 tst cs_paging_gprs_active.py:38: Test FAILED (8.2 sec) 07:18:42.804081 run osmo-hlr_10.42.42.2(pid=9917): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9917)] 07:18:42.851912 run osmo-hlr_10.42.42.2(pid=9917): stdout: | (launched: 2022-12-10_07:18:39.711220) 07:18:42.901280 run osmo-hlr_10.42.42.2(pid=9917): stderr: | [0;m[1;31m20221210071839885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071839885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071839885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071839885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071839885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071839885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071839897 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071839906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071839906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071839906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:18:42.950802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9910): Terminating (SIGTERM) 07:18:42.990483 run iperf3-srv_10.42.42.10(pid=9911): Terminating (SIGTERM) 07:18:43.030097 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9912): Terminating (SIGTERM) 07:18:43.069829 run iperf3-srv_10.42.42.10(pid=9913): Terminating (SIGTERM) 07:18:43.109271 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9916): Terminating (SIGTERM) 07:18:43.148925 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9919): Terminating (SIGTERM) 07:18:43.188364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9923): Terminating (SIGTERM) 07:18:43.228220 --- ParallelTerminationStrategy: PID 9910 died... 07:18:43.247244 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9910): Terminated: ok {rc=0} 07:18:43.291297 --- ParallelTerminationStrategy: PID 9911 died... 07:18:43.309565 run iperf3-srv_10.42.42.10(pid=9911): Terminated {rc=256} 07:18:43.353152 --- ParallelTerminationStrategy: PID 9912 died... 07:18:43.371455 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9912): Terminated: ok {rc=0} 07:18:43.415491 --- ParallelTerminationStrategy: PID 9913 died... 07:18:43.433857 run iperf3-srv_10.42.42.10(pid=9913): Terminated {rc=256} 07:18:43.477395 --- ParallelTerminationStrategy: PID 9916 died... 07:18:43.495753 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9916): Terminated: ok {rc=0} 07:18:43.539314 --- ParallelTerminationStrategy: PID 9919 died... 07:18:43.557749 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9919): Terminated: ok {rc=0} 07:18:43.601329 --- ParallelTerminationStrategy: PID 9923 died... 07:18:43.619656 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9923): Terminated: ok {rc=0} 07:18:43.703622 bus /gobi_0: Setting Powered False 07:18:44.798978 bus /gobi_0: Setting Powered False 07:18:45.928491 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:18:47.079732 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:47.092600 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:18:47.170654 tst iperf3.py: using LAC 26754 07:18:47.295577 tst iperf3.py: using RAC 234 07:18:47.411457 tst iperf3.py: using CellId 26754 07:18:47.529828 tst iperf3.py: using BVCI 26755 07:18:47.645716 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:47.657145 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:47.668347 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:47.679395 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:47.690611 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:47.701928 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:47.713241 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:47.724387 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:47.735766 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:18:47.852235 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:18:48.051018 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:18:48.347677 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9925): Launched 07:18:48.605788 run iperf3-srv_10.42.42.10(pid=9926): Launched 07:18:48.716442 tst iperf3.py:8: start network... 07:18:48.913533 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:18:49.368264 run create_hlr_db(pid=9927): Launched 07:18:49.482366 bus /gobi_6: Setting Powered False 07:18:50.540884 run create_hlr_db(pid=9927): Terminated: ok {rc=0} 07:18:50.971579 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9929): Launched 07:18:51.286928 run osmo-hlr_10.42.42.2(pid=9930): Launched 07:18:51.408107 run osmo-stp_10.42.42.5: Starting osmo-stp 07:18:51.956090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9932): Launched 07:18:52.271888 run osmo-stp_10.42.42.5(pid=9933): Launched 07:18:52.393238 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:18:52.940044 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9935): Launched 07:18:53.061956 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:18:53.328905 run patchelf(pid=9936): Launched 07:18:53.505901 run osmo-stp_10.42.42.5(pid=9933): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9933)] 07:18:53.641150 run osmo-stp_10.42.42.5(pid=9933): stdout: | (launched: 2022-12-10_07:18:52.214957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:53.776938 run osmo-stp_10.42.42.5(pid=9933): stderr: | [0;m[38;5;43m20221210071852404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071852405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071852405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071852405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071852408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071852408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071852408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:53.913404 run osmo-stp_10.42.42.5(pid=9933): stdout: | (launched: 2022-12-10_07:18:52.214957) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:18:54.042957 run osmo-stp_10.42.42.5(pid=9933): stderr: | [0;m[38;5;43m20221210071852404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071852405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071852405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071852405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071852408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071852408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071852408 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:18:54.196392 run patchelf(pid=9936): Terminating (SIGINT) 07:18:54.374519 run patchelf(pid=9936): Terminated: ok {rc=0} 07:18:54.503045 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9933): Process ended prematurely: osmo-stp_10.42.42.5(pid=9933) [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9933)] [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8] 07:18:54.512675 tst iperf3.py:8: Test FAILED (7.5 sec) 07:18:54.541458 run osmo-hlr_10.42.42.2(pid=9930): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9930)] 07:18:54.591910 run osmo-hlr_10.42.42.2(pid=9930): stdout: | (launched: 2022-12-10_07:18:51.229999) 07:18:54.643695 run osmo-hlr_10.42.42.2(pid=9930): stderr: | [0;m[1;31m20221210071851427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071851427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071851427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071851427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071851427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071851427 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071851440 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071851448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071851448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071851448 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:18:54.695983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9925): Terminating (SIGTERM) 07:18:54.737646 run iperf3-srv_10.42.42.10(pid=9926): Terminating (SIGTERM) 07:18:54.779448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9929): Terminating (SIGTERM) 07:18:54.821365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9932): Terminating (SIGTERM) 07:18:54.863062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9935): Terminating (SIGTERM) 07:18:54.905086 --- ParallelTerminationStrategy: PID 9925 died... 07:18:54.925129 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9925): Terminated: ok {rc=0} 07:18:54.971199 --- ParallelTerminationStrategy: PID 9926 died... 07:18:54.990822 run iperf3-srv_10.42.42.10(pid=9926): Terminated {rc=256} 07:18:55.036354 --- ParallelTerminationStrategy: PID 9929 died... 07:18:55.055796 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9929): Terminated: ok {rc=0} 07:18:55.101549 --- ParallelTerminationStrategy: PID 9932 died... 07:18:55.120775 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9932): Terminated: ok {rc=0} 07:18:55.166322 --- ParallelTerminationStrategy: PID 9935 died... 07:18:55.185828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9935): Terminated: ok {rc=0} 07:18:55.273535 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:18:56.421377 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:56.433418 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:18:56.505804 tst iperf3m4.py: using LAC 26755 07:18:56.628628 tst iperf3m4.py: using RAC 235 07:18:56.750540 tst iperf3m4.py: using CellId 26755 07:18:56.872484 tst iperf3m4.py: using BVCI 26756 07:18:56.986895 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:56.998250 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:57.009432 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:57.020500 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:57.031518 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:57.042680 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:57.053849 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:57.064908 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:18:57.076281 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:18:57.190724 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:18:57.313360 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:18:57.432025 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:18:57.548906 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:18:57.748846 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:18:58.046192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9938): Launched 07:18:58.303718 run iperf3-srv_10.42.42.10(pid=9939): Launched 07:18:58.415227 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:18:58.612683 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:18:58.909486 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9940): Launched 07:18:59.166648 run iperf3-srv_10.42.42.10(pid=9941): Launched 07:18:59.277960 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:18:59.475509 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:18:59.771104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9942): Launched 07:19:00.029228 run iperf3-srv_10.42.42.10(pid=9943): Launched 07:19:00.140389 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:19:00.337722 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:19:00.634014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9944): Launched 07:19:00.917875 run iperf3-srv_10.42.42.10(pid=9945): Launched 07:19:01.066289 tst iperf3m4.py:8: start network... 07:19:01.307418 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:19:01.782576 run create_hlr_db(pid=9946): Launched 07:19:01.925078 bus /gobi_6: Setting Powered False 07:19:02.988066 run create_hlr_db(pid=9946): Terminated: ok {rc=0} 07:19:03.419813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9948): Launched 07:19:03.715846 run osmo-hlr_10.42.42.2(pid=9949): Launched 07:19:03.829626 run osmo-stp_10.42.42.5: Starting osmo-stp 07:19:04.340640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9951): Launched 07:19:04.637074 run osmo-stp_10.42.42.5(pid=9952): Launched 07:19:04.750608 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:19:05.259192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9954): Launched 07:19:05.373017 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:19:05.621946 run patchelf(pid=9955): Launched 07:19:05.787074 run osmo-stp_10.42.42.5(pid=9952): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9952)] 07:19:05.912376 run osmo-stp_10.42.42.5(pid=9952): stdout: | (launched: 2022-12-10_07:19:04.582964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:06.039343 run osmo-stp_10.42.42.5(pid=9952): stderr: | [0;m[38;5;43m20221210071904753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071904753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071904753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071904754 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071904754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071904754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071904754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:06.166212 run osmo-stp_10.42.42.5(pid=9952): stdout: | (launched: 2022-12-10_07:19:04.582964) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:06.287202 run osmo-stp_10.42.42.5(pid=9952): stderr: | [0;m[38;5;43m20221210071904753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071904753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071904753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071904754 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071904754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071904754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071904754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:06.430614 run patchelf(pid=9955): Terminating (SIGINT) 07:19:06.598497 run patchelf(pid=9955): Terminated: ok {rc=0} 07:19:06.719366 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=9952): Process ended prematurely: osmo-stp_10.42.42.5(pid=9952) [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9952)] [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:19:06.728690 tst iperf3m4.py:8: Test FAILED (10.3 sec) 07:19:06.756136 run osmo-hlr_10.42.42.2(pid=9949): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9949)] 07:19:06.803845 run osmo-hlr_10.42.42.2(pid=9949): stdout: | (launched: 2022-12-10_07:19:03.662022) 07:19:06.853254 run osmo-hlr_10.42.42.2(pid=9949): stderr: | [0;m[1;31m20221210071903842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071903842 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071903843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071903843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071903843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071903843 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071903853 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071903862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071903862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071903862 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:19:06.902766 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9938): Terminating (SIGTERM) 07:19:06.942586 run iperf3-srv_10.42.42.10(pid=9939): Terminating (SIGTERM) 07:19:06.982431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9940): Terminating (SIGTERM) 07:19:07.022144 run iperf3-srv_10.42.42.10(pid=9941): Terminating (SIGTERM) 07:19:07.061740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9942): Terminating (SIGTERM) 07:19:07.101451 run iperf3-srv_10.42.42.10(pid=9943): Terminating (SIGTERM) 07:19:07.141085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9944): Terminating (SIGTERM) 07:19:07.180626 run iperf3-srv_10.42.42.10(pid=9945): Terminating (SIGTERM) 07:19:07.220116 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9948): Terminating (SIGTERM) 07:19:07.259707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9951): Terminating (SIGTERM) 07:19:07.299143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9954): Terminating (SIGTERM) 07:19:07.339047 --- ParallelTerminationStrategy: PID 9938 died... 07:19:07.358205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9938): Terminated: ok {rc=0} 07:19:07.402445 --- ParallelTerminationStrategy: PID 9939 died... 07:19:07.420745 run iperf3-srv_10.42.42.10(pid=9939): Terminated {rc=256} 07:19:07.464603 --- ParallelTerminationStrategy: PID 9940 died... 07:19:07.483051 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9940): Terminated: ok {rc=0} 07:19:07.527078 --- ParallelTerminationStrategy: PID 9941 died... 07:19:07.545535 run iperf3-srv_10.42.42.10(pid=9941): Terminated {rc=256} 07:19:07.589277 --- ParallelTerminationStrategy: PID 9942 died... 07:19:07.607749 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9942): Terminated: ok {rc=0} 07:19:07.652037 --- ParallelTerminationStrategy: PID 9943 died... 07:19:07.670465 run iperf3-srv_10.42.42.10(pid=9943): Terminated {rc=256} 07:19:07.714100 --- ParallelTerminationStrategy: PID 9944 died... 07:19:07.732671 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9944): Terminated: ok {rc=0} 07:19:07.776424 --- ParallelTerminationStrategy: PID 9945 died... 07:19:07.794852 run iperf3-srv_10.42.42.10(pid=9945): Terminated {rc=256} 07:19:07.838503 --- ParallelTerminationStrategy: PID 9948 died... 07:19:07.856895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9948): Terminated: ok {rc=0} 07:19:07.900937 --- ParallelTerminationStrategy: PID 9951 died... 07:19:07.919512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9951): Terminated: ok {rc=0} 07:19:07.963396 --- ParallelTerminationStrategy: PID 9954 died... 07:19:07.981843 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9954): Terminated: ok {rc=0} 07:19:08.065622 bus /gobi_4: Setting Powered False 07:19:09.163344 bus /gobi_4: Setting Powered False 07:19:10.279054 bus /gobi_1: Setting Powered False 07:19:11.376788 bus /gobi_1: Setting Powered False 07:19:12.493296 bus /gobi_0: Setting Powered False 07:19:13.590463 bus /gobi_0: Setting Powered False 07:19:14.703589 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:19:15.806285 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:15.818091 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:19:15.889769 tst ping.py: using LAC 26756 07:19:16.025270 tst ping.py: using RAC 236 07:19:16.151644 tst ping.py: using CellId 26756 07:19:16.305888 tst ping.py: using BVCI 26757 07:19:16.427402 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:16.439359 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:16.451026 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:16.462798 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:16.474427 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:16.486606 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:16.498783 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:16.510552 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:19:16.632879 tst ping.py:19: start network... 07:19:16.874253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:19:17.421072 run create_hlr_db(pid=9956): Launched 07:19:17.543980 bus /gobi_6: Setting Powered False 07:19:18.603242 run create_hlr_db(pid=9956): Terminated: ok {rc=0} 07:19:19.029339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9958): Launched 07:19:19.340923 run osmo-hlr_10.42.42.2(pid=9959): Launched 07:19:19.460571 run osmo-stp_10.42.42.5: Starting osmo-stp 07:19:20.001466 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9961): Launched 07:19:20.311832 run osmo-stp_10.42.42.5(pid=9962): Launched 07:19:20.430990 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:19:20.969143 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9964): Launched 07:19:21.088824 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:19:21.352391 run patchelf(pid=9965): Launched 07:19:21.526378 run osmo-stp_10.42.42.5(pid=9962): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9962)] 07:19:21.659334 run osmo-stp_10.42.42.5(pid=9962): stdout: | (launched: 2022-12-10_07:19:20.255633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:21.793303 run osmo-stp_10.42.42.5(pid=9962): stderr: | [0;m[38;5;43m20221210071920448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071920448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071920448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071920449 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071920449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071920449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071920449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:21.927312 run osmo-stp_10.42.42.5(pid=9962): stdout: | (launched: 2022-12-10_07:19:20.255633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:22.055980 run osmo-stp_10.42.42.5(pid=9962): stderr: | [0;m[38;5;43m20221210071920448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071920448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071920448 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071920449 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071920449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071920449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071920449 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:22.207779 run patchelf(pid=9965): Terminating (SIGINT) 07:19:22.383316 run patchelf(pid=9965): Terminated: ok {rc=0} 07:19:22.509746 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=9962): Process ended prematurely: osmo-stp_10.42.42.5(pid=9962) [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9962)] [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22] 07:19:22.519089 tst ping.py:22: Test FAILED (6.7 sec) 07:19:22.547107 run osmo-hlr_10.42.42.2(pid=9959): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9959)] 07:19:22.597501 run osmo-hlr_10.42.42.2(pid=9959): stdout: | (launched: 2022-12-10_07:19:19.284492) 07:19:22.649453 run osmo-hlr_10.42.42.2(pid=9959): stderr: | [0;m[1;31m20221210071919479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071919479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071919479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071919479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071919479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071919479 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071919491 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071919499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071919499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071919500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:19:22.701683 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9958): Terminating (SIGTERM) 07:19:22.743573 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9961): Terminating (SIGTERM) 07:19:22.785606 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9964): Terminating (SIGTERM) 07:19:22.827736 --- ParallelTerminationStrategy: PID 9958 died... 07:19:22.847731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9958): Terminated: ok {rc=0} 07:19:22.894669 --- ParallelTerminationStrategy: PID 9961 died... 07:19:22.914425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9961): Terminated: ok {rc=0} 07:19:22.960465 --- ParallelTerminationStrategy: PID 9964 died... 07:19:22.979984 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9964): Terminated: ok {rc=0} 07:19:23.067509 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:19:24.155755 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:24.168026 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:19:24.239149 tst ping_idle_ping.py: using LAC 26757 07:19:24.362228 tst ping_idle_ping.py: using RAC 237 07:19:24.486438 tst ping_idle_ping.py: using CellId 26757 07:19:24.610844 tst ping_idle_ping.py: using BVCI 26758 07:19:24.726012 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:24.737435 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:24.748677 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:24.759823 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:24.770902 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:24.782045 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:24.793253 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:19:24.804189 tst gprs:trx-b200+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:19:24.922121 tst ping_idle_ping.py:24: start network... 07:19:25.133486 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:19:25.624816 run create_hlr_db(pid=9966): Launched 07:19:25.752657 bus /gobi_6: Setting Powered False 07:19:26.815397 run create_hlr_db(pid=9966): Terminated: ok {rc=0} 07:19:27.234004 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9968): Launched 07:19:27.525661 run osmo-hlr_10.42.42.2(pid=9969): Launched 07:19:27.647915 run osmo-stp_10.42.42.5: Starting osmo-stp 07:19:28.187064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9971): Launched 07:19:28.498483 run osmo-stp_10.42.42.5(pid=9972): Launched 07:19:28.618629 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:19:29.156007 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9974): Launched 07:19:29.275552 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:19:29.538391 run patchelf(pid=9975): Launched 07:19:29.713169 run osmo-stp_10.42.42.5(pid=9972): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9972)] 07:19:29.845554 run osmo-stp_10.42.42.5(pid=9972): stdout: | (launched: 2022-12-10_07:19:28.442127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:29.979469 run osmo-stp_10.42.42.5(pid=9972): stderr: | [0;m[38;5;43m20221210071928633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071928633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071928634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071928634 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071928634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071928634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071928634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:30.114175 run osmo-stp_10.42.42.5(pid=9972): stdout: | (launched: 2022-12-10_07:19:28.442127) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:30.242475 run osmo-stp_10.42.42.5(pid=9972): stderr: | [0;m[38;5;43m20221210071928633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071928633 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071928634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071928634 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071928634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071928634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071928634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:30.394221 run patchelf(pid=9975): Terminating (SIGINT) 07:19:30.569367 run patchelf(pid=9975): Terminated: ok {rc=0} 07:19:30.696699 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=9972): Process ended prematurely: osmo-stp_10.42.42.5(pid=9972) [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9972)] [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 07:19:30.706053 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 07:19:30.733815 run osmo-hlr_10.42.42.2(pid=9969): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9969)] 07:19:30.783446 run osmo-hlr_10.42.42.2(pid=9969): stdout: | (launched: 2022-12-10_07:19:27.471789) 07:19:30.835175 run osmo-hlr_10.42.42.2(pid=9969): stderr: | [0;m[1;31m20221210071927664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071927664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071927664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071927664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071927664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071927664 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071927676 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071927684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071927684 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071927685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:19:30.911835 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9968): Terminating (SIGTERM) 07:19:30.954962 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9971): Terminating (SIGTERM) 07:19:30.998563 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9974): Terminating (SIGTERM) 07:19:31.041658 --- ParallelTerminationStrategy: PID 9968 died... 07:19:31.062303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9968): Terminated: ok {rc=0} 07:19:31.111062 --- ParallelTerminationStrategy: PID 9971 died... 07:19:31.131491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9971): Terminated: ok {rc=0} 07:19:31.178193 --- ParallelTerminationStrategy: PID 9974 died... 07:19:31.197919 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9974): Terminated: ok {rc=0} 07:19:31.287120 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:19:32.593250 tst gprs:trx-b200+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:19:32.600166 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:19:32.633706 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 07:19:32.672683 tst gprs:trx-b200+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 07:19:32.762574 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:19:32.797095 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 07:19:32.836279 tst gprs:trx-b200+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 07:19:33.429590 tst gprs:trx-b200+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 07:19:33.481110 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:33.492467 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:19:33.564151 tst cs_paging_gprs_active.py: using LAC 26758 07:19:33.690661 tst cs_paging_gprs_active.py: using RAC 238 07:19:33.814858 tst cs_paging_gprs_active.py: using CellId 26758 07:19:33.940713 tst cs_paging_gprs_active.py: using BVCI 26759 07:19:34.055734 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:34.066925 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:34.077999 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:34.089410 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:34.100656 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:34.112133 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:34.123509 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:34.134891 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:34.146457 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:19:34.262179 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:19:34.381531 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:19:34.599159 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:19:34.917460 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9979): Launched 07:19:35.193573 run iperf3-srv_10.42.42.10(pid=9980): Launched 07:19:35.313270 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:19:35.527842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:19:35.846614 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9981): Launched 07:19:36.122638 run iperf3-srv_10.42.42.10(pid=9982): Launched 07:19:36.242383 tst cs_paging_gprs_active.py:38: start network... 07:19:36.456913 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:19:36.948439 run create_hlr_db(pid=9983): Launched 07:19:37.077612 bus /gobi_6: Setting Powered False 07:19:38.142161 run create_hlr_db(pid=9983): Terminated: ok {rc=0} 07:19:38.564651 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9985): Launched 07:19:38.861441 run osmo-hlr_10.42.42.2(pid=9986): Launched 07:19:38.975749 run osmo-stp_10.42.42.5: Starting osmo-stp 07:19:39.500430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9988): Launched 07:19:39.796226 run osmo-stp_10.42.42.5(pid=9989): Launched 07:19:39.910777 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:19:40.423680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9991): Launched 07:19:40.538650 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:19:40.788565 run patchelf(pid=9992): Launched 07:19:40.953609 run osmo-stp_10.42.42.5(pid=9989): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9989)] 07:19:41.078856 run osmo-stp_10.42.42.5(pid=9989): stdout: | (launched: 2022-12-10_07:19:39.742412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:41.205973 run osmo-stp_10.42.42.5(pid=9989): stderr: | [0;m[38;5;43m20221210071939910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071939910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071939910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071939911 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071939911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071939911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071939911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:41.332893 run osmo-stp_10.42.42.5(pid=9989): stdout: | (launched: 2022-12-10_07:19:39.742412) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:41.453903 run osmo-stp_10.42.42.5(pid=9989): stderr: | [0;m[38;5;43m20221210071939910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071939910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071939910 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071939911 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071939911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071939911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071939911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:41.597963 run patchelf(pid=9992): Terminating (SIGINT) 07:19:41.765328 run patchelf(pid=9992): Terminated: ok {rc=0} 07:19:41.886559 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=9989): Process ended prematurely: osmo-stp_10.42.42.5(pid=9989) [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9989)] [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 07:19:41.895888 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 07:19:41.923483 run osmo-hlr_10.42.42.2(pid=9986): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9986)] 07:19:41.971025 run osmo-hlr_10.42.42.2(pid=9986): stdout: | (launched: 2022-12-10_07:19:38.807366) 07:19:42.020108 run osmo-hlr_10.42.42.2(pid=9986): stderr: | [0;m[1;31m20221210071938982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071938982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071938982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071938982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071938982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071938982 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071938994 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071939003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071939003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071939003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:19:42.069465 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9979): Terminating (SIGTERM) 07:19:42.109250 run iperf3-srv_10.42.42.10(pid=9980): Terminating (SIGTERM) 07:19:42.148737 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9981): Terminating (SIGTERM) 07:19:42.188462 run iperf3-srv_10.42.42.10(pid=9982): Terminating (SIGTERM) 07:19:42.227737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9985): Terminating (SIGTERM) 07:19:42.267116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9988): Terminating (SIGTERM) 07:19:42.306460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9991): Terminating (SIGTERM) 07:19:42.346009 --- ParallelTerminationStrategy: PID 9979 died... 07:19:42.364842 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9979): Terminated: ok {rc=0} 07:19:42.408724 --- ParallelTerminationStrategy: PID 9980 died... 07:19:42.427144 run iperf3-srv_10.42.42.10(pid=9980): Terminated {rc=256} 07:19:42.470839 --- ParallelTerminationStrategy: PID 9981 died... 07:19:42.489386 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9981): Terminated: ok {rc=0} 07:19:42.533086 --- ParallelTerminationStrategy: PID 9982 died... 07:19:42.551301 run iperf3-srv_10.42.42.10(pid=9982): Terminated {rc=256} 07:19:42.594843 --- ParallelTerminationStrategy: PID 9985 died... 07:19:42.613154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9985): Terminated: ok {rc=0} 07:19:42.656697 --- ParallelTerminationStrategy: PID 9988 died... 07:19:42.675082 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=9988): Terminated: ok {rc=0} 07:19:42.718629 --- ParallelTerminationStrategy: PID 9991 died... 07:19:42.736902 run pcap-recorder_any(filters='host 10.42.42.6')(pid=9991): Terminated: ok {rc=0} 07:19:42.820180 bus /gobi_0: Setting Powered False 07:19:43.916391 bus /gobi_0: Setting Powered False 07:19:45.030418 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 07:19:46.174917 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:46.187584 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:19:46.263111 tst iperf3.py: using LAC 26759 07:19:46.387646 tst iperf3.py: using RAC 239 07:19:46.547206 tst iperf3.py: using CellId 26759 07:19:46.673521 tst iperf3.py: using BVCI 26760 07:19:46.812667 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:46.827682 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:46.842721 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:46.854732 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:46.867466 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:46.879280 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:46.891406 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:46.903166 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:46.915091 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:19:47.034306 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:19:47.300477 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:19:47.619894 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9993): Launched 07:19:47.895608 run iperf3-srv_10.42.42.10(pid=9994): Launched 07:19:48.014854 tst iperf3.py:8: start network... 07:19:48.229386 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:19:48.720186 run create_hlr_db(pid=9995): Launched 07:19:48.849238 bus /gobi_6: Setting Powered False 07:19:49.912005 run create_hlr_db(pid=9995): Terminated: ok {rc=0} 07:19:50.335277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9997): Launched 07:19:50.630721 run osmo-hlr_10.42.42.2(pid=9998): Launched 07:19:50.743637 run osmo-stp_10.42.42.5: Starting osmo-stp 07:19:51.263543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10000): Launched 07:19:51.558298 run osmo-stp_10.42.42.5(pid=10001): Launched 07:19:51.671295 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:19:52.180344 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10003): Launched 07:19:52.294846 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:19:52.542975 run patchelf(pid=10004): Launched 07:19:52.707027 run osmo-stp_10.42.42.5(pid=10001): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10001)] 07:19:52.831696 run osmo-stp_10.42.42.5(pid=10001): stdout: | (launched: 2022-12-10_07:19:51.504577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:52.957987 run osmo-stp_10.42.42.5(pid=10001): stderr: | [0;m[38;5;43m20221210071951675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071951675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071951676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071951676 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071951676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071951677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071951677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:53.084287 run osmo-stp_10.42.42.5(pid=10001): stdout: | (launched: 2022-12-10_07:19:51.504577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:19:53.204709 run osmo-stp_10.42.42.5(pid=10001): stderr: | [0;m[38;5;43m20221210071951675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210071951675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210071951676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210071951676 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210071951676 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210071951677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210071951677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:19:53.347151 run patchelf(pid=10004): Terminating (SIGINT) 07:19:53.513473 run patchelf(pid=10004): Terminated: ok {rc=0} 07:19:53.633503 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10001): Process ended prematurely: osmo-stp_10.42.42.5(pid=10001) [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10001)] [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8] 07:19:53.642683 tst iperf3.py:8: Test FAILED (7.5 sec) 07:19:53.669779 run osmo-hlr_10.42.42.2(pid=9998): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=9998)] 07:19:53.717255 run osmo-hlr_10.42.42.2(pid=9998): stdout: | (launched: 2022-12-10_07:19:50.577096) 07:19:53.765870 run osmo-hlr_10.42.42.2(pid=9998): stderr: | [0;m[1;31m20221210071950753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210071950753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210071950753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210071950753 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210071950754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210071950754 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210071950765 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210071950774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210071950774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210071950774 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:19:53.815163 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9993): Terminating (SIGTERM) 07:19:53.854480 run iperf3-srv_10.42.42.10(pid=9994): Terminating (SIGTERM) 07:19:53.893707 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9997): Terminating (SIGTERM) 07:19:53.933216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10000): Terminating (SIGTERM) 07:19:53.972478 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10003): Terminating (SIGTERM) 07:19:54.012128 --- ParallelTerminationStrategy: PID 9993 died... 07:19:54.030753 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=9993): Terminated: ok {rc=0} 07:19:54.074541 --- ParallelTerminationStrategy: PID 9994 died... 07:19:54.092681 run iperf3-srv_10.42.42.10(pid=9994): Terminated {rc=256} 07:19:54.136498 --- ParallelTerminationStrategy: PID 9997 died... 07:19:54.154940 run pcap-recorder_any(filters='host 10.42.42.2')(pid=9997): Terminated: ok {rc=0} 07:19:54.198772 --- ParallelTerminationStrategy: PID 10000 died... 07:19:54.217182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10000): Terminated: ok {rc=0} 07:19:54.261986 --- ParallelTerminationStrategy: PID 10003 died... 07:19:54.280596 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10003): Terminated: ok {rc=0} 07:19:54.365094 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 07:19:55.513885 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:55.525942 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:19:55.603696 tst iperf3m4.py: using LAC 26760 07:19:55.729287 tst iperf3m4.py: using RAC 240 07:19:55.852098 tst iperf3m4.py: using CellId 26760 07:19:55.975300 tst iperf3m4.py: using BVCI 26761 07:19:56.091052 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:56.102523 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:56.113857 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:56.125688 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:56.137316 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:56.149102 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:56.160684 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:56.172202 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:19:56.184052 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:19:56.304168 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:19:56.423367 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:19:56.540304 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:19:56.655255 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:19:56.854914 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:19:57.153370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10005): Launched 07:19:57.412174 run iperf3-srv_10.42.42.10(pid=10006): Launched 07:19:57.524355 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:19:57.722916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:19:58.019933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10007): Launched 07:19:58.277808 run iperf3-srv_10.42.42.10(pid=10008): Launched 07:19:58.390209 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:19:58.588463 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:19:58.885723 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10009): Launched 07:19:59.142912 run iperf3-srv_10.42.42.10(pid=10010): Launched 07:19:59.254475 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:19:59.452464 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:19:59.749169 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10011): Launched 07:20:00.006506 run iperf3-srv_10.42.42.10(pid=10012): Launched 07:20:00.118251 tst iperf3m4.py:8: start network... 07:20:00.316888 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:20:00.774168 run create_hlr_db(pid=10013): Launched 07:20:00.921999 bus /gobi_6: Setting Powered False 07:20:01.995084 run create_hlr_db(pid=10013): Terminated: ok {rc=0} 07:20:02.448628 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10018): Launched 07:20:02.767679 run osmo-hlr_10.42.42.2(pid=10019): Launched 07:20:02.889528 run osmo-stp_10.42.42.5: Starting osmo-stp 07:20:03.434291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10021): Launched 07:20:03.750009 run osmo-stp_10.42.42.5(pid=10022): Launched 07:20:03.870174 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:20:04.413217 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10024): Launched 07:20:04.534671 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:20:04.802622 run patchelf(pid=10025): Launched 07:20:04.978804 run osmo-stp_10.42.42.5(pid=10022): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10022)] 07:20:05.113107 run osmo-stp_10.42.42.5(pid=10022): stdout: | (launched: 2022-12-10_07:20:03.692808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:05.249143 run osmo-stp_10.42.42.5(pid=10022): stderr: | [0;m[38;5;43m20221210072003884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072003884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072003884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072003885 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072003885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072003885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072003885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:05.385198 run osmo-stp_10.42.42.5(pid=10022): stdout: | (launched: 2022-12-10_07:20:03.692808) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:05.514915 run osmo-stp_10.42.42.5(pid=10022): stderr: | [0;m[38;5;43m20221210072003884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072003884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072003884 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072003885 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072003885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072003885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072003885 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:05.669126 run patchelf(pid=10025): Terminating (SIGINT) 07:20:05.847284 run patchelf(pid=10025): Terminated: ok {rc=0} 07:20:05.976030 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10022): Process ended prematurely: osmo-stp_10.42.42.5(pid=10022) [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10022)] [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8] 07:20:05.986035 tst iperf3m4.py:8: Test FAILED (10.5 sec) 07:20:06.014544 run osmo-hlr_10.42.42.2(pid=10019): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10019)] 07:20:06.063913 run osmo-hlr_10.42.42.2(pid=10019): stdout: | (launched: 2022-12-10_07:20:02.709556) 07:20:06.115146 run osmo-hlr_10.42.42.2(pid=10019): stderr: | [0;m[1;31m20221210072002905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072002905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072002905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072002905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072002905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072002905 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072002918 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072002927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072002927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072002927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:20:06.166765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10005): Terminating (SIGTERM) 07:20:06.208153 run iperf3-srv_10.42.42.10(pid=10006): Terminating (SIGTERM) 07:20:06.249706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10007): Terminating (SIGTERM) 07:20:06.291144 run iperf3-srv_10.42.42.10(pid=10008): Terminating (SIGTERM) 07:20:06.332510 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10009): Terminating (SIGTERM) 07:20:06.374076 run iperf3-srv_10.42.42.10(pid=10010): Terminating (SIGTERM) 07:20:06.415247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10011): Terminating (SIGTERM) 07:20:06.456468 run iperf3-srv_10.42.42.10(pid=10012): Terminating (SIGTERM) 07:20:06.497586 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10018): Terminating (SIGTERM) 07:20:06.539093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10021): Terminating (SIGTERM) 07:20:06.580366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10024): Terminating (SIGTERM) 07:20:06.622344 --- ParallelTerminationStrategy: PID 10005 died... 07:20:06.642301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10005): Terminated: ok {rc=0} 07:20:06.688376 --- ParallelTerminationStrategy: PID 10006 died... 07:20:06.708019 run iperf3-srv_10.42.42.10(pid=10006): Terminated {rc=256} 07:20:06.753728 --- ParallelTerminationStrategy: PID 10007 died... 07:20:06.773248 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10007): Terminated: ok {rc=0} 07:20:06.818905 --- ParallelTerminationStrategy: PID 10008 died... 07:20:06.838361 run iperf3-srv_10.42.42.10(pid=10008): Terminated {rc=256} 07:20:06.883767 --- ParallelTerminationStrategy: PID 10009 died... 07:20:06.903165 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10009): Terminated: ok {rc=0} 07:20:06.948739 --- ParallelTerminationStrategy: PID 10010 died... 07:20:06.968141 run iperf3-srv_10.42.42.10(pid=10010): Terminated {rc=256} 07:20:07.013684 --- ParallelTerminationStrategy: PID 10011 died... 07:20:07.033202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10011): Terminated: ok {rc=0} 07:20:07.078847 --- ParallelTerminationStrategy: PID 10012 died... 07:20:07.098255 run iperf3-srv_10.42.42.10(pid=10012): Terminated {rc=256} 07:20:07.143735 --- ParallelTerminationStrategy: PID 10018 died... 07:20:07.163072 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10018): Terminated: ok {rc=0} 07:20:07.208497 --- ParallelTerminationStrategy: PID 10021 died... 07:20:07.227967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10021): Terminated: ok {rc=0} 07:20:07.273522 --- ParallelTerminationStrategy: PID 10024 died... 07:20:07.292931 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10024): Terminated: ok {rc=0} 07:20:07.380327 bus /gobi_4: Setting Powered False 07:20:08.478368 bus /gobi_4: Setting Powered False 07:20:09.594636 bus /gobi_1: Setting Powered False 07:20:10.693672 bus /gobi_1: Setting Powered False 07:20:11.809536 bus /gobi_0: Setting Powered False 07:20:12.907861 bus /gobi_0: Setting Powered False 07:20:14.024386 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 07:20:15.127072 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:15.138680 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:20:15.210464 tst ping.py: using LAC 26761 07:20:15.326475 tst ping.py: using RAC 241 07:20:15.440372 tst ping.py: using CellId 26761 07:20:15.564338 tst ping.py: using BVCI 26762 07:20:15.678761 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:15.690119 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:15.701256 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:15.713065 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:15.724544 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:15.736250 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:15.747995 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:15.759591 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:20:15.884150 tst ping.py:19: start network... 07:20:16.098748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:20:16.575542 run create_hlr_db(pid=10026): Launched 07:20:16.731812 bus /gobi_6: Setting Powered False 07:20:17.793462 run create_hlr_db(pid=10026): Terminated: ok {rc=0} 07:20:18.209607 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10028): Launched 07:20:18.501343 run osmo-hlr_10.42.42.2(pid=10029): Launched 07:20:18.614035 run osmo-stp_10.42.42.5: Starting osmo-stp 07:20:19.133512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10031): Launched 07:20:19.423838 run osmo-stp_10.42.42.5(pid=10032): Launched 07:20:19.536429 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:20:20.035305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10034): Launched 07:20:20.146468 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:20:20.389920 run patchelf(pid=10035): Launched 07:20:20.552485 run osmo-stp_10.42.42.5(pid=10032): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10032)] 07:20:20.675689 run osmo-stp_10.42.42.5(pid=10032): stdout: | (launched: 2022-12-10_07:20:19.370773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:20.800145 run osmo-stp_10.42.42.5(pid=10032): stderr: | [0;m[38;5;43m20221210072019538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072019538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072019538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072019539 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072019539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072019539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072019539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:20.924748 run osmo-stp_10.42.42.5(pid=10032): stdout: | (launched: 2022-12-10_07:20:19.370773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:21.043393 run osmo-stp_10.42.42.5(pid=10032): stderr: | [0;m[38;5;43m20221210072019538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072019538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072019538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072019539 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072019539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072019539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072019539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:21.184124 run patchelf(pid=10035): Terminating (SIGINT) 07:20:21.347670 run patchelf(pid=10035): Terminated: ok {rc=0} 07:20:21.465910 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10032): Process ended prematurely: osmo-stp_10.42.42.5(pid=10032) [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10032)] [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22] 07:20:21.474479 tst ping.py:22: Test FAILED (6.3 sec) 07:20:21.501364 run osmo-hlr_10.42.42.2(pid=10029): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10029)] 07:20:21.549175 run osmo-hlr_10.42.42.2(pid=10029): stdout: | (launched: 2022-12-10_07:20:18.447334) 07:20:21.598468 run osmo-hlr_10.42.42.2(pid=10029): stderr: | [0;m[1;31m20221210072018622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072018622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072018622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072018622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072018622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072018622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072018634 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072018645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072018645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072018645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:20:21.648267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10028): Terminating (SIGTERM) 07:20:21.687975 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10031): Terminating (SIGTERM) 07:20:21.727703 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10034): Terminating (SIGTERM) 07:20:21.767709 --- ParallelTerminationStrategy: PID 10028 died... 07:20:21.786725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10028): Terminated: ok {rc=0} 07:20:21.830622 --- ParallelTerminationStrategy: PID 10031 died... 07:20:21.849166 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10031): Terminated: ok {rc=0} 07:20:21.892794 --- ParallelTerminationStrategy: PID 10034 died... 07:20:21.911296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10034): Terminated: ok {rc=0} 07:20:21.996394 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 07:20:23.084855 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:23.096777 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:20:23.167815 tst ping_idle_ping.py: using LAC 26762 07:20:23.280749 tst ping_idle_ping.py: using RAC 242 07:20:23.398908 tst ping_idle_ping.py: using CellId 26762 07:20:23.512655 tst ping_idle_ping.py: using BVCI 26763 07:20:23.618162 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:23.628786 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:23.639490 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:23.650298 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:23.661148 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:23.671912 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:23.682899 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:20:23.693669 tst gprs:trx-b200+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:20:23.810315 tst ping_idle_ping.py:24: start network... 07:20:24.021751 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:20:24.507641 run create_hlr_db(pid=10036): Launched 07:20:24.636546 bus /gobi_6: Setting Powered False 07:20:25.698417 run create_hlr_db(pid=10036): Terminated: ok {rc=0} 07:20:26.115036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10038): Launched 07:20:26.405386 run osmo-hlr_10.42.42.2(pid=10039): Launched 07:20:26.517123 run osmo-stp_10.42.42.5: Starting osmo-stp 07:20:27.016762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10041): Launched 07:20:27.306987 run osmo-stp_10.42.42.5(pid=10042): Launched 07:20:27.418805 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:20:27.922790 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10044): Launched 07:20:28.034263 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:20:28.279157 run patchelf(pid=10045): Launched 07:20:28.441329 run osmo-stp_10.42.42.5(pid=10042): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10042)] 07:20:28.564574 run osmo-stp_10.42.42.5(pid=10042): stdout: | (launched: 2022-12-10_07:20:27.253945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:28.689542 run osmo-stp_10.42.42.5(pid=10042): stderr: | [0;m[38;5;43m20221210072027422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072027422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072027422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072027422 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072027423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072027423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072027423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:28.814052 run osmo-stp_10.42.42.5(pid=10042): stdout: | (launched: 2022-12-10_07:20:27.253945) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:28.932864 run osmo-stp_10.42.42.5(pid=10042): stderr: | [0;m[38;5;43m20221210072027422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072027422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072027422 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072027422 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072027423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072027423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072027423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:29.073557 run patchelf(pid=10045): Terminating (SIGINT) 07:20:29.237321 run patchelf(pid=10045): Terminated: ok {rc=0} 07:20:29.355338 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10042): Process ended prematurely: osmo-stp_10.42.42.5(pid=10042) [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10042)] [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 07:20:29.364055 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 07:20:29.390659 run osmo-hlr_10.42.42.2(pid=10039): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10039)] 07:20:29.438088 run osmo-hlr_10.42.42.2(pid=10039): stdout: | (launched: 2022-12-10_07:20:26.352479) 07:20:29.487249 run osmo-hlr_10.42.42.2(pid=10039): stderr: | [0;m[1;31m20221210072026528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072026528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072026528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072026528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072026528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072026528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072026539 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072026547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072026547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072026547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:20:29.536778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10038): Terminating (SIGTERM) 07:20:29.576225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10041): Terminating (SIGTERM) 07:20:29.616166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10044): Terminating (SIGTERM) 07:20:29.656019 --- ParallelTerminationStrategy: PID 10038 died... 07:20:29.674931 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10038): Terminated: ok {rc=0} 07:20:29.719027 --- ParallelTerminationStrategy: PID 10041 died... 07:20:29.737370 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10041): Terminated: ok {rc=0} 07:20:29.781133 --- ParallelTerminationStrategy: PID 10044 died... 07:20:29.799550 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10044): Terminated: ok {rc=0} 07:20:29.884576 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 07:20:31.234936 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:20:31.247935 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 07:20:31.295274 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 07:20:31.346464 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 07:20:31.462658 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 07:20:31.506055 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 07:20:31.557115 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 07:20:32.130754 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 07:20:32.186368 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:32.198714 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:20:32.251783 tst cs_paging_gprs_active.py: using LAC 26763 07:20:32.370260 tst cs_paging_gprs_active.py: using RAC 243 07:20:32.486610 tst cs_paging_gprs_active.py: using CellId 26763 07:20:32.606934 tst cs_paging_gprs_active.py: using BVCI 26764 07:20:32.725253 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:32.736877 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:32.748535 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:32.760684 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:32.772823 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:32.784942 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:32.799791 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:32.811201 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:32.822736 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:20:32.942780 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:20:33.059971 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:20:33.260855 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:20:33.558091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10049): Launched 07:20:33.816815 run iperf3-srv_10.42.42.10(pid=10050): Launched 07:20:33.928541 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:20:34.127678 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:20:34.424756 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10051): Launched 07:20:34.683387 run iperf3-srv_10.42.42.10(pid=10052): Launched 07:20:34.795097 tst cs_paging_gprs_active.py:38: start network... 07:20:34.993321 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:20:35.449386 run create_hlr_db(pid=10053): Launched 07:20:35.563554 bus /gobi_6: Setting Powered False 07:20:36.622696 run create_hlr_db(pid=10053): Terminated: ok {rc=0} 07:20:37.034798 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10055): Launched 07:20:37.330356 run osmo-hlr_10.42.42.2(pid=10056): Launched 07:20:37.443819 run osmo-stp_10.42.42.5: Starting osmo-stp 07:20:37.968540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10058): Launched 07:20:38.264215 run osmo-stp_10.42.42.5(pid=10059): Launched 07:20:38.378729 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:20:38.887811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10061): Launched 07:20:39.002759 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:20:39.252862 run patchelf(pid=10062): Launched 07:20:39.418151 run osmo-stp_10.42.42.5(pid=10059): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10059)] 07:20:39.543453 run osmo-stp_10.42.42.5(pid=10059): stdout: | (launched: 2022-12-10_07:20:38.210156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:39.670622 run osmo-stp_10.42.42.5(pid=10059): stderr: | [0;m[38;5;43m20221210072038381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072038381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072038381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072038382 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072038382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072038382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072038382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:39.797758 run osmo-stp_10.42.42.5(pid=10059): stdout: | (launched: 2022-12-10_07:20:38.210156) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:39.919339 run osmo-stp_10.42.42.5(pid=10059): stderr: | [0;m[38;5;43m20221210072038381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072038381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072038381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072038382 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072038382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072038382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072038382 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:40.063904 run patchelf(pid=10062): Terminating (SIGINT) 07:20:40.231282 run patchelf(pid=10062): Terminated: ok {rc=0} 07:20:40.352321 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=10059): Process ended prematurely: osmo-stp_10.42.42.5(pid=10059) [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10059)] [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 07:20:40.361614 tst cs_paging_gprs_active.py:38: Test FAILED (8.2 sec) 07:20:40.388740 run osmo-hlr_10.42.42.2(pid=10056): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10056)] 07:20:40.436612 run osmo-hlr_10.42.42.2(pid=10056): stdout: | (launched: 2022-12-10_07:20:37.276479) 07:20:40.485905 run osmo-hlr_10.42.42.2(pid=10056): stderr: | [0;m[1;31m20221210072037451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072037451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072037451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072037451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072037451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072037451 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072037463 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072037472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072037472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072037472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:20:40.535874 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10049): Terminating (SIGTERM) 07:20:40.575569 run iperf3-srv_10.42.42.10(pid=10050): Terminating (SIGTERM) 07:20:40.615833 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10051): Terminating (SIGTERM) 07:20:40.655989 run iperf3-srv_10.42.42.10(pid=10052): Terminating (SIGTERM) 07:20:40.695811 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10055): Terminating (SIGTERM) 07:20:40.735628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10058): Terminating (SIGTERM) 07:20:40.775490 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10061): Terminating (SIGTERM) 07:20:40.815509 --- ParallelTerminationStrategy: PID 10049 died... 07:20:40.834349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10049): Terminated: ok {rc=0} 07:20:40.878623 --- ParallelTerminationStrategy: PID 10050 died... 07:20:40.897111 run iperf3-srv_10.42.42.10(pid=10050): Terminated {rc=256} 07:20:40.940847 --- ParallelTerminationStrategy: PID 10051 died... 07:20:40.959321 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10051): Terminated: ok {rc=0} 07:20:41.003239 --- ParallelTerminationStrategy: PID 10052 died... 07:20:41.021791 run iperf3-srv_10.42.42.10(pid=10052): Terminated {rc=256} 07:20:41.065345 --- ParallelTerminationStrategy: PID 10055 died... 07:20:41.084011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10055): Terminated: ok {rc=0} 07:20:41.127918 --- ParallelTerminationStrategy: PID 10058 died... 07:20:41.146562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10058): Terminated: ok {rc=0} 07:20:41.190755 --- ParallelTerminationStrategy: PID 10061 died... 07:20:41.209428 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10061): Terminated: ok {rc=0} 07:20:41.295301 bus /gobi_0: Setting Powered False 07:20:42.392395 bus /gobi_0: Setting Powered False 07:20:43.507299 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 07:20:44.652106 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:44.664130 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:20:44.719150 tst iperf3.py: using LAC 26764 07:20:44.837033 tst iperf3.py: using RAC 244 07:20:44.951913 tst iperf3.py: using CellId 26764 07:20:45.068014 tst iperf3.py: using BVCI 26765 07:20:45.175248 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:45.186397 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:45.197451 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:45.208562 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:45.219721 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:45.231427 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:45.242824 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:45.253870 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:45.265282 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:20:45.379351 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:20:45.578229 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:20:45.892064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10064): Launched 07:20:46.214971 run iperf3-srv_10.42.42.10(pid=10065): Launched 07:20:46.347884 tst iperf3.py:8: start network... 07:20:46.568638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:20:47.079725 run create_hlr_db(pid=10066): Launched 07:20:47.221998 bus /gobi_6: Setting Powered False 07:20:48.284823 run create_hlr_db(pid=10066): Terminated: ok {rc=0} 07:20:48.708389 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10068): Launched 07:20:49.004267 run osmo-hlr_10.42.42.2(pid=10069): Launched 07:20:49.117279 run osmo-stp_10.42.42.5: Starting osmo-stp 07:20:49.642271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10071): Launched 07:20:49.938081 run osmo-stp_10.42.42.5(pid=10072): Launched 07:20:50.051148 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:20:50.559848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10074): Launched 07:20:50.674429 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:20:50.924492 run patchelf(pid=10075): Launched 07:20:51.089685 run osmo-stp_10.42.42.5(pid=10072): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10072)] 07:20:51.215432 run osmo-stp_10.42.42.5(pid=10072): stdout: | (launched: 2022-12-10_07:20:49.883983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:51.342746 run osmo-stp_10.42.42.5(pid=10072): stderr: | [0;m[38;5;43m20221210072050052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072050052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072050053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072050053 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072050053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072050054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072050054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:51.470511 run osmo-stp_10.42.42.5(pid=10072): stdout: | (launched: 2022-12-10_07:20:49.883983) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:20:51.591607 run osmo-stp_10.42.42.5(pid=10072): stderr: | [0;m[38;5;43m20221210072050052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072050052 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072050053 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072050053 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072050053 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072050054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072050054 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:20:51.735360 run patchelf(pid=10075): Terminating (SIGINT) 07:20:51.903093 run patchelf(pid=10075): Terminated: ok {rc=0} 07:20:52.024419 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10072): Process ended prematurely: osmo-stp_10.42.42.5(pid=10072) [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10072)] [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 07:20:52.033647 tst iperf3.py:8: Test FAILED (7.4 sec) 07:20:52.061158 run osmo-hlr_10.42.42.2(pid=10069): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10069)] 07:20:52.108681 run osmo-hlr_10.42.42.2(pid=10069): stdout: | (launched: 2022-12-10_07:20:48.950210) 07:20:52.157794 run osmo-hlr_10.42.42.2(pid=10069): stderr: | [0;m[1;31m20221210072049124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072049124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072049124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072049124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072049124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072049124 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072049136 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072049145 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072049146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072049146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:20:52.207198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10064): Terminating (SIGTERM) 07:20:52.247133 run iperf3-srv_10.42.42.10(pid=10065): Terminating (SIGTERM) 07:20:52.287321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10068): Terminating (SIGTERM) 07:20:52.327043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10071): Terminating (SIGTERM) 07:20:52.366771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10074): Terminating (SIGTERM) 07:20:52.406754 --- ParallelTerminationStrategy: PID 10064 died... 07:20:52.425651 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10064): Terminated: ok {rc=0} 07:20:52.470039 --- ParallelTerminationStrategy: PID 10065 died... 07:20:52.488398 run iperf3-srv_10.42.42.10(pid=10065): Terminated {rc=256} 07:20:52.532382 --- ParallelTerminationStrategy: PID 10068 died... 07:20:52.550720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10068): Terminated: ok {rc=0} 07:20:52.594738 --- ParallelTerminationStrategy: PID 10071 died... 07:20:52.613274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10071): Terminated: ok {rc=0} 07:20:52.657846 --- ParallelTerminationStrategy: PID 10074 died... 07:20:52.676358 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10074): Terminated: ok {rc=0} 07:20:52.762900 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 07:20:53.908701 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:53.920583 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:20:53.983011 tst iperf3m4.py: using LAC 26765 07:20:54.101334 tst iperf3m4.py: using RAC 245 07:20:54.219199 tst iperf3m4.py: using CellId 26765 07:20:54.335265 tst iperf3m4.py: using BVCI 26766 07:20:54.443892 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:54.455071 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:54.466051 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:54.477242 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:54.488375 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:54.499729 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:54.511073 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:54.522234 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:20:54.533695 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:20:54.653091 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:20:54.776606 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:20:54.894287 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:20:55.014476 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:20:55.230364 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:20:55.549735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10076): Launched 07:20:55.827043 run iperf3-srv_10.42.42.10(pid=10077): Launched 07:20:55.947024 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:20:56.161511 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:20:56.480267 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10078): Launched 07:20:56.756929 run iperf3-srv_10.42.42.10(pid=10079): Launched 07:20:56.876496 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:20:57.090283 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:20:57.399601 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10080): Launched 07:20:57.658289 run iperf3-srv_10.42.42.10(pid=10081): Launched 07:20:57.769979 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:20:57.969116 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:20:58.266985 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10082): Launched 07:20:58.524812 run iperf3-srv_10.42.42.10(pid=10083): Launched 07:20:58.636078 tst iperf3m4.py:8: start network... 07:20:58.834616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:20:59.291412 run create_hlr_db(pid=10084): Launched 07:20:59.404513 bus /gobi_6: Setting Powered False 07:21:00.464344 run create_hlr_db(pid=10084): Terminated: ok {rc=0} 07:21:00.909782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10086): Launched 07:21:01.264114 run osmo-hlr_10.42.42.2(pid=10087): Launched 07:21:01.516000 run osmo-stp_10.42.42.5: Starting osmo-stp 07:21:02.179979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10089): Launched 07:21:02.500391 run osmo-stp_10.42.42.5(pid=10090): Launched 07:21:02.623474 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:21:03.172879 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10092): Launched 07:21:03.294800 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:21:03.562151 run patchelf(pid=10093): Launched 07:21:03.740024 run osmo-stp_10.42.42.5(pid=10090): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10090)] 07:21:03.874343 run osmo-stp_10.42.42.5(pid=10090): stdout: | (launched: 2022-12-10_07:21:02.443081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:04.009895 run osmo-stp_10.42.42.5(pid=10090): stderr: | [0;m[38;5;43m20221210072102634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072102635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072102635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072102635 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072102636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072102636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072102636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:04.145701 run osmo-stp_10.42.42.5(pid=10090): stdout: | (launched: 2022-12-10_07:21:02.443081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:04.275695 run osmo-stp_10.42.42.5(pid=10090): stderr: | [0;m[38;5;43m20221210072102634 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072102635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072102635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072102635 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072102636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072102636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072102636 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:04.429625 run patchelf(pid=10093): Terminating (SIGINT) 07:21:04.607972 run patchelf(pid=10093): Terminated: ok {rc=0} 07:21:04.737540 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10090): Process ended prematurely: osmo-stp_10.42.42.5(pid=10090) [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10090)] [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 07:21:04.747533 tst iperf3m4.py:8: Test FAILED (10.9 sec) 07:21:04.776208 run osmo-hlr_10.42.42.2(pid=10087): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10087)] 07:21:04.826179 run osmo-hlr_10.42.42.2(pid=10087): stdout: | (launched: 2022-12-10_07:21:01.201714) 07:21:04.877847 run osmo-hlr_10.42.42.2(pid=10087): stderr: | [0;m[1;31m20221210072101508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072101508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072101508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072101508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072101508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072101508 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072101523 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072101539 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072101540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072101540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:21:04.929660 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10076): Terminating (SIGTERM) 07:21:04.971480 run iperf3-srv_10.42.42.10(pid=10077): Terminating (SIGTERM) 07:21:05.013080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10078): Terminating (SIGTERM) 07:21:05.054959 run iperf3-srv_10.42.42.10(pid=10079): Terminating (SIGTERM) 07:21:05.096197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10080): Terminating (SIGTERM) 07:21:05.137904 run iperf3-srv_10.42.42.10(pid=10081): Terminating (SIGTERM) 07:21:05.179450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10082): Terminating (SIGTERM) 07:21:05.221046 run iperf3-srv_10.42.42.10(pid=10083): Terminating (SIGTERM) 07:21:05.262476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10086): Terminating (SIGTERM) 07:21:05.304045 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10089): Terminating (SIGTERM) 07:21:05.345710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10092): Terminating (SIGTERM) 07:21:05.387349 --- ParallelTerminationStrategy: PID 10076 died... 07:21:05.407225 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10076): Terminated: ok {rc=0} 07:21:05.453178 --- ParallelTerminationStrategy: PID 10077 died... 07:21:05.472728 run iperf3-srv_10.42.42.10(pid=10077): Terminated {rc=256} 07:21:05.518486 --- ParallelTerminationStrategy: PID 10078 died... 07:21:05.538021 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10078): Terminated: ok {rc=0} 07:21:05.583855 --- ParallelTerminationStrategy: PID 10079 died... 07:21:05.603280 run iperf3-srv_10.42.42.10(pid=10079): Terminated {rc=256} 07:21:05.649242 --- ParallelTerminationStrategy: PID 10080 died... 07:21:05.668741 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10080): Terminated: ok {rc=0} 07:21:05.714560 --- ParallelTerminationStrategy: PID 10081 died... 07:21:05.734008 run iperf3-srv_10.42.42.10(pid=10081): Terminated {rc=256} 07:21:05.779451 --- ParallelTerminationStrategy: PID 10082 died... 07:21:05.798801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=10082): Terminated: ok {rc=0} 07:21:05.844464 --- ParallelTerminationStrategy: PID 10083 died... 07:21:05.863896 run iperf3-srv_10.42.42.10(pid=10083): Terminated {rc=256} 07:21:05.909576 --- ParallelTerminationStrategy: PID 10086 died... 07:21:05.929241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10086): Terminated: ok {rc=0} 07:21:05.975004 --- ParallelTerminationStrategy: PID 10089 died... 07:21:05.994580 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10089): Terminated: ok {rc=0} 07:21:06.040277 --- ParallelTerminationStrategy: PID 10092 died... 07:21:06.059886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10092): Terminated: ok {rc=0} 07:21:06.146078 bus /gobi_4: Setting Powered False 07:21:07.244286 bus /gobi_4: Setting Powered False 07:21:08.360001 bus /gobi_1: Setting Powered False 07:21:09.457260 bus /gobi_1: Setting Powered False 07:21:10.572265 bus /gobi_0: Setting Powered False 07:21:11.671984 bus /gobi_0: Setting Powered False 07:21:12.787748 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 07:21:13.887226 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:13.898906 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:21:13.955191 tst ping.py: using LAC 26766 07:21:14.068136 tst ping.py: using RAC 246 07:21:14.180156 tst ping.py: using CellId 26766 07:21:14.293167 tst ping.py: using BVCI 26767 07:21:14.406969 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:14.418828 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:14.430437 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:14.442400 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:14.454192 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:14.466011 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:14.477976 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:14.489868 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:21:14.607125 tst ping.py:19: start network... 07:21:14.816659 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:21:15.297383 run create_hlr_db(pid=10094): Launched 07:21:15.424902 bus /gobi_6: Setting Powered False 07:21:16.499562 run create_hlr_db(pid=10094): Terminated: ok {rc=0} 07:21:17.030124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10096): Launched 07:21:17.364638 run osmo-hlr_10.42.42.2(pid=10097): Launched 07:21:17.484068 run osmo-stp_10.42.42.5: Starting osmo-stp 07:21:18.026496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10099): Launched 07:21:18.338238 run osmo-stp_10.42.42.5(pid=10100): Launched 07:21:18.456841 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:21:18.994343 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10102): Launched 07:21:19.113889 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:21:19.376880 run patchelf(pid=10103): Launched 07:21:19.550940 run osmo-stp_10.42.42.5(pid=10100): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10100)] 07:21:19.683609 run osmo-stp_10.42.42.5(pid=10100): stdout: | (launched: 2022-12-10_07:21:18.281587) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:19.817786 run osmo-stp_10.42.42.5(pid=10100): stderr: | [0;m[38;5;43m20221210072118470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072118471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072118471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072118471 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072118472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072118472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072118472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:19.951892 run osmo-stp_10.42.42.5(pid=10100): stdout: | (launched: 2022-12-10_07:21:18.281587) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:20.080226 run osmo-stp_10.42.42.5(pid=10100): stderr: | [0;m[38;5;43m20221210072118470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072118471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072118471 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072118471 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072118472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072118472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072118472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:20.232245 run patchelf(pid=10103): Terminating (SIGINT) 07:21:20.408416 run patchelf(pid=10103): Terminated: ok {rc=0} 07:21:20.535252 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=10100): Process ended prematurely: osmo-stp_10.42.42.5(pid=10100) [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10100)] [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 07:21:20.544590 tst ping.py:22: Test FAILED (6.6 sec) 07:21:20.572740 run osmo-hlr_10.42.42.2(pid=10097): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10097)] 07:21:20.622595 run osmo-hlr_10.42.42.2(pid=10097): stdout: | (launched: 2022-12-10_07:21:17.307925) 07:21:20.674615 run osmo-hlr_10.42.42.2(pid=10097): stderr: | [0;m[1;31m20221210072117504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072117504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072117504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072117504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072117504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072117504 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072117517 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072117527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072117527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072117527 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:21:20.726765 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10096): Terminating (SIGTERM) 07:21:20.768607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10099): Terminating (SIGTERM) 07:21:20.810705 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10102): Terminating (SIGTERM) 07:21:20.853074 --- ParallelTerminationStrategy: PID 10096 died... 07:21:20.873255 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10096): Terminated: ok {rc=0} 07:21:20.919977 --- ParallelTerminationStrategy: PID 10099 died... 07:21:20.939981 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10099): Terminated: ok {rc=0} 07:21:20.986936 --- ParallelTerminationStrategy: PID 10102 died... 07:21:21.006736 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10102): Terminated: ok {rc=0} 07:21:21.095300 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 07:21:22.179377 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:22.191146 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:21:22.245397 tst ping_idle_ping.py: using LAC 26767 07:21:22.361576 tst ping_idle_ping.py: using RAC 247 07:21:22.475376 tst ping_idle_ping.py: using CellId 26767 07:21:22.590880 tst ping_idle_ping.py: using BVCI 26768 07:21:22.698433 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:22.709742 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:22.720673 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:22.732238 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:22.743370 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:22.754779 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:22.766106 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:21:22.777287 tst gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:21:22.891660 tst ping_idle_ping.py:24: start network... 07:21:23.088589 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:21:23.541125 run create_hlr_db(pid=10104): Launched 07:21:23.651943 bus /gobi_6: Setting Powered False 07:21:24.710190 run create_hlr_db(pid=10104): Terminated: ok {rc=0} 07:21:25.137708 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10106): Launched 07:21:25.449123 run osmo-hlr_10.42.42.2(pid=10107): Launched 07:21:25.569446 run osmo-stp_10.42.42.5: Starting osmo-stp 07:21:26.109016 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10109): Launched 07:21:26.420875 run osmo-stp_10.42.42.5(pid=10110): Launched 07:21:26.541391 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:21:27.081506 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10112): Launched 07:21:27.201227 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:21:27.463618 run patchelf(pid=10113): Launched 07:21:27.637500 run osmo-stp_10.42.42.5(pid=10110): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10110)] 07:21:27.770006 run osmo-stp_10.42.42.5(pid=10110): stdout: | (launched: 2022-12-10_07:21:26.364208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:27.903630 run osmo-stp_10.42.42.5(pid=10110): stderr: | [0;m[38;5;43m20221210072126554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072126554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072126554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072126555 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072126555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072126555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072126555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:28.037534 run osmo-stp_10.42.42.5(pid=10110): stdout: | (launched: 2022-12-10_07:21:26.364208) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:28.165615 run osmo-stp_10.42.42.5(pid=10110): stderr: | [0;m[38;5;43m20221210072126554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072126554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072126554 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072126555 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072126555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072126555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072126555 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:28.317365 run patchelf(pid=10113): Terminating (SIGINT) 07:21:28.492434 run patchelf(pid=10113): Terminated: ok {rc=0} 07:21:28.618847 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=10110): Process ended prematurely: osmo-stp_10.42.42.5(pid=10110) [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10110)] [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 07:21:28.628142 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 07:21:28.656285 run osmo-hlr_10.42.42.2(pid=10107): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10107)] 07:21:28.705741 run osmo-hlr_10.42.42.2(pid=10107): stdout: | (launched: 2022-12-10_07:21:25.392663) 07:21:28.757174 run osmo-hlr_10.42.42.2(pid=10107): stderr: | [0;m[1;31m20221210072125587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072125587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072125587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072125587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072125587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072125587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072125600 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072125608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072125608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072125608 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:21:28.808622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10106): Terminating (SIGTERM) 07:21:28.850136 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10109): Terminating (SIGTERM) 07:21:28.891543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10112): Terminating (SIGTERM) 07:21:28.933167 --- ParallelTerminationStrategy: PID 10106 died... 07:21:28.952929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10106): Terminated: ok {rc=0} 07:21:28.998929 --- ParallelTerminationStrategy: PID 10109 died... 07:21:29.018828 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10109): Terminated: ok {rc=0} 07:21:29.064599 --- ParallelTerminationStrategy: PID 10112 died... 07:21:29.084153 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10112): Terminated: ok {rc=0} 07:21:29.171234 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:21:30.486171 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:21:30.493988 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:21:30.527128 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 07:21:30.561399 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:21:30.615217 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:21:30.648939 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 07:21:30.683023 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:21:31.239365 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2371 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 07:21:31.245315 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:21:31.257250 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:21:31.333209 tst switch_tch_pdch.py: using LAC 26768 07:21:31.484889 tst switch_tch_pdch.py: using RAC 248 07:21:31.628511 tst switch_tch_pdch.py: using CellId 26768 07:21:31.753418 tst switch_tch_pdch.py: using BVCI 26769 07:21:31.861667 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:21:31.873736 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:21:31.885628 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:21:31.898426 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:21:31.911014 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:21:31.924477 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:21:31.937889 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:21:31.950415 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:21:32.072587 tst dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:21:32.197353 tst switch_tch_pdch.py:51: start network... 07:21:32.410193 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:21:32.892656 run create_hlr_db(pid=10118): Launched 07:21:33.020118 bus /gobi_6: Setting Powered False 07:21:34.082719 run create_hlr_db(pid=10118): Terminated: ok {rc=0} 07:21:34.499251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10120): Launched 07:21:34.790073 run osmo-hlr_10.42.42.2(pid=10121): Launched 07:21:34.901487 run osmo-stp_10.42.42.5: Starting osmo-stp 07:21:35.413661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10123): Launched 07:21:35.704160 run osmo-stp_10.42.42.5(pid=10124): Launched 07:21:35.816318 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:21:36.316274 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10126): Launched 07:21:36.427432 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:21:36.671909 run patchelf(pid=10127): Launched 07:21:36.833674 run osmo-stp_10.42.42.5(pid=10124): ERR: Terminated: ERROR {rc=1} [trial-2371↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10124)] 07:21:36.956645 run osmo-stp_10.42.42.5(pid=10124): stdout: | (launched: 2022-12-10_07:21:35.651202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:37.081900 run osmo-stp_10.42.42.5(pid=10124): stderr: | [0;m[38;5;43m20221210072135820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072135820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072135820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072135821 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072135821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072135821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072135821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:37.207223 run osmo-stp_10.42.42.5(pid=10124): stdout: | (launched: 2022-12-10_07:21:35.651202) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:37.326800 run osmo-stp_10.42.42.5(pid=10124): stderr: | [0;m[38;5;43m20221210072135820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072135820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072135820 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072135821 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072135821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072135821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072135821 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:37.468449 run patchelf(pid=10127): Terminating (SIGINT) 07:21:37.632747 run patchelf(pid=10127): Terminated: ok {rc=0} 07:21:37.751266 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10124): Process ended prematurely: osmo-stp_10.42.42.5(pid=10124) [trial-2371↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10124)] [trial-2371↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 07:21:37.760065 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 07:21:37.786617 run osmo-hlr_10.42.42.2(pid=10121): ERR: Terminated: ERROR {rc=237} [trial-2371↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10121)] 07:21:37.834189 run osmo-hlr_10.42.42.2(pid=10121): stdout: | (launched: 2022-12-10_07:21:34.737189) 07:21:37.883445 run osmo-hlr_10.42.42.2(pid=10121): stderr: | [0;m[1;31m20221210072134912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072134912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072134912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072134912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072134912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072134912 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072134925 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072134933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072134934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072134934 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:21:37.933429 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10120): Terminating (SIGTERM) 07:21:37.973252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10123): Terminating (SIGTERM) 07:21:38.013110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10126): Terminating (SIGTERM) 07:21:38.053064 --- ParallelTerminationStrategy: PID 10120 died... 07:21:38.072060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10120): Terminated: ok {rc=0} 07:21:38.116206 --- ParallelTerminationStrategy: PID 10123 died... 07:21:38.134861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10123): Terminated: ok {rc=0} 07:21:38.178730 --- ParallelTerminationStrategy: PID 10126 died... 07:21:38.197245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10126): Terminated: ok {rc=0} 07:21:38.281044 bus /gobi_0: Setting Powered False 07:21:39.378596 bus /gobi_0: Setting Powered False 07:21:40.496185 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 dynts:trx-b200+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 07:21:41.753415 tst dynts:trx-b200+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:21:41.759711 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 07:21:41.793367 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 07:21:41.828143 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 07:21:41.881657 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 07:21:41.915525 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 07:21:41.950825 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 07:21:42.509237 tst dynts:trx-b200+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2371 dynts:trx-b200+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 07:21:42.514611 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:21:42.526042 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 07:21:42.595436 tst switch_tch_pdch.py: using LAC 26769 07:21:42.716513 tst switch_tch_pdch.py: using RAC 249 07:21:42.837118 tst switch_tch_pdch.py: using CellId 26769 07:21:42.957189 tst switch_tch_pdch.py: using BVCI 26770 07:21:43.069647 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:21:43.080824 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:21:43.091909 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:21:43.103072 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:21:43.114431 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:21:43.125638 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:21:43.137002 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:21:43.148157 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:21:43.266372 tst dynts:trx-b200+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:21:43.384658 tst switch_tch_pdch.py:51: start network... 07:21:43.594285 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:21:44.049036 run create_hlr_db(pid=10131): Launched 07:21:44.176632 bus /gobi_6: Setting Powered False 07:21:45.238999 run create_hlr_db(pid=10131): Terminated: ok {rc=0} 07:21:45.646321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10133): Launched 07:21:45.977729 run osmo-hlr_10.42.42.2(pid=10134): Launched 07:21:46.198814 run osmo-stp_10.42.42.5: Starting osmo-stp 07:21:46.769038 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10136): Launched 07:21:47.099096 run osmo-stp_10.42.42.5(pid=10137): Launched 07:21:47.252261 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:21:47.816526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10139): Launched 07:21:47.927698 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:21:48.172034 run patchelf(pid=10140): Launched 07:21:48.333747 run osmo-stp_10.42.42.5(pid=10137): ERR: Terminated: ERROR {rc=1} [trial-2371↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10137)] 07:21:48.456911 run osmo-stp_10.42.42.5(pid=10137): stdout: | (launched: 2022-12-10_07:21:47.038077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:48.581894 run osmo-stp_10.42.42.5(pid=10137): stderr: | [0;m[38;5;43m20221210072147351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072147351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072147351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072147352 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072147352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072147352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072147352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:48.706872 run osmo-stp_10.42.42.5(pid=10137): stdout: | (launched: 2022-12-10_07:21:47.038077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:21:48.826523 run osmo-stp_10.42.42.5(pid=10137): stderr: | [0;m[38;5;43m20221210072147351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072147351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072147351 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072147352 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072147352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072147352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072147352 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:21:48.967982 run patchelf(pid=10140): Terminating (SIGINT) 07:21:49.132206 run patchelf(pid=10140): Terminated: ok {rc=0} 07:21:49.251112 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=10137): Process ended prematurely: osmo-stp_10.42.42.5(pid=10137) [trial-2371↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10137)] [trial-2371↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 07:21:49.259832 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 07:21:49.286645 run osmo-hlr_10.42.42.2(pid=10134): ERR: Terminated: ERROR {rc=237} [trial-2371↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10134)] 07:21:49.334042 run osmo-hlr_10.42.42.2(pid=10134): stdout: | (launched: 2022-12-10_07:21:45.906464) 07:21:49.383292 run osmo-hlr_10.42.42.2(pid=10134): stderr: | [0;m[1;31m20221210072146115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072146115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072146115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072146115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072146115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072146115 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072146139 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/dynts:trx-b200+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072146147 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072146148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072146148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:21:49.433273 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10133): Terminating (SIGTERM) 07:21:49.472723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10136): Terminating (SIGTERM) 07:21:49.512135 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10139): Terminating (SIGTERM) 07:21:49.552267 --- ParallelTerminationStrategy: PID 10133 died... 07:21:49.571298 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10133): Terminated: ok {rc=0} 07:21:49.615639 --- ParallelTerminationStrategy: PID 10136 died... 07:21:49.634197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10136): Terminated: ok {rc=0} 07:21:49.678238 --- ParallelTerminationStrategy: PID 10139 died... 07:21:49.696624 run pcap-recorder_any(filters='host 10.42.42.6')(pid=10139): Terminated: ok {rc=0} 07:21:49.782815 bus /gobi_0: Setting Powered False 07:21:50.881467 bus /gobi_0: Setting Powered False 07:21:51.996301 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 dynts:trx-b200+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 nitb_sms:trx-sysmocell5000 --------------------------------------------------------------------- 07:21:53.254561 tst nitb_sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:21:53.258753 tst nitb_sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 07:21:53.293030 tst nitb_sms:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 07:21:53.299961 tst nitb_sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 07:21:53.352316 tst nitb_sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 07:21:53.386415 tst nitb_sms:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 07:21:53.393295 tst nitb_sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 07:21:53.933566 tst nitb_sms:trx-sysmocell5000: RESERVED RESOURCES for nitb_sms: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 nitb_sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 07:21:53.938588 tst nitb_sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 07:21:53.949763 tst nitb_sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:21:53.999035 tst mo_mt_sms.py: using LAC 26770 07:21:54.122584 tst mo_mt_sms.py: using RAC 250 07:21:54.245728 tst mo_mt_sms.py: using CellId 26770 07:21:54.368690 tst mo_mt_sms.py: using BVCI 26771 07:21:54.481099 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 07:21:54.595309 tst nitb_sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 07:21:54.708507 tst mo_mt_sms.py:9: start nitb and bts... 07:21:54.905347 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:21:55.498452 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10145): Launched 07:21:55.788460 run osmo-nitb_10.42.42.2(pid=10146): Launched 07:21:55.950383 run osmo-nitb_10.42.42.2(pid=10146): ERR: Terminated: ERROR {rc=2} [trial-2371↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10146)] 07:21:56.080674 run osmo-nitb_10.42.42.2(pid=10146): stdout: | (launched: 2022-12-10_07:21:55.735332) 07:21:56.212474 run osmo-nitb_10.42.42.2(pid=10146): stderr: | (launched: 2022-12-10_07:21:55.778719) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:21:56.343713 run osmo-nitb_10.42.42.2(pid=10146): stdout: | (launched: 2022-12-10_07:21:55.735332) 07:21:56.470239 run osmo-nitb_10.42.42.2(pid=10146): stderr: | (launched: 2022-12-10_07:21:55.778719) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f5483dba268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10146): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10146) [trial-2371↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10146)] 07:21:56.899148 tst osmo-nitb_10.42.42.2(pid=10146): stdout: | (launched: 2022-12-10_07:21:55.735332) 07:21:57.016939 tst osmo-nitb_10.42.42.2(pid=10146): stderr: | (launched: 2022-12-10_07:21:55.778719) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:21:57.155115 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=10146): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10146) [trial-2371↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10146)] [trial-2371↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11] 07:21:57.163283 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 07:21:57.169735 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10145): Terminating (SIGTERM) 07:21:57.378765 --- ParallelTerminationStrategy: PID 10145 died... 07:21:57.399563 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10145): Terminated: ok {rc=0} 07:21:57.486067 bus /sierra_3: Setting Powered False 07:21:58.585047 bus /sierra_3: Setting Powered False 07:21:59.702414 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 nitb_sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 sms:trx-sysmocell5000 --------------------------------------------------------------------- 07:22:00.910351 tst sms:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:22:00.915128 tst sms:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 07:22:00.950809 tst sms:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 07:22:00.979261 tst sms:trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 07:22:01.031591 tst sms:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 07:22:01.068182 tst sms:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 07:22:01.096736 tst sms:trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 07:22:01.646946 tst sms:trx-sysmocell5000: RESERVED RESOURCES for sms: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 sms:trx-sysmocell5000 mo_mt_sms.py ---------------------------------------------- 07:22:01.653521 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:22:01.669040 tst sms:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:22:01.732466 tst mo_mt_sms.py: using LAC 26771 07:22:01.881338 tst mo_mt_sms.py: using RAC 251 07:22:02.002071 tst mo_mt_sms.py: using CellId 26771 07:22:02.153217 tst mo_mt_sms.py: using BVCI 26772 07:22:02.294923 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:22:02.309635 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:22:02.325103 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:22:02.339098 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:22:02.350476 tst sms:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:22:02.362732 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 07:22:02.483005 tst sms:trx-sysmocell5000: Using 1 x modem (candidates: 2) 07:22:02.598552 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:22:03.049377 run create_hlr_db(pid=10151): Launched 07:22:03.160649 bus /sierra_2: Setting Powered False 07:22:04.219866 run create_hlr_db(pid=10151): Terminated: ok {rc=0} 07:22:04.646008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10153): Launched 07:22:04.956866 run osmo-hlr_10.42.42.2(pid=10154): Launched 07:22:05.076415 run osmo-stp_10.42.42.5: Starting osmo-stp 07:22:05.617207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10156): Launched 07:22:05.928411 run osmo-stp_10.42.42.5(pid=10157): Launched 07:22:06.042041 run osmo-msc_10.42.42.6: Starting osmo-msc 07:22:06.567915 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10159): Launched 07:22:06.858731 run osmo-msc_10.42.42.6(pid=10160): Launched 07:22:07.021489 run osmo-stp_10.42.42.5(pid=10157): ERR: Terminated: ERROR {rc=1} [trial-2371↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10157)] 07:22:07.144326 run osmo-stp_10.42.42.5(pid=10157): stdout: | (launched: 2022-12-10_07:22:05.871818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:07.268669 run osmo-stp_10.42.42.5(pid=10157): stderr: | [0;m[38;5;43m20221210072206041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072206041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072206042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072206042 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072206042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072206042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072206043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:07.390586 run osmo-stp_10.42.42.5(pid=10157): stdout: | (launched: 2022-12-10_07:22:05.871818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:07.506461 run osmo-stp_10.42.42.5(pid=10157): stderr: | [0;m[38;5;43m20221210072206041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072206041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072206042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072206042 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072206042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072206042 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072206043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:07.645130 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=10157): Process ended prematurely: osmo-stp_10.42.42.5(pid=10157) [trial-2371↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10157)] [trial-2371↪sms:trx-sysmocell5000↪mo_mt_sms.py:16] 07:22:07.653333 tst mo_mt_sms.py:16: Test FAILED (6.0 sec) 07:22:07.679659 run osmo-hlr_10.42.42.2(pid=10154): ERR: Terminated: ERROR {rc=237} [trial-2371↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10154)] 07:22:07.727689 run osmo-hlr_10.42.42.2(pid=10154): stdout: | (launched: 2022-12-10_07:22:04.900566) 07:22:07.777278 run osmo-hlr_10.42.42.2(pid=10154): stderr: | [0;m[1;31m20221210072205095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072205095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072205095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072205095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072205095 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072205096 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072205108 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/sms:trx-sysmocell5000/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072205116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072205117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072205117 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:22:07.846218 run osmo-msc_10.42.42.6(pid=10160): ERR: Terminated: ERROR {rc=2} [trial-2371↪sms:trx-sysmocell5000↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10160)] 07:22:07.893901 run osmo-msc_10.42.42.6(pid=10160): stdout: | (launched: 2022-12-10_07:22:06.805779) 07:22:07.943202 run osmo-msc_10.42.42.6(pid=10160): stderr: | [0;m[38;5;43m20221210072207074 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210072207074 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fab886e0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210072207074 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210072207074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210072207074 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210072207075 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210072207076 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210072207077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210072207077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210072207077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:22:07.993342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10153): Terminating (SIGTERM) 07:22:08.033069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10156): Terminating (SIGTERM) 07:22:08.072840 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10159): Terminating (SIGTERM) 07:22:08.112690 --- ParallelTerminationStrategy: PID 10153 died... 07:22:08.131689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10153): Terminated: ok {rc=0} 07:22:08.175767 --- ParallelTerminationStrategy: PID 10156 died... 07:22:08.194208 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10156): Terminated: ok {rc=0} 07:22:08.238094 --- ParallelTerminationStrategy: PID 10159 died... 07:22:08.256627 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10159): Terminated: ok {rc=0} 07:22:08.343012 bus /sierra_3: Setting Powered False 07:22:09.442765 bus /sierra_3: Setting Powered False 07:22:10.558132 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 sms:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 nitb_ussd:trx-sysmocell5000 --------------------------------------------------------------------- 07:22:11.792146 tst nitb_ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:22:11.796796 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 07:22:11.831522 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x ip_address (candidates: 9) 07:22:11.838208 tst nitb_ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 07:22:11.873968 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 07:22:11.907592 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x ip_address (candidates: 9) 07:22:11.914419 tst nitb_ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 07:22:12.433474 tst nitb_ussd:trx-sysmocell5000: RESERVED RESOURCES for nitb_ussd: bts sysmoCell 5000 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2371 nitb_ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 07:22:12.438723 tst nitb_ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 1) 07:22:12.449732 tst nitb_ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:22:12.503284 tst assert_extension.py: using LAC 26772 07:22:12.617260 tst assert_extension.py: using RAC 252 07:22:12.731225 tst assert_extension.py: using CellId 26772 07:22:12.843909 tst assert_extension.py: using BVCI 26773 07:22:12.948433 tst nitb_ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 07:22:13.063879 tst assert_extension.py:10: start nitb and bts... 07:22:13.273843 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:22:13.912218 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10165): Launched 07:22:14.223873 run osmo-nitb_10.42.42.2(pid=10166): Launched 07:22:14.396837 run osmo-nitb_10.42.42.2(pid=10166): ERR: Terminated: ERROR {rc=2} [trial-2371↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10166)] 07:22:14.536746 run osmo-nitb_10.42.42.2(pid=10166): stdout: | (launched: 2022-12-10_07:22:14.167371) 07:22:14.678019 run osmo-nitb_10.42.42.2(pid=10166): stderr: | (launched: 2022-12-10_07:22:14.213848) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:22:14.819788 run osmo-nitb_10.42.42.2(pid=10166): stdout: | (launched: 2022-12-10_07:22:14.167371) 07:22:14.955623 run osmo-nitb_10.42.42.2(pid=10166): stderr: | (launched: 2022-12-10_07:22:14.213848) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f5483dba268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=10166): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10166) [trial-2371↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10166)] 07:22:15.341746 tst osmo-nitb_10.42.42.2(pid=10166): stdout: | (launched: 2022-12-10_07:22:14.167371) 07:22:15.467950 tst osmo-nitb_10.42.42.2(pid=10166): stderr: | (launched: 2022-12-10_07:22:14.213848) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:22:15.616613 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=10166): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10166) [trial-2371↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10166)] [trial-2371↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12] 07:22:15.625712 tst assert_extension.py:12: Test FAILED (3.2 sec) 07:22:15.633081 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10165): Terminating (SIGTERM) 07:22:15.843294 --- ParallelTerminationStrategy: PID 10165 died... 07:22:15.871435 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=10165): Terminated: ok {rc=0} 07:22:15.989472 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 nitb_ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 ussd:trx-sysmocell5000 --------------------------------------------------------------------- 07:22:17.191076 tst ussd:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:22:17.194995 tst ussd:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 07:22:17.232112 tst ussd:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 07:22:17.259999 tst ussd:trx-sysmocell5000: Verifying 1 x modem (candidates: 12) 07:22:17.294529 tst ussd:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 07:22:17.336484 tst ussd:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 07:22:17.364522 tst ussd:trx-sysmocell5000: Reserving 1 x modem (candidates: 12) 07:22:17.886041 tst ussd:trx-sysmocell5000: RESERVED RESOURCES for ussd: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2371 ussd:trx-sysmocell5000 assert_extension.py ---------------------------------------------- 07:22:17.891234 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:22:17.901974 tst ussd:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:22:17.949733 tst assert_extension.py: using LAC 26773 07:22:18.065082 tst assert_extension.py: using RAC 253 07:22:18.179915 tst assert_extension.py: using CellId 26773 07:22:18.293377 tst assert_extension.py: using BVCI 26774 07:22:18.400121 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:22:18.410831 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:22:18.421557 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:22:18.432368 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:22:18.443321 tst ussd:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:22:18.454245 tst ussd:trx-sysmocell5000: Using 1 x modem (candidates: 1) 07:22:18.567522 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:22:19.016930 run create_hlr_db(pid=10170): Launched 07:22:19.128433 bus /sierra_2: Setting Powered False 07:22:20.187469 run create_hlr_db(pid=10170): Terminated: ok {rc=0} 07:22:20.594197 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10172): Launched 07:22:20.884316 run osmo-hlr_10.42.42.2(pid=10173): Launched 07:22:20.996807 run osmo-stp_10.42.42.5: Starting osmo-stp 07:22:21.596320 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10175): Launched 07:22:21.882693 run osmo-stp_10.42.42.5(pid=10176): Launched 07:22:21.993094 run osmo-msc_10.42.42.6: Starting osmo-msc 07:22:22.508645 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10178): Launched 07:22:22.794504 run osmo-msc_10.42.42.6(pid=10179): Launched 07:22:22.954893 run osmo-stp_10.42.42.5(pid=10176): ERR: Terminated: ERROR {rc=1} [trial-2371↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10176)] 07:22:23.075938 run osmo-stp_10.42.42.5(pid=10176): stdout: | (launched: 2022-12-10_07:22:21.830227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:23.198143 run osmo-stp_10.42.42.5(pid=10176): stderr: | [0;m[38;5;43m20221210072222000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072222000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072222001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072222001 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072222001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072222001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072222002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:23.317305 run osmo-stp_10.42.42.5(pid=10176): stdout: | (launched: 2022-12-10_07:22:21.830227) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:23.431333 run osmo-stp_10.42.42.5(pid=10176): stderr: | [0;m[38;5;43m20221210072222000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072222000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072222001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072222001 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072222001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072222001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072222002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:23.568133 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=10176): Process ended prematurely: osmo-stp_10.42.42.5(pid=10176) [trial-2371↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10176)] [trial-2371↪ussd:trx-sysmocell5000↪assert_extension.py:17] 07:22:23.576331 tst assert_extension.py:17: Test FAILED (5.7 sec) 07:22:23.602784 run osmo-hlr_10.42.42.2(pid=10173): ERR: Terminated: ERROR {rc=237} [trial-2371↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10173)] 07:22:23.650607 run osmo-hlr_10.42.42.2(pid=10173): stdout: | (launched: 2022-12-10_07:22:20.831425) 07:22:23.699890 run osmo-hlr_10.42.42.2(pid=10173): stderr: | [0;m[1;31m20221210072221006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072221006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072221006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072221006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072221006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072221006 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072221018 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/ussd:trx-sysmocell5000/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072221029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072221029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072221029 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:22:23.768240 run osmo-msc_10.42.42.6(pid=10179): ERR: Terminated: ERROR {rc=2} [trial-2371↪ussd:trx-sysmocell5000↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10179)] 07:22:23.815656 run osmo-msc_10.42.42.6(pid=10179): stdout: | (launched: 2022-12-10_07:22:22.742359) 07:22:23.864628 run osmo-msc_10.42.42.6(pid=10179): stderr: | [0;m[38;5;43m20221210072223011 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210072223012 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1c4e778c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210072223012 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210072223012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210072223012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210072223012 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210072223014 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210072223014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210072223014 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210072223015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:22:23.914001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10172): Terminating (SIGTERM) 07:22:23.953533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10175): Terminating (SIGTERM) 07:22:23.993128 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10178): Terminating (SIGTERM) 07:22:24.032754 --- ParallelTerminationStrategy: PID 10172 died... 07:22:24.051720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10172): Terminated: ok {rc=0} 07:22:24.095478 --- ParallelTerminationStrategy: PID 10175 died... 07:22:24.113923 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10175): Terminated: ok {rc=0} 07:22:24.157445 --- ParallelTerminationStrategy: PID 10178 died... 07:22:24.175926 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10178): Terminated: ok {rc=0} 07:22:24.261047 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 ussd:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 07:22:25.476941 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:22:25.484089 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 07:22:25.518744 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 07:22:25.545866 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 07:22:25.598905 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 07:22:25.633718 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 07:22:25.660868 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 07:22:26.212045 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 07:22:26.262150 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:22:26.273390 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:22:26.345980 tst mo_mt_call.py: using LAC 26774 07:22:26.459796 tst mo_mt_call.py: using RAC 254 07:22:26.572230 tst mo_mt_call.py: using CellId 26774 07:22:26.684833 tst mo_mt_call.py: using BVCI 26775 07:22:26.790145 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:22:26.801273 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:22:26.812102 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:22:26.823266 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:22:26.834470 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:22:26.845563 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:22:26.963000 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:22:27.081114 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:22:27.565904 run create_hlr_db(pid=10184): Launched 07:22:27.678196 bus /sierra_2: Setting Powered False 07:22:28.736933 run create_hlr_db(pid=10184): Terminated: ok {rc=0} 07:22:29.164601 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10186): Launched 07:22:29.477242 run osmo-hlr_10.42.42.2(pid=10187): Launched 07:22:29.598268 run osmo-stp_10.42.42.5: Starting osmo-stp 07:22:30.133862 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10189): Launched 07:22:30.445365 run osmo-stp_10.42.42.5(pid=10190): Launched 07:22:30.565058 run osmo-msc_10.42.42.6: Starting osmo-msc 07:22:31.194868 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10192): Launched 07:22:31.521626 run osmo-msc_10.42.42.6(pid=10193): Launched 07:22:31.795205 run osmo-stp_10.42.42.5(pid=10190): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10190)] 07:22:32.120055 run osmo-stp_10.42.42.5(pid=10190): stdout: | (launched: 2022-12-10_07:22:30.388807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:32.389787 run osmo-stp_10.42.42.5(pid=10190): stderr: | [0;m[38;5;43m20221210072230579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072230579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072230579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072230580 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072230580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072230580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072230580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:32.520931 run osmo-stp_10.42.42.5(pid=10190): stdout: | (launched: 2022-12-10_07:22:30.388807) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:32.645792 run osmo-stp_10.42.42.5(pid=10190): stderr: | [0;m[38;5;43m20221210072230579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072230579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072230579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072230580 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072230580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072230580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072230580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:32.795284 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10190): Process ended prematurely: osmo-stp_10.42.42.5(pid=10190) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10190)] [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:22:32.804799 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 07:22:32.832556 run osmo-hlr_10.42.42.2(pid=10187): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10187)] 07:22:32.882360 run osmo-hlr_10.42.42.2(pid=10187): stdout: | (launched: 2022-12-10_07:22:29.421145) 07:22:32.934090 run osmo-hlr_10.42.42.2(pid=10187): stderr: | [0;m[1;31m20221210072229617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072229617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072229617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072229617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072229617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072229617 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072229630 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072229638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072229638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072229638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:22:33.005842 run osmo-msc_10.42.42.6(pid=10193): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10193)] 07:22:33.055210 run osmo-msc_10.42.42.6(pid=10193): stdout: | (launched: 2022-12-10_07:22:31.459646) 07:22:33.106338 run osmo-msc_10.42.42.6(pid=10193): stderr: | [0;m[38;5;43m20221210072232003 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210072232005 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f27db0f8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210072232005 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210072232005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210072232005 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210072232007 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210072232011 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210072232013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210072232013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210072232013 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:22:33.157923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10186): Terminating (SIGTERM) 07:22:33.199318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10189): Terminating (SIGTERM) 07:22:33.240853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10192): Terminating (SIGTERM) 07:22:33.282532 --- ParallelTerminationStrategy: PID 10186 died... 07:22:33.302266 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10186): Terminated: ok {rc=0} 07:22:33.348025 --- ParallelTerminationStrategy: PID 10189 died... 07:22:33.367394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10189): Terminated: ok {rc=0} 07:22:33.412899 --- ParallelTerminationStrategy: PID 10192 died... 07:22:33.432568 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10192): Terminated: ok {rc=0} 07:22:33.520138 bus /sierra_3: Setting Powered False 07:22:34.619075 bus /sierra_3: Setting Powered False 07:22:35.737468 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:22:36.882044 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:22:36.893955 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:22:36.967490 tst mo_mt_call_osmux.py: using LAC 26775 07:22:37.082318 tst mo_mt_call_osmux.py: using RAC 255 07:22:37.195251 tst mo_mt_call_osmux.py: using CellId 26775 07:22:37.308110 tst mo_mt_call_osmux.py: using BVCI 26776 07:22:37.414233 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:22:37.425635 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:22:37.436551 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:22:37.448564 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:22:37.460328 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:22:37.471996 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:22:37.588105 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:22:37.703342 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:22:38.154861 run create_hlr_db(pid=10196): Launched 07:22:38.266205 bus /sierra_2: Setting Powered False 07:22:39.325283 run create_hlr_db(pid=10196): Terminated: ok {rc=0} 07:22:39.753737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10198): Launched 07:22:40.065979 run osmo-hlr_10.42.42.2(pid=10199): Launched 07:22:40.185715 run osmo-stp_10.42.42.5: Starting osmo-stp 07:22:40.727534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10201): Launched 07:22:41.040524 run osmo-stp_10.42.42.5(pid=10202): Launched 07:22:41.160255 run osmo-msc_10.42.42.6: Starting osmo-msc 07:22:41.725695 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10204): Launched 07:22:42.019299 run osmo-msc_10.42.42.6(pid=10205): Launched 07:22:42.183761 run osmo-stp_10.42.42.5(pid=10202): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10202)] 07:22:42.308514 run osmo-stp_10.42.42.5(pid=10202): stdout: | (launched: 2022-12-10_07:22:40.983886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:42.433778 run osmo-stp_10.42.42.5(pid=10202): stderr: | [0;m[38;5;43m20221210072241174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072241174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072241174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072241175 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072241175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072241175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072241175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:42.555560 run osmo-stp_10.42.42.5(pid=10202): stdout: | (launched: 2022-12-10_07:22:40.983886) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:42.671859 run osmo-stp_10.42.42.5(pid=10202): stderr: | [0;m[38;5;43m20221210072241174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072241174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072241174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072241175 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072241175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072241175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072241175 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:42.811160 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10202): Process ended prematurely: osmo-stp_10.42.42.5(pid=10202) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10202)] [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:22:42.819983 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 07:22:42.846282 run osmo-hlr_10.42.42.2(pid=10199): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10199)] 07:22:42.893486 run osmo-hlr_10.42.42.2(pid=10199): stdout: | (launched: 2022-12-10_07:22:40.009681) 07:22:42.942163 run osmo-hlr_10.42.42.2(pid=10199): stderr: | [0;m[1;31m20221210072240204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072240204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072240204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072240204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072240204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072240204 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072240218 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072240226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072240226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072240226 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:22:43.010217 run osmo-msc_10.42.42.6(pid=10205): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10205)] 07:22:43.057587 run osmo-msc_10.42.42.6(pid=10205): stdout: | (launched: 2022-12-10_07:22:41.966270) 07:22:43.106278 run osmo-msc_10.42.42.6(pid=10205): stderr: | [0;m[38;5;43m20221210072242235 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210072242235 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f76bce35c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210072242235 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210072242235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210072242235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210072242235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210072242237 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210072242238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210072242238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210072242238 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:22:43.155595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10198): Terminating (SIGTERM) 07:22:43.194979 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10201): Terminating (SIGTERM) 07:22:43.234460 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10204): Terminating (SIGTERM) 07:22:43.274113 --- ParallelTerminationStrategy: PID 10198 died... 07:22:43.292932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10198): Terminated: ok {rc=0} 07:22:43.336727 --- ParallelTerminationStrategy: PID 10201 died... 07:22:43.354990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10201): Terminated: ok {rc=0} 07:22:43.398459 --- ParallelTerminationStrategy: PID 10204 died... 07:22:43.416601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10204): Terminated: ok {rc=0} 07:22:43.499869 bus /sierra_3: Setting Powered False 07:22:44.594256 bus /sierra_3: Setting Powered False 07:22:45.708244 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:22:47.011785 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:22:47.020235 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:22:47.065643 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:22:47.100339 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:22:47.161028 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:22:47.197949 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:22:47.226177 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:22:47.773344 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:22:47.821091 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:22:47.832267 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:22:47.902323 tst mo_mt_call.py: using LAC 26776 07:22:48.017581 tst mo_mt_call.py: using RAC 1 07:22:48.133972 tst mo_mt_call.py: using CellId 26776 07:22:48.253917 tst mo_mt_call.py: using BVCI 26777 07:22:48.361062 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:22:48.372117 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:22:48.382989 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:22:48.394719 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:22:48.406392 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:22:48.417989 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:22:48.537428 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:22:48.652385 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:22:49.102816 run create_hlr_db(pid=10210): Launched 07:22:49.215765 bus /sierra_2: Setting Powered False 07:22:50.274077 run create_hlr_db(pid=10210): Terminated: ok {rc=0} 07:22:50.701044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10212): Launched 07:22:51.014266 run osmo-hlr_10.42.42.2(pid=10213): Launched 07:22:51.134205 run osmo-stp_10.42.42.5: Starting osmo-stp 07:22:51.671692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10215): Launched 07:22:51.984831 run osmo-stp_10.42.42.5(pid=10216): Launched 07:22:52.104760 run osmo-msc_10.42.42.6: Starting osmo-msc 07:22:52.674650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10218): Launched 07:22:52.987624 run osmo-msc_10.42.42.6(pid=10219): Launched 07:22:53.162824 run osmo-stp_10.42.42.5(pid=10216): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10216)] 07:22:53.294282 run osmo-stp_10.42.42.5(pid=10216): stdout: | (launched: 2022-12-10_07:22:51.928500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:53.426720 run osmo-stp_10.42.42.5(pid=10216): stderr: | [0;m[38;5;43m20221210072252117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072252117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072252117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072252118 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072252118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072252118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072252118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:53.558722 run osmo-stp_10.42.42.5(pid=10216): stdout: | (launched: 2022-12-10_07:22:51.928500) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:22:53.683630 run osmo-stp_10.42.42.5(pid=10216): stderr: | [0;m[38;5;43m20221210072252117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072252117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072252117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072252118 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072252118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072252118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072252118 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:22:53.833477 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10216): Process ended prematurely: osmo-stp_10.42.42.5(pid=10216) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10216)] [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:22:53.842778 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:22:53.870457 run osmo-hlr_10.42.42.2(pid=10213): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10213)] 07:22:53.920426 run osmo-hlr_10.42.42.2(pid=10213): stdout: | (launched: 2022-12-10_07:22:50.957892) 07:22:53.971765 run osmo-hlr_10.42.42.2(pid=10213): stderr: | [0;m[1;31m20221210072251153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072251153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072251153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072251153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072251153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072251153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072251166 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072251174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072251174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072251174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:22:54.043683 run osmo-msc_10.42.42.6(pid=10219): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10219)] 07:22:54.093299 run osmo-msc_10.42.42.6(pid=10219): stdout: | (launched: 2022-12-10_07:22:52.931005) 07:22:54.145109 run osmo-msc_10.42.42.6(pid=10219): stderr: | [0;m[38;5;43m20221210072253250 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210072253250 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2047713c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210072253250 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210072253250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210072253250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210072253250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210072253252 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210072253252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210072253252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210072253253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:22:54.196640 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10212): Terminating (SIGTERM) 07:22:54.238137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10215): Terminating (SIGTERM) 07:22:54.279506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10218): Terminating (SIGTERM) 07:22:54.321371 --- ParallelTerminationStrategy: PID 10212 died... 07:22:54.340584 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10212): Terminated: ok {rc=0} 07:22:54.386481 --- ParallelTerminationStrategy: PID 10215 died... 07:22:54.405690 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10215): Terminated: ok {rc=0} 07:22:54.450914 --- ParallelTerminationStrategy: PID 10218 died... 07:22:54.470210 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10218): Terminated: ok {rc=0} 07:22:54.557297 bus /sierra_3: Setting Powered False 07:22:55.654885 bus /sierra_3: Setting Powered False 07:22:56.771457 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:22:57.917986 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:22:57.930306 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:22:58.002238 tst mo_mt_call_osmux.py: using LAC 26777 07:22:58.123402 tst mo_mt_call_osmux.py: using RAC 2 07:22:58.237473 tst mo_mt_call_osmux.py: using CellId 26777 07:22:58.353388 tst mo_mt_call_osmux.py: using BVCI 26778 07:22:58.460814 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:22:58.471943 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:22:58.482948 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:22:58.494368 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:22:58.505673 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:22:58.516660 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:22:58.637752 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:22:58.758339 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:22:59.244551 run create_hlr_db(pid=10221): Launched 07:22:59.372012 bus /sierra_2: Setting Powered False 07:23:00.434654 run create_hlr_db(pid=10221): Terminated: ok {rc=0} 07:23:00.897825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10223): Launched 07:23:01.210490 run osmo-hlr_10.42.42.2(pid=10224): Launched 07:23:01.457732 run osmo-stp_10.42.42.5: Starting osmo-stp 07:23:02.119017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10226): Launched 07:23:02.439751 run osmo-stp_10.42.42.5(pid=10227): Launched 07:23:02.559525 run osmo-msc_10.42.42.6: Starting osmo-msc 07:23:03.126132 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10229): Launched 07:23:03.439768 run osmo-msc_10.42.42.6(pid=10230): Launched 07:23:03.615414 run osmo-stp_10.42.42.5(pid=10227): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10227)] 07:23:03.748072 run osmo-stp_10.42.42.5(pid=10227): stdout: | (launched: 2022-12-10_07:23:02.382818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:03.881622 run osmo-stp_10.42.42.5(pid=10227): stderr: | [0;m[38;5;43m20221210072302576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072302576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072302577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072302577 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072302577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072302578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072302578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:04.013534 run osmo-stp_10.42.42.5(pid=10227): stdout: | (launched: 2022-12-10_07:23:02.382818) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:04.138424 run osmo-stp_10.42.42.5(pid=10227): stderr: | [0;m[38;5;43m20221210072302576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072302576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072302577 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072302577 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072302577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072302578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072302578 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:04.288015 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10227): Process ended prematurely: osmo-stp_10.42.42.5(pid=10227) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10227)] [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:23:04.297471 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:23:04.324679 run osmo-hlr_10.42.42.2(pid=10224): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10224)] 07:23:04.374685 run osmo-hlr_10.42.42.2(pid=10224): stdout: | (launched: 2022-12-10_07:23:01.149378) 07:23:04.425692 run osmo-hlr_10.42.42.2(pid=10224): stderr: | [0;m[1;31m20221210072301452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072301452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072301452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072301452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072301452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072301452 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072301467 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072301483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072301484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072301484 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:23:04.496803 run osmo-msc_10.42.42.6(pid=10230): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10230)] 07:23:04.545979 run osmo-msc_10.42.42.6(pid=10230): stdout: | (launched: 2022-12-10_07:23:03.382915) 07:23:04.596613 run osmo-msc_10.42.42.6(pid=10230): stderr: | [0;m[38;5;43m20221210072303703 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210072303703 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0c8b7e8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210072303703 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210072303703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210072303703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210072303704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210072303705 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210072303706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210072303706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210072303706 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:23:04.647907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10223): Terminating (SIGTERM) 07:23:04.688852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10226): Terminating (SIGTERM) 07:23:04.730507 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10229): Terminating (SIGTERM) 07:23:04.772180 --- ParallelTerminationStrategy: PID 10223 died... 07:23:04.791885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10223): Terminated: ok {rc=0} 07:23:04.837357 --- ParallelTerminationStrategy: PID 10226 died... 07:23:04.856527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10226): Terminated: ok {rc=0} 07:23:04.901943 --- ParallelTerminationStrategy: PID 10229 died... 07:23:04.921277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10229): Terminated: ok {rc=0} 07:23:05.007963 bus /sierra_3: Setting Powered False 07:23:06.107455 bus /sierra_3: Setting Powered False 07:23:07.221207 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:23:08.473763 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:23:08.480941 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:23:08.515151 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:23:08.542184 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:23:08.595895 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:23:08.630389 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:23:08.657389 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:23:09.209183 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:23:09.259106 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:23:09.270660 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:23:09.342535 tst mo_mt_call.py: using LAC 26778 07:23:09.466868 tst mo_mt_call.py: using RAC 3 07:23:09.601812 tst mo_mt_call.py: using CellId 26778 07:23:09.724909 tst mo_mt_call.py: using BVCI 26779 07:23:09.838871 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:23:09.850398 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:23:09.861710 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:23:09.872925 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:23:09.884406 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:23:09.895766 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:23:10.015554 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:23:10.128168 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:23:10.581409 run create_hlr_db(pid=10235): Launched 07:23:10.695318 bus /sierra_2: Setting Powered False 07:23:11.754244 run create_hlr_db(pid=10235): Terminated: ok {rc=0} 07:23:12.162932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10237): Launched 07:23:12.455482 run osmo-hlr_10.42.42.2(pid=10238): Launched 07:23:12.568495 run osmo-stp_10.42.42.5: Starting osmo-stp 07:23:13.071988 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10240): Launched 07:23:13.365466 run osmo-stp_10.42.42.5(pid=10241): Launched 07:23:13.478219 run osmo-msc_10.42.42.6: Starting osmo-msc 07:23:14.009501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10243): Launched 07:23:14.302276 run osmo-msc_10.42.42.6(pid=10244): Launched 07:23:14.466609 run osmo-stp_10.42.42.5(pid=10241): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10241)] 07:23:14.591315 run osmo-stp_10.42.42.5(pid=10241): stdout: | (launched: 2022-12-10_07:23:13.312101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:14.717726 run osmo-stp_10.42.42.5(pid=10241): stderr: | [0;m[38;5;43m20221210072313482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072313482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072313482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072313482 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072313483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072313483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072313483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:14.839870 run osmo-stp_10.42.42.5(pid=10241): stdout: | (launched: 2022-12-10_07:23:13.312101) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:14.956542 run osmo-stp_10.42.42.5(pid=10241): stderr: | [0;m[38;5;43m20221210072313482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072313482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072313482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072313482 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072313483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072313483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072313483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:15.096248 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10241): Process ended prematurely: osmo-stp_10.42.42.5(pid=10241) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10241)] [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:23:15.105180 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 07:23:15.131669 run osmo-hlr_10.42.42.2(pid=10238): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10238)] 07:23:15.179613 run osmo-hlr_10.42.42.2(pid=10238): stdout: | (launched: 2022-12-10_07:23:12.402468) 07:23:15.228773 run osmo-hlr_10.42.42.2(pid=10238): stderr: | [0;m[1;31m20221210072312576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072312576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072312576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072312576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072312576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072312576 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072312589 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072312597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072312597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072312598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:23:15.297229 run osmo-msc_10.42.42.6(pid=10244): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10244)] 07:23:15.344599 run osmo-msc_10.42.42.6(pid=10244): stdout: | (launched: 2022-12-10_07:23:14.249101) 07:23:15.393289 run osmo-msc_10.42.42.6(pid=10244): stderr: | [0;m[38;5;43m20221210072314520 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210072314520 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f29e914ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210072314520 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210072314520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210072314520 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210072314521 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210072314523 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210072314523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210072314523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210072314523 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:23:15.442700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10237): Terminating (SIGTERM) 07:23:15.482145 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10240): Terminating (SIGTERM) 07:23:15.521666 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10243): Terminating (SIGTERM) 07:23:15.561464 --- ParallelTerminationStrategy: PID 10237 died... 07:23:15.580295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10237): Terminated: ok {rc=0} 07:23:15.624410 --- ParallelTerminationStrategy: PID 10240 died... 07:23:15.642978 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10240): Terminated: ok {rc=0} 07:23:15.687051 --- ParallelTerminationStrategy: PID 10243 died... 07:23:15.705529 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10243): Terminated: ok {rc=0} 07:23:15.789643 bus /sierra_3: Setting Powered False 07:23:16.911216 bus /sierra_3: Setting Powered False 07:23:18.081171 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:23:19.249322 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:23:19.262530 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:23:19.334451 tst mo_mt_call_osmux.py: using LAC 26779 07:23:19.458454 tst mo_mt_call_osmux.py: using RAC 4 07:23:19.582112 tst mo_mt_call_osmux.py: using CellId 26779 07:23:19.705357 tst mo_mt_call_osmux.py: using BVCI 26780 07:23:19.822581 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:23:19.835362 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:23:19.847843 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:23:19.860638 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:23:19.873340 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:23:19.886258 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:23:20.007178 tst voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:23:20.127562 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:23:20.628543 run create_hlr_db(pid=10518): Launched 07:23:20.777432 bus /sierra_2: Setting Powered False 07:23:21.840261 run create_hlr_db(pid=10518): Terminated: ok {rc=0} 07:23:22.275340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10520): Launched 07:23:22.591826 run osmo-hlr_10.42.42.2(pid=10521): Launched 07:23:22.820232 run osmo-stp_10.42.42.5: Starting osmo-stp 07:23:23.540128 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10523): Launched 07:23:23.878154 run osmo-stp_10.42.42.5(pid=10524): Launched 07:23:24.121843 run osmo-msc_10.42.42.6: Starting osmo-msc 07:23:24.806098 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10526): Launched 07:23:25.136773 run osmo-msc_10.42.42.6(pid=10527): Launched 07:23:25.491548 run osmo-stp_10.42.42.5(pid=10524): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10524)] 07:23:25.770501 run osmo-stp_10.42.42.5(pid=10524): stdout: | (launched: 2022-12-10_07:23:23.815031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:25.952194 run osmo-stp_10.42.42.5(pid=10524): stderr: | [0;m[38;5;43m20221210072324108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072324108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072324109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072324109 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072324111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072324111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072324112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:26.086693 run osmo-stp_10.42.42.5(pid=10524): stdout: | (launched: 2022-12-10_07:23:23.815031) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:26.216108 run osmo-stp_10.42.42.5(pid=10524): stderr: | [0;m[38;5;43m20221210072324108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072324108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072324109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072324109 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072324111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072324111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072324112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:26.371237 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10524): Process ended prematurely: osmo-stp_10.42.42.5(pid=10524) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10524)] [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:23:26.381862 tst mo_mt_call_osmux.py:8: Test FAILED (7.2 sec) 07:23:26.411807 run osmo-hlr_10.42.42.2(pid=10521): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10521)] 07:23:26.464011 run osmo-hlr_10.42.42.2(pid=10521): stdout: | (launched: 2022-12-10_07:23:22.530590) 07:23:26.517133 run osmo-hlr_10.42.42.2(pid=10521): stderr: | [0;m[1;31m20221210072322868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072322868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072322868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072322868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072322868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072322868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072322895 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072322912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072322912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072322912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:23:26.592813 run osmo-msc_10.42.42.6(pid=10527): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10527)] 07:23:26.644297 run osmo-msc_10.42.42.6(pid=10527): stdout: | (launched: 2022-12-10_07:23:25.073817) 07:23:26.697352 run osmo-msc_10.42.42.6(pid=10527): stderr: | [0;m[38;5;43m20221210072325583 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210072325583 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcf4f982c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210072325583 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210072325584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210072325584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210072325584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210072325588 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210072325588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210072325588 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210072325597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:23:26.752310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10520): Terminating (SIGTERM) 07:23:26.796248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10523): Terminating (SIGTERM) 07:23:26.841298 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10526): Terminating (SIGTERM) 07:23:26.886620 --- ParallelTerminationStrategy: PID 10520 died... 07:23:26.907656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10520): Terminated: ok {rc=0} 07:23:26.957913 --- ParallelTerminationStrategy: PID 10523 died... 07:23:26.978501 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10523): Terminated: ok {rc=0} 07:23:27.025980 --- ParallelTerminationStrategy: PID 10526 died... 07:23:27.046628 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10526): Terminated: ok {rc=0} 07:23:27.137258 bus /sierra_3: Setting Powered False 07:23:28.239144 bus /sierra_3: Setting Powered False 07:23:29.358467 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 07:23:30.614543 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:23:30.621577 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 07:23:30.659543 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 07:23:30.688567 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 07:23:30.742210 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 07:23:30.778268 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 07:23:30.807171 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 07:23:31.428750 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 07:23:31.480641 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:23:31.493023 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:23:31.568346 tst mo_mt_call.py: using LAC 26780 07:23:31.714961 tst mo_mt_call.py: using RAC 5 07:23:31.871617 tst mo_mt_call.py: using CellId 26780 07:23:32.037450 tst mo_mt_call.py: using BVCI 26781 07:23:32.172253 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:23:32.188747 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:23:32.203070 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:23:32.218441 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:23:32.234162 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:23:32.249348 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:23:32.396493 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:23:32.535946 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:23:33.101860 run create_hlr_db(pid=10532): Launched 07:23:33.269951 bus /sierra_2: Setting Powered False 07:23:34.333415 run create_hlr_db(pid=10532): Terminated: ok {rc=0} 07:23:34.797481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10534): Launched 07:23:35.138029 run osmo-hlr_10.42.42.2(pid=10535): Launched 07:23:35.388415 run osmo-stp_10.42.42.5: Starting osmo-stp 07:23:36.054930 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10537): Launched 07:23:36.401764 run osmo-stp_10.42.42.5(pid=10538): Launched 07:23:36.640410 run osmo-msc_10.42.42.6: Starting osmo-msc 07:23:37.322933 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10540): Launched 07:23:37.665776 run osmo-msc_10.42.42.6(pid=10541): Launched 07:23:38.021808 run osmo-stp_10.42.42.5(pid=10538): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10538)] 07:23:38.301207 run osmo-stp_10.42.42.5(pid=10538): stdout: | (launched: 2022-12-10_07:23:36.329446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:38.480560 run osmo-stp_10.42.42.5(pid=10538): stderr: | [0;m[38;5;43m20221210072336627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072336627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072336627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072336627 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072336628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072336628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072336628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:38.617936 run osmo-stp_10.42.42.5(pid=10538): stdout: | (launched: 2022-12-10_07:23:36.329446) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:38.748110 run osmo-stp_10.42.42.5(pid=10538): stderr: | [0;m[38;5;43m20221210072336627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072336627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072336627 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072336627 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072336628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072336628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072336628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:38.904286 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10538): Process ended prematurely: osmo-stp_10.42.42.5(pid=10538) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10538)] [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 07:23:38.915080 tst mo_mt_call.py:8: Test FAILED (7.5 sec) 07:23:38.945194 run osmo-hlr_10.42.42.2(pid=10535): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10535)] 07:23:39.001143 run osmo-hlr_10.42.42.2(pid=10535): stdout: | (launched: 2022-12-10_07:23:35.073124) 07:23:39.052633 run osmo-hlr_10.42.42.2(pid=10535): stderr: | [0;m[1;31m20221210072335384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072335384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072335384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072335384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072335384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072335384 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072335411 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072335428 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072335429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072335429 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:23:39.124137 run osmo-msc_10.42.42.6(pid=10541): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10541)] 07:23:39.173962 run osmo-msc_10.42.42.6(pid=10541): stdout: | (launched: 2022-12-10_07:23:37.595434) 07:23:39.225365 run osmo-msc_10.42.42.6(pid=10541): stderr: | [0;m[38;5;43m20221210072338100 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210072338100 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd0feeedc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210072338109 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210072338109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210072338109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210072338109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210072338111 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210072338112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210072338112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210072338112 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:23:39.276869 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10534): Terminating (SIGTERM) 07:23:39.318493 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10537): Terminating (SIGTERM) 07:23:39.360194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10540): Terminating (SIGTERM) 07:23:39.402125 --- ParallelTerminationStrategy: PID 10534 died... 07:23:39.422008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10534): Terminated: ok {rc=0} 07:23:39.468006 --- ParallelTerminationStrategy: PID 10537 died... 07:23:39.487303 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10537): Terminated: ok {rc=0} 07:23:39.533241 --- ParallelTerminationStrategy: PID 10540 died... 07:23:39.552617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10540): Terminated: ok {rc=0} 07:23:39.639418 bus /sierra_3: Setting Powered False 07:23:40.736902 bus /sierra_3: Setting Powered False 07:23:41.852523 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 07:23:42.997193 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:23:43.008708 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:23:43.079027 tst mo_mt_call_osmux.py: using LAC 26781 07:23:43.194646 tst mo_mt_call_osmux.py: using RAC 6 07:23:43.310888 tst mo_mt_call_osmux.py: using CellId 26781 07:23:43.426995 tst mo_mt_call_osmux.py: using BVCI 26782 07:23:43.534719 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:23:43.545800 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:23:43.556680 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:23:43.568015 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:23:43.579210 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:23:43.590301 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:23:43.709430 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:23:43.825548 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:23:44.293365 run create_hlr_db(pid=10543): Launched 07:23:44.423081 bus /sierra_2: Setting Powered False 07:23:45.485673 run create_hlr_db(pid=10543): Terminated: ok {rc=0} 07:23:45.941781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10545): Launched 07:23:46.275448 run osmo-hlr_10.42.42.2(pid=10546): Launched 07:23:46.514181 run osmo-stp_10.42.42.5: Starting osmo-stp 07:23:47.125685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10548): Launched 07:23:47.429082 run osmo-stp_10.42.42.5(pid=10549): Launched 07:23:47.543386 run osmo-msc_10.42.42.6: Starting osmo-msc 07:23:48.075327 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10551): Launched 07:23:48.369477 run osmo-msc_10.42.42.6(pid=10552): Launched 07:23:48.535109 run osmo-stp_10.42.42.5(pid=10549): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10549)] 07:23:48.660500 run osmo-stp_10.42.42.5(pid=10549): stdout: | (launched: 2022-12-10_07:23:47.375365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:48.785804 run osmo-stp_10.42.42.5(pid=10549): stderr: | [0;m[38;5;43m20221210072347545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072347545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072347545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072347546 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072347546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072347546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072347546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:48.907982 run osmo-stp_10.42.42.5(pid=10549): stdout: | (launched: 2022-12-10_07:23:47.375365) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:49.024753 run osmo-stp_10.42.42.5(pid=10549): stderr: | [0;m[38;5;43m20221210072347545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072347545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072347545 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072347546 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072347546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072347546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072347546 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:49.164622 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10549): Process ended prematurely: osmo-stp_10.42.42.5(pid=10549) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10549)] [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 07:23:49.173426 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:23:49.199641 run osmo-hlr_10.42.42.2(pid=10546): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10546)] 07:23:49.247674 run osmo-hlr_10.42.42.2(pid=10546): stdout: | (launched: 2022-12-10_07:23:46.211665) 07:23:49.296654 run osmo-hlr_10.42.42.2(pid=10546): stderr: | [0;m[1;31m20221210072346547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072346547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072346547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072346547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072346547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072346547 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072346571 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072346583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072346583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072346583 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:23:49.365399 run osmo-msc_10.42.42.6(pid=10552): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10552)] 07:23:49.412775 run osmo-msc_10.42.42.6(pid=10552): stdout: | (launched: 2022-12-10_07:23:48.316001) 07:23:49.461535 run osmo-msc_10.42.42.6(pid=10552): stderr: | [0;m[38;5;43m20221210072348589 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210072348589 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f240da83c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210072348589 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210072348589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210072348589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210072348589 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210072348591 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210072348591 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210072348592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210072348592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:23:49.510838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10545): Terminating (SIGTERM) 07:23:49.550137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10548): Terminating (SIGTERM) 07:23:49.590029 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10551): Terminating (SIGTERM) 07:23:49.629717 --- ParallelTerminationStrategy: PID 10545 died... 07:23:49.648590 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10545): Terminated: ok {rc=0} 07:23:49.692361 --- ParallelTerminationStrategy: PID 10548 died... 07:23:49.710715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10548): Terminated: ok {rc=0} 07:23:49.754792 --- ParallelTerminationStrategy: PID 10551 died... 07:23:49.773125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10551): Terminated: ok {rc=0} 07:23:49.856431 bus /sierra_3: Setting Powered False 07:23:50.953959 bus /sierra_3: Setting Powered False 07:23:52.069841 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:23:53.322327 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:23:53.328832 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:23:53.362700 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:23:53.388671 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:23:53.439021 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:23:53.473600 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:23:53.501171 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:23:54.054929 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:23:54.105761 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:23:54.117476 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:23:54.188480 tst mo_mt_call.py: using LAC 26782 07:23:54.310552 tst mo_mt_call.py: using RAC 7 07:23:54.434467 tst mo_mt_call.py: using CellId 26782 07:23:54.557149 tst mo_mt_call.py: using BVCI 26783 07:23:54.672644 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:23:54.684340 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:23:54.695956 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:23:54.707722 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:23:54.719585 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:23:54.731922 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:23:54.848081 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:23:54.964124 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:23:55.450798 run create_hlr_db(pid=10558): Launched 07:23:55.579411 bus /sierra_2: Setting Powered False 07:23:56.642035 run create_hlr_db(pid=10558): Terminated: ok {rc=0} 07:23:57.080568 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10560): Launched 07:23:57.394171 run osmo-hlr_10.42.42.2(pid=10561): Launched 07:23:57.515679 run osmo-stp_10.42.42.5: Starting osmo-stp 07:23:58.057250 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10563): Launched 07:23:58.372654 run osmo-stp_10.42.42.5(pid=10564): Launched 07:23:58.492841 run osmo-msc_10.42.42.6: Starting osmo-msc 07:23:59.063239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10566): Launched 07:23:59.378601 run osmo-msc_10.42.42.6(pid=10567): Launched 07:23:59.554202 run osmo-stp_10.42.42.5(pid=10564): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10564)] 07:23:59.686614 run osmo-stp_10.42.42.5(pid=10564): stdout: | (launched: 2022-12-10_07:23:58.315738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:23:59.819882 run osmo-stp_10.42.42.5(pid=10564): stderr: | [0;m[38;5;43m20221210072358506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072358506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072358506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072358506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072358509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072358509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072358509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:23:59.952591 run osmo-stp_10.42.42.5(pid=10564): stdout: | (launched: 2022-12-10_07:23:58.315738) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:00.078217 run osmo-stp_10.42.42.5(pid=10564): stderr: | [0;m[38;5;43m20221210072358506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072358506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072358506 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072358506 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072358509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072358509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072358509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:00.228834 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10564): Process ended prematurely: osmo-stp_10.42.42.5(pid=10564) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10564)] [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:24:00.238339 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:24:00.266020 run osmo-hlr_10.42.42.2(pid=10561): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10561)] 07:24:00.315569 run osmo-hlr_10.42.42.2(pid=10561): stdout: | (launched: 2022-12-10_07:23:57.337589) 07:24:00.366949 run osmo-hlr_10.42.42.2(pid=10561): stderr: | [0;m[1;31m20221210072357535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072357535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072357535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072357535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072357535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072357535 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072357549 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072357557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072357558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072357558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:24:00.438467 run osmo-msc_10.42.42.6(pid=10567): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10567)] 07:24:00.487939 run osmo-msc_10.42.42.6(pid=10567): stdout: | (launched: 2022-12-10_07:23:59.321625) 07:24:00.538738 run osmo-msc_10.42.42.6(pid=10567): stderr: | [0;m[38;5;43m20221210072359642 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210072359642 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7dbb1cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210072359642 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210072359642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210072359642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210072359642 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210072359644 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210072359645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210072359645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210072359645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:24:00.589995 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10560): Terminating (SIGTERM) 07:24:00.631432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10563): Terminating (SIGTERM) 07:24:00.672714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10566): Terminating (SIGTERM) 07:24:00.715494 --- ParallelTerminationStrategy: PID 10560 died... 07:24:00.735569 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10560): Terminated: ok {rc=0} 07:24:00.781095 --- ParallelTerminationStrategy: PID 10563 died... 07:24:00.800611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10563): Terminated: ok {rc=0} 07:24:00.862703 --- ParallelTerminationStrategy: PID 10566 died... 07:24:00.887328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10566): Terminated: ok {rc=0} 07:24:00.992403 bus /sierra_3: Setting Powered False 07:24:02.104281 bus /sierra_3: Setting Powered False 07:24:03.218959 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 07:24:04.368688 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:24:04.381082 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:24:04.457183 tst mo_mt_call_osmux.py: using LAC 26783 07:24:04.580893 tst mo_mt_call_osmux.py: using RAC 8 07:24:04.703493 tst mo_mt_call_osmux.py: using CellId 26783 07:24:04.826401 tst mo_mt_call_osmux.py: using BVCI 26784 07:24:04.940582 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:24:04.952346 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:24:04.963986 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:24:04.975953 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:24:04.988032 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:24:04.999941 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:24:05.119059 tst voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:24:05.235810 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:24:05.690227 run create_hlr_db(pid=10569): Launched 07:24:05.804184 bus /sierra_2: Setting Powered False 07:24:06.863604 run create_hlr_db(pid=10569): Terminated: ok {rc=0} 07:24:07.294448 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10571): Launched 07:24:07.594692 run osmo-hlr_10.42.42.2(pid=10572): Launched 07:24:07.707286 run osmo-stp_10.42.42.5: Starting osmo-stp 07:24:08.228804 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10574): Launched 07:24:08.523327 run osmo-stp_10.42.42.5(pid=10575): Launched 07:24:08.636290 run osmo-msc_10.42.42.6: Starting osmo-msc 07:24:09.168550 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10577): Launched 07:24:09.462747 run osmo-msc_10.42.42.6(pid=10578): Launched 07:24:09.629397 run osmo-stp_10.42.42.5(pid=10575): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10575)] 07:24:09.754648 run osmo-stp_10.42.42.5(pid=10575): stdout: | (launched: 2022-12-10_07:24:08.469978) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:09.879794 run osmo-stp_10.42.42.5(pid=10575): stderr: | [0;m[38;5;43m20221210072408640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072408640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072408641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072408641 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072408642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072408642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072408642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:10.002605 run osmo-stp_10.42.42.5(pid=10575): stdout: | (launched: 2022-12-10_07:24:08.469978) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:10.120415 run osmo-stp_10.42.42.5(pid=10575): stderr: | [0;m[38;5;43m20221210072408640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072408640 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072408641 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072408641 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072408642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072408642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072408642 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:10.261312 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10575): Process ended prematurely: osmo-stp_10.42.42.5(pid=10575) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10575)] [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 07:24:10.270353 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 07:24:10.297268 run osmo-hlr_10.42.42.2(pid=10572): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10572)] 07:24:10.345386 run osmo-hlr_10.42.42.2(pid=10572): stdout: | (launched: 2022-12-10_07:24:07.541616) 07:24:10.394881 run osmo-hlr_10.42.42.2(pid=10572): stderr: | [0;m[1;31m20221210072407715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072407715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072407715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072407715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072407715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072407715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072407727 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072407736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072407736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072407736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:24:10.463929 run osmo-msc_10.42.42.6(pid=10578): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10578)] 07:24:10.511800 run osmo-msc_10.42.42.6(pid=10578): stdout: | (launched: 2022-12-10_07:24:09.409447) 07:24:10.561924 run osmo-msc_10.42.42.6(pid=10578): stderr: | [0;m[38;5;43m20221210072409680 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210072409680 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7feb54362c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210072409680 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210072409680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210072409681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210072409681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210072409682 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210072409683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210072409683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210072409683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:24:10.611734 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10571): Terminating (SIGTERM) 07:24:10.651281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10574): Terminating (SIGTERM) 07:24:10.691161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10577): Terminating (SIGTERM) 07:24:10.731075 --- ParallelTerminationStrategy: PID 10571 died... 07:24:10.750110 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10571): Terminated: ok {rc=0} 07:24:10.794283 --- ParallelTerminationStrategy: PID 10574 died... 07:24:10.812860 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10574): Terminated: ok {rc=0} 07:24:10.856853 --- ParallelTerminationStrategy: PID 10577 died... 07:24:10.875787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10577): Terminated: ok {rc=0} 07:24:10.961468 bus /sierra_3: Setting Powered False 07:24:12.060153 bus /sierra_3: Setting Powered False 07:24:13.174947 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:24:14.428681 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:24:14.435191 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:24:14.468842 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 07:24:14.494792 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:24:14.546040 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:24:14.580655 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 07:24:14.606711 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:24:15.156465 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 07:24:15.203639 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:24:15.214850 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:24:15.283489 tst mo_mt_call.py: using LAC 26784 07:24:15.399612 tst mo_mt_call.py: using RAC 9 07:24:15.523714 tst mo_mt_call.py: using CellId 26784 07:24:15.648940 tst mo_mt_call.py: using BVCI 26785 07:24:15.763036 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:24:15.774801 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:24:15.786496 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:24:15.798124 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:24:15.809684 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:24:15.821112 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:24:15.969645 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:24:16.115044 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:24:16.629570 run create_hlr_db(pid=10583): Launched 07:24:16.791989 bus /sierra_2: Setting Powered False 07:24:17.854489 run create_hlr_db(pid=10583): Terminated: ok {rc=0} 07:24:18.274400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10585): Launched 07:24:18.567725 run osmo-hlr_10.42.42.2(pid=10586): Launched 07:24:18.679816 run osmo-stp_10.42.42.5: Starting osmo-stp 07:24:19.198888 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10588): Launched 07:24:19.491710 run osmo-stp_10.42.42.5(pid=10589): Launched 07:24:19.603438 run osmo-msc_10.42.42.6: Starting osmo-msc 07:24:20.133807 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10591): Launched 07:24:20.428149 run osmo-msc_10.42.42.6(pid=10592): Launched 07:24:20.592279 run osmo-stp_10.42.42.5(pid=10589): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10589)] 07:24:20.716812 run osmo-stp_10.42.42.5(pid=10589): stdout: | (launched: 2022-12-10_07:24:19.438415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:20.841987 run osmo-stp_10.42.42.5(pid=10589): stderr: | [0;m[38;5;43m20221210072419607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072419608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072419608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072419608 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072419609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072419609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072419609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:20.964282 run osmo-stp_10.42.42.5(pid=10589): stdout: | (launched: 2022-12-10_07:24:19.438415) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:21.081256 run osmo-stp_10.42.42.5(pid=10589): stderr: | [0;m[38;5;43m20221210072419607 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072419608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072419608 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072419608 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072419609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072419609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072419609 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:21.221525 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10589): Process ended prematurely: osmo-stp_10.42.42.5(pid=10589) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10589)] [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:24:21.230236 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:24:21.256392 run osmo-hlr_10.42.42.2(pid=10586): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10586)] 07:24:21.304069 run osmo-hlr_10.42.42.2(pid=10586): stdout: | (launched: 2022-12-10_07:24:18.514741) 07:24:21.353225 run osmo-hlr_10.42.42.2(pid=10586): stderr: | [0;m[1;31m20221210072418690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072418690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072418690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072418690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072418690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072418690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072418705 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072418714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072418714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072418714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:24:21.421815 run osmo-msc_10.42.42.6(pid=10592): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10592)] 07:24:21.469111 run osmo-msc_10.42.42.6(pid=10592): stdout: | (launched: 2022-12-10_07:24:20.374183) 07:24:21.517919 run osmo-msc_10.42.42.6(pid=10592): stderr: | [0;m[38;5;43m20221210072420645 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210072420646 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0765f33c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210072420646 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210072420646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210072420646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210072420646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210072420648 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210072420648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210072420648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210072420648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:24:21.567061 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10585): Terminating (SIGTERM) 07:24:21.606515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10588): Terminating (SIGTERM) 07:24:21.645878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10591): Terminating (SIGTERM) 07:24:21.685352 --- ParallelTerminationStrategy: PID 10585 died... 07:24:21.704118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10585): Terminated: ok {rc=0} 07:24:21.747969 --- ParallelTerminationStrategy: PID 10588 died... 07:24:21.766255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10588): Terminated: ok {rc=0} 07:24:21.809872 --- ParallelTerminationStrategy: PID 10591 died... 07:24:21.828134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10591): Terminated: ok {rc=0} 07:24:21.913176 bus /sierra_3: Setting Powered False 07:24:23.011854 bus /sierra_3: Setting Powered False 07:24:24.125177 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:24:25.269994 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:24:25.281763 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:24:25.351163 tst mo_mt_call_osmux.py: using LAC 26785 07:24:25.468080 tst mo_mt_call_osmux.py: using RAC 10 07:24:25.584828 tst mo_mt_call_osmux.py: using CellId 26785 07:24:25.699910 tst mo_mt_call_osmux.py: using BVCI 26786 07:24:25.806221 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:24:25.817429 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:24:25.828446 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:24:25.839734 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:24:25.851005 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:24:25.862130 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:24:25.980451 tst voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:24:26.097973 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:24:26.552751 run create_hlr_db(pid=10594): Launched 07:24:26.664601 bus /sierra_2: Setting Powered False 07:24:27.723669 run create_hlr_db(pid=10594): Terminated: ok {rc=0} 07:24:28.152781 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10596): Launched 07:24:28.467771 run osmo-hlr_10.42.42.2(pid=10597): Launched 07:24:28.589736 run osmo-stp_10.42.42.5: Starting osmo-stp 07:24:29.130536 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10599): Launched 07:24:29.444106 run osmo-stp_10.42.42.5(pid=10600): Launched 07:24:29.565042 run osmo-msc_10.42.42.6: Starting osmo-msc 07:24:30.134374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10602): Launched 07:24:30.449224 run osmo-msc_10.42.42.6(pid=10603): Launched 07:24:30.626496 run osmo-stp_10.42.42.5(pid=10600): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10600)] 07:24:30.759468 run osmo-stp_10.42.42.5(pid=10600): stdout: | (launched: 2022-12-10_07:24:29.387507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:30.949063 run osmo-stp_10.42.42.5(pid=10600): stderr: | [0;m[38;5;43m20221210072429579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072429579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072429579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072429580 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072429580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072429580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072429580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:31.127136 run osmo-stp_10.42.42.5(pid=10600): stdout: | (launched: 2022-12-10_07:24:29.387507) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:31.248536 run osmo-stp_10.42.42.5(pid=10600): stderr: | [0;m[38;5;43m20221210072429579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072429579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072429579 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072429580 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072429580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072429580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072429580 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:31.394531 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10600): Process ended prematurely: osmo-stp_10.42.42.5(pid=10600) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10600)] [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:24:31.404225 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:24:31.433876 run osmo-hlr_10.42.42.2(pid=10597): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10597)] 07:24:31.484085 run osmo-hlr_10.42.42.2(pid=10597): stdout: | (launched: 2022-12-10_07:24:28.410546) 07:24:31.535914 run osmo-hlr_10.42.42.2(pid=10597): stderr: | [0;m[1;31m20221210072428608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072428608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072428608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072428608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072428608 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072428609 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072428620 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072428629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072428629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072428629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:24:31.608583 run osmo-msc_10.42.42.6(pid=10603): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10603)] 07:24:31.658489 run osmo-msc_10.42.42.6(pid=10603): stdout: | (launched: 2022-12-10_07:24:30.392097) 07:24:31.709783 run osmo-msc_10.42.42.6(pid=10603): stderr: | [0;m[38;5;43m20221210072430714 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210072430714 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7ce74ffc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210072430714 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210072430714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210072430714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210072430714 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210072430716 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210072430716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210072430716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210072430717 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:24:31.762560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10596): Terminating (SIGTERM) 07:24:31.805039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10599): Terminating (SIGTERM) 07:24:31.849006 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10602): Terminating (SIGTERM) 07:24:31.893664 --- ParallelTerminationStrategy: PID 10596 died... 07:24:31.913222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10596): Terminated: ok {rc=0} 07:24:31.963186 --- ParallelTerminationStrategy: PID 10599 died... 07:24:31.982790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10599): Terminated: ok {rc=0} 07:24:32.029574 --- ParallelTerminationStrategy: PID 10602 died... 07:24:32.049062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10602): Terminated: ok {rc=0} 07:24:32.137651 bus /sierra_3: Setting Powered False 07:24:33.242470 bus /sierra_3: Setting Powered False 07:24:34.356677 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:24:35.609151 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:24:35.615186 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:24:35.649551 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 07:24:35.676665 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 07:24:35.730338 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:24:35.765377 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 07:24:35.792379 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 07:24:36.342117 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 07:24:36.392527 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:24:36.403944 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:24:36.476383 tst mo_mt_call.py: using LAC 26786 07:24:36.601785 tst mo_mt_call.py: using RAC 11 07:24:36.723998 tst mo_mt_call.py: using CellId 26786 07:24:36.846492 tst mo_mt_call.py: using BVCI 26787 07:24:36.960284 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:24:36.971633 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:24:36.982888 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:24:36.994113 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:24:37.005444 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:24:37.016506 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:24:37.136511 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:24:37.255718 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:24:37.743229 run create_hlr_db(pid=10608): Launched 07:24:37.871651 bus /sierra_2: Setting Powered False 07:24:38.934165 run create_hlr_db(pid=10608): Terminated: ok {rc=0} 07:24:39.353460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10610): Launched 07:24:39.647229 run osmo-hlr_10.42.42.2(pid=10611): Launched 07:24:39.760933 run osmo-stp_10.42.42.5: Starting osmo-stp 07:24:40.278982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10613): Launched 07:24:40.573648 run osmo-stp_10.42.42.5(pid=10614): Launched 07:24:40.686657 run osmo-msc_10.42.42.6: Starting osmo-msc 07:24:41.217667 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10616): Launched 07:24:41.512043 run osmo-msc_10.42.42.6(pid=10617): Launched 07:24:41.680664 run osmo-stp_10.42.42.5(pid=10614): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10614)] 07:24:41.807501 run osmo-stp_10.42.42.5(pid=10614): stdout: | (launched: 2022-12-10_07:24:40.519503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:41.932771 run osmo-stp_10.42.42.5(pid=10614): stderr: | [0;m[38;5;43m20221210072440688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072440688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072440689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072440689 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072440689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072440690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072440690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:42.055555 run osmo-stp_10.42.42.5(pid=10614): stdout: | (launched: 2022-12-10_07:24:40.519503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:42.173179 run osmo-stp_10.42.42.5(pid=10614): stderr: | [0;m[38;5;43m20221210072440688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072440688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072440689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072440689 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072440689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072440690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072440690 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:42.313916 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10614): Process ended prematurely: osmo-stp_10.42.42.5(pid=10614) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10614)] [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 07:24:42.322565 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 07:24:42.349142 run osmo-hlr_10.42.42.2(pid=10611): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10611)] 07:24:42.396737 run osmo-hlr_10.42.42.2(pid=10611): stdout: | (launched: 2022-12-10_07:24:39.593906) 07:24:42.446255 run osmo-hlr_10.42.42.2(pid=10611): stderr: | [0;m[1;31m20221210072439770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072439770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072439770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072439770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072439770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072439770 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072439782 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072439791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072439791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072439791 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:24:42.515187 run osmo-msc_10.42.42.6(pid=10617): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10617)] 07:24:42.563340 run osmo-msc_10.42.42.6(pid=10617): stdout: | (launched: 2022-12-10_07:24:41.458352) 07:24:42.612854 run osmo-msc_10.42.42.6(pid=10617): stderr: | [0;m[38;5;43m20221210072441730 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210072441730 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6813212c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210072441730 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210072441730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210072441730 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210072441731 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210072441732 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210072441733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210072441733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210072441733 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:24:42.662832 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10610): Terminating (SIGTERM) 07:24:42.702849 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10613): Terminating (SIGTERM) 07:24:42.742457 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10616): Terminating (SIGTERM) 07:24:42.782349 --- ParallelTerminationStrategy: PID 10610 died... 07:24:42.801340 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10610): Terminated: ok {rc=0} 07:24:42.846163 --- ParallelTerminationStrategy: PID 10613 died... 07:24:42.864489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10613): Terminated: ok {rc=0} 07:24:42.908425 --- ParallelTerminationStrategy: PID 10616 died... 07:24:42.927002 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10616): Terminated: ok {rc=0} 07:24:43.012612 bus /sierra_3: Setting Powered False 07:24:44.110559 bus /sierra_3: Setting Powered False 07:24:45.226874 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 07:24:46.371942 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:24:46.384569 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:24:46.459031 tst mo_mt_call_osmux.py: using LAC 26787 07:24:46.616384 tst mo_mt_call_osmux.py: using RAC 12 07:24:46.771053 tst mo_mt_call_osmux.py: using CellId 26787 07:24:46.923850 tst mo_mt_call_osmux.py: using BVCI 26788 07:24:47.053826 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:24:47.065755 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:24:47.078518 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:24:47.091202 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:24:47.102973 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:24:47.116069 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:24:47.233454 tst voice:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:24:47.355430 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:24:47.809086 run create_hlr_db(pid=10619): Launched 07:24:47.922638 bus /sierra_2: Setting Powered False 07:24:48.981536 run create_hlr_db(pid=10619): Terminated: ok {rc=0} 07:24:49.411321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10621): Launched 07:24:49.726069 run osmo-hlr_10.42.42.2(pid=10622): Launched 07:24:49.846575 run osmo-stp_10.42.42.5: Starting osmo-stp 07:24:50.392496 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10624): Launched 07:24:50.707427 run osmo-stp_10.42.42.5(pid=10625): Launched 07:24:50.828105 run osmo-msc_10.42.42.6: Starting osmo-msc 07:24:51.397528 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10627): Launched 07:24:51.712058 run osmo-msc_10.42.42.6(pid=10628): Launched 07:24:51.889664 run osmo-stp_10.42.42.5(pid=10625): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10625)] 07:24:52.023147 run osmo-stp_10.42.42.5(pid=10625): stdout: | (launched: 2022-12-10_07:24:50.650696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:52.155888 run osmo-stp_10.42.42.5(pid=10625): stderr: | [0;m[38;5;43m20221210072450844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072450844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072450844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072450844 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072450845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072450845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072450845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:52.288923 run osmo-stp_10.42.42.5(pid=10625): stdout: | (launched: 2022-12-10_07:24:50.650696) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:24:52.414529 run osmo-stp_10.42.42.5(pid=10625): stderr: | [0;m[38;5;43m20221210072450844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072450844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072450844 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072450844 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072450845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072450845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072450845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:24:52.564747 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=10625): Process ended prematurely: osmo-stp_10.42.42.5(pid=10625) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10625)] [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 07:24:52.574335 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:24:52.601897 run osmo-hlr_10.42.42.2(pid=10622): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10622)] 07:24:52.652038 run osmo-hlr_10.42.42.2(pid=10622): stdout: | (launched: 2022-12-10_07:24:49.669527) 07:24:52.703448 run osmo-hlr_10.42.42.2(pid=10622): stderr: | [0;m[1;31m20221210072449868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072449868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072449868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072449868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072449868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072449868 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072449881 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-sysmocell5000+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072449890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072449890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072449890 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:24:52.775119 run osmo-msc_10.42.42.6(pid=10628): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10628)] 07:24:52.825494 run osmo-msc_10.42.42.6(pid=10628): stdout: | (launched: 2022-12-10_07:24:51.655113) 07:24:52.876847 run osmo-msc_10.42.42.6(pid=10628): stderr: | [0;m[38;5;43m20221210072451981 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210072451981 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f20706e0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210072451981 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210072451981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210072451981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210072451982 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210072451983 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210072451984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210072451984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210072451984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:24:52.928503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10621): Terminating (SIGTERM) 07:24:52.970106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10624): Terminating (SIGTERM) 07:24:53.011796 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10627): Terminating (SIGTERM) 07:24:53.053794 --- ParallelTerminationStrategy: PID 10621 died... 07:24:53.073235 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10621): Terminated: ok {rc=0} 07:24:53.119123 --- ParallelTerminationStrategy: PID 10624 died... 07:24:53.138678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10624): Terminated: ok {rc=0} 07:24:53.184409 --- ParallelTerminationStrategy: PID 10627 died... 07:24:53.203970 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10627): Terminated: ok {rc=0} 07:24:53.290928 bus /sierra_3: Setting Powered False 07:24:54.390183 bus /sierra_3: Setting Powered False 07:24:55.502410 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 emergency:trx-sysmocell5000 --------------------------------------------------------------------- 07:24:56.755222 tst emergency:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:24:56.759803 tst emergency:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 07:24:56.794369 tst emergency:trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 07:24:56.821666 tst emergency:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 07:24:56.907273 tst emergency:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 07:24:56.941798 tst emergency:trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 07:24:56.968995 tst emergency:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 07:24:57.555626 tst emergency:trx-sysmocell5000: RESERVED RESOURCES for emergency: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2371 emergency:trx-sysmocell5000 emergency_mo_mt_call.py ---------------------------------------------- 07:24:57.560751 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:24:57.571864 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:24:57.622985 tst emergency_mo_mt_call.py: using LAC 26788 07:24:57.743675 tst emergency_mo_mt_call.py: using RAC 13 07:24:57.869131 tst emergency_mo_mt_call.py: using CellId 26788 07:24:57.988009 tst emergency_mo_mt_call.py: using BVCI 26789 07:24:58.094320 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:24:58.105184 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:24:58.115763 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:24:58.126993 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:24:58.138066 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:24:58.148664 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:24:58.264553 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:24:58.382477 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:24:58.862161 run create_hlr_db(pid=10633): Launched 07:24:58.988147 bus /sierra_2: Setting Powered False 07:25:00.050310 run create_hlr_db(pid=10633): Terminated: ok {rc=0} 07:25:00.463983 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10635): Launched 07:25:00.752782 run osmo-hlr_10.42.42.2(pid=10636): Launched 07:25:00.894743 run osmo-stp_10.42.42.5: Starting osmo-stp 07:25:01.661694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10642): Launched 07:25:02.010715 run osmo-stp_10.42.42.5(pid=10647): Launched 07:25:02.198728 tst emergency_mo_mt_call.py: using MSISDN 7613 07:25:02.479382 run osmo-msc_10.42.42.6: Starting osmo-msc 07:25:03.006738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10651): Launched 07:25:03.295066 run osmo-msc_10.42.42.6(pid=10652): Launched 07:25:03.457154 run osmo-stp_10.42.42.5(pid=10647): ERR: Terminated: ERROR {rc=1} [trial-2371↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10647)] 07:25:03.579059 run osmo-stp_10.42.42.5(pid=10647): stdout: | (launched: 2022-12-10_07:25:01.946145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:03.702560 run osmo-stp_10.42.42.5(pid=10647): stderr: | [0;m[38;5;43m20221210072502309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072502310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072502310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072502310 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072502311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072502311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072502311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:03.823402 run osmo-stp_10.42.42.5(pid=10647): stdout: | (launched: 2022-12-10_07:25:01.946145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:03.938976 run osmo-stp_10.42.42.5(pid=10647): stderr: | [0;m[38;5;43m20221210072502309 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072502310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072502310 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072502310 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072502311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072502311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072502311 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:04.076874 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=10647): Process ended prematurely: osmo-stp_10.42.42.5(pid=10647) [trial-2371↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10647)] [trial-2371↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19] 07:25:04.085370 tst emergency_mo_mt_call.py:19: Test FAILED (6.5 sec) 07:25:04.111652 run osmo-hlr_10.42.42.2(pid=10636): ERR: Terminated: ERROR {rc=237} [trial-2371↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10636)] 07:25:04.160004 run osmo-hlr_10.42.42.2(pid=10636): stdout: | (launched: 2022-12-10_07:25:00.699891) 07:25:04.209591 run osmo-hlr_10.42.42.2(pid=10636): stderr: | [0;m[1;31m20221210072500947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072500947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072500947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072500947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072500947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072500947 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072500964 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/emergency:trx-sysmocell5000/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072500983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072500983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072500983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:25:04.278462 run osmo-msc_10.42.42.6(pid=10652): ERR: Terminated: ERROR {rc=2} [trial-2371↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10652)] 07:25:04.326272 run osmo-msc_10.42.42.6(pid=10652): stdout: | (launched: 2022-12-10_07:25:03.242341) 07:25:04.375445 run osmo-msc_10.42.42.6(pid=10652): stderr: | [0;m[38;5;43m20221210072503513 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210072503513 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd866197c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210072503513 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210072503513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210072503513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210072503514 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210072503515 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210072503516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210072503516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210072503516 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:25:04.425502 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10635): Terminating (SIGTERM) 07:25:04.465480 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10642): Terminating (SIGTERM) 07:25:04.505541 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10651): Terminating (SIGTERM) 07:25:04.545802 --- ParallelTerminationStrategy: PID 10635 died... 07:25:04.564837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10635): Terminated: ok {rc=0} 07:25:04.609321 --- ParallelTerminationStrategy: PID 10642 died... 07:25:04.627715 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10642): Terminated: ok {rc=0} 07:25:04.671745 --- ParallelTerminationStrategy: PID 10651 died... 07:25:04.690402 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10651): Terminated: ok {rc=0} 07:25:04.774598 bus /sierra_3: Setting Powered False 07:25:05.873139 bus /sierra_3: Setting Powered False 07:25:06.991499 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 emergency:trx-sysmocell5000 emergency_preemptive_call.py ---------------------------------------------- 07:25:08.079194 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:25:08.090477 tst emergency:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:25:08.141207 tst emergency_preemptive_call.py: using LAC 26789 07:25:08.252624 tst emergency_preemptive_call.py: using RAC 14 07:25:08.364282 tst emergency_preemptive_call.py: using CellId 26789 07:25:08.475426 tst emergency_preemptive_call.py: using BVCI 26790 07:25:08.579572 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:25:08.590357 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:25:08.600773 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:25:08.611685 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:25:08.622401 tst emergency:trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 07:25:08.633023 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:25:08.749579 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:25:08.864013 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:25:08.976229 tst emergency:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:25:09.089417 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:25:09.537213 run create_hlr_db(pid=10654): Launched 07:25:09.647780 bus /sierra_2: Setting Powered False 07:25:10.706536 run create_hlr_db(pid=10654): Terminated: ok {rc=0} 07:25:11.131031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10656): Launched 07:25:11.440607 run osmo-hlr_10.42.42.2(pid=10657): Launched 07:25:11.560919 run osmo-stp_10.42.42.5: Starting osmo-stp 07:25:12.097530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10659): Launched 07:25:12.417707 run osmo-stp_10.42.42.5(pid=10662): Launched 07:25:12.717403 tst emergency_preemptive_call.py: using MSISDN 7614 07:25:12.896179 run osmo-msc_10.42.42.6: Starting osmo-msc 07:25:13.444876 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10808): Launched 07:25:13.760880 run osmo-msc_10.42.42.6(pid=10855): Launched 07:25:14.043127 run osmo-stp_10.42.42.5(pid=10662): ERR: Terminated: ERROR {rc=1} [trial-2371↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10662)] 07:25:14.201844 run osmo-stp_10.42.42.5(pid=10662): stdout: | (launched: 2022-12-10_07:25:12.350498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:14.349793 run osmo-stp_10.42.42.5(pid=10662): stderr: | [0;m[38;5;43m20221210072512614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072512614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072512615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072512615 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072512616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072512616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072512616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:14.554456 run osmo-stp_10.42.42.5(pid=10662): stdout: | (launched: 2022-12-10_07:25:12.350498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:14.704025 run osmo-stp_10.42.42.5(pid=10662): stderr: | [0;m[38;5;43m20221210072512614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072512614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072512615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072512615 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072512616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072512616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072512616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:14.854400 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=10662): Process ended prematurely: osmo-stp_10.42.42.5(pid=10662) [trial-2371↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10662)] [trial-2371↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32] 07:25:14.863205 tst emergency_preemptive_call.py:32: Test FAILED (6.8 sec) 07:25:14.890259 run osmo-hlr_10.42.42.2(pid=10657): ERR: Terminated: ERROR {rc=237} [trial-2371↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=10657)] 07:25:14.939814 run osmo-hlr_10.42.42.2(pid=10657): stdout: | (launched: 2022-12-10_07:25:11.384453) 07:25:14.991394 run osmo-hlr_10.42.42.2(pid=10657): stderr: | [0;m[1;31m20221210072511582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072511582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072511582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072511582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072511582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072511582 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072511594 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/emergency:trx-sysmocell5000/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072511604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072511604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072511604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:25:15.062900 run osmo-msc_10.42.42.6(pid=10855): ERR: Terminated: ERROR {rc=2} [trial-2371↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=10855)] 07:25:15.112445 run osmo-msc_10.42.42.6(pid=10855): stdout: | (launched: 2022-12-10_07:25:13.699116) 07:25:15.163575 run osmo-msc_10.42.42.6(pid=10855): stderr: | [0;m[38;5;43m20221210072514281 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210072514281 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faf6d2f0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210072514282 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210072514282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210072514282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210072514282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210072514284 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210072514284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210072514284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210072514284 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:25:15.215103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10656): Terminating (SIGTERM) 07:25:15.256469 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10659): Terminating (SIGTERM) 07:25:15.297946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10808): Terminating (SIGTERM) 07:25:15.339680 --- ParallelTerminationStrategy: PID 10656 died... 07:25:15.359490 run pcap-recorder_any(filters='host 10.42.42.2')(pid=10656): Terminated: ok {rc=0} 07:25:15.405257 --- ParallelTerminationStrategy: PID 10659 died... 07:25:15.424581 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=10659): Terminated: ok {rc=0} 07:25:15.469887 --- ParallelTerminationStrategy: PID 10808 died... 07:25:15.489622 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=10808): Terminated: ok {rc=0} 07:25:15.577123 bus /sierra_9: Setting Powered False 07:25:16.672628 bus /sierra_9: Setting Powered False 07:25:17.784558 bus /sierra_8: Setting Powered False 07:25:18.882738 bus /sierra_8: Setting Powered False 07:25:20.000078 bus /sierra_3: Setting Powered False 07:25:21.098444 bus /sierra_3: Setting Powered False 07:25:22.213662 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 emergency:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-sysmocell5000 --------------------------------------------------------------------- 07:25:23.495813 tst gprs:trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:25:23.500476 tst gprs:trx-sysmocell5000: Verifying 1 x bts (candidates: 11) 07:25:23.534818 tst gprs:trx-sysmocell5000: Verifying 9 x ip_address (candidates: 9) 07:25:23.577776 tst gprs:trx-sysmocell5000: Verifying 4 x modem (candidates: 12) 07:25:23.669696 tst gprs:trx-sysmocell5000: Reserving 1 x bts (candidates: 11) 07:25:23.704841 tst gprs:trx-sysmocell5000: Reserving 9 x ip_address (candidates: 9) 07:25:23.747700 tst gprs:trx-sysmocell5000: Reserving 4 x modem (candidates: 12) 07:25:24.337019 tst gprs:trx-sysmocell5000: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-sysmocell5000 cs_paging_gprs_active.py ---------------------------------------------- 07:25:24.391267 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:24.403378 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:25:24.453519 tst cs_paging_gprs_active.py: using LAC 26790 07:25:24.571626 tst cs_paging_gprs_active.py: using RAC 15 07:25:24.688726 tst cs_paging_gprs_active.py: using CellId 26790 07:25:24.809620 tst cs_paging_gprs_active.py: using BVCI 26791 07:25:24.918647 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:24.930253 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:24.941773 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:24.953077 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:24.965525 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:24.978891 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:24.991415 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:25.003370 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:25.015908 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:25:25.135691 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:25:25.254545 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:25:25.456885 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:25:25.765704 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11228): Launched 07:25:26.046510 run iperf3-srv_10.42.42.10(pid=11229): Launched 07:25:26.176224 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:25:26.377831 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:25:26.693780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11230): Launched 07:25:26.973720 run iperf3-srv_10.42.42.10(pid=11231): Launched 07:25:27.099854 tst cs_paging_gprs_active.py:38: start network... 07:25:27.316871 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:25:27.825966 run create_hlr_db(pid=11232): Launched 07:25:27.999557 bus /sierra_2: Setting Powered False 07:25:29.062348 run create_hlr_db(pid=11232): Terminated: ok {rc=0} 07:25:29.501874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11235): Launched 07:25:29.818298 run osmo-hlr_10.42.42.2(pid=11236): Launched 07:25:29.938510 run osmo-stp_10.42.42.5: Starting osmo-stp 07:25:30.480798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11238): Launched 07:25:30.796623 run osmo-stp_10.42.42.5(pid=11239): Launched 07:25:30.948250 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:25:31.627489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11241): Launched 07:25:31.749285 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:25:32.011408 run patchelf(pid=11242): Launched 07:25:32.196611 run osmo-stp_10.42.42.5(pid=11239): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11239)] 07:25:32.326390 run osmo-stp_10.42.42.5(pid=11239): stdout: | (launched: 2022-12-10_07:25:30.739177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:32.458581 run osmo-stp_10.42.42.5(pid=11239): stderr: | [0;m[38;5;43m20221210072531014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072531014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072531014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072531015 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072531015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072531015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072531015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:32.586674 run osmo-stp_10.42.42.5(pid=11239): stdout: | (launched: 2022-12-10_07:25:30.739177) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:32.708419 run osmo-stp_10.42.42.5(pid=11239): stderr: | [0;m[38;5;43m20221210072531014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072531014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072531014 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072531015 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072531015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072531015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072531015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:32.852554 run patchelf(pid=11242): Terminating (SIGINT) 07:25:33.021417 run patchelf(pid=11242): Terminated: ok {rc=0} 07:25:33.142982 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11239): Process ended prematurely: osmo-stp_10.42.42.5(pid=11239) [trial-2371↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11239)] [trial-2371↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38] 07:25:33.152487 tst cs_paging_gprs_active.py:38: Test FAILED (8.8 sec) 07:25:33.179437 run osmo-hlr_10.42.42.2(pid=11236): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11236)] 07:25:33.227488 run osmo-hlr_10.42.42.2(pid=11236): stdout: | (launched: 2022-12-10_07:25:29.760557) 07:25:33.276842 run osmo-hlr_10.42.42.2(pid=11236): stderr: | [0;m[1;31m20221210072529958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072529958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072529958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072529958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072529958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072529958 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072529971 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-sysmocell5000/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072529980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072529980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072529980 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:25:33.327111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11228): Terminating (SIGTERM) 07:25:33.366888 run iperf3-srv_10.42.42.10(pid=11229): Terminating (SIGTERM) 07:25:33.406742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11230): Terminating (SIGTERM) 07:25:33.446725 run iperf3-srv_10.42.42.10(pid=11231): Terminating (SIGTERM) 07:25:33.486485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11235): Terminating (SIGTERM) 07:25:33.526265 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11238): Terminating (SIGTERM) 07:25:33.566072 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11241): Terminating (SIGTERM) 07:25:33.606136 --- ParallelTerminationStrategy: PID 11228 died... 07:25:33.625534 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11228): Terminated: ok {rc=0} 07:25:33.669936 --- ParallelTerminationStrategy: PID 11229 died... 07:25:33.688827 run iperf3-srv_10.42.42.10(pid=11229): Terminated {rc=256} 07:25:33.732936 --- ParallelTerminationStrategy: PID 11230 died... 07:25:33.752008 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11230): Terminated: ok {rc=0} 07:25:33.796145 --- ParallelTerminationStrategy: PID 11231 died... 07:25:33.815259 run iperf3-srv_10.42.42.10(pid=11231): Terminated {rc=256} 07:25:33.859485 --- ParallelTerminationStrategy: PID 11235 died... 07:25:33.878460 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11235): Terminated: ok {rc=0} 07:25:33.922432 --- ParallelTerminationStrategy: PID 11238 died... 07:25:33.941371 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11238): Terminated: ok {rc=0} 07:25:33.985866 --- ParallelTerminationStrategy: PID 11241 died... 07:25:34.005101 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11241): Terminated: ok {rc=0} 07:25:34.092043 bus /gobi_0: Setting Powered False 07:25:35.192184 bus /gobi_0: Setting Powered False 07:25:36.305894 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-sysmocell5000 iperf3.py ---------------------------------------------- 07:25:37.450898 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:37.462219 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:25:37.515171 tst iperf3.py: using LAC 26791 07:25:37.632915 tst iperf3.py: using RAC 16 07:25:37.747950 tst iperf3.py: using CellId 26791 07:25:37.862842 tst iperf3.py: using BVCI 26792 07:25:37.969550 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:37.980093 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:37.990597 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:38.001395 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:38.011989 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:38.022666 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:38.033476 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:38.043966 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:38.054765 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:25:38.167283 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:25:38.365582 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:25:38.661463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11243): Launched 07:25:38.918719 run iperf3-srv_10.42.42.10(pid=11244): Launched 07:25:39.030629 tst iperf3.py:8: start network... 07:25:39.228207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:25:39.684100 run create_hlr_db(pid=11245): Launched 07:25:39.797302 bus /gobi_6: Setting Powered False 07:25:40.854827 run create_hlr_db(pid=11245): Terminated: ok {rc=0} 07:25:41.288064 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11247): Launched 07:25:41.604881 run osmo-hlr_10.42.42.2(pid=11248): Launched 07:25:41.726402 run osmo-stp_10.42.42.5: Starting osmo-stp 07:25:42.284820 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11250): Launched 07:25:42.600668 run osmo-stp_10.42.42.5(pid=11251): Launched 07:25:42.722800 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:25:43.271628 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11253): Launched 07:25:43.393481 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:25:43.660145 run patchelf(pid=11254): Launched 07:25:43.836922 run osmo-stp_10.42.42.5(pid=11251): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11251)] 07:25:43.971351 run osmo-stp_10.42.42.5(pid=11251): stdout: | (launched: 2022-12-10_07:25:42.543373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:44.107136 run osmo-stp_10.42.42.5(pid=11251): stderr: | [0;m[38;5;43m20221210072542735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072542735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072542735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072542736 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072542736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072542736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072542736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:44.243171 run osmo-stp_10.42.42.5(pid=11251): stdout: | (launched: 2022-12-10_07:25:42.543373) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:44.373048 run osmo-stp_10.42.42.5(pid=11251): stderr: | [0;m[38;5;43m20221210072542735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072542735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072542735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072542736 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072542736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072542736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072542736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:44.527055 run patchelf(pid=11254): Terminating (SIGINT) 07:25:44.705300 run patchelf(pid=11254): Terminated: ok {rc=0} 07:25:44.834203 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11251): Process ended prematurely: osmo-stp_10.42.42.5(pid=11251) [trial-2371↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11251)] [trial-2371↪gprs:trx-sysmocell5000↪iperf3.py:8] 07:25:44.844307 tst iperf3.py:8: Test FAILED (7.4 sec) 07:25:44.872623 run osmo-hlr_10.42.42.2(pid=11248): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-sysmocell5000↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11248)] 07:25:44.922210 run osmo-hlr_10.42.42.2(pid=11248): stdout: | (launched: 2022-12-10_07:25:41.547696) 07:25:44.973340 run osmo-hlr_10.42.42.2(pid=11248): stderr: | [0;m[1;31m20221210072541743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072541743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072541743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072541743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072541743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072541743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072541756 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-sysmocell5000/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072541765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072541765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072541765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:25:45.024885 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11243): Terminating (SIGTERM) 07:25:45.067360 run iperf3-srv_10.42.42.10(pid=11244): Terminating (SIGTERM) 07:25:45.109075 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11247): Terminating (SIGTERM) 07:25:45.150769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11250): Terminating (SIGTERM) 07:25:45.192366 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11253): Terminating (SIGTERM) 07:25:45.234327 --- ParallelTerminationStrategy: PID 11243 died... 07:25:45.254078 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11243): Terminated: ok {rc=0} 07:25:45.300023 --- ParallelTerminationStrategy: PID 11244 died... 07:25:45.319410 run iperf3-srv_10.42.42.10(pid=11244): Terminated {rc=256} 07:25:45.365302 --- ParallelTerminationStrategy: PID 11247 died... 07:25:45.384813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11247): Terminated: ok {rc=0} 07:25:45.430825 --- ParallelTerminationStrategy: PID 11250 died... 07:25:45.450473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11250): Terminated: ok {rc=0} 07:25:45.496384 --- ParallelTerminationStrategy: PID 11253 died... 07:25:45.515905 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11253): Terminated: ok {rc=0} 07:25:45.603804 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-sysmocell5000 iperf3m4.py ---------------------------------------------- 07:25:46.754097 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:46.765980 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:25:46.817465 tst iperf3m4.py: using LAC 26792 07:25:46.970398 tst iperf3m4.py: using RAC 17 07:25:47.089537 tst iperf3m4.py: using CellId 26792 07:25:47.210780 tst iperf3m4.py: using BVCI 26793 07:25:47.325466 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:47.336375 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:47.347029 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:47.357753 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:47.368451 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:47.379311 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:47.390374 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:47.401087 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:25:47.412130 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:25:47.529157 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:25:47.649300 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:25:47.763838 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:25:47.882964 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:25:48.096719 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:25:48.413809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11256): Launched 07:25:48.688752 run iperf3-srv_10.42.42.10(pid=11257): Launched 07:25:48.808241 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:25:49.021509 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:25:49.338877 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11258): Launched 07:25:49.613250 run iperf3-srv_10.42.42.10(pid=11259): Launched 07:25:49.732060 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:25:49.945676 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:25:50.262752 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11260): Launched 07:25:50.537696 run iperf3-srv_10.42.42.10(pid=11261): Launched 07:25:50.656378 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:25:50.869709 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:25:51.186427 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11262): Launched 07:25:51.460699 run iperf3-srv_10.42.42.10(pid=11263): Launched 07:25:51.579424 tst iperf3m4.py:8: start network... 07:25:51.791785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:25:52.281363 run create_hlr_db(pid=11264): Launched 07:25:52.410725 bus /gobi_6: Setting Powered False 07:25:53.473551 run create_hlr_db(pid=11264): Terminated: ok {rc=0} 07:25:53.896063 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11266): Launched 07:25:54.192596 run osmo-hlr_10.42.42.2(pid=11267): Launched 07:25:54.306349 run osmo-stp_10.42.42.5: Starting osmo-stp 07:25:54.830739 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11269): Launched 07:25:55.126507 run osmo-stp_10.42.42.5(pid=11270): Launched 07:25:55.239746 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:25:55.748941 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11272): Launched 07:25:55.862936 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:25:56.112239 run patchelf(pid=11273): Launched 07:25:56.277720 run osmo-stp_10.42.42.5(pid=11270): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11270)] 07:25:56.403411 run osmo-stp_10.42.42.5(pid=11270): stdout: | (launched: 2022-12-10_07:25:55.072495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:56.531146 run osmo-stp_10.42.42.5(pid=11270): stderr: | [0;m[38;5;43m20221210072555240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072555241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072555241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072555241 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072555243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072555244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072555244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:56.658749 run osmo-stp_10.42.42.5(pid=11270): stdout: | (launched: 2022-12-10_07:25:55.072495) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:25:56.780153 run osmo-stp_10.42.42.5(pid=11270): stderr: | [0;m[38;5;43m20221210072555240 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072555241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072555241 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072555241 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072555243 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072555244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072555244 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:25:56.923934 run patchelf(pid=11273): Terminating (SIGINT) 07:25:57.091440 run patchelf(pid=11273): Terminated: ok {rc=0} 07:25:57.213070 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11270): Process ended prematurely: osmo-stp_10.42.42.5(pid=11270) [trial-2371↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11270)] [trial-2371↪gprs:trx-sysmocell5000↪iperf3m4.py:8] 07:25:57.222374 tst iperf3m4.py:8: Test FAILED (10.5 sec) 07:25:57.249563 run osmo-hlr_10.42.42.2(pid=11267): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-sysmocell5000↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11267)] 07:25:57.298127 run osmo-hlr_10.42.42.2(pid=11267): stdout: | (launched: 2022-12-10_07:25:54.138724) 07:25:57.347607 run osmo-hlr_10.42.42.2(pid=11267): stderr: | [0;m[1;31m20221210072554314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072554314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072554314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072554314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072554314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072554314 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072554326 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-sysmocell5000/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072554335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072554335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072554335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:25:57.397730 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11256): Terminating (SIGTERM) 07:25:57.437362 run iperf3-srv_10.42.42.10(pid=11257): Terminating (SIGTERM) 07:25:57.477280 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11258): Terminating (SIGTERM) 07:25:57.517262 run iperf3-srv_10.42.42.10(pid=11259): Terminating (SIGTERM) 07:25:57.557080 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11260): Terminating (SIGTERM) 07:25:57.597069 run iperf3-srv_10.42.42.10(pid=11261): Terminating (SIGTERM) 07:25:57.636817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11262): Terminating (SIGTERM) 07:25:57.676642 run iperf3-srv_10.42.42.10(pid=11263): Terminating (SIGTERM) 07:25:57.716353 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11266): Terminating (SIGTERM) 07:25:57.756081 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11269): Terminating (SIGTERM) 07:25:57.795918 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11272): Terminating (SIGTERM) 07:25:57.836002 --- ParallelTerminationStrategy: PID 11256 died... 07:25:57.855404 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11256): Terminated: ok {rc=0} 07:25:57.899568 --- ParallelTerminationStrategy: PID 11257 died... 07:25:57.918449 run iperf3-srv_10.42.42.10(pid=11257): Terminated {rc=256} 07:25:57.962416 --- ParallelTerminationStrategy: PID 11258 died... 07:25:57.981277 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11258): Terminated: ok {rc=0} 07:25:58.025569 --- ParallelTerminationStrategy: PID 11259 died... 07:25:58.043984 run iperf3-srv_10.42.42.10(pid=11259): Terminated {rc=256} 07:25:58.087893 --- ParallelTerminationStrategy: PID 11260 died... 07:25:58.106577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11260): Terminated: ok {rc=0} 07:25:58.150632 --- ParallelTerminationStrategy: PID 11261 died... 07:25:58.169200 run iperf3-srv_10.42.42.10(pid=11261): Terminated {rc=256} 07:25:58.213484 --- ParallelTerminationStrategy: PID 11262 died... 07:25:58.232063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11262): Terminated: ok {rc=0} 07:25:58.276200 --- ParallelTerminationStrategy: PID 11263 died... 07:25:58.294870 run iperf3-srv_10.42.42.10(pid=11263): Terminated {rc=256} 07:25:58.339516 --- ParallelTerminationStrategy: PID 11266 died... 07:25:58.358180 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11266): Terminated: ok {rc=0} 07:25:58.403131 --- ParallelTerminationStrategy: PID 11269 died... 07:25:58.421814 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11269): Terminated: ok {rc=0} 07:25:58.466431 --- ParallelTerminationStrategy: PID 11272 died... 07:25:58.485704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11272): Terminated: ok {rc=0} 07:25:58.578404 bus /gobi_4: Setting Powered False 07:25:59.681275 bus /gobi_4: Setting Powered False 07:26:00.797603 bus /gobi_1: Setting Powered False 07:26:01.912784 bus /gobi_1: Setting Powered False 07:26:03.026813 bus /gobi_0: Setting Powered False 07:26:04.125625 bus /gobi_0: Setting Powered False 07:26:05.243565 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-sysmocell5000 ping.py ---------------------------------------------- 07:26:06.345952 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:06.357111 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:26:06.405790 tst ping.py: using LAC 26793 07:26:06.529768 tst ping.py: using RAC 18 07:26:06.653258 tst ping.py: using CellId 26793 07:26:06.775141 tst ping.py: using BVCI 26794 07:26:06.888252 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:06.899501 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:06.910801 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:06.921842 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:06.932668 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:06.943588 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:06.954632 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:06.965647 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:26:07.078005 tst ping.py:19: start network... 07:26:07.271843 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:26:07.718127 run create_hlr_db(pid=11274): Launched 07:26:07.828575 bus /gobi_6: Setting Powered False 07:26:08.886710 run create_hlr_db(pid=11274): Terminated: ok {rc=0} 07:26:09.311481 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11276): Launched 07:26:09.620809 run osmo-hlr_10.42.42.2(pid=11277): Launched 07:26:09.740248 run osmo-stp_10.42.42.5: Starting osmo-stp 07:26:10.280433 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11279): Launched 07:26:10.590503 run osmo-stp_10.42.42.5(pid=11280): Launched 07:26:10.708727 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:26:11.242864 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11282): Launched 07:26:11.361381 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:26:11.621718 run patchelf(pid=11283): Launched 07:26:11.794369 run osmo-stp_10.42.42.5(pid=11280): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11280)] 07:26:11.925955 run osmo-stp_10.42.42.5(pid=11280): stdout: | (launched: 2022-12-10_07:26:10.534027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:12.058594 run osmo-stp_10.42.42.5(pid=11280): stderr: | [0;m[38;5;43m20221210072610722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072610722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072610723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072610723 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072610725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072610725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072610726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:12.191375 run osmo-stp_10.42.42.5(pid=11280): stdout: | (launched: 2022-12-10_07:26:10.534027) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:12.318278 run osmo-stp_10.42.42.5(pid=11280): stderr: | [0;m[38;5;43m20221210072610722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072610722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072610723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072610723 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072610725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072610725 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072610726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:12.468543 run patchelf(pid=11283): Terminating (SIGINT) 07:26:12.642602 run patchelf(pid=11283): Terminated: ok {rc=0} 07:26:12.768205 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11280): Process ended prematurely: osmo-stp_10.42.42.5(pid=11280) [trial-2371↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11280)] [trial-2371↪gprs:trx-sysmocell5000↪ping.py:22] 07:26:12.777438 tst ping.py:22: Test FAILED (6.4 sec) 07:26:12.805499 run osmo-hlr_10.42.42.2(pid=11277): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-sysmocell5000↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11277)] 07:26:12.855482 run osmo-hlr_10.42.42.2(pid=11277): stdout: | (launched: 2022-12-10_07:26:09.564841) 07:26:12.906955 run osmo-hlr_10.42.42.2(pid=11277): stderr: | [0;m[1;31m20221210072609762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072609762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072609762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072609762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072609762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072609762 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072609774 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-sysmocell5000/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072609784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072609784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072609784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:26:12.958826 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11276): Terminating (SIGTERM) 07:26:13.000667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11279): Terminating (SIGTERM) 07:26:13.042469 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11282): Terminating (SIGTERM) 07:26:13.084307 --- ParallelTerminationStrategy: PID 11276 died... 07:26:13.104441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11276): Terminated: ok {rc=0} 07:26:13.151025 --- ParallelTerminationStrategy: PID 11279 died... 07:26:13.171007 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11279): Terminated: ok {rc=0} 07:26:13.217044 --- ParallelTerminationStrategy: PID 11282 died... 07:26:13.236681 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11282): Terminated: ok {rc=0} 07:26:13.324568 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-sysmocell5000 ping_idle_ping.py ---------------------------------------------- 07:26:14.412599 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:14.424446 tst gprs:trx-sysmocell5000: Using 1 x bts (candidates: 1) 07:26:14.476735 tst ping_idle_ping.py: using LAC 26794 07:26:14.604352 tst ping_idle_ping.py: using RAC 19 07:26:14.724842 tst ping_idle_ping.py: using CellId 26794 07:26:14.845415 tst ping_idle_ping.py: using BVCI 26795 07:26:14.957724 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:14.969020 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:14.980162 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:14.991309 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:15.002440 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:15.013557 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:15.024815 tst gprs:trx-sysmocell5000: Using 1 x ip_address (candidates: 9) 07:26:15.035899 tst gprs:trx-sysmocell5000: Using 1 x modem (candidates: 4) 07:26:15.150524 tst ping_idle_ping.py:24: start network... 07:26:15.344870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:26:15.795910 run create_hlr_db(pid=11284): Launched 07:26:15.957972 bus /gobi_6: Setting Powered False 07:26:17.019342 run create_hlr_db(pid=11284): Terminated: ok {rc=0} 07:26:17.458904 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11286): Launched 07:26:17.753560 run osmo-hlr_10.42.42.2(pid=11287): Launched 07:26:17.864324 run osmo-stp_10.42.42.5: Starting osmo-stp 07:26:18.373159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11289): Launched 07:26:18.661683 run osmo-stp_10.42.42.5(pid=11290): Launched 07:26:18.782892 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:26:19.322181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11292): Launched 07:26:19.441404 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:26:19.703015 run patchelf(pid=11293): Launched 07:26:19.876433 run osmo-stp_10.42.42.5(pid=11290): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11290)] 07:26:20.008342 run osmo-stp_10.42.42.5(pid=11290): stdout: | (launched: 2022-12-10_07:26:18.609105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:20.141974 run osmo-stp_10.42.42.5(pid=11290): stderr: | [0;m[38;5;43m20221210072618796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072618796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072618796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072618797 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072618797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072618797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072618797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:20.275842 run osmo-stp_10.42.42.5(pid=11290): stdout: | (launched: 2022-12-10_07:26:18.609105) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:20.403611 run osmo-stp_10.42.42.5(pid=11290): stderr: | [0;m[38;5;43m20221210072618796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072618796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072618796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072618797 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072618797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072618797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072618797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:20.554870 run patchelf(pid=11293): Terminating (SIGINT) 07:26:20.729600 run patchelf(pid=11293): Terminated: ok {rc=0} 07:26:20.855980 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11290): Process ended prematurely: osmo-stp_10.42.42.5(pid=11290) [trial-2371↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11290)] [trial-2371↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27] 07:26:20.865259 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 07:26:20.892883 run osmo-hlr_10.42.42.2(pid=11287): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-sysmocell5000↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11287)] 07:26:20.942437 run osmo-hlr_10.42.42.2(pid=11287): stdout: | (launched: 2022-12-10_07:26:17.700238) 07:26:20.993737 run osmo-hlr_10.42.42.2(pid=11287): stderr: | [0;m[1;31m20221210072617875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072617875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072617875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072617875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072617875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072617875 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072617891 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-sysmocell5000/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072617900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072617900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072617900 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:26:21.045430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11286): Terminating (SIGTERM) 07:26:21.086823 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11289): Terminating (SIGTERM) 07:26:21.128257 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11292): Terminating (SIGTERM) 07:26:21.170178 --- ParallelTerminationStrategy: PID 11286 died... 07:26:21.190048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11286): Terminated: ok {rc=0} 07:26:21.235681 --- ParallelTerminationStrategy: PID 11289 died... 07:26:21.255201 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11289): Terminated: ok {rc=0} 07:26:21.300843 --- ParallelTerminationStrategy: PID 11292 died... 07:26:21.320698 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11292): Terminated: ok {rc=0} 07:26:21.409380 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-sysmocell5000+mod-bts0-egprs --------------------------------------------------------------------- 07:26:22.728383 tst gprs:trx-sysmocell5000+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:26:22.734539 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:26:22.768378 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:26:22.806277 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:26:22.889448 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:26:22.922562 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:26:22.960442 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:26:23.559861 tst gprs:trx-sysmocell5000+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-sysmocell5000+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:26:23.611256 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:23.622754 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:26:23.673447 tst cs_paging_gprs_active.py: using LAC 26795 07:26:23.801734 tst cs_paging_gprs_active.py: using RAC 20 07:26:23.925919 tst cs_paging_gprs_active.py: using CellId 26795 07:26:24.048385 tst cs_paging_gprs_active.py: using BVCI 26796 07:26:24.163144 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:24.174606 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:24.185812 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:24.197188 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:24.208316 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:24.219639 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:24.231180 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:24.242326 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:24.253761 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:26:24.373673 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:26:24.489646 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:26:24.688117 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:26:24.984588 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11297): Launched 07:26:25.241565 run iperf3-srv_10.42.42.10(pid=11298): Launched 07:26:25.352494 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:26:25.550482 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:26:25.846313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11299): Launched 07:26:26.103182 run iperf3-srv_10.42.42.10(pid=11300): Launched 07:26:26.214560 tst cs_paging_gprs_active.py:38: start network... 07:26:26.412288 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:26:26.869036 run create_hlr_db(pid=11301): Launched 07:26:26.983513 bus /gobi_6: Setting Powered False 07:26:28.042912 run create_hlr_db(pid=11301): Terminated: ok {rc=0} 07:26:28.455642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11303): Launched 07:26:28.766319 run osmo-hlr_10.42.42.2(pid=11304): Launched 07:26:28.890006 run osmo-stp_10.42.42.5: Starting osmo-stp 07:26:29.437140 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11306): Launched 07:26:29.754164 run osmo-stp_10.42.42.5(pid=11307): Launched 07:26:29.876314 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:26:30.423068 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11309): Launched 07:26:30.544870 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:26:30.812329 run patchelf(pid=11310): Launched 07:26:31.007937 run osmo-stp_10.42.42.5(pid=11307): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11307)] 07:26:31.145110 run osmo-stp_10.42.42.5(pid=11307): stdout: | (launched: 2022-12-10_07:26:29.696843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:31.283718 run osmo-stp_10.42.42.5(pid=11307): stderr: | [0;m[38;5;43m20221210072629890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072629890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072629890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072629891 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072629891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072629891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072629891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:31.423596 run osmo-stp_10.42.42.5(pid=11307): stdout: | (launched: 2022-12-10_07:26:29.696843) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:31.556519 run osmo-stp_10.42.42.5(pid=11307): stderr: | [0;m[38;5;43m20221210072629890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072629890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072629890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072629891 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072629891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072629891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072629891 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:31.714123 run patchelf(pid=11310): Terminating (SIGINT) 07:26:31.897492 run patchelf(pid=11310): Terminated: ok {rc=0} 07:26:32.026543 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11307): Process ended prematurely: osmo-stp_10.42.42.5(pid=11307) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11307)] [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:26:32.037500 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 07:26:32.068466 run osmo-hlr_10.42.42.2(pid=11304): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11304)] 07:26:32.119153 run osmo-hlr_10.42.42.2(pid=11304): stdout: | (launched: 2022-12-10_07:26:28.709112) 07:26:32.172009 run osmo-hlr_10.42.42.2(pid=11304): stderr: | [0;m[1;31m20221210072628904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072628904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072628904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072628904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072628904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072628904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072628917 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-sysmocell5000+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072628925 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072628926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072628926 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:26:32.222257 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11297): Terminating (SIGTERM) 07:26:32.262494 run iperf3-srv_10.42.42.10(pid=11298): Terminating (SIGTERM) 07:26:32.303075 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11299): Terminating (SIGTERM) 07:26:32.343322 run iperf3-srv_10.42.42.10(pid=11300): Terminating (SIGTERM) 07:26:32.383760 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11303): Terminating (SIGTERM) 07:26:32.423997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11306): Terminating (SIGTERM) 07:26:32.464241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11309): Terminating (SIGTERM) 07:26:32.504539 --- ParallelTerminationStrategy: PID 11297 died... 07:26:32.523806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11297): Terminated: ok {rc=0} 07:26:32.568878 --- ParallelTerminationStrategy: PID 11298 died... 07:26:32.587833 run iperf3-srv_10.42.42.10(pid=11298): Terminated {rc=256} 07:26:32.632508 --- ParallelTerminationStrategy: PID 11299 died... 07:26:32.651227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11299): Terminated: ok {rc=0} 07:26:32.695955 --- ParallelTerminationStrategy: PID 11300 died... 07:26:32.714653 run iperf3-srv_10.42.42.10(pid=11300): Terminated {rc=256} 07:26:32.759291 --- ParallelTerminationStrategy: PID 11303 died... 07:26:32.778115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11303): Terminated: ok {rc=0} 07:26:32.823332 --- ParallelTerminationStrategy: PID 11306 died... 07:26:32.842125 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11306): Terminated: ok {rc=0} 07:26:32.886735 --- ParallelTerminationStrategy: PID 11309 died... 07:26:32.905384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11309): Terminated: ok {rc=0} 07:26:32.992219 bus /gobi_0: Setting Powered False 07:26:34.092167 bus /gobi_0: Setting Powered False 07:26:35.207486 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:26:36.352636 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:36.364042 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:26:36.418522 tst iperf3.py: using LAC 26796 07:26:36.534495 tst iperf3.py: using RAC 21 07:26:36.650033 tst iperf3.py: using CellId 26796 07:26:36.768447 tst iperf3.py: using BVCI 26797 07:26:36.875397 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:36.886326 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:36.896787 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:36.907731 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:36.918533 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:36.929467 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:36.940316 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:36.951024 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:36.961966 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:26:37.078140 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:26:37.275471 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:26:37.571508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11311): Launched 07:26:37.827533 run iperf3-srv_10.42.42.10(pid=11312): Launched 07:26:37.938165 tst iperf3.py:8: start network... 07:26:38.135164 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:26:38.589372 run create_hlr_db(pid=11313): Launched 07:26:38.701499 bus /gobi_6: Setting Powered False 07:26:39.760338 run create_hlr_db(pid=11313): Terminated: ok {rc=0} 07:26:40.191485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11315): Launched 07:26:40.506454 run osmo-hlr_10.42.42.2(pid=11316): Launched 07:26:40.628559 run osmo-stp_10.42.42.5: Starting osmo-stp 07:26:41.176680 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11318): Launched 07:26:41.491969 run osmo-stp_10.42.42.5(pid=11319): Launched 07:26:41.613673 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:26:42.155836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11321): Launched 07:26:42.276703 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:26:42.541661 run patchelf(pid=11322): Launched 07:26:42.717290 run osmo-stp_10.42.42.5(pid=11319): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11319)] 07:26:42.851393 run osmo-stp_10.42.42.5(pid=11319): stdout: | (launched: 2022-12-10_07:26:41.434845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:42.987402 run osmo-stp_10.42.42.5(pid=11319): stderr: | [0;m[38;5;43m20221210072641625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072641625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072641626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072641626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072641628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072641629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072641629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:43.122995 run osmo-stp_10.42.42.5(pid=11319): stdout: | (launched: 2022-12-10_07:26:41.434845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:43.252220 run osmo-stp_10.42.42.5(pid=11319): stderr: | [0;m[38;5;43m20221210072641625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072641625 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072641626 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072641626 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072641628 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072641629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072641629 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:43.405294 run patchelf(pid=11322): Terminating (SIGINT) 07:26:43.583067 run patchelf(pid=11322): Terminated: ok {rc=0} 07:26:43.711085 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11319): Process ended prematurely: osmo-stp_10.42.42.5(pid=11319) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11319)] [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8] 07:26:43.720938 tst iperf3.py:8: Test FAILED (7.4 sec) 07:26:43.749182 run osmo-hlr_10.42.42.2(pid=11316): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11316)] 07:26:43.798789 run osmo-hlr_10.42.42.2(pid=11316): stdout: | (launched: 2022-12-10_07:26:40.449685) 07:26:43.850596 run osmo-hlr_10.42.42.2(pid=11316): stderr: | [0;m[1;31m20221210072640647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072640647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072640648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072640648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072640648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072640648 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072640662 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072640672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072640672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072640672 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:26:43.902624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11311): Terminating (SIGTERM) 07:26:43.944321 run iperf3-srv_10.42.42.10(pid=11312): Terminating (SIGTERM) 07:26:43.985968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11315): Terminating (SIGTERM) 07:26:44.027397 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11318): Terminating (SIGTERM) 07:26:44.068875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11321): Terminating (SIGTERM) 07:26:44.110662 --- ParallelTerminationStrategy: PID 11311 died... 07:26:44.130480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11311): Terminated: ok {rc=0} 07:26:44.175987 --- ParallelTerminationStrategy: PID 11312 died... 07:26:44.195169 run iperf3-srv_10.42.42.10(pid=11312): Terminated {rc=256} 07:26:44.240335 --- ParallelTerminationStrategy: PID 11315 died... 07:26:44.259880 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11315): Terminated: ok {rc=0} 07:26:44.305261 --- ParallelTerminationStrategy: PID 11318 died... 07:26:44.324365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11318): Terminated: ok {rc=0} 07:26:44.369946 --- ParallelTerminationStrategy: PID 11321 died... 07:26:44.389354 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11321): Terminated: ok {rc=0} 07:26:44.476263 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-sysmocell5000+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:26:45.622208 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:45.633738 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:26:45.687231 tst iperf3m4.py: using LAC 26797 07:26:45.803102 tst iperf3m4.py: using RAC 22 07:26:45.959551 tst iperf3m4.py: using CellId 26797 07:26:46.087788 tst iperf3m4.py: using BVCI 26798 07:26:46.246511 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:46.262954 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:46.279361 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:46.296105 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:46.312918 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:46.329461 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:46.346192 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:46.362779 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:26:46.378884 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:26:46.510637 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:26:46.636336 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:26:46.782149 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:26:46.904694 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:26:47.115710 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:26:47.421388 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11323): Launched 07:26:47.681243 run iperf3-srv_10.42.42.10(pid=11324): Launched 07:26:47.792823 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:26:47.990563 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:26:48.286898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11325): Launched 07:26:48.544132 run iperf3-srv_10.42.42.10(pid=11326): Launched 07:26:48.655335 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:26:48.853601 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:26:49.150247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11327): Launched 07:26:49.407205 run iperf3-srv_10.42.42.10(pid=11328): Launched 07:26:49.518495 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:26:49.717704 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:26:50.014020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11329): Launched 07:26:50.270505 run iperf3-srv_10.42.42.10(pid=11330): Launched 07:26:50.381603 tst iperf3m4.py:8: start network... 07:26:50.578742 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:26:51.034440 run create_hlr_db(pid=11331): Launched 07:26:51.147850 bus /gobi_6: Setting Powered False 07:26:52.207552 run create_hlr_db(pid=11331): Terminated: ok {rc=0} 07:26:52.618981 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11333): Launched 07:26:52.913994 run osmo-hlr_10.42.42.2(pid=11334): Launched 07:26:53.027322 run osmo-stp_10.42.42.5: Starting osmo-stp 07:26:53.546707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11336): Launched 07:26:53.842455 run osmo-stp_10.42.42.5(pid=11337): Launched 07:26:53.956170 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:26:54.467912 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11339): Launched 07:26:54.581275 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:26:54.829674 run patchelf(pid=11340): Launched 07:26:54.994386 run osmo-stp_10.42.42.5(pid=11337): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11337)] 07:26:55.119079 run osmo-stp_10.42.42.5(pid=11337): stdout: | (launched: 2022-12-10_07:26:53.788591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:55.245295 run osmo-stp_10.42.42.5(pid=11337): stderr: | [0;m[38;5;43m20221210072653954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072653955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072653955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072653955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072653956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072653956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072653956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:55.371762 run osmo-stp_10.42.42.5(pid=11337): stdout: | (launched: 2022-12-10_07:26:53.788591) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:26:55.491965 run osmo-stp_10.42.42.5(pid=11337): stderr: | [0;m[38;5;43m20221210072653954 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072653955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072653955 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072653955 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072653956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072653956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072653956 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:26:55.635235 run patchelf(pid=11340): Terminating (SIGINT) 07:26:55.802136 run patchelf(pid=11340): Terminated: ok {rc=0} 07:26:55.922840 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11337): Process ended prematurely: osmo-stp_10.42.42.5(pid=11337) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11337)] [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8] 07:26:55.932004 tst iperf3m4.py:8: Test FAILED (10.3 sec) 07:26:55.959749 run osmo-hlr_10.42.42.2(pid=11334): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11334)] 07:26:56.007055 run osmo-hlr_10.42.42.2(pid=11334): stdout: | (launched: 2022-12-10_07:26:52.860428) 07:26:56.056152 run osmo-hlr_10.42.42.2(pid=11334): stderr: | [0;m[1;31m20221210072653035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072653035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072653035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072653035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072653035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072653035 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072653049 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-sysmocell5000+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072653057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072653057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072653057 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:26:56.105787 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11323): Terminating (SIGTERM) 07:26:56.145497 run iperf3-srv_10.42.42.10(pid=11324): Terminating (SIGTERM) 07:26:56.185146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11325): Terminating (SIGTERM) 07:26:56.224621 run iperf3-srv_10.42.42.10(pid=11326): Terminating (SIGTERM) 07:26:56.263992 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11327): Terminating (SIGTERM) 07:26:56.303452 run iperf3-srv_10.42.42.10(pid=11328): Terminating (SIGTERM) 07:26:56.342773 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11329): Terminating (SIGTERM) 07:26:56.382176 run iperf3-srv_10.42.42.10(pid=11330): Terminating (SIGTERM) 07:26:56.421475 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11333): Terminating (SIGTERM) 07:26:56.460931 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11336): Terminating (SIGTERM) 07:26:56.500421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11339): Terminating (SIGTERM) 07:26:56.540192 --- ParallelTerminationStrategy: PID 11323 died... 07:26:56.559107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11323): Terminated: ok {rc=0} 07:26:56.603777 --- ParallelTerminationStrategy: PID 11324 died... 07:26:56.622251 run iperf3-srv_10.42.42.10(pid=11324): Terminated {rc=256} 07:26:56.666075 --- ParallelTerminationStrategy: PID 11325 died... 07:26:56.684636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11325): Terminated: ok {rc=0} 07:26:56.728400 --- ParallelTerminationStrategy: PID 11326 died... 07:26:56.746793 run iperf3-srv_10.42.42.10(pid=11326): Terminated {rc=256} 07:26:56.790626 --- ParallelTerminationStrategy: PID 11327 died... 07:26:56.809148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11327): Terminated: ok {rc=0} 07:26:56.853008 --- ParallelTerminationStrategy: PID 11328 died... 07:26:56.871798 run iperf3-srv_10.42.42.10(pid=11328): Terminated {rc=256} 07:26:56.915550 --- ParallelTerminationStrategy: PID 11329 died... 07:26:56.933933 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11329): Terminated: ok {rc=0} 07:26:56.978088 --- ParallelTerminationStrategy: PID 11330 died... 07:26:56.996843 run iperf3-srv_10.42.42.10(pid=11330): Terminated {rc=256} 07:26:57.040748 --- ParallelTerminationStrategy: PID 11333 died... 07:26:57.059343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11333): Terminated: ok {rc=0} 07:26:57.103309 --- ParallelTerminationStrategy: PID 11336 died... 07:26:57.121941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11336): Terminated: ok {rc=0} 07:26:57.166609 --- ParallelTerminationStrategy: PID 11339 died... 07:26:57.185405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11339): Terminated: ok {rc=0} 07:26:57.271385 bus /gobi_4: Setting Powered False 07:26:58.371033 bus /gobi_4: Setting Powered False 07:26:59.487415 bus /gobi_1: Setting Powered False 07:27:00.586893 bus /gobi_1: Setting Powered False 07:27:01.701688 bus /gobi_0: Setting Powered False 07:27:02.808107 bus /gobi_0: Setting Powered False 07:27:03.924147 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-sysmocell5000+mod-bts0-egprs ping.py ---------------------------------------------- 07:27:05.027883 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:05.039577 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:27:05.091167 tst ping.py: using LAC 26798 07:27:05.211127 tst ping.py: using RAC 23 07:27:05.334276 tst ping.py: using CellId 26798 07:27:05.454430 tst ping.py: using BVCI 26799 07:27:05.567021 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:05.578442 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:05.590210 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:05.601448 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:05.612394 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:05.623590 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:05.635006 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:05.646144 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:27:05.763165 tst ping.py:19: start network... 07:27:05.971866 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:27:06.451319 run create_hlr_db(pid=11341): Launched 07:27:06.577894 bus /gobi_6: Setting Powered False 07:27:07.639724 run create_hlr_db(pid=11341): Terminated: ok {rc=0} 07:27:08.072911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11343): Launched 07:27:08.383829 run osmo-hlr_10.42.42.2(pid=11344): Launched 07:27:08.502946 run osmo-stp_10.42.42.5: Starting osmo-stp 07:27:09.042922 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11346): Launched 07:27:09.352167 run osmo-stp_10.42.42.5(pid=11347): Launched 07:27:09.471017 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:27:10.006778 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11349): Launched 07:27:10.125321 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:27:10.386631 run patchelf(pid=11350): Launched 07:27:10.559858 run osmo-stp_10.42.42.5(pid=11347): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11347)] 07:27:10.691421 run osmo-stp_10.42.42.5(pid=11347): stdout: | (launched: 2022-12-10_07:27:09.295779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:10.824494 run osmo-stp_10.42.42.5(pid=11347): stderr: | [0;m[38;5;43m20221210072709484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072709485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072709485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072709485 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072709486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072709486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072709486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:10.957884 run osmo-stp_10.42.42.5(pid=11347): stdout: | (launched: 2022-12-10_07:27:09.295779) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:11.084898 run osmo-stp_10.42.42.5(pid=11347): stderr: | [0;m[38;5;43m20221210072709484 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072709485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072709485 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072709485 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072709486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072709486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072709486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:11.235444 run patchelf(pid=11350): Terminating (SIGINT) 07:27:11.409932 run patchelf(pid=11350): Terminated: ok {rc=0} 07:27:11.535630 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11347): Process ended prematurely: osmo-stp_10.42.42.5(pid=11347) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11347)] [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22] 07:27:11.544753 tst ping.py:22: Test FAILED (6.5 sec) 07:27:11.572501 run osmo-hlr_10.42.42.2(pid=11344): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11344)] 07:27:11.622094 run osmo-hlr_10.42.42.2(pid=11344): stdout: | (launched: 2022-12-10_07:27:08.326749) 07:27:11.673242 run osmo-hlr_10.42.42.2(pid=11344): stderr: | [0;m[1;31m20221210072708522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072708522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072708522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072708522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072708522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072708522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072708535 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-sysmocell5000+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072708544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072708544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072708544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:27:11.725144 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11343): Terminating (SIGTERM) 07:27:11.766625 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11346): Terminating (SIGTERM) 07:27:11.807956 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11349): Terminating (SIGTERM) 07:27:11.849881 --- ParallelTerminationStrategy: PID 11343 died... 07:27:11.869689 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11343): Terminated: ok {rc=0} 07:27:11.915654 --- ParallelTerminationStrategy: PID 11346 died... 07:27:11.935179 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11346): Terminated: ok {rc=0} 07:27:11.980767 --- ParallelTerminationStrategy: PID 11349 died... 07:27:12.000189 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11349): Terminated: ok {rc=0} 07:27:12.088065 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-sysmocell5000+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:27:13.175301 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:13.187689 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:27:13.241605 tst ping_idle_ping.py: using LAC 26799 07:27:13.365611 tst ping_idle_ping.py: using RAC 24 07:27:13.489608 tst ping_idle_ping.py: using CellId 26799 07:27:13.611471 tst ping_idle_ping.py: using BVCI 26800 07:27:13.723901 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:13.735342 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:13.746706 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:13.757993 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:13.769245 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:13.780342 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:13.791651 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:27:13.802808 tst gprs:trx-sysmocell5000+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:27:13.916020 tst ping_idle_ping.py:24: start network... 07:27:14.111464 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:27:14.563344 run create_hlr_db(pid=11351): Launched 07:27:14.676839 bus /gobi_6: Setting Powered False 07:27:15.735804 run create_hlr_db(pid=11351): Terminated: ok {rc=0} 07:27:16.189882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11353): Launched 07:27:16.514195 run osmo-hlr_10.42.42.2(pid=11354): Launched 07:27:16.745422 run osmo-stp_10.42.42.5: Starting osmo-stp 07:27:17.388364 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11356): Launched 07:27:17.699004 run osmo-stp_10.42.42.5(pid=11357): Launched 07:27:17.819140 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:27:18.357239 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11359): Launched 07:27:18.476427 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:27:18.739144 run patchelf(pid=11360): Launched 07:27:18.913524 run osmo-stp_10.42.42.5(pid=11357): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11357)] 07:27:19.045449 run osmo-stp_10.42.42.5(pid=11357): stdout: | (launched: 2022-12-10_07:27:17.642451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:19.179271 run osmo-stp_10.42.42.5(pid=11357): stderr: | [0;m[38;5;43m20221210072717832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072717832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072717832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072717832 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072717835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072717835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072717835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:19.312797 run osmo-stp_10.42.42.5(pid=11357): stdout: | (launched: 2022-12-10_07:27:17.642451) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:19.440675 run osmo-stp_10.42.42.5(pid=11357): stderr: | [0;m[38;5;43m20221210072717832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072717832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072717832 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072717832 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072717835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072717835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072717835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:19.592052 run patchelf(pid=11360): Terminating (SIGINT) 07:27:19.767414 run patchelf(pid=11360): Terminated: ok {rc=0} 07:27:19.894837 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11357): Process ended prematurely: osmo-stp_10.42.42.5(pid=11357) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11357)] [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27] 07:27:19.903870 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 07:27:19.931879 run osmo-hlr_10.42.42.2(pid=11354): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11354)] 07:27:19.981355 run osmo-hlr_10.42.42.2(pid=11354): stdout: | (launched: 2022-12-10_07:27:16.453725) 07:27:20.032535 run osmo-hlr_10.42.42.2(pid=11354): stderr: | [0;m[1;31m20221210072716780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072716780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072716780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072716780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072716780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072716780 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072716799 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-sysmocell5000+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072716808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072716808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072716808 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:27:20.084166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11353): Terminating (SIGTERM) 07:27:20.125724 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11356): Terminating (SIGTERM) 07:27:20.167449 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11359): Terminating (SIGTERM) 07:27:20.209351 --- ParallelTerminationStrategy: PID 11353 died... 07:27:20.229348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11353): Terminated: ok {rc=0} 07:27:20.275460 --- ParallelTerminationStrategy: PID 11356 died... 07:27:20.294886 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11356): Terminated: ok {rc=0} 07:27:20.341190 --- ParallelTerminationStrategy: PID 11359 died... 07:27:20.360512 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11359): Terminated: ok {rc=0} 07:27:20.448609 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-sysmocell5000+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:27:21.760676 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:27:21.767626 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:27:21.802204 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:27:21.842257 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:27:21.928365 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:27:21.962422 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:27:22.001243 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:27:22.600714 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:27:22.651336 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:22.662653 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:27:22.732500 tst cs_paging_gprs_active.py: using LAC 26800 07:27:22.855180 tst cs_paging_gprs_active.py: using RAC 25 07:27:22.977456 tst cs_paging_gprs_active.py: using CellId 26800 07:27:23.099846 tst cs_paging_gprs_active.py: using BVCI 26801 07:27:23.214113 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:23.225502 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:23.236583 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:23.247880 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:23.259029 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:23.270152 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:23.281467 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:23.292461 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:23.303865 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:27:23.424052 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:27:23.542048 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:27:23.755489 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:27:24.073840 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11365): Launched 07:27:24.349166 run iperf3-srv_10.42.42.10(pid=11366): Launched 07:27:24.468296 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:27:24.682138 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:27:25.000365 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11367): Launched 07:27:25.275827 run iperf3-srv_10.42.42.10(pid=11368): Launched 07:27:25.395075 tst cs_paging_gprs_active.py:38: start network... 07:27:25.609322 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:27:26.101133 run create_hlr_db(pid=11369): Launched 07:27:26.230850 bus /gobi_6: Setting Powered False 07:27:27.293915 run create_hlr_db(pid=11369): Terminated: ok {rc=0} 07:27:27.718782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11371): Launched 07:27:28.028485 run osmo-hlr_10.42.42.2(pid=11372): Launched 07:27:28.151186 run osmo-stp_10.42.42.5: Starting osmo-stp 07:27:28.695893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11374): Launched 07:27:29.012795 run osmo-stp_10.42.42.5(pid=11375): Launched 07:27:29.134708 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:27:29.681342 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11377): Launched 07:27:29.802671 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:27:30.070099 run patchelf(pid=11378): Launched 07:27:30.245881 run osmo-stp_10.42.42.5(pid=11375): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11375)] 07:27:30.379768 run osmo-stp_10.42.42.5(pid=11375): stdout: | (launched: 2022-12-10_07:27:28.955478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:30.515267 run osmo-stp_10.42.42.5(pid=11375): stderr: | [0;m[38;5;43m20221210072729148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072729148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072729148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072729149 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072729149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072729149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072729149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:30.651267 run osmo-stp_10.42.42.5(pid=11375): stdout: | (launched: 2022-12-10_07:27:28.955478) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:30.780388 run osmo-stp_10.42.42.5(pid=11375): stderr: | [0;m[38;5;43m20221210072729148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072729148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072729148 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072729149 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072729149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072729149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072729149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:30.937353 run patchelf(pid=11378): Terminating (SIGINT) 07:27:31.118447 run patchelf(pid=11378): Terminated: ok {rc=0} 07:27:31.249224 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11375): Process ended prematurely: osmo-stp_10.42.42.5(pid=11375) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11375)] [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:27:31.259620 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 07:27:31.288849 run osmo-hlr_10.42.42.2(pid=11372): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11372)] 07:27:31.339641 run osmo-hlr_10.42.42.2(pid=11372): stdout: | (launched: 2022-12-10_07:27:27.971165) 07:27:31.392036 run osmo-hlr_10.42.42.2(pid=11372): stderr: | [0;m[1;31m20221210072728168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072728168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072728168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072728168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072728169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072728169 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072728181 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072728190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072728190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072728190 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:27:31.444521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11365): Terminating (SIGTERM) 07:27:31.486635 run iperf3-srv_10.42.42.10(pid=11366): Terminating (SIGTERM) 07:27:31.530137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11367): Terminating (SIGTERM) 07:27:31.572427 run iperf3-srv_10.42.42.10(pid=11368): Terminating (SIGTERM) 07:27:31.614915 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11371): Terminating (SIGTERM) 07:27:31.657467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11374): Terminating (SIGTERM) 07:27:31.701096 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11377): Terminating (SIGTERM) 07:27:31.743528 --- ParallelTerminationStrategy: PID 11365 died... 07:27:31.763385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11365): Terminated: ok {rc=0} 07:27:31.809871 --- ParallelTerminationStrategy: PID 11366 died... 07:27:31.829881 run iperf3-srv_10.42.42.10(pid=11366): Terminated {rc=256} 07:27:31.876914 --- ParallelTerminationStrategy: PID 11367 died... 07:27:31.897594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11367): Terminated: ok {rc=0} 07:27:31.944248 --- ParallelTerminationStrategy: PID 11368 died... 07:27:31.964100 run iperf3-srv_10.42.42.10(pid=11368): Terminated {rc=256} 07:27:32.010658 --- ParallelTerminationStrategy: PID 11371 died... 07:27:32.030505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11371): Terminated: ok {rc=0} 07:27:32.077176 --- ParallelTerminationStrategy: PID 11374 died... 07:27:32.097155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11374): Terminated: ok {rc=0} 07:27:32.143774 --- ParallelTerminationStrategy: PID 11377 died... 07:27:32.163814 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11377): Terminated: ok {rc=0} 07:27:32.254322 bus /gobi_0: Setting Powered False 07:27:33.352495 bus /gobi_0: Setting Powered False 07:27:34.468463 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:27:35.613889 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:35.625360 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:27:35.698732 tst iperf3.py: using LAC 26801 07:27:35.814944 tst iperf3.py: using RAC 26 07:27:35.933249 tst iperf3.py: using CellId 26801 07:27:36.061803 tst iperf3.py: using BVCI 26802 07:27:36.176600 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:36.188324 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:36.199554 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:36.211364 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:36.223013 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:36.234735 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:36.246498 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:36.258078 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:36.270002 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:27:36.384552 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:27:36.583251 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:27:36.878550 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11380): Launched 07:27:37.134897 run iperf3-srv_10.42.42.10(pid=11381): Launched 07:27:37.245945 tst iperf3.py:8: start network... 07:27:37.442826 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:27:37.897886 run create_hlr_db(pid=11382): Launched 07:27:38.011417 bus /gobi_6: Setting Powered False 07:27:39.070704 run create_hlr_db(pid=11382): Terminated: ok {rc=0} 07:27:39.503104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11384): Launched 07:27:39.819342 run osmo-hlr_10.42.42.2(pid=11385): Launched 07:27:39.941443 run osmo-stp_10.42.42.5: Starting osmo-stp 07:27:40.487845 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11387): Launched 07:27:40.803634 run osmo-stp_10.42.42.5(pid=11388): Launched 07:27:40.925227 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:27:41.470028 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11390): Launched 07:27:41.590964 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:27:41.857689 run patchelf(pid=11391): Launched 07:27:42.034232 run osmo-stp_10.42.42.5(pid=11388): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11388)] 07:27:42.167975 run osmo-stp_10.42.42.5(pid=11388): stdout: | (launched: 2022-12-10_07:27:40.746533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:42.303523 run osmo-stp_10.42.42.5(pid=11388): stderr: | [0;m[38;5;43m20221210072740937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072740937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072740937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072740938 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072740940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072740940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072740940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:42.439307 run osmo-stp_10.42.42.5(pid=11388): stdout: | (launched: 2022-12-10_07:27:40.746533) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:42.568354 run osmo-stp_10.42.42.5(pid=11388): stderr: | [0;m[38;5;43m20221210072740937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072740937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072740937 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072740938 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072740940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072740940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072740940 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:42.721961 run patchelf(pid=11391): Terminating (SIGINT) 07:27:42.900350 run patchelf(pid=11391): Terminated: ok {rc=0} 07:27:43.029074 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11388): Process ended prematurely: osmo-stp_10.42.42.5(pid=11388) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11388)] [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8] 07:27:43.039033 tst iperf3.py:8: Test FAILED (7.5 sec) 07:27:43.067344 run osmo-hlr_10.42.42.2(pid=11385): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11385)] 07:27:43.117341 run osmo-hlr_10.42.42.2(pid=11385): stdout: | (launched: 2022-12-10_07:27:39.762336) 07:27:43.169176 run osmo-hlr_10.42.42.2(pid=11385): stderr: | [0;m[1;31m20221210072739959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072739959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072739959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072739959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072739959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072739959 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072739971 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072739981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072739981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072739981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:27:43.221202 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11380): Terminating (SIGTERM) 07:27:43.262839 run iperf3-srv_10.42.42.10(pid=11381): Terminating (SIGTERM) 07:27:43.304582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11384): Terminating (SIGTERM) 07:27:43.346326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11387): Terminating (SIGTERM) 07:27:43.388052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11390): Terminating (SIGTERM) 07:27:43.430034 --- ParallelTerminationStrategy: PID 11380 died... 07:27:43.449990 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11380): Terminated: ok {rc=0} 07:27:43.496143 --- ParallelTerminationStrategy: PID 11381 died... 07:27:43.515649 run iperf3-srv_10.42.42.10(pid=11381): Terminated {rc=256} 07:27:43.561434 --- ParallelTerminationStrategy: PID 11384 died... 07:27:43.580776 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11384): Terminated: ok {rc=0} 07:27:43.626571 --- ParallelTerminationStrategy: PID 11387 died... 07:27:43.646274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11387): Terminated: ok {rc=0} 07:27:43.692174 --- ParallelTerminationStrategy: PID 11390 died... 07:27:43.711626 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11390): Terminated: ok {rc=0} 07:27:43.799259 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:27:44.947185 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:44.959116 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:27:45.032320 tst iperf3m4.py: using LAC 26802 07:27:45.156075 tst iperf3m4.py: using RAC 27 07:27:45.274355 tst iperf3m4.py: using CellId 26802 07:27:45.392122 tst iperf3m4.py: using BVCI 26803 07:27:45.499011 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:45.510017 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:45.520732 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:45.531942 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:45.542793 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:45.553903 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:45.565244 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:45.575998 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:27:45.587286 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:27:45.701772 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:27:45.819139 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:27:45.952550 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:27:46.089462 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:27:46.346274 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:27:46.674120 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11392): Launched 07:27:46.966603 run iperf3-srv_10.42.42.10(pid=11393): Launched 07:27:47.103225 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:27:47.320462 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:27:47.640027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11394): Launched 07:27:47.916188 run iperf3-srv_10.42.42.10(pid=11395): Launched 07:27:48.036052 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:27:48.250446 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:27:48.567685 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11396): Launched 07:27:48.842804 run iperf3-srv_10.42.42.10(pid=11397): Launched 07:27:48.962522 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:27:49.176064 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:27:49.493941 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11398): Launched 07:27:49.769393 run iperf3-srv_10.42.42.10(pid=11399): Launched 07:27:49.888398 tst iperf3m4.py:8: start network... 07:27:50.102452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:27:50.593466 run create_hlr_db(pid=11400): Launched 07:27:50.722637 bus /gobi_6: Setting Powered False 07:27:51.785437 run create_hlr_db(pid=11400): Terminated: ok {rc=0} 07:27:52.213694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11402): Launched 07:27:52.509326 run osmo-hlr_10.42.42.2(pid=11403): Launched 07:27:52.622904 run osmo-stp_10.42.42.5: Starting osmo-stp 07:27:53.171322 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11405): Launched 07:27:53.487239 run osmo-stp_10.42.42.5(pid=11406): Launched 07:27:53.608483 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:27:54.154308 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11408): Launched 07:27:54.275854 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:27:54.542227 run patchelf(pid=11409): Launched 07:27:54.719010 run osmo-stp_10.42.42.5(pid=11406): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11406)] 07:27:54.852795 run osmo-stp_10.42.42.5(pid=11406): stdout: | (launched: 2022-12-10_07:27:53.430039) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:54.988856 run osmo-stp_10.42.42.5(pid=11406): stderr: | [0;m[38;5;43m20221210072753620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072753620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072753621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072753621 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072753621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072753622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072753622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:55.124250 run osmo-stp_10.42.42.5(pid=11406): stdout: | (launched: 2022-12-10_07:27:53.430039) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:27:55.253873 run osmo-stp_10.42.42.5(pid=11406): stderr: | [0;m[38;5;43m20221210072753620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072753620 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072753621 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072753621 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072753621 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072753622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072753622 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:27:55.407153 run patchelf(pid=11409): Terminating (SIGINT) 07:27:55.585765 run patchelf(pid=11409): Terminated: ok {rc=0} 07:27:55.714392 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11406): Process ended prematurely: osmo-stp_10.42.42.5(pid=11406) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11406)] [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:27:55.724298 tst iperf3m4.py:8: Test FAILED (10.8 sec) 07:27:55.752779 run osmo-hlr_10.42.42.2(pid=11403): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11403)] 07:27:55.802474 run osmo-hlr_10.42.42.2(pid=11403): stdout: | (launched: 2022-12-10_07:27:52.455702) 07:27:55.854318 run osmo-hlr_10.42.42.2(pid=11403): stderr: | [0;m[1;31m20221210072752630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072752630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072752630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072752630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072752630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072752630 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072752642 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072752650 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072752651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072752651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:27:55.906271 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11392): Terminating (SIGTERM) 07:27:55.947530 run iperf3-srv_10.42.42.10(pid=11393): Terminating (SIGTERM) 07:27:55.988879 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11394): Terminating (SIGTERM) 07:27:56.030808 run iperf3-srv_10.42.42.10(pid=11395): Terminating (SIGTERM) 07:27:56.072196 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11396): Terminating (SIGTERM) 07:27:56.114300 run iperf3-srv_10.42.42.10(pid=11397): Terminating (SIGTERM) 07:27:56.155472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11398): Terminating (SIGTERM) 07:27:56.196928 run iperf3-srv_10.42.42.10(pid=11399): Terminating (SIGTERM) 07:27:56.238202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11402): Terminating (SIGTERM) 07:27:56.279511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11405): Terminating (SIGTERM) 07:27:56.320794 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11408): Terminating (SIGTERM) 07:27:56.362506 --- ParallelTerminationStrategy: PID 11392 died... 07:27:56.382362 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11392): Terminated: ok {rc=0} 07:27:56.428185 --- ParallelTerminationStrategy: PID 11393 died... 07:27:56.447574 run iperf3-srv_10.42.42.10(pid=11393): Terminated {rc=256} 07:27:56.493384 --- ParallelTerminationStrategy: PID 11394 died... 07:27:56.512658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11394): Terminated: ok {rc=0} 07:27:56.558320 --- ParallelTerminationStrategy: PID 11395 died... 07:27:56.577692 run iperf3-srv_10.42.42.10(pid=11395): Terminated {rc=256} 07:27:56.623276 --- ParallelTerminationStrategy: PID 11396 died... 07:27:56.642495 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11396): Terminated: ok {rc=0} 07:27:56.687904 --- ParallelTerminationStrategy: PID 11397 died... 07:27:56.707109 run iperf3-srv_10.42.42.10(pid=11397): Terminated {rc=256} 07:27:56.752359 --- ParallelTerminationStrategy: PID 11398 died... 07:27:56.771801 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11398): Terminated: ok {rc=0} 07:27:56.817432 --- ParallelTerminationStrategy: PID 11399 died... 07:27:56.836703 run iperf3-srv_10.42.42.10(pid=11399): Terminated {rc=256} 07:27:56.882485 --- ParallelTerminationStrategy: PID 11402 died... 07:27:56.901971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11402): Terminated: ok {rc=0} 07:27:56.947548 --- ParallelTerminationStrategy: PID 11405 died... 07:27:56.967056 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11405): Terminated: ok {rc=0} 07:27:57.012552 --- ParallelTerminationStrategy: PID 11408 died... 07:27:57.031999 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11408): Terminated: ok {rc=0} 07:27:57.119016 bus /gobi_4: Setting Powered False 07:27:58.217541 bus /gobi_4: Setting Powered False 07:27:59.333683 bus /gobi_1: Setting Powered False 07:28:00.431431 bus /gobi_1: Setting Powered False 07:28:01.550460 bus /gobi_0: Setting Powered False 07:28:02.658708 bus /gobi_0: Setting Powered False 07:28:03.772470 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:28:04.876449 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:04.888384 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:28:04.959913 tst ping.py: using LAC 26803 07:28:05.082590 tst ping.py: using RAC 28 07:28:05.205409 tst ping.py: using CellId 26803 07:28:05.327900 tst ping.py: using BVCI 26804 07:28:05.441252 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:05.452672 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:05.463959 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:05.475303 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:05.486480 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:05.497744 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:05.509046 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:05.520265 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:28:05.634007 tst ping.py:19: start network... 07:28:05.828340 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:28:06.276262 run create_hlr_db(pid=11410): Launched 07:28:06.388171 bus /gobi_6: Setting Powered False 07:28:07.446321 run create_hlr_db(pid=11410): Terminated: ok {rc=0} 07:28:07.869642 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11412): Launched 07:28:08.179387 run osmo-hlr_10.42.42.2(pid=11413): Launched 07:28:08.292372 run osmo-stp_10.42.42.5: Starting osmo-stp 07:28:08.804074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11415): Launched 07:28:09.093212 run osmo-stp_10.42.42.5(pid=11416): Launched 07:28:09.204092 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:28:09.703113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11418): Launched 07:28:09.813830 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:28:10.057431 run patchelf(pid=11419): Launched 07:28:10.219183 run osmo-stp_10.42.42.5(pid=11416): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11416)] 07:28:10.341920 run osmo-stp_10.42.42.5(pid=11416): stdout: | (launched: 2022-12-10_07:28:09.040229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:10.466308 run osmo-stp_10.42.42.5(pid=11416): stderr: | [0;m[38;5;43m20221210072809207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072809207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072809207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072809208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072809210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072809210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072809210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:10.591666 run osmo-stp_10.42.42.5(pid=11416): stdout: | (launched: 2022-12-10_07:28:09.040229) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:10.710524 run osmo-stp_10.42.42.5(pid=11416): stderr: | [0;m[38;5;43m20221210072809207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072809207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072809207 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072809208 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072809210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072809210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072809210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:10.851061 run patchelf(pid=11419): Terminating (SIGINT) 07:28:11.015202 run patchelf(pid=11419): Terminated: ok {rc=0} 07:28:11.133584 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11416): Process ended prematurely: osmo-stp_10.42.42.5(pid=11416) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11416)] [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22] 07:28:11.142234 tst ping.py:22: Test FAILED (6.3 sec) 07:28:11.168643 run osmo-hlr_10.42.42.2(pid=11413): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11413)] 07:28:11.216189 run osmo-hlr_10.42.42.2(pid=11413): stdout: | (launched: 2022-12-10_07:28:08.123282) 07:28:11.265325 run osmo-hlr_10.42.42.2(pid=11413): stderr: | [0;m[1;31m20221210072808298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072808298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072808298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072808298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072808298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072808298 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072808311 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072808319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072808319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072808319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:28:11.314927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11412): Terminating (SIGTERM) 07:28:11.354498 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11415): Terminating (SIGTERM) 07:28:11.394005 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11418): Terminating (SIGTERM) 07:28:11.433848 --- ParallelTerminationStrategy: PID 11412 died... 07:28:11.452807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11412): Terminated: ok {rc=0} 07:28:11.497333 --- ParallelTerminationStrategy: PID 11415 died... 07:28:11.515746 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11415): Terminated: ok {rc=0} 07:28:11.560431 --- ParallelTerminationStrategy: PID 11418 died... 07:28:11.579205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11418): Terminated: ok {rc=0} 07:28:11.663379 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:28:12.746926 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:12.758433 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:28:12.834748 tst ping_idle_ping.py: using LAC 26804 07:28:12.957655 tst ping_idle_ping.py: using RAC 29 07:28:13.087854 tst ping_idle_ping.py: using CellId 26804 07:28:13.210443 tst ping_idle_ping.py: using BVCI 26805 07:28:13.324746 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:13.336261 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:13.347640 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:13.358922 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:13.370069 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:13.381372 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:13.393234 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:28:13.405439 tst gprs:trx-sysmocell5000+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:28:13.521208 tst ping_idle_ping.py:24: start network... 07:28:13.716143 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:28:14.172938 run create_hlr_db(pid=11420): Launched 07:28:14.286109 bus /gobi_6: Setting Powered False 07:28:15.344853 run create_hlr_db(pid=11420): Terminated: ok {rc=0} 07:28:15.750694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11422): Launched 07:28:16.095435 run osmo-hlr_10.42.42.2(pid=11423): Launched 07:28:16.407420 run osmo-stp_10.42.42.5: Starting osmo-stp 07:28:17.064997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11425): Launched 07:28:17.391262 run osmo-stp_10.42.42.5(pid=11426): Launched 07:28:17.512643 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:28:18.058966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11428): Launched 07:28:18.177980 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:28:18.439861 run patchelf(pid=11429): Launched 07:28:18.612753 run osmo-stp_10.42.42.5(pid=11426): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11426)] 07:28:18.743825 run osmo-stp_10.42.42.5(pid=11426): stdout: | (launched: 2022-12-10_07:28:17.334405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:18.877414 run osmo-stp_10.42.42.5(pid=11426): stderr: | [0;m[38;5;43m20221210072817524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072817524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072817524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072817524 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072817525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072817525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072817525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:19.010564 run osmo-stp_10.42.42.5(pid=11426): stdout: | (launched: 2022-12-10_07:28:17.334405) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:19.137590 run osmo-stp_10.42.42.5(pid=11426): stderr: | [0;m[38;5;43m20221210072817524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072817524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072817524 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072817524 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072817525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072817525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072817525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:19.287866 run patchelf(pid=11429): Terminating (SIGINT) 07:28:19.462146 run patchelf(pid=11429): Terminated: ok {rc=0} 07:28:19.587652 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11426): Process ended prematurely: osmo-stp_10.42.42.5(pid=11426) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11426)] [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 07:28:19.596922 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 07:28:19.624479 run osmo-hlr_10.42.42.2(pid=11423): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11423)] 07:28:19.673621 run osmo-hlr_10.42.42.2(pid=11423): stdout: | (launched: 2022-12-10_07:28:16.025371) 07:28:19.724930 run osmo-hlr_10.42.42.2(pid=11423): stderr: | [0;m[1;31m20221210072816301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072816301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072816301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072816301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072816301 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072816302 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072816318 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-sysmocell5000+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072816328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072816328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072816328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:28:19.776725 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11422): Terminating (SIGTERM) 07:28:19.818047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11425): Terminating (SIGTERM) 07:28:19.859460 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11428): Terminating (SIGTERM) 07:28:19.900788 --- ParallelTerminationStrategy: PID 11422 died... 07:28:19.920621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11422): Terminated: ok {rc=0} 07:28:19.965933 --- ParallelTerminationStrategy: PID 11425 died... 07:28:19.985203 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11425): Terminated: ok {rc=0} 07:28:20.030370 --- ParallelTerminationStrategy: PID 11428 died... 07:28:20.049623 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11428): Terminated: ok {rc=0} 07:28:20.136206 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-sysmocell5000+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:28:21.448510 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:28:21.454865 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:28:21.488860 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 07:28:21.528207 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 07:28:21.618841 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:28:21.653049 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 07:28:21.691345 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 07:28:22.287597 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 07:28:22.338933 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:22.350540 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:28:22.422559 tst cs_paging_gprs_active.py: using LAC 26805 07:28:22.547922 tst cs_paging_gprs_active.py: using RAC 30 07:28:22.672626 tst cs_paging_gprs_active.py: using CellId 26805 07:28:22.796238 tst cs_paging_gprs_active.py: using BVCI 26806 07:28:22.906010 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:22.916891 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:22.927708 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:22.938684 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:22.949613 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:22.960189 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:22.971482 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:22.983057 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:22.994079 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:28:23.109594 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:28:23.224488 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:28:23.424359 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:28:23.722430 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11433): Launched 07:28:23.981695 run iperf3-srv_10.42.42.10(pid=11434): Launched 07:28:24.093881 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:28:24.293707 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:28:24.591898 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11435): Launched 07:28:24.850303 run iperf3-srv_10.42.42.10(pid=11436): Launched 07:28:24.962168 tst cs_paging_gprs_active.py:38: start network... 07:28:25.161074 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:28:25.618128 run create_hlr_db(pid=11437): Launched 07:28:25.732158 bus /gobi_6: Setting Powered False 07:28:26.792163 run create_hlr_db(pid=11437): Terminated: ok {rc=0} 07:28:27.227213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11439): Launched 07:28:27.528487 run osmo-hlr_10.42.42.2(pid=11440): Launched 07:28:27.642435 run osmo-stp_10.42.42.5: Starting osmo-stp 07:28:28.162023 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11442): Launched 07:28:28.457223 run osmo-stp_10.42.42.5(pid=11443): Launched 07:28:28.570222 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:28:29.078886 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11445): Launched 07:28:29.192111 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:28:29.440484 run patchelf(pid=11446): Launched 07:28:29.605297 run osmo-stp_10.42.42.5(pid=11443): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11443)] 07:28:29.730282 run osmo-stp_10.42.42.5(pid=11443): stdout: | (launched: 2022-12-10_07:28:28.403615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:29.857191 run osmo-stp_10.42.42.5(pid=11443): stderr: | [0;m[38;5;43m20221210072828570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072828570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072828571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072828571 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072828573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072828573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072828573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:29.984203 run osmo-stp_10.42.42.5(pid=11443): stdout: | (launched: 2022-12-10_07:28:28.403615) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:30.105254 run osmo-stp_10.42.42.5(pid=11443): stderr: | [0;m[38;5;43m20221210072828570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072828570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072828571 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072828571 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072828573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072828573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072828573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:30.248234 run patchelf(pid=11446): Terminating (SIGINT) 07:28:30.415427 run patchelf(pid=11446): Terminated: ok {rc=0} 07:28:30.536263 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11443): Process ended prematurely: osmo-stp_10.42.42.5(pid=11443) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11443)] [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 07:28:30.545741 tst cs_paging_gprs_active.py:38: Test FAILED (8.2 sec) 07:28:30.572523 run osmo-hlr_10.42.42.2(pid=11440): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11440)] 07:28:30.621020 run osmo-hlr_10.42.42.2(pid=11440): stdout: | (launched: 2022-12-10_07:28:27.474319) 07:28:30.670542 run osmo-hlr_10.42.42.2(pid=11440): stderr: | [0;m[1;31m20221210072827650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072827650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072827650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072827650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072827650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072827650 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072827675 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072827685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072827685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072827685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:28:30.720554 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11433): Terminating (SIGTERM) 07:28:30.760372 run iperf3-srv_10.42.42.10(pid=11434): Terminating (SIGTERM) 07:28:30.800361 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11435): Terminating (SIGTERM) 07:28:30.860495 run iperf3-srv_10.42.42.10(pid=11436): Terminating (SIGTERM) 07:28:30.914582 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11439): Terminating (SIGTERM) 07:28:30.959315 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11442): Terminating (SIGTERM) 07:28:31.005050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11445): Terminating (SIGTERM) 07:28:31.051190 --- ParallelTerminationStrategy: PID 11433 died... 07:28:31.073102 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11433): Terminated: ok {rc=0} 07:28:31.122935 --- ParallelTerminationStrategy: PID 11434 died... 07:28:31.144773 run iperf3-srv_10.42.42.10(pid=11434): Terminated {rc=256} 07:28:31.194359 --- ParallelTerminationStrategy: PID 11435 died... 07:28:31.216182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11435): Terminated: ok {rc=0} 07:28:31.264761 --- ParallelTerminationStrategy: PID 11436 died... 07:28:31.286484 run iperf3-srv_10.42.42.10(pid=11436): Terminated {rc=256} 07:28:31.334598 --- ParallelTerminationStrategy: PID 11439 died... 07:28:31.356404 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11439): Terminated: ok {rc=0} 07:28:31.406753 --- ParallelTerminationStrategy: PID 11442 died... 07:28:31.427379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11442): Terminated: ok {rc=0} 07:28:31.477138 --- ParallelTerminationStrategy: PID 11445 died... 07:28:31.497537 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11445): Terminated: ok {rc=0} 07:28:31.595322 bus /gobi_0: Setting Powered False 07:28:32.709277 bus /gobi_0: Setting Powered False 07:28:33.825598 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 07:28:34.973345 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:34.985501 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:28:35.060854 tst iperf3.py: using LAC 26806 07:28:35.186569 tst iperf3.py: using RAC 31 07:28:35.310629 tst iperf3.py: using CellId 26806 07:28:35.435253 tst iperf3.py: using BVCI 26807 07:28:35.551018 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:35.562480 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:35.573772 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:35.585065 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:35.596238 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:35.607437 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:35.618831 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:35.629976 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:35.641343 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:28:35.757974 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:28:35.972468 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:28:36.289815 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11447): Launched 07:28:36.565866 run iperf3-srv_10.42.42.10(pid=11448): Launched 07:28:36.685046 tst iperf3.py:8: start network... 07:28:36.899096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:28:37.389495 run create_hlr_db(pid=11449): Launched 07:28:37.518960 bus /gobi_6: Setting Powered False 07:28:38.582162 run create_hlr_db(pid=11449): Terminated: ok {rc=0} 07:28:39.004717 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11451): Launched 07:28:39.300810 run osmo-hlr_10.42.42.2(pid=11452): Launched 07:28:39.414503 run osmo-stp_10.42.42.5: Starting osmo-stp 07:28:39.923387 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11454): Launched 07:28:40.218900 run osmo-stp_10.42.42.5(pid=11455): Launched 07:28:40.332641 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:28:40.843208 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11457): Launched 07:28:40.957257 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:28:41.206451 run patchelf(pid=11458): Launched 07:28:41.371628 run osmo-stp_10.42.42.5(pid=11455): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11455)] 07:28:41.496814 run osmo-stp_10.42.42.5(pid=11455): stdout: | (launched: 2022-12-10_07:28:40.165133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:41.623770 run osmo-stp_10.42.42.5(pid=11455): stderr: | [0;m[38;5;43m20221210072840334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072840334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072840334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072840335 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072840335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072840335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072840335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:41.750770 run osmo-stp_10.42.42.5(pid=11455): stdout: | (launched: 2022-12-10_07:28:40.165133) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:41.872184 run osmo-stp_10.42.42.5(pid=11455): stderr: | [0;m[38;5;43m20221210072840334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072840334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072840334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072840335 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072840335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072840335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072840335 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:42.015801 run patchelf(pid=11458): Terminating (SIGINT) 07:28:42.182804 run patchelf(pid=11458): Terminated: ok {rc=0} 07:28:42.303422 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11455): Process ended prematurely: osmo-stp_10.42.42.5(pid=11455) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11455)] [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8] 07:28:42.312809 tst iperf3.py:8: Test FAILED (7.4 sec) 07:28:42.340152 run osmo-hlr_10.42.42.2(pid=11452): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11452)] 07:28:42.387848 run osmo-hlr_10.42.42.2(pid=11452): stdout: | (launched: 2022-12-10_07:28:39.247107) 07:28:42.437257 run osmo-hlr_10.42.42.2(pid=11452): stderr: | [0;m[1;31m20221210072839422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072839422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072839422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072839422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072839422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072839422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072839435 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072839445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072839446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072839446 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:28:42.487313 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11447): Terminating (SIGTERM) 07:28:42.527035 run iperf3-srv_10.42.42.10(pid=11448): Terminating (SIGTERM) 07:28:42.566866 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11451): Terminating (SIGTERM) 07:28:42.606640 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11454): Terminating (SIGTERM) 07:28:42.646415 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11457): Terminating (SIGTERM) 07:28:42.686448 --- ParallelTerminationStrategy: PID 11447 died... 07:28:42.705597 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11447): Terminated: ok {rc=0} 07:28:42.750206 --- ParallelTerminationStrategy: PID 11448 died... 07:28:42.768635 run iperf3-srv_10.42.42.10(pid=11448): Terminated {rc=256} 07:28:42.812807 --- ParallelTerminationStrategy: PID 11451 died... 07:28:42.831813 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11451): Terminated: ok {rc=0} 07:28:42.876011 --- ParallelTerminationStrategy: PID 11454 died... 07:28:42.894451 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11454): Terminated: ok {rc=0} 07:28:42.938749 --- ParallelTerminationStrategy: PID 11457 died... 07:28:42.957237 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11457): Terminated: ok {rc=0} 07:28:43.043077 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 07:28:44.187513 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:44.199149 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:28:44.270737 tst iperf3m4.py: using LAC 26807 07:28:44.388000 tst iperf3m4.py: using RAC 32 07:28:44.507597 tst iperf3m4.py: using CellId 26807 07:28:44.623480 tst iperf3m4.py: using BVCI 26808 07:28:44.730444 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:44.741470 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:44.752217 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:44.763252 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:44.774307 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:44.785415 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:44.796326 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:44.807288 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:28:44.818685 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:28:44.937635 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:28:45.059470 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:28:45.175063 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:28:45.291037 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:28:45.489760 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:28:45.787412 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11459): Launched 07:28:46.101810 run iperf3-srv_10.42.42.10(pid=11460): Launched 07:28:46.255938 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:28:46.461436 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:28:46.771532 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11461): Launched 07:28:47.113898 run iperf3-srv_10.42.42.10(pid=11462): Launched 07:28:47.248712 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:28:47.447991 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:28:47.744450 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11463): Launched 07:28:48.002125 run iperf3-srv_10.42.42.10(pid=11464): Launched 07:28:48.113569 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:28:48.310916 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:28:48.607409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11465): Launched 07:28:48.864797 run iperf3-srv_10.42.42.10(pid=11466): Launched 07:28:48.976257 tst iperf3m4.py:8: start network... 07:28:49.174011 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:28:49.629647 run create_hlr_db(pid=11467): Launched 07:28:49.742669 bus /gobi_6: Setting Powered False 07:28:50.800530 run create_hlr_db(pid=11467): Terminated: ok {rc=0} 07:28:51.233120 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11469): Launched 07:28:51.549397 run osmo-hlr_10.42.42.2(pid=11470): Launched 07:28:51.671040 run osmo-stp_10.42.42.5: Starting osmo-stp 07:28:52.218123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11472): Launched 07:28:52.533720 run osmo-stp_10.42.42.5(pid=11473): Launched 07:28:52.654721 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:28:53.203969 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11475): Launched 07:28:53.325374 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:28:53.591786 run patchelf(pid=11476): Launched 07:28:53.768062 run osmo-stp_10.42.42.5(pid=11473): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11473)] 07:28:53.902053 run osmo-stp_10.42.42.5(pid=11473): stdout: | (launched: 2022-12-10_07:28:52.476201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:54.037601 run osmo-stp_10.42.42.5(pid=11473): stderr: | [0;m[38;5;43m20221210072852666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072852666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072852667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072852667 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072852667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072852667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072852668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:54.173197 run osmo-stp_10.42.42.5(pid=11473): stdout: | (launched: 2022-12-10_07:28:52.476201) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:28:54.302328 run osmo-stp_10.42.42.5(pid=11473): stderr: | [0;m[38;5;43m20221210072852666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072852666 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072852667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072852667 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072852667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072852667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072852668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:28:54.455583 run patchelf(pid=11476): Terminating (SIGINT) 07:28:54.634156 run patchelf(pid=11476): Terminated: ok {rc=0} 07:28:54.762300 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11473): Process ended prematurely: osmo-stp_10.42.42.5(pid=11473) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11473)] [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8] 07:28:54.772168 tst iperf3m4.py:8: Test FAILED (10.6 sec) 07:28:54.800599 run osmo-hlr_10.42.42.2(pid=11470): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11470)] 07:28:54.850442 run osmo-hlr_10.42.42.2(pid=11470): stdout: | (launched: 2022-12-10_07:28:51.492248) 07:28:54.902180 run osmo-hlr_10.42.42.2(pid=11470): stderr: | [0;m[1;31m20221210072851690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072851690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072851690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072851690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072851690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072851690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072851703 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072851712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072851712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072851712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:28:54.953887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11459): Terminating (SIGTERM) 07:28:54.995388 run iperf3-srv_10.42.42.10(pid=11460): Terminating (SIGTERM) 07:28:55.037061 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11461): Terminating (SIGTERM) 07:28:55.078635 run iperf3-srv_10.42.42.10(pid=11462): Terminating (SIGTERM) 07:28:55.120234 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11463): Terminating (SIGTERM) 07:28:55.161926 run iperf3-srv_10.42.42.10(pid=11464): Terminating (SIGTERM) 07:28:55.203242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11465): Terminating (SIGTERM) 07:28:55.244629 run iperf3-srv_10.42.42.10(pid=11466): Terminating (SIGTERM) 07:28:55.287226 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11469): Terminating (SIGTERM) 07:28:55.329041 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11472): Terminating (SIGTERM) 07:28:55.370241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11475): Terminating (SIGTERM) 07:28:55.411642 --- ParallelTerminationStrategy: PID 11459 died... 07:28:55.431493 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11459): Terminated: ok {rc=0} 07:28:55.477306 --- ParallelTerminationStrategy: PID 11460 died... 07:28:55.496409 run iperf3-srv_10.42.42.10(pid=11460): Terminated {rc=256} 07:28:55.541937 --- ParallelTerminationStrategy: PID 11461 died... 07:28:55.561384 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11461): Terminated: ok {rc=0} 07:28:55.606973 --- ParallelTerminationStrategy: PID 11462 died... 07:28:55.626321 run iperf3-srv_10.42.42.10(pid=11462): Terminated {rc=256} 07:28:55.671573 --- ParallelTerminationStrategy: PID 11463 died... 07:28:55.690893 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11463): Terminated: ok {rc=0} 07:28:55.736281 --- ParallelTerminationStrategy: PID 11464 died... 07:28:55.755594 run iperf3-srv_10.42.42.10(pid=11464): Terminated {rc=256} 07:28:55.801155 --- ParallelTerminationStrategy: PID 11465 died... 07:28:55.820469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11465): Terminated: ok {rc=0} 07:28:55.865961 --- ParallelTerminationStrategy: PID 11466 died... 07:28:55.885589 run iperf3-srv_10.42.42.10(pid=11466): Terminated {rc=256} 07:28:55.931262 --- ParallelTerminationStrategy: PID 11469 died... 07:28:55.950652 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11469): Terminated: ok {rc=0} 07:28:55.996054 --- ParallelTerminationStrategy: PID 11472 died... 07:28:56.015396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11472): Terminated: ok {rc=0} 07:28:56.061011 --- ParallelTerminationStrategy: PID 11475 died... 07:28:56.080492 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11475): Terminated: ok {rc=0} 07:28:56.167848 bus /gobi_4: Setting Powered False 07:28:57.267514 bus /gobi_4: Setting Powered False 07:28:58.383558 bus /gobi_1: Setting Powered False 07:28:59.481988 bus /gobi_1: Setting Powered False 07:29:00.597726 bus /gobi_0: Setting Powered False 07:29:01.695246 bus /gobi_0: Setting Powered False 07:29:02.812684 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 07:29:03.914413 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:03.926062 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:29:03.997391 tst ping.py: using LAC 26808 07:29:04.111019 tst ping.py: using RAC 33 07:29:04.224060 tst ping.py: using CellId 26808 07:29:04.337072 tst ping.py: using BVCI 26809 07:29:04.443131 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:04.454100 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:04.464836 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:04.475964 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:04.486889 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:04.497940 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:04.508893 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:04.519816 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:29:04.636503 tst ping.py:19: start network... 07:29:04.846696 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:29:05.328031 run create_hlr_db(pid=11477): Launched 07:29:05.455772 bus /gobi_6: Setting Powered False 07:29:06.518245 run create_hlr_db(pid=11477): Terminated: ok {rc=0} 07:29:06.933735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11479): Launched 07:29:07.222436 run osmo-hlr_10.42.42.2(pid=11480): Launched 07:29:07.332937 run osmo-stp_10.42.42.5: Starting osmo-stp 07:29:07.841435 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11482): Launched 07:29:08.130497 run osmo-stp_10.42.42.5(pid=11483): Launched 07:29:08.241516 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:29:08.739387 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11485): Launched 07:29:08.850247 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:29:09.093523 run patchelf(pid=11486): Launched 07:29:09.254614 run osmo-stp_10.42.42.5(pid=11483): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11483)] 07:29:09.377140 run osmo-stp_10.42.42.5(pid=11483): stdout: | (launched: 2022-12-10_07:29:08.077633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:09.501414 run osmo-stp_10.42.42.5(pid=11483): stderr: | [0;m[38;5;43m20221210072908246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072908246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072908247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072908247 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072908247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072908248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072908248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:09.625491 run osmo-stp_10.42.42.5(pid=11483): stdout: | (launched: 2022-12-10_07:29:08.077633) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:09.743898 run osmo-stp_10.42.42.5(pid=11483): stderr: | [0;m[38;5;43m20221210072908246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072908246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072908247 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072908247 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072908247 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072908248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072908248 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:09.884623 run patchelf(pid=11486): Terminating (SIGINT) 07:29:10.048269 run patchelf(pid=11486): Terminated: ok {rc=0} 07:29:10.166531 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11483): Process ended prematurely: osmo-stp_10.42.42.5(pid=11483) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11483)] [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22] 07:29:10.175033 tst ping.py:22: Test FAILED (6.3 sec) 07:29:10.201951 run osmo-hlr_10.42.42.2(pid=11480): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11480)] 07:29:10.249650 run osmo-hlr_10.42.42.2(pid=11480): stdout: | (launched: 2022-12-10_07:29:07.169589) 07:29:10.298981 run osmo-hlr_10.42.42.2(pid=11480): stderr: | [0;m[1;31m20221210072907341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072907341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072907341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072907341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072907341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072907341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072907358 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072907368 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072907369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072907369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:29:10.348598 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11479): Terminating (SIGTERM) 07:29:10.388428 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11482): Terminating (SIGTERM) 07:29:10.428303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11485): Terminating (SIGTERM) 07:29:10.468412 --- ParallelTerminationStrategy: PID 11479 died... 07:29:10.487507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11479): Terminated: ok {rc=0} 07:29:10.532010 --- ParallelTerminationStrategy: PID 11482 died... 07:29:10.550608 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11482): Terminated: ok {rc=0} 07:29:10.595285 --- ParallelTerminationStrategy: PID 11485 died... 07:29:10.613891 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11485): Terminated: ok {rc=0} 07:29:10.700067 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 07:29:11.787599 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:11.799061 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:29:11.870863 tst ping_idle_ping.py: using LAC 26809 07:29:11.985396 tst ping_idle_ping.py: using RAC 34 07:29:12.101382 tst ping_idle_ping.py: using CellId 26809 07:29:12.216650 tst ping_idle_ping.py: using BVCI 26810 07:29:12.321360 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:12.332128 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:12.342924 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:12.353943 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:12.364739 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:12.376205 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:12.387021 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:29:12.397692 tst gprs:trx-sysmocell5000+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:29:12.512860 tst ping_idle_ping.py:24: start network... 07:29:12.707221 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:29:13.157779 run create_hlr_db(pid=11487): Launched 07:29:13.271973 bus /gobi_6: Setting Powered False 07:29:14.331231 run create_hlr_db(pid=11487): Terminated: ok {rc=0} 07:29:14.736554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11490): Launched 07:29:15.028082 run osmo-hlr_10.42.42.2(pid=11491): Launched 07:29:15.139328 run osmo-stp_10.42.42.5: Starting osmo-stp 07:29:15.636661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11493): Launched 07:29:15.958359 run osmo-stp_10.42.42.5(pid=11494): Launched 07:29:16.292051 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:29:17.032719 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11496): Launched 07:29:17.198714 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:29:17.469052 run patchelf(pid=11497): Launched 07:29:17.631719 run osmo-stp_10.42.42.5(pid=11494): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11494)] 07:29:17.754755 run osmo-stp_10.42.42.5(pid=11494): stdout: | (launched: 2022-12-10_07:29:15.885210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:17.879629 run osmo-stp_10.42.42.5(pid=11494): stderr: | [0;m[38;5;43m20221210072916200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072916200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072916201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072916202 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072916207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072916208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072916208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:18.004541 run osmo-stp_10.42.42.5(pid=11494): stdout: | (launched: 2022-12-10_07:29:15.885210) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:18.123704 run osmo-stp_10.42.42.5(pid=11494): stderr: | [0;m[38;5;43m20221210072916200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072916200 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072916201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072916202 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072916207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072916208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072916208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:18.264901 run patchelf(pid=11497): Terminating (SIGINT) 07:29:18.429857 run patchelf(pid=11497): Terminated: ok {rc=0} 07:29:18.548602 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11494): Process ended prematurely: osmo-stp_10.42.42.5(pid=11494) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11494)] [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 07:29:18.557373 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 07:29:18.584148 run osmo-hlr_10.42.42.2(pid=11491): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11491)] 07:29:18.631218 run osmo-hlr_10.42.42.2(pid=11491): stdout: | (launched: 2022-12-10_07:29:14.975340) 07:29:18.680056 run osmo-hlr_10.42.42.2(pid=11491): stderr: | [0;m[1;31m20221210072915147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072915147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072915147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072915147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072915147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072915147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072915160 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-sysmocell5000+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072915168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072915169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072915169 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:29:18.729594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11490): Terminating (SIGTERM) 07:29:18.769684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11493): Terminating (SIGTERM) 07:29:18.809377 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11496): Terminating (SIGTERM) 07:29:18.849794 --- ParallelTerminationStrategy: PID 11490 died... 07:29:18.868479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11490): Terminated: ok {rc=0} 07:29:18.912472 --- ParallelTerminationStrategy: PID 11493 died... 07:29:18.930807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11493): Terminated: ok {rc=0} 07:29:18.974466 --- ParallelTerminationStrategy: PID 11496 died... 07:29:18.992842 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11496): Terminated: ok {rc=0} 07:29:19.075602 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-sysmocell5000+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:29:20.383869 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:29:20.391283 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:29:20.425903 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 07:29:20.461215 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:29:20.515324 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:29:20.549715 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 07:29:20.584622 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:29:21.141428 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2371 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 07:29:21.146416 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:29:21.157821 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:29:21.239039 tst switch_tch_pdch.py: using LAC 26810 07:29:21.359976 tst switch_tch_pdch.py: using RAC 35 07:29:21.480673 tst switch_tch_pdch.py: using CellId 26810 07:29:21.601195 tst switch_tch_pdch.py: using BVCI 26811 07:29:21.713266 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:29:21.725034 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:29:21.736671 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:29:21.748561 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:29:21.760063 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:29:21.771489 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:29:21.783088 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:29:21.795139 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:29:21.910163 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:29:22.028741 tst switch_tch_pdch.py:51: start network... 07:29:22.237685 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:29:22.716223 run create_hlr_db(pid=11501): Launched 07:29:22.842577 bus /gobi_6: Setting Powered False 07:29:23.905389 run create_hlr_db(pid=11501): Terminated: ok {rc=0} 07:29:24.319288 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11503): Launched 07:29:24.608274 run osmo-hlr_10.42.42.2(pid=11504): Launched 07:29:24.719878 run osmo-stp_10.42.42.5: Starting osmo-stp 07:29:25.231225 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11506): Launched 07:29:25.518972 run osmo-stp_10.42.42.5(pid=11507): Launched 07:29:25.629021 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:29:26.126966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11509): Launched 07:29:26.237648 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:29:26.480506 run patchelf(pid=11510): Launched 07:29:26.641651 run osmo-stp_10.42.42.5(pid=11507): ERR: Terminated: ERROR {rc=1} [trial-2371↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11507)] 07:29:26.764005 run osmo-stp_10.42.42.5(pid=11507): stdout: | (launched: 2022-12-10_07:29:25.466349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:26.888199 run osmo-stp_10.42.42.5(pid=11507): stderr: | [0;m[38;5;43m20221210072925636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072925636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072925637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072925637 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072925638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072925638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072925638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:27.012362 run osmo-stp_10.42.42.5(pid=11507): stdout: | (launched: 2022-12-10_07:29:25.466349) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:27.130818 run osmo-stp_10.42.42.5(pid=11507): stderr: | [0;m[38;5;43m20221210072925636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072925636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072925637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072925637 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072925638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072925638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072925638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:27.270834 run patchelf(pid=11510): Terminating (SIGINT) 07:29:27.434573 run patchelf(pid=11510): Terminated: ok {rc=0} 07:29:27.552258 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11507): Process ended prematurely: osmo-stp_10.42.42.5(pid=11507) [trial-2371↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11507)] [trial-2371↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 07:29:27.561176 tst switch_tch_pdch.py:54: Test FAILED (6.4 sec) 07:29:27.587731 run osmo-hlr_10.42.42.2(pid=11504): ERR: Terminated: ERROR {rc=237} [trial-2371↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11504)] 07:29:27.635246 run osmo-hlr_10.42.42.2(pid=11504): stdout: | (launched: 2022-12-10_07:29:24.555634) 07:29:27.684302 run osmo-hlr_10.42.42.2(pid=11504): stderr: | [0;m[1;31m20221210072924727 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072924727 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072924727 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072924727 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072924727 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072924727 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072924742 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072924750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072924750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072924750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:29:27.733674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11503): Terminating (SIGTERM) 07:29:27.773182 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11506): Terminating (SIGTERM) 07:29:27.812691 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11509): Terminating (SIGTERM) 07:29:27.852497 --- ParallelTerminationStrategy: PID 11503 died... 07:29:27.871241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11503): Terminated: ok {rc=0} 07:29:27.916029 --- ParallelTerminationStrategy: PID 11506 died... 07:29:27.934762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11506): Terminated: ok {rc=0} 07:29:27.978879 --- ParallelTerminationStrategy: PID 11509 died... 07:29:27.997443 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11509): Terminated: ok {rc=0} 07:29:28.084082 bus /gobi_0: Setting Powered False 07:29:29.183871 bus /gobi_0: Setting Powered False 07:29:30.299516 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 07:29:31.561473 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:29:31.571507 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 07:29:31.616746 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 07:29:31.662873 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 07:29:31.726081 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 07:29:31.765781 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 07:29:31.811170 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 07:29:32.350411 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2371 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 07:29:32.355588 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:29:32.366988 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 07:29:32.438469 tst switch_tch_pdch.py: using LAC 26811 07:29:32.561391 tst switch_tch_pdch.py: using RAC 36 07:29:32.682716 tst switch_tch_pdch.py: using CellId 26811 07:29:32.804226 tst switch_tch_pdch.py: using BVCI 26812 07:29:32.919054 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:29:32.930433 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:29:32.941644 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:29:32.952926 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:29:32.964103 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:29:32.975260 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:29:32.986641 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:29:32.998219 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:29:33.112668 tst dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:29:33.226591 tst switch_tch_pdch.py:51: start network... 07:29:33.420318 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:29:33.844013 run create_hlr_db(pid=11514): Launched 07:29:33.956248 bus /gobi_6: Setting Powered False 07:29:35.015641 run create_hlr_db(pid=11514): Terminated: ok {rc=0} 07:29:35.397085 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11516): Launched 07:29:35.687233 run osmo-hlr_10.42.42.2(pid=11517): Launched 07:29:35.798830 run osmo-stp_10.42.42.5: Starting osmo-stp 07:29:36.282669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11519): Launched 07:29:36.571747 run osmo-stp_10.42.42.5(pid=11520): Launched 07:29:36.683296 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:29:37.158062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11522): Launched 07:29:37.269114 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:29:37.513098 run patchelf(pid=11523): Launched 07:29:37.675488 run osmo-stp_10.42.42.5(pid=11520): ERR: Terminated: ERROR {rc=1} [trial-2371↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11520)] 07:29:37.798143 run osmo-stp_10.42.42.5(pid=11520): stdout: | (launched: 2022-12-10_07:29:36.518768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:37.923078 run osmo-stp_10.42.42.5(pid=11520): stderr: | [0;m[38;5;43m20221210072936688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072936688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072936688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072936689 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072936689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072936689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072936689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:38.048080 run osmo-stp_10.42.42.5(pid=11520): stdout: | (launched: 2022-12-10_07:29:36.518768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:38.166876 run osmo-stp_10.42.42.5(pid=11520): stderr: | [0;m[38;5;43m20221210072936688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072936688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072936688 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072936689 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072936689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072936689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072936689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:38.307943 run patchelf(pid=11523): Terminating (SIGINT) 07:29:38.471774 run patchelf(pid=11523): Terminated: ok {rc=0} 07:29:38.590494 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=11520): Process ended prematurely: osmo-stp_10.42.42.5(pid=11520) [trial-2371↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11520)] [trial-2371↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 07:29:38.599441 tst switch_tch_pdch.py:54: Test FAILED (6.2 sec) 07:29:38.626517 run osmo-hlr_10.42.42.2(pid=11517): ERR: Terminated: ERROR {rc=237} [trial-2371↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11517)] 07:29:38.674414 run osmo-hlr_10.42.42.2(pid=11517): stdout: | (launched: 2022-12-10_07:29:35.634490) 07:29:38.723750 run osmo-hlr_10.42.42.2(pid=11517): stderr: | [0;m[1;31m20221210072935809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072935809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072935809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072935809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072935809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072935809 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072935821 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072935829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072935829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072935829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:29:38.773537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11516): Terminating (SIGTERM) 07:29:38.813286 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11519): Terminating (SIGTERM) 07:29:38.853348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11522): Terminating (SIGTERM) 07:29:38.893950 --- ParallelTerminationStrategy: PID 11516 died... 07:29:38.913213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11516): Terminated: ok {rc=0} 07:29:38.957935 --- ParallelTerminationStrategy: PID 11519 died... 07:29:38.976440 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11519): Terminated: ok {rc=0} 07:29:39.021024 --- ParallelTerminationStrategy: PID 11522 died... 07:29:39.039612 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11522): Terminated: ok {rc=0} 07:29:39.123510 bus /gobi_0: Setting Powered False 07:29:40.221633 bus /gobi_0: Setting Powered False 07:29:41.337566 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 nitb_sms:trx-umtrx --------------------------------------------------------------------- 07:29:42.589593 tst nitb_sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:29:42.593341 tst nitb_sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 07:29:42.626223 tst nitb_sms:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 07:29:42.633086 tst nitb_sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 07:29:42.685595 tst nitb_sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 07:29:42.718555 tst nitb_sms:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 07:29:42.725311 tst nitb_sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 07:29:43.260855 tst nitb_sms:trx-umtrx: RESERVED RESOURCES for nitb_sms: bts UmTRX ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 nitb_sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 07:29:43.266046 tst nitb_sms:trx-umtrx: Using 1 x ip_address (candidates: 1) 07:29:43.276696 tst nitb_sms:trx-umtrx: Using 1 x bts (candidates: 1) 07:29:43.323944 tst mo_mt_sms.py: using LAC 26812 07:29:43.436809 tst mo_mt_sms.py: using RAC 37 07:29:43.549770 tst mo_mt_sms.py: using CellId 26812 07:29:43.662607 tst mo_mt_sms.py: using BVCI 26813 07:29:43.766533 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 07:29:43.880067 tst nitb_sms:trx-umtrx: Using 1 x modem (candidates: 2) 07:29:43.996570 tst mo_mt_sms.py:9: start nitb and bts... 07:29:44.206958 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:29:44.840101 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11527): Launched 07:29:45.151421 run osmo-nitb_10.42.42.2(pid=11528): Launched 07:29:45.324130 run osmo-nitb_10.42.42.2(pid=11528): ERR: Terminated: ERROR {rc=2} [trial-2371↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11528)] 07:29:45.463405 run osmo-nitb_10.42.42.2(pid=11528): stdout: | (launched: 2022-12-10_07:29:45.095235) 07:29:45.603768 run osmo-nitb_10.42.42.2(pid=11528): stderr: | (launched: 2022-12-10_07:29:45.141524) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:29:45.744056 run osmo-nitb_10.42.42.2(pid=11528): stdout: | (launched: 2022-12-10_07:29:45.095235) 07:29:45.890144 run osmo-nitb_10.42.42.2(pid=11528): stderr: | (launched: 2022-12-10_07:29:45.141524) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f5483dba268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11528): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11528) [trial-2371↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11528)] 07:29:46.268827 tst osmo-nitb_10.42.42.2(pid=11528): stdout: | (launched: 2022-12-10_07:29:45.095235) 07:29:46.427338 tst osmo-nitb_10.42.42.2(pid=11528): stderr: | (launched: 2022-12-10_07:29:45.141524) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:29:46.617346 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=11528): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11528) [trial-2371↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11528)] [trial-2371↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11] 07:29:46.629386 tst mo_mt_sms.py:11: Test FAILED (3.4 sec) 07:29:46.636683 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11527): Terminating (SIGTERM) 07:29:46.848605 --- ParallelTerminationStrategy: PID 11527 died... 07:29:46.867622 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11527): Terminated: ok {rc=0} 07:29:46.957441 bus /sierra_3: Setting Powered False 07:29:48.057225 bus /sierra_3: Setting Powered False 07:29:49.173181 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 nitb_sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 sms:trx-umtrx --------------------------------------------------------------------- 07:29:50.370306 tst sms:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:29:50.375041 tst sms:trx-umtrx: Verifying 1 x bts (candidates: 11) 07:29:50.408487 tst sms:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 07:29:50.435950 tst sms:trx-umtrx: Verifying 2 x modem (candidates: 12) 07:29:50.490423 tst sms:trx-umtrx: Reserving 1 x bts (candidates: 11) 07:29:50.524818 tst sms:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 07:29:50.551598 tst sms:trx-umtrx: Reserving 2 x modem (candidates: 12) 07:29:51.096315 tst sms:trx-umtrx: RESERVED RESOURCES for sms: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 sms:trx-umtrx mo_mt_sms.py ---------------------------------------------- 07:29:51.102443 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:29:51.113959 tst sms:trx-umtrx: Using 1 x bts (candidates: 1) 07:29:51.162686 tst mo_mt_sms.py: using LAC 26813 07:29:51.286397 tst mo_mt_sms.py: using RAC 38 07:29:51.408012 tst mo_mt_sms.py: using CellId 26813 07:29:51.531752 tst mo_mt_sms.py: using BVCI 26814 07:29:51.643763 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:29:51.654720 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:29:51.665538 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:29:51.676467 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:29:51.687437 tst sms:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:29:51.698409 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 07:29:51.814339 tst sms:trx-umtrx: Using 1 x modem (candidates: 2) 07:29:51.929427 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:29:52.379044 run create_hlr_db(pid=11532): Launched 07:29:52.491572 bus /sierra_2: Setting Powered False 07:29:53.549406 run create_hlr_db(pid=11532): Terminated: ok {rc=0} 07:29:53.953693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11534): Launched 07:29:54.242460 run osmo-hlr_10.42.42.2(pid=11535): Launched 07:29:54.353922 run osmo-stp_10.42.42.5: Starting osmo-stp 07:29:54.851927 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11537): Launched 07:29:55.142783 run osmo-stp_10.42.42.5(pid=11538): Launched 07:29:55.254318 run osmo-msc_10.42.42.6: Starting osmo-msc 07:29:55.778335 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11540): Launched 07:29:56.068015 run osmo-msc_10.42.42.6(pid=11541): Launched 07:29:56.231076 run osmo-stp_10.42.42.5(pid=11538): ERR: Terminated: ERROR {rc=1} [trial-2371↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11538)] 07:29:56.353651 run osmo-stp_10.42.42.5(pid=11538): stdout: | (launched: 2022-12-10_07:29:55.089847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:56.476912 run osmo-stp_10.42.42.5(pid=11538): stderr: | [0;m[38;5;43m20221210072955258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072955258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072955259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072955259 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072955260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072955260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072955260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:56.597379 run osmo-stp_10.42.42.5(pid=11538): stdout: | (launched: 2022-12-10_07:29:55.089847) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:29:56.712202 run osmo-stp_10.42.42.5(pid=11538): stderr: | [0;m[38;5;43m20221210072955258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210072955258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210072955259 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210072955259 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210072955260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210072955260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210072955260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:29:56.850129 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=11538): Process ended prematurely: osmo-stp_10.42.42.5(pid=11538) [trial-2371↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11538)] [trial-2371↪sms:trx-umtrx↪mo_mt_sms.py:16] 07:29:56.858155 tst mo_mt_sms.py:16: Test FAILED (5.7 sec) 07:29:56.884001 run osmo-hlr_10.42.42.2(pid=11535): ERR: Terminated: ERROR {rc=237} [trial-2371↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11535)] 07:29:56.931418 run osmo-hlr_10.42.42.2(pid=11535): stdout: | (launched: 2022-12-10_07:29:54.189607) 07:29:56.980479 run osmo-hlr_10.42.42.2(pid=11535): stderr: | [0;m[1;31m20221210072954363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210072954363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210072954363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210072954363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210072954363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210072954363 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210072954375 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/sms:trx-umtrx/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210072954385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210072954385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210072954385 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:29:57.049246 run osmo-msc_10.42.42.6(pid=11541): ERR: Terminated: ERROR {rc=2} [trial-2371↪sms:trx-umtrx↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11541)] 07:29:57.096699 run osmo-msc_10.42.42.6(pid=11541): stdout: | (launched: 2022-12-10_07:29:56.014865) 07:29:57.145535 run osmo-msc_10.42.42.6(pid=11541): stderr: | [0;m[38;5;43m20221210072956282 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210072956282 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5e06915c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210072956282 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210072956282 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210072956283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210072956283 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210072956284 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210072956285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210072956285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210072956285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:29:57.195049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11534): Terminating (SIGTERM) 07:29:57.234672 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11537): Terminating (SIGTERM) 07:29:57.274107 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11540): Terminating (SIGTERM) 07:29:57.313982 --- ParallelTerminationStrategy: PID 11534 died... 07:29:57.332779 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11534): Terminated: ok {rc=0} 07:29:57.376868 --- ParallelTerminationStrategy: PID 11537 died... 07:29:57.395756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11537): Terminated: ok {rc=0} 07:29:57.439699 --- ParallelTerminationStrategy: PID 11540 died... 07:29:57.458142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11540): Terminated: ok {rc=0} 07:29:57.544019 bus /sierra_3: Setting Powered False 07:29:58.643504 bus /sierra_3: Setting Powered False 07:29:59.755982 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 sms:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 nitb_ussd:trx-umtrx --------------------------------------------------------------------- 07:30:01.006425 tst nitb_ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:30:01.010350 tst nitb_ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 07:30:01.045165 tst nitb_ussd:trx-umtrx: Verifying 1 x ip_address (candidates: 9) 07:30:01.052592 tst nitb_ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 07:30:01.089148 tst nitb_ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 07:30:01.130843 tst nitb_ussd:trx-umtrx: Reserving 1 x ip_address (candidates: 9) 07:30:01.140365 tst nitb_ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 07:30:01.646737 tst nitb_ussd:trx-umtrx: RESERVED RESOURCES for nitb_ussd: bts UmTRX ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2371 nitb_ussd:trx-umtrx assert_extension.py ---------------------------------------------- 07:30:01.655482 tst nitb_ussd:trx-umtrx: Using 1 x ip_address (candidates: 1) 07:30:01.672483 tst nitb_ussd:trx-umtrx: Using 1 x bts (candidates: 1) 07:30:01.739617 tst assert_extension.py: using LAC 26814 07:30:01.895633 tst assert_extension.py: using RAC 39 07:30:02.057516 tst assert_extension.py: using CellId 26814 07:30:02.179825 tst assert_extension.py: using BVCI 26815 07:30:02.319891 tst nitb_ussd:trx-umtrx: Using 1 x modem (candidates: 1) 07:30:02.439780 tst assert_extension.py:10: start nitb and bts... 07:30:02.634688 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:30:03.230213 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11549): Launched 07:30:03.518956 run osmo-nitb_10.42.42.2(pid=11550): Launched 07:30:03.680225 run osmo-nitb_10.42.42.2(pid=11550): ERR: Terminated: ERROR {rc=2} [trial-2371↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11550)] 07:30:03.811046 run osmo-nitb_10.42.42.2(pid=11550): stdout: | (launched: 2022-12-10_07:30:03.466348) 07:30:03.943154 run osmo-nitb_10.42.42.2(pid=11550): stderr: | (launched: 2022-12-10_07:30:03.509327) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:30:04.075166 run osmo-nitb_10.42.42.2(pid=11550): stdout: | (launched: 2022-12-10_07:30:03.466348) 07:30:04.201909 run osmo-nitb_10.42.42.2(pid=11550): stderr: | (launched: 2022-12-10_07:30:03.509327) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f5483dba268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=11550): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11550) [trial-2371↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11550)] 07:30:04.628931 tst osmo-nitb_10.42.42.2(pid=11550): stdout: | (launched: 2022-12-10_07:30:03.466348) 07:30:04.746067 tst osmo-nitb_10.42.42.2(pid=11550): stderr: | (launched: 2022-12-10_07:30:03.509327) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:30:04.884084 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=11550): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11550) [trial-2371↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11550)] [trial-2371↪nitb_ussd:trx-umtrx↪assert_extension.py:12] 07:30:04.892395 tst assert_extension.py:12: Test FAILED (3.2 sec) 07:30:04.898913 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11549): Terminating (SIGTERM) 07:30:05.108197 --- ParallelTerminationStrategy: PID 11549 died... 07:30:05.128764 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=11549): Terminated: ok {rc=0} 07:30:05.215213 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 nitb_ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 ussd:trx-umtrx --------------------------------------------------------------------- 07:30:06.393345 tst ussd:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:30:06.397530 tst ussd:trx-umtrx: Verifying 1 x bts (candidates: 11) 07:30:06.430400 tst ussd:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 07:30:06.456618 tst ussd:trx-umtrx: Verifying 1 x modem (candidates: 12) 07:30:06.489297 tst ussd:trx-umtrx: Reserving 1 x bts (candidates: 11) 07:30:06.521392 tst ussd:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 07:30:06.547519 tst ussd:trx-umtrx: Reserving 1 x modem (candidates: 12) 07:30:07.077811 tst ussd:trx-umtrx: RESERVED RESOURCES for ussd: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2371 ussd:trx-umtrx assert_extension.py ---------------------------------------------- 07:30:07.082886 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:30:07.093498 tst ussd:trx-umtrx: Using 1 x bts (candidates: 1) 07:30:07.142401 tst assert_extension.py: using LAC 26815 07:30:07.263512 tst assert_extension.py: using RAC 40 07:30:07.385343 tst assert_extension.py: using CellId 26815 07:30:07.505951 tst assert_extension.py: using BVCI 26816 07:30:07.618777 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:30:07.629890 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:30:07.640854 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:30:07.651856 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:30:07.662752 tst ussd:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:30:07.674095 tst ussd:trx-umtrx: Using 1 x modem (candidates: 1) 07:30:07.788096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:30:08.237143 run create_hlr_db(pid=11554): Launched 07:30:08.349355 bus /sierra_2: Setting Powered False 07:30:09.407739 run create_hlr_db(pid=11554): Terminated: ok {rc=0} 07:30:09.833473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11556): Launched 07:30:10.145774 run osmo-hlr_10.42.42.2(pid=11557): Launched 07:30:10.265771 run osmo-stp_10.42.42.5: Starting osmo-stp 07:30:10.809870 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11559): Launched 07:30:11.120375 run osmo-stp_10.42.42.5(pid=11560): Launched 07:30:11.239872 run osmo-msc_10.42.42.6: Starting osmo-msc 07:30:11.799744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11562): Launched 07:30:12.109841 run osmo-msc_10.42.42.6(pid=11563): Launched 07:30:12.283282 run osmo-stp_10.42.42.5(pid=11560): ERR: Terminated: ERROR {rc=1} [trial-2371↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11560)] 07:30:12.414581 run osmo-stp_10.42.42.5(pid=11560): stdout: | (launched: 2022-12-10_07:30:11.064072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:12.545917 run osmo-stp_10.42.42.5(pid=11560): stderr: | [0;m[38;5;43m20221210073011254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073011254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073011254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073011255 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073011255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073011255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073011255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:12.676491 run osmo-stp_10.42.42.5(pid=11560): stdout: | (launched: 2022-12-10_07:30:11.064072) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:12.800312 run osmo-stp_10.42.42.5(pid=11560): stderr: | [0;m[38;5;43m20221210073011254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073011254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073011254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073011255 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073011255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073011255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073011255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:12.948550 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=11560): Process ended prematurely: osmo-stp_10.42.42.5(pid=11560) [trial-2371↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11560)] [trial-2371↪ussd:trx-umtrx↪assert_extension.py:17] 07:30:12.957479 tst assert_extension.py:17: Test FAILED (5.9 sec) 07:30:12.984934 run osmo-hlr_10.42.42.2(pid=11557): ERR: Terminated: ERROR {rc=237} [trial-2371↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11557)] 07:30:13.035099 run osmo-hlr_10.42.42.2(pid=11557): stdout: | (launched: 2022-12-10_07:30:10.089347) 07:30:13.086859 run osmo-hlr_10.42.42.2(pid=11557): stderr: | [0;m[1;31m20221210073010287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073010287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073010287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073010287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073010287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073010287 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073010300 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/ussd:trx-umtrx/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073010310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073010310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073010310 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:30:13.159349 run osmo-msc_10.42.42.6(pid=11563): ERR: Terminated: ERROR {rc=2} [trial-2371↪ussd:trx-umtrx↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11563)] 07:30:13.209644 run osmo-msc_10.42.42.6(pid=11563): stdout: | (launched: 2022-12-10_07:30:12.053821) 07:30:13.260804 run osmo-msc_10.42.42.6(pid=11563): stderr: | [0;m[38;5;43m20221210073012373 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073012373 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa764149c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073012373 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073012373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073012373 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073012374 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073012375 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073012376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073012376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073012376 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:30:13.312424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11556): Terminating (SIGTERM) 07:30:13.353885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11559): Terminating (SIGTERM) 07:30:13.395617 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11562): Terminating (SIGTERM) 07:30:13.437609 --- ParallelTerminationStrategy: PID 11556 died... 07:30:13.457342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11556): Terminated: ok {rc=0} 07:30:13.503274 --- ParallelTerminationStrategy: PID 11559 died... 07:30:13.522789 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11559): Terminated: ok {rc=0} 07:30:13.568502 --- ParallelTerminationStrategy: PID 11562 died... 07:30:13.587975 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11562): Terminated: ok {rc=0} 07:30:13.674806 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 ussd:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 07:30:14.883166 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:30:14.889699 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 07:30:14.922909 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 07:30:14.949136 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 07:30:15.002629 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 07:30:15.035793 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 07:30:15.063029 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 07:30:15.609458 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 07:30:15.657819 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:30:15.668705 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:30:15.736633 tst mo_mt_call.py: using LAC 26816 07:30:15.860108 tst mo_mt_call.py: using RAC 41 07:30:15.998848 tst mo_mt_call.py: using CellId 26816 07:30:16.127126 tst mo_mt_call.py: using BVCI 26817 07:30:16.237383 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:30:16.249444 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:30:16.261397 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:30:16.274057 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:30:16.287120 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:30:16.300499 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:30:16.436917 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:30:16.578976 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:30:17.141089 run create_hlr_db(pid=11568): Launched 07:30:17.303894 bus /sierra_2: Setting Powered False 07:30:18.367062 run create_hlr_db(pid=11568): Terminated: ok {rc=0} 07:30:18.790006 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11570): Launched 07:30:19.084792 run osmo-hlr_10.42.42.2(pid=11571): Launched 07:30:19.197884 run osmo-stp_10.42.42.5: Starting osmo-stp 07:30:19.715135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11573): Launched 07:30:20.010821 run osmo-stp_10.42.42.5(pid=11574): Launched 07:30:20.123949 run osmo-msc_10.42.42.6: Starting osmo-msc 07:30:20.659432 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11576): Launched 07:30:20.954941 run osmo-msc_10.42.42.6(pid=11577): Launched 07:30:21.120407 run osmo-stp_10.42.42.5(pid=11574): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11574)] 07:30:21.245917 run osmo-stp_10.42.42.5(pid=11574): stdout: | (launched: 2022-12-10_07:30:19.957319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:21.371403 run osmo-stp_10.42.42.5(pid=11574): stderr: | [0;m[38;5;43m20221210073020124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073020125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073020125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073020125 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073020126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073020126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073020126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:21.494074 run osmo-stp_10.42.42.5(pid=11574): stdout: | (launched: 2022-12-10_07:30:19.957319) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:21.611892 run osmo-stp_10.42.42.5(pid=11574): stderr: | [0;m[38;5;43m20221210073020124 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073020125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073020125 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073020125 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073020126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073020126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073020126 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:21.752472 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11574): Process ended prematurely: osmo-stp_10.42.42.5(pid=11574) [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11574)] [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:30:21.761407 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:30:21.787823 run osmo-hlr_10.42.42.2(pid=11571): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11571)] 07:30:21.835661 run osmo-hlr_10.42.42.2(pid=11571): stdout: | (launched: 2022-12-10_07:30:19.031275) 07:30:21.885180 run osmo-hlr_10.42.42.2(pid=11571): stderr: | [0;m[1;31m20221210073019207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073019207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073019207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073019207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073019207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073019207 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073019219 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073019228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073019228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073019228 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:30:21.953696 run osmo-msc_10.42.42.6(pid=11577): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11577)] 07:30:22.001833 run osmo-msc_10.42.42.6(pid=11577): stdout: | (launched: 2022-12-10_07:30:20.900818) 07:30:22.051164 run osmo-msc_10.42.42.6(pid=11577): stderr: | [0;m[38;5;43m20221210073021171 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073021171 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f470ac21c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073021171 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073021171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073021171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073021171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073021173 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073021174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073021174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073021174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:30:22.100784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11570): Terminating (SIGTERM) 07:30:22.140353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11573): Terminating (SIGTERM) 07:30:22.179793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11576): Terminating (SIGTERM) 07:30:22.219905 --- ParallelTerminationStrategy: PID 11570 died... 07:30:22.238868 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11570): Terminated: ok {rc=0} 07:30:22.283348 --- ParallelTerminationStrategy: PID 11573 died... 07:30:22.301868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11573): Terminated: ok {rc=0} 07:30:22.346016 --- ParallelTerminationStrategy: PID 11576 died... 07:30:22.364461 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11576): Terminated: ok {rc=0} 07:30:22.450351 bus /sierra_3: Setting Powered False 07:30:23.549915 bus /sierra_3: Setting Powered False 07:30:24.664305 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:30:25.809309 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:30:25.820794 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:30:25.893449 tst mo_mt_call_osmux.py: using LAC 26817 07:30:26.009318 tst mo_mt_call_osmux.py: using RAC 42 07:30:26.123465 tst mo_mt_call_osmux.py: using CellId 26817 07:30:26.240565 tst mo_mt_call_osmux.py: using BVCI 26818 07:30:26.348893 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:30:26.359885 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:30:26.370665 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:30:26.381932 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:30:26.392914 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:30:26.403903 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:30:26.520720 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:30:26.640719 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:30:27.129281 run create_hlr_db(pid=11579): Launched 07:30:27.258333 bus /sierra_2: Setting Powered False 07:30:28.320714 run create_hlr_db(pid=11579): Terminated: ok {rc=0} 07:30:28.758992 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11581): Launched 07:30:29.075053 run osmo-hlr_10.42.42.2(pid=11582): Launched 07:30:29.195820 run osmo-stp_10.42.42.5: Starting osmo-stp 07:30:29.741335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11584): Launched 07:30:30.058389 run osmo-stp_10.42.42.5(pid=11585): Launched 07:30:30.179748 run osmo-msc_10.42.42.6: Starting osmo-msc 07:30:30.750430 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11587): Launched 07:30:31.074769 run osmo-msc_10.42.42.6(pid=11588): Launched 07:30:31.440663 run osmo-stp_10.42.42.5(pid=11585): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11585)] 07:30:31.778452 run osmo-stp_10.42.42.5(pid=11585): stdout: | (launched: 2022-12-10_07:30:30.000341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:32.127856 run osmo-stp_10.42.42.5(pid=11585): stderr: | [0;m[38;5;43m20221210073030191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073030191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073030192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073030192 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073030192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073030193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073030193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:32.394679 run osmo-stp_10.42.42.5(pid=11585): stdout: | (launched: 2022-12-10_07:30:30.000341) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:32.512586 run osmo-stp_10.42.42.5(pid=11585): stderr: | [0;m[38;5;43m20221210073030191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073030191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073030192 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073030192 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073030192 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073030193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073030193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:32.653624 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11585): Process ended prematurely: osmo-stp_10.42.42.5(pid=11585) [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11585)] [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:30:32.662927 tst mo_mt_call_osmux.py:8: Test FAILED (6.9 sec) 07:30:32.689827 run osmo-hlr_10.42.42.2(pid=11582): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11582)] 07:30:32.737788 run osmo-hlr_10.42.42.2(pid=11582): stdout: | (launched: 2022-12-10_07:30:29.018154) 07:30:32.787458 run osmo-hlr_10.42.42.2(pid=11582): stderr: | [0;m[1;31m20221210073029216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073029216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073029216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073029216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073029216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073029216 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073029231 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073029239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073029239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073029239 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:30:32.856366 run osmo-msc_10.42.42.6(pid=11588): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11588)] 07:30:32.904510 run osmo-msc_10.42.42.6(pid=11588): stdout: | (launched: 2022-12-10_07:30:31.012830) 07:30:32.954115 run osmo-msc_10.42.42.6(pid=11588): stderr: | [0;m[38;5;43m20221210073031862 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073031862 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0214fadc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073031862 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073031862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073031862 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073031863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073031864 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073031865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073031865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073031865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:30:33.003660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11581): Terminating (SIGTERM) 07:30:33.043230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11584): Terminating (SIGTERM) 07:30:33.083406 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11587): Terminating (SIGTERM) 07:30:33.123651 --- ParallelTerminationStrategy: PID 11581 died... 07:30:33.142862 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11581): Terminated: ok {rc=0} 07:30:33.187587 --- ParallelTerminationStrategy: PID 11584 died... 07:30:33.206280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11584): Terminated: ok {rc=0} 07:30:33.250374 --- ParallelTerminationStrategy: PID 11587 died... 07:30:33.269025 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11587): Terminated: ok {rc=0} 07:30:33.353338 bus /sierra_3: Setting Powered False 07:30:34.451291 bus /sierra_3: Setting Powered False 07:30:35.566784 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:30:36.810238 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:30:36.818393 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:30:36.851340 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:30:36.878312 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:30:36.931320 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:30:36.963540 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:30:36.989938 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:30:37.542561 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:30:37.593309 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:30:37.604738 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:30:37.674911 tst mo_mt_call.py: using LAC 26818 07:30:37.800892 tst mo_mt_call.py: using RAC 43 07:30:37.926076 tst mo_mt_call.py: using CellId 26818 07:30:38.050724 tst mo_mt_call.py: using BVCI 26819 07:30:38.164846 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:30:38.176376 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:30:38.187698 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:30:38.199067 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:30:38.210496 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:30:38.221881 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:30:38.338436 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:30:38.452417 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:30:38.910762 run create_hlr_db(pid=11593): Launched 07:30:39.025468 bus /sierra_2: Setting Powered False 07:30:40.084427 run create_hlr_db(pid=11593): Terminated: ok {rc=0} 07:30:40.516069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11595): Launched 07:30:40.831061 run osmo-hlr_10.42.42.2(pid=11596): Launched 07:30:40.952610 run osmo-stp_10.42.42.5: Starting osmo-stp 07:30:41.494357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11598): Launched 07:30:41.810456 run osmo-stp_10.42.42.5(pid=11599): Launched 07:30:41.932161 run osmo-msc_10.42.42.6: Starting osmo-msc 07:30:42.505037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11601): Launched 07:30:42.820493 run osmo-msc_10.42.42.6(pid=11602): Launched 07:30:42.998455 run osmo-stp_10.42.42.5(pid=11599): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11599)] 07:30:43.131444 run osmo-stp_10.42.42.5(pid=11599): stdout: | (launched: 2022-12-10_07:30:41.753378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:43.265338 run osmo-stp_10.42.42.5(pid=11599): stderr: | [0;m[38;5;43m20221210073041941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073041942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073041942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073041942 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073041945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073041945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073041945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:43.397968 run osmo-stp_10.42.42.5(pid=11599): stdout: | (launched: 2022-12-10_07:30:41.753378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:43.524136 run osmo-stp_10.42.42.5(pid=11599): stderr: | [0;m[38;5;43m20221210073041941 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073041942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073041942 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073041942 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073041945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073041945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073041945 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:43.674823 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11599): Process ended prematurely: osmo-stp_10.42.42.5(pid=11599) [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11599)] [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:30:43.683956 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:30:43.711544 run osmo-hlr_10.42.42.2(pid=11596): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11596)] 07:30:43.761328 run osmo-hlr_10.42.42.2(pid=11596): stdout: | (launched: 2022-12-10_07:30:40.774293) 07:30:43.812941 run osmo-hlr_10.42.42.2(pid=11596): stderr: | [0;m[1;31m20221210073040971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073040971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073040971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073040971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073040971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073040971 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073040983 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073040994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073040994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073040995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:30:43.884809 run osmo-msc_10.42.42.6(pid=11602): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11602)] 07:30:43.934475 run osmo-msc_10.42.42.6(pid=11602): stdout: | (launched: 2022-12-10_07:30:42.763453) 07:30:43.985912 run osmo-msc_10.42.42.6(pid=11602): stderr: | [0;m[38;5;43m20221210073043083 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073043083 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f773c11dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073043083 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073043083 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073043084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073043084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073043085 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073043086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073043086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073043086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:30:44.037723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11595): Terminating (SIGTERM) 07:30:44.079224 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11598): Terminating (SIGTERM) 07:30:44.120669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11601): Terminating (SIGTERM) 07:30:44.162521 --- ParallelTerminationStrategy: PID 11595 died... 07:30:44.182060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11595): Terminated: ok {rc=0} 07:30:44.228164 --- ParallelTerminationStrategy: PID 11598 died... 07:30:44.247778 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11598): Terminated: ok {rc=0} 07:30:44.293780 --- ParallelTerminationStrategy: PID 11601 died... 07:30:44.313443 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11601): Terminated: ok {rc=0} 07:30:44.401656 bus /sierra_3: Setting Powered False 07:30:45.500771 bus /sierra_3: Setting Powered False 07:30:46.621398 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:30:47.779375 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:30:47.791138 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:30:47.864590 tst mo_mt_call_osmux.py: using LAC 26819 07:30:47.982156 tst mo_mt_call_osmux.py: using RAC 44 07:30:48.098669 tst mo_mt_call_osmux.py: using CellId 26819 07:30:48.216191 tst mo_mt_call_osmux.py: using BVCI 26820 07:30:48.323643 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:30:48.334843 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:30:48.345644 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:30:48.356881 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:30:48.368106 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:30:48.379291 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:30:48.492270 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:30:48.614556 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:30:49.107303 run create_hlr_db(pid=11604): Launched 07:30:49.236185 bus /sierra_2: Setting Powered False 07:30:50.299271 run create_hlr_db(pid=11604): Terminated: ok {rc=0} 07:30:50.722156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11606): Launched 07:30:51.016742 run osmo-hlr_10.42.42.2(pid=11607): Launched 07:30:51.130037 run osmo-stp_10.42.42.5: Starting osmo-stp 07:30:51.653069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11609): Launched 07:30:51.948248 run osmo-stp_10.42.42.5(pid=11610): Launched 07:30:52.061382 run osmo-msc_10.42.42.6: Starting osmo-msc 07:30:52.595173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11612): Launched 07:30:52.890116 run osmo-msc_10.42.42.6(pid=11613): Launched 07:30:53.055158 run osmo-stp_10.42.42.5(pid=11610): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11610)] 07:30:53.179941 run osmo-stp_10.42.42.5(pid=11610): stdout: | (launched: 2022-12-10_07:30:51.894816) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:53.305210 run osmo-stp_10.42.42.5(pid=11610): stderr: | [0;m[38;5;43m20221210073052062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073052062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073052062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073052062 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073052065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073052065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073052065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:53.428024 run osmo-stp_10.42.42.5(pid=11610): stdout: | (launched: 2022-12-10_07:30:51.894816) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:30:53.546065 run osmo-stp_10.42.42.5(pid=11610): stderr: | [0;m[38;5;43m20221210073052062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073052062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073052062 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073052062 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073052065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073052065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073052065 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:30:53.686514 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11610): Process ended prematurely: osmo-stp_10.42.42.5(pid=11610) [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11610)] [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:30:53.695232 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 07:30:53.721669 run osmo-hlr_10.42.42.2(pid=11607): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11607)] 07:30:53.769546 run osmo-hlr_10.42.42.2(pid=11607): stdout: | (launched: 2022-12-10_07:30:50.963329) 07:30:53.818763 run osmo-hlr_10.42.42.2(pid=11607): stderr: | [0;m[1;31m20221210073051138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073051138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073051138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073051138 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073051139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073051139 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073051151 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073051162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073051162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073051162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:30:53.887380 run osmo-msc_10.42.42.6(pid=11613): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11613)] 07:30:53.934896 run osmo-msc_10.42.42.6(pid=11613): stdout: | (launched: 2022-12-10_07:30:52.836197) 07:30:53.984144 run osmo-msc_10.42.42.6(pid=11613): stderr: | [0;m[38;5;43m20221210073053108 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073053108 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdcefd5cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073053108 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073053108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073053108 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073053109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073053111 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073053111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073053111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073053111 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:30:54.033396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11606): Terminating (SIGTERM) 07:30:54.073333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11609): Terminating (SIGTERM) 07:30:54.113121 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11612): Terminating (SIGTERM) 07:30:54.153128 --- ParallelTerminationStrategy: PID 11606 died... 07:30:54.172062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11606): Terminated: ok {rc=0} 07:30:54.217061 --- ParallelTerminationStrategy: PID 11609 died... 07:30:54.235629 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11609): Terminated: ok {rc=0} 07:30:54.279626 --- ParallelTerminationStrategy: PID 11612 died... 07:30:54.298240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11612): Terminated: ok {rc=0} 07:30:54.383742 bus /sierra_3: Setting Powered False 07:30:55.481596 bus /sierra_3: Setting Powered False 07:30:56.597715 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:30:57.843663 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:30:57.849824 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:30:57.882372 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:30:57.908692 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:30:57.959526 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:30:57.991341 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:30:58.017567 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:30:58.568111 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:30:58.621068 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:30:58.632547 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:30:58.703082 tst mo_mt_call.py: using LAC 26820 07:30:58.827544 tst mo_mt_call.py: using RAC 45 07:30:58.958094 tst mo_mt_call.py: using CellId 26820 07:30:59.074274 tst mo_mt_call.py: using BVCI 26821 07:30:59.182674 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:30:59.193859 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:30:59.204490 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:30:59.215534 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:30:59.226656 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:30:59.237509 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:30:59.355168 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:30:59.470245 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:30:59.928337 run create_hlr_db(pid=11618): Launched 07:31:00.040778 bus /sierra_2: Setting Powered False 07:31:01.102632 run create_hlr_db(pid=11618): Terminated: ok {rc=0} 07:31:01.558373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11620): Launched 07:31:01.904432 run osmo-hlr_10.42.42.2(pid=11621): Launched 07:31:02.141282 run osmo-stp_10.42.42.5: Starting osmo-stp 07:31:02.708742 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11623): Launched 07:31:03.026545 run osmo-stp_10.42.42.5(pid=11624): Launched 07:31:03.147730 run osmo-msc_10.42.42.6: Starting osmo-msc 07:31:03.722146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11626): Launched 07:31:04.040434 run osmo-msc_10.42.42.6(pid=11627): Launched 07:31:04.218276 run osmo-stp_10.42.42.5(pid=11624): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11624)] 07:31:04.352027 run osmo-stp_10.42.42.5(pid=11624): stdout: | (launched: 2022-12-10_07:31:02.969284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:04.486541 run osmo-stp_10.42.42.5(pid=11624): stderr: | [0;m[38;5;43m20221210073103160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073103160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073103161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073103161 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073103162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073103162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073103162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:04.620469 run osmo-stp_10.42.42.5(pid=11624): stdout: | (launched: 2022-12-10_07:31:02.969284) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:04.747596 run osmo-stp_10.42.42.5(pid=11624): stderr: | [0;m[38;5;43m20221210073103160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073103160 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073103161 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073103161 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073103162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073103162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073103162 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:04.899396 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11624): Process ended prematurely: osmo-stp_10.42.42.5(pid=11624) [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11624)] [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:31:04.909137 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 07:31:04.937071 run osmo-hlr_10.42.42.2(pid=11621): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11621)] 07:31:04.987620 run osmo-hlr_10.42.42.2(pid=11621): stdout: | (launched: 2022-12-10_07:31:01.837878) 07:31:05.039799 run osmo-hlr_10.42.42.2(pid=11621): stderr: | [0;m[1;31m20221210073102085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073102085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073102085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073102085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073102085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073102085 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073102111 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073102120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073102120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073102120 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:31:05.112081 run osmo-msc_10.42.42.6(pid=11627): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11627)] 07:31:05.162216 run osmo-msc_10.42.42.6(pid=11627): stdout: | (launched: 2022-12-10_07:31:03.982780) 07:31:05.213833 run osmo-msc_10.42.42.6(pid=11627): stderr: | [0;m[38;5;43m20221210073104305 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073104305 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7feceb099c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073104306 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073104306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073104306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073104306 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073104308 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073104308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073104308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073104308 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:31:05.265710 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11620): Terminating (SIGTERM) 07:31:05.307491 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11623): Terminating (SIGTERM) 07:31:05.349366 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11626): Terminating (SIGTERM) 07:31:05.391735 --- ParallelTerminationStrategy: PID 11620 died... 07:31:05.411908 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11620): Terminated: ok {rc=0} 07:31:05.458393 --- ParallelTerminationStrategy: PID 11623 died... 07:31:05.478134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11623): Terminated: ok {rc=0} 07:31:05.524364 --- ParallelTerminationStrategy: PID 11626 died... 07:31:05.544149 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11626): Terminated: ok {rc=0} 07:31:05.633689 bus /sierra_3: Setting Powered False 07:31:06.730659 bus /sierra_3: Setting Powered False 07:31:07.843005 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:31:08.984655 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:31:08.996202 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:31:09.065258 tst mo_mt_call_osmux.py: using LAC 26821 07:31:09.181230 tst mo_mt_call_osmux.py: using RAC 46 07:31:09.298906 tst mo_mt_call_osmux.py: using CellId 26821 07:31:09.417245 tst mo_mt_call_osmux.py: using BVCI 26822 07:31:09.523765 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:31:09.534832 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:31:09.545706 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:31:09.556617 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:31:09.568070 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:31:09.579162 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:31:09.698700 tst voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:31:09.818682 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:31:10.308830 run create_hlr_db(pid=11630): Launched 07:31:10.439175 bus /sierra_2: Setting Powered False 07:31:11.502569 run create_hlr_db(pid=11630): Terminated: ok {rc=0} 07:31:11.925608 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11632): Launched 07:31:12.220658 run osmo-hlr_10.42.42.2(pid=11633): Launched 07:31:12.333558 run osmo-stp_10.42.42.5: Starting osmo-stp 07:31:12.841892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11635): Launched 07:31:13.136938 run osmo-stp_10.42.42.5(pid=11636): Launched 07:31:13.249750 run osmo-msc_10.42.42.6: Starting osmo-msc 07:31:13.784235 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11638): Launched 07:31:14.079548 run osmo-msc_10.42.42.6(pid=11639): Launched 07:31:14.245236 run osmo-stp_10.42.42.5(pid=11636): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11636)] 07:31:14.369986 run osmo-stp_10.42.42.5(pid=11636): stdout: | (launched: 2022-12-10_07:31:13.083172) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:14.494883 run osmo-stp_10.42.42.5(pid=11636): stderr: | [0;m[38;5;43m20221210073113250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073113250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073113250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073113251 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073113253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073113253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073113253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:14.617545 run osmo-stp_10.42.42.5(pid=11636): stdout: | (launched: 2022-12-10_07:31:13.083172) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:14.734411 run osmo-stp_10.42.42.5(pid=11636): stderr: | [0;m[38;5;43m20221210073113250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073113250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073113250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073113251 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073113253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073113253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073113253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:14.875247 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11636): Process ended prematurely: osmo-stp_10.42.42.5(pid=11636) [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11636)] [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:31:14.883891 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 07:31:14.910387 run osmo-hlr_10.42.42.2(pid=11633): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11633)] 07:31:14.957553 run osmo-hlr_10.42.42.2(pid=11633): stdout: | (launched: 2022-12-10_07:31:12.166985) 07:31:15.006420 run osmo-hlr_10.42.42.2(pid=11633): stderr: | [0;m[1;31m20221210073112341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073112341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073112341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073112341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073112341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073112341 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073112354 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073112365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073112365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073112365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:31:15.075346 run osmo-msc_10.42.42.6(pid=11639): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11639)] 07:31:15.122607 run osmo-msc_10.42.42.6(pid=11639): stdout: | (launched: 2022-12-10_07:31:14.025697) 07:31:15.171305 run osmo-msc_10.42.42.6(pid=11639): stderr: | [0;m[38;5;43m20221210073114294 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073114294 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc2435e7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073114295 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073114295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073114295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073114295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073114297 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073114298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073114298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073114298 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:31:15.220207 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11632): Terminating (SIGTERM) 07:31:15.259279 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11635): Terminating (SIGTERM) 07:31:15.298656 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11638): Terminating (SIGTERM) 07:31:15.338301 --- ParallelTerminationStrategy: PID 11632 died... 07:31:15.357258 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11632): Terminated: ok {rc=0} 07:31:15.401261 --- ParallelTerminationStrategy: PID 11635 died... 07:31:15.419689 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11635): Terminated: ok {rc=0} 07:31:15.463394 --- ParallelTerminationStrategy: PID 11638 died... 07:31:15.481780 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11638): Terminated: ok {rc=0} 07:31:15.564712 bus /sierra_3: Setting Powered False 07:31:16.668130 bus /sierra_3: Setting Powered False 07:31:17.802272 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 07:31:19.049159 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:31:19.055752 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 07:31:19.089402 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 07:31:19.115904 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 07:31:19.167925 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 07:31:19.201239 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 07:31:19.228431 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 07:31:19.775025 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 07:31:19.823269 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:31:19.834490 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:31:19.902015 tst mo_mt_call.py: using LAC 26822 07:31:20.020646 tst mo_mt_call.py: using RAC 47 07:31:20.137096 tst mo_mt_call.py: using CellId 26822 07:31:20.253068 tst mo_mt_call.py: using BVCI 26823 07:31:20.359911 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:31:20.370835 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:31:20.381748 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:31:20.392580 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:31:20.403674 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:31:20.414699 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:31:20.532595 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:31:20.655367 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:31:21.112828 run create_hlr_db(pid=11645): Launched 07:31:21.225707 bus /sierra_2: Setting Powered False 07:31:22.284765 run create_hlr_db(pid=11645): Terminated: ok {rc=0} 07:31:22.695886 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11647): Launched 07:31:22.991891 run osmo-hlr_10.42.42.2(pid=11648): Launched 07:31:23.114603 run osmo-stp_10.42.42.5: Starting osmo-stp 07:31:23.661326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11650): Launched 07:31:23.979522 run osmo-stp_10.42.42.5(pid=11651): Launched 07:31:24.100349 run osmo-msc_10.42.42.6: Starting osmo-msc 07:31:24.672361 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11653): Launched 07:31:24.990214 run osmo-msc_10.42.42.6(pid=11654): Launched 07:31:25.167555 run osmo-stp_10.42.42.5(pid=11651): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11651)] 07:31:25.302083 run osmo-stp_10.42.42.5(pid=11651): stdout: | (launched: 2022-12-10_07:31:23.921869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:25.436890 run osmo-stp_10.42.42.5(pid=11651): stderr: | [0;m[38;5;43m20221210073124113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073124113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073124113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073124114 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073124116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073124116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073124116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:25.570010 run osmo-stp_10.42.42.5(pid=11651): stdout: | (launched: 2022-12-10_07:31:23.921869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:25.696716 run osmo-stp_10.42.42.5(pid=11651): stderr: | [0;m[38;5;43m20221210073124113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073124113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073124113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073124114 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073124116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073124116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073124116 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:25.848495 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11651): Process ended prematurely: osmo-stp_10.42.42.5(pid=11651) [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11651)] [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 07:31:25.858128 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:31:25.886100 run osmo-hlr_10.42.42.2(pid=11648): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11648)] 07:31:25.936227 run osmo-hlr_10.42.42.2(pid=11648): stdout: | (launched: 2022-12-10_07:31:22.937502) 07:31:25.988038 run osmo-hlr_10.42.42.2(pid=11648): stderr: | [0;m[1;31m20221210073123127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073123127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073123127 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073123128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073123128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073123128 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073123140 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073123148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073123148 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073123149 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:31:26.060058 run osmo-msc_10.42.42.6(pid=11654): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11654)] 07:31:26.109789 run osmo-msc_10.42.42.6(pid=11654): stdout: | (launched: 2022-12-10_07:31:24.932253) 07:31:26.160897 run osmo-msc_10.42.42.6(pid=11654): stderr: | [0;m[38;5;43m20221210073125253 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073125253 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f218e84bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073125253 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073125253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073125253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073125254 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073125255 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073125256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073125256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073125256 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:31:26.212375 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11647): Terminating (SIGTERM) 07:31:26.253634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11650): Terminating (SIGTERM) 07:31:26.295089 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11653): Terminating (SIGTERM) 07:31:26.336803 --- ParallelTerminationStrategy: PID 11647 died... 07:31:26.356895 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11647): Terminated: ok {rc=0} 07:31:26.403369 --- ParallelTerminationStrategy: PID 11650 died... 07:31:26.423127 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11650): Terminated: ok {rc=0} 07:31:26.469329 --- ParallelTerminationStrategy: PID 11653 died... 07:31:26.488992 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11653): Terminated: ok {rc=0} 07:31:26.575697 bus /sierra_3: Setting Powered False 07:31:27.673268 bus /sierra_3: Setting Powered False 07:31:28.787292 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 07:31:29.934157 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:31:29.946390 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:31:30.018130 tst mo_mt_call_osmux.py: using LAC 26823 07:31:30.149132 tst mo_mt_call_osmux.py: using RAC 48 07:31:30.273784 tst mo_mt_call_osmux.py: using CellId 26823 07:31:30.396490 tst mo_mt_call_osmux.py: using BVCI 26824 07:31:30.511443 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:31:30.523073 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:31:30.534417 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:31:30.545823 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:31:30.557354 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:31:30.568939 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:31:30.684166 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:31:30.804196 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:31:31.306378 run create_hlr_db(pid=11656): Launched 07:31:31.467168 bus /sierra_2: Setting Powered False 07:31:32.529673 run create_hlr_db(pid=11656): Terminated: ok {rc=0} 07:31:32.971102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11658): Launched 07:31:33.287560 run osmo-hlr_10.42.42.2(pid=11659): Launched 07:31:33.408524 run osmo-stp_10.42.42.5: Starting osmo-stp 07:31:33.953215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11661): Launched 07:31:34.269703 run osmo-stp_10.42.42.5(pid=11662): Launched 07:31:34.390162 run osmo-msc_10.42.42.6: Starting osmo-msc 07:31:34.959540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11664): Launched 07:31:35.275660 run osmo-msc_10.42.42.6(pid=11665): Launched 07:31:35.451996 run osmo-stp_10.42.42.5(pid=11662): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11662)] 07:31:35.585369 run osmo-stp_10.42.42.5(pid=11662): stdout: | (launched: 2022-12-10_07:31:34.212432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:35.718998 run osmo-stp_10.42.42.5(pid=11662): stderr: | [0;m[38;5;43m20221210073134403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073134404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073134404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073134405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073134405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073134405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073134405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:35.852326 run osmo-stp_10.42.42.5(pid=11662): stdout: | (launched: 2022-12-10_07:31:34.212432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:35.978768 run osmo-stp_10.42.42.5(pid=11662): stderr: | [0;m[38;5;43m20221210073134403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073134404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073134404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073134405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073134405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073134405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073134405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:36.130248 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11662): Process ended prematurely: osmo-stp_10.42.42.5(pid=11662) [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11662)] [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 07:31:36.139801 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:31:36.167960 run osmo-hlr_10.42.42.2(pid=11659): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11659)] 07:31:36.217879 run osmo-hlr_10.42.42.2(pid=11659): stdout: | (launched: 2022-12-10_07:31:33.230312) 07:31:36.269410 run osmo-hlr_10.42.42.2(pid=11659): stderr: | [0;m[1;31m20221210073133429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073133429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073133429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073133429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073133429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073133429 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073133446 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073133455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073133455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073133455 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:31:36.341100 run osmo-msc_10.42.42.6(pid=11665): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11665)] 07:31:36.390638 run osmo-msc_10.42.42.6(pid=11665): stdout: | (launched: 2022-12-10_07:31:35.218532) 07:31:36.441810 run osmo-msc_10.42.42.6(pid=11665): stderr: | [0;m[38;5;43m20221210073135540 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073135540 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f45d9325c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073135541 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073135541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073135541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073135541 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073135543 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073135543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073135543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073135543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:31:36.493251 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11658): Terminating (SIGTERM) 07:31:36.534576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11661): Terminating (SIGTERM) 07:31:36.576012 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11664): Terminating (SIGTERM) 07:31:36.618004 --- ParallelTerminationStrategy: PID 11658 died... 07:31:36.638855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11658): Terminated: ok {rc=0} 07:31:36.684898 --- ParallelTerminationStrategy: PID 11661 died... 07:31:36.704549 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11661): Terminated: ok {rc=0} 07:31:36.750547 --- ParallelTerminationStrategy: PID 11664 died... 07:31:36.770203 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11664): Terminated: ok {rc=0} 07:31:36.856812 bus /sierra_3: Setting Powered False 07:31:37.954378 bus /sierra_3: Setting Powered False 07:31:39.070990 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:31:40.319231 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:31:40.325880 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:31:40.358850 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:31:40.385060 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:31:40.437427 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:31:40.470334 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:31:40.496574 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:31:41.045623 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:31:41.098242 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:31:41.109915 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:31:41.180315 tst mo_mt_call.py: using LAC 26824 07:31:41.304624 tst mo_mt_call.py: using RAC 49 07:31:41.432637 tst mo_mt_call.py: using CellId 26824 07:31:41.556607 tst mo_mt_call.py: using BVCI 26825 07:31:41.672746 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:31:41.684200 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:31:41.695439 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:31:41.706865 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:31:41.718420 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:31:41.729856 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:31:41.846646 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:31:41.966609 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:31:42.457487 run create_hlr_db(pid=11670): Launched 07:31:42.587082 bus /sierra_2: Setting Powered False 07:31:43.647554 run create_hlr_db(pid=11670): Terminated: ok {rc=0} 07:31:44.086372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11672): Launched 07:31:44.402788 run osmo-hlr_10.42.42.2(pid=11673): Launched 07:31:44.524638 run osmo-stp_10.42.42.5: Starting osmo-stp 07:31:45.067902 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11675): Launched 07:31:45.384102 run osmo-stp_10.42.42.5(pid=11676): Launched 07:31:45.504884 run osmo-msc_10.42.42.6: Starting osmo-msc 07:31:46.079282 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11678): Launched 07:31:46.407548 run osmo-msc_10.42.42.6(pid=11679): Launched 07:31:46.604038 run osmo-stp_10.42.42.5(pid=11676): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11676)] 07:31:46.884898 run osmo-stp_10.42.42.5(pid=11676): stdout: | (launched: 2022-12-10_07:31:45.326951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:47.270113 run osmo-stp_10.42.42.5(pid=11676): stderr: | [0;m[38;5;43m20221210073145496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073145496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073145496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073145497 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073145499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073145499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073145499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:47.427044 run osmo-stp_10.42.42.5(pid=11676): stdout: | (launched: 2022-12-10_07:31:45.326951) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:47.547339 run osmo-stp_10.42.42.5(pid=11676): stderr: | [0;m[38;5;43m20221210073145496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073145496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073145496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073145497 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073145499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073145499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073145499 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:47.689212 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11676): Process ended prematurely: osmo-stp_10.42.42.5(pid=11676) [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11676)] [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:31:47.698216 tst mo_mt_call.py:8: Test FAILED (6.6 sec) 07:31:47.725415 run osmo-hlr_10.42.42.2(pid=11673): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11673)] 07:31:47.774193 run osmo-hlr_10.42.42.2(pid=11673): stdout: | (launched: 2022-12-10_07:31:44.345636) 07:31:47.824381 run osmo-hlr_10.42.42.2(pid=11673): stderr: | [0;m[1;31m20221210073144541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073144541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073144541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073144541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073144541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073144541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073144554 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073144562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073144562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073144562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:31:47.893981 run osmo-msc_10.42.42.6(pid=11679): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11679)] 07:31:47.942625 run osmo-msc_10.42.42.6(pid=11679): stdout: | (launched: 2022-12-10_07:31:46.338052) 07:31:47.993131 run osmo-msc_10.42.42.6(pid=11679): stderr: | [0;m[38;5;43m20221210073146911 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073146912 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2f41039c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073146912 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073146912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073146912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073146912 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073146915 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073146915 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073146916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073146916 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:31:48.043042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11672): Terminating (SIGTERM) 07:31:48.083213 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11675): Terminating (SIGTERM) 07:31:48.123864 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11678): Terminating (SIGTERM) 07:31:48.164635 --- ParallelTerminationStrategy: PID 11672 died... 07:31:48.184011 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11672): Terminated: ok {rc=0} 07:31:48.229896 --- ParallelTerminationStrategy: PID 11675 died... 07:31:48.248837 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11675): Terminated: ok {rc=0} 07:31:48.294314 --- ParallelTerminationStrategy: PID 11678 died... 07:31:48.313207 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11678): Terminated: ok {rc=0} 07:31:48.400213 bus /sierra_3: Setting Powered False 07:31:49.499444 bus /sierra_3: Setting Powered False 07:31:50.615972 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 07:31:51.760853 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:31:51.772421 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:31:51.841675 tst mo_mt_call_osmux.py: using LAC 26825 07:31:51.966426 tst mo_mt_call_osmux.py: using RAC 50 07:31:52.093766 tst mo_mt_call_osmux.py: using CellId 26825 07:31:52.216610 tst mo_mt_call_osmux.py: using BVCI 26826 07:31:52.330953 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:31:52.342576 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:31:52.354234 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:31:52.365569 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:31:52.376881 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:31:52.388145 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:31:52.508425 tst voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:31:52.625633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:31:53.084396 run create_hlr_db(pid=11681): Launched 07:31:53.198487 bus /sierra_2: Setting Powered False 07:31:54.257457 run create_hlr_db(pid=11681): Terminated: ok {rc=0} 07:31:54.690458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11683): Launched 07:31:55.008580 run osmo-hlr_10.42.42.2(pid=11684): Launched 07:31:55.130761 run osmo-stp_10.42.42.5: Starting osmo-stp 07:31:55.676815 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11686): Launched 07:31:55.993720 run osmo-stp_10.42.42.5(pid=11687): Launched 07:31:56.114924 run osmo-msc_10.42.42.6: Starting osmo-msc 07:31:56.687217 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11689): Launched 07:31:57.004527 run osmo-msc_10.42.42.6(pid=11690): Launched 07:31:57.181772 run osmo-stp_10.42.42.5(pid=11687): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11687)] 07:31:57.313986 run osmo-stp_10.42.42.5(pid=11687): stdout: | (launched: 2022-12-10_07:31:55.935758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:57.446990 run osmo-stp_10.42.42.5(pid=11687): stderr: | [0;m[38;5;43m20221210073156126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073156126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073156126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073156126 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073156129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073156129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073156129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:57.581273 run osmo-stp_10.42.42.5(pid=11687): stdout: | (launched: 2022-12-10_07:31:55.935758) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:31:57.707749 run osmo-stp_10.42.42.5(pid=11687): stderr: | [0;m[38;5;43m20221210073156126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073156126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073156126 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073156126 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073156129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073156129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073156129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:31:57.858690 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11687): Process ended prematurely: osmo-stp_10.42.42.5(pid=11687) [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11687)] [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 07:31:57.868275 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 07:31:57.896379 run osmo-hlr_10.42.42.2(pid=11684): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11684)] 07:31:57.946405 run osmo-hlr_10.42.42.2(pid=11684): stdout: | (launched: 2022-12-10_07:31:54.950583) 07:31:57.998694 run osmo-hlr_10.42.42.2(pid=11684): stderr: | [0;m[1;31m20221210073155147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073155147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073155147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073155147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073155147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073155147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073155159 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073155168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073155168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073155168 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:31:58.071029 run osmo-msc_10.42.42.6(pid=11690): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11690)] 07:31:58.121267 run osmo-msc_10.42.42.6(pid=11690): stdout: | (launched: 2022-12-10_07:31:56.946772) 07:31:58.172493 run osmo-msc_10.42.42.6(pid=11690): stderr: | [0;m[38;5;43m20221210073157268 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073157268 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5a22182c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073157269 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073157269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073157269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073157269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073157271 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073157271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073157271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073157271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:31:58.224031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11683): Terminating (SIGTERM) 07:31:58.265486 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11686): Terminating (SIGTERM) 07:31:58.307275 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11689): Terminating (SIGTERM) 07:31:58.349520 --- ParallelTerminationStrategy: PID 11683 died... 07:31:58.369700 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11683): Terminated: ok {rc=0} 07:31:58.416247 --- ParallelTerminationStrategy: PID 11686 died... 07:31:58.435957 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11686): Terminated: ok {rc=0} 07:31:58.482103 --- ParallelTerminationStrategy: PID 11689 died... 07:31:58.501687 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11689): Terminated: ok {rc=0} 07:31:58.589806 bus /sierra_3: Setting Powered False 07:31:59.687812 bus /sierra_3: Setting Powered False 07:32:00.802609 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:32:02.097478 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:32:02.108333 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:32:02.146753 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 07:32:02.174353 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:32:02.231351 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:32:02.265851 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 07:32:02.293037 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:32:02.835941 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 07:32:02.885910 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:32:02.897105 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:32:02.965839 tst mo_mt_call.py: using LAC 26826 07:32:03.085184 tst mo_mt_call.py: using RAC 51 07:32:03.201160 tst mo_mt_call.py: using CellId 26826 07:32:03.315050 tst mo_mt_call.py: using BVCI 26827 07:32:03.421844 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:32:03.432852 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:32:03.443971 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:32:03.455128 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:32:03.466371 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:32:03.477393 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:32:03.596491 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:32:03.713635 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:32:04.171181 run create_hlr_db(pid=11695): Launched 07:32:04.284022 bus /sierra_2: Setting Powered False 07:32:05.342737 run create_hlr_db(pid=11695): Terminated: ok {rc=0} 07:32:05.775048 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11697): Launched 07:32:06.092745 run osmo-hlr_10.42.42.2(pid=11698): Launched 07:32:06.214164 run osmo-stp_10.42.42.5: Starting osmo-stp 07:32:06.761630 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11700): Launched 07:32:07.078337 run osmo-stp_10.42.42.5(pid=11701): Launched 07:32:07.198909 run osmo-msc_10.42.42.6: Starting osmo-msc 07:32:07.772889 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11703): Launched 07:32:08.090781 run osmo-msc_10.42.42.6(pid=11704): Launched 07:32:08.267674 run osmo-stp_10.42.42.5(pid=11701): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11701)] 07:32:08.401095 run osmo-stp_10.42.42.5(pid=11701): stdout: | (launched: 2022-12-10_07:32:07.021024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:08.534213 run osmo-stp_10.42.42.5(pid=11701): stderr: | [0;m[38;5;43m20221210073207214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073207214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073207214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073207214 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073207215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073207215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073207215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:08.667007 run osmo-stp_10.42.42.5(pid=11701): stdout: | (launched: 2022-12-10_07:32:07.021024) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:08.792649 run osmo-stp_10.42.42.5(pid=11701): stderr: | [0;m[38;5;43m20221210073207214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073207214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073207214 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073207214 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073207215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073207215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073207215 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:08.943907 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11701): Process ended prematurely: osmo-stp_10.42.42.5(pid=11701) [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11701)] [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:32:08.953587 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:32:08.981939 run osmo-hlr_10.42.42.2(pid=11698): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11698)] 07:32:09.031776 run osmo-hlr_10.42.42.2(pid=11698): stdout: | (launched: 2022-12-10_07:32:06.035184) 07:32:09.083336 run osmo-hlr_10.42.42.2(pid=11698): stderr: | [0;m[1;31m20221210073206232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073206232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073206232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073206232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073206232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073206232 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073206246 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073206254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073206254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073206254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:32:09.154874 run osmo-msc_10.42.42.6(pid=11704): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11704)] 07:32:09.204385 run osmo-msc_10.42.42.6(pid=11704): stdout: | (launched: 2022-12-10_07:32:08.033106) 07:32:09.255114 run osmo-msc_10.42.42.6(pid=11704): stderr: | [0;m[38;5;43m20221210073208353 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073208353 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb89da4bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073208353 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073208353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073208353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073208353 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073208355 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073208355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073208356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073208356 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:32:09.306577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11697): Terminating (SIGTERM) 07:32:09.348230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11700): Terminating (SIGTERM) 07:32:09.389916 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11703): Terminating (SIGTERM) 07:32:09.431775 --- ParallelTerminationStrategy: PID 11697 died... 07:32:09.451489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11697): Terminated: ok {rc=0} 07:32:09.497604 --- ParallelTerminationStrategy: PID 11700 died... 07:32:09.516872 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11700): Terminated: ok {rc=0} 07:32:09.563119 --- ParallelTerminationStrategy: PID 11703 died... 07:32:09.582795 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11703): Terminated: ok {rc=0} 07:32:09.670576 bus /sierra_3: Setting Powered False 07:32:10.768931 bus /sierra_3: Setting Powered False 07:32:11.883229 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:32:13.031164 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:32:13.043428 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:32:13.115324 tst mo_mt_call_osmux.py: using LAC 26827 07:32:13.244810 tst mo_mt_call_osmux.py: using RAC 52 07:32:13.369206 tst mo_mt_call_osmux.py: using CellId 26827 07:32:13.490947 tst mo_mt_call_osmux.py: using BVCI 26828 07:32:13.604902 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:32:13.616425 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:32:13.627764 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:32:13.639076 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:32:13.650516 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:32:13.661864 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:32:13.780781 tst voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:32:13.897948 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:32:14.355791 run create_hlr_db(pid=11706): Launched 07:32:14.469996 bus /sierra_2: Setting Powered False 07:32:15.530268 run create_hlr_db(pid=11706): Terminated: ok {rc=0} 07:32:15.991091 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11708): Launched 07:32:16.318033 run osmo-hlr_10.42.42.2(pid=11709): Launched 07:32:16.555432 run osmo-stp_10.42.42.5: Starting osmo-stp 07:32:17.203646 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11711): Launched 07:32:17.514754 run osmo-stp_10.42.42.5(pid=11712): Launched 07:32:17.627888 run osmo-msc_10.42.42.6: Starting osmo-msc 07:32:18.162582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11714): Launched 07:32:18.458570 run osmo-msc_10.42.42.6(pid=11715): Launched 07:32:18.623982 run osmo-stp_10.42.42.5(pid=11712): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11712)] 07:32:18.749590 run osmo-stp_10.42.42.5(pid=11712): stdout: | (launched: 2022-12-10_07:32:17.460626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:18.874642 run osmo-stp_10.42.42.5(pid=11712): stderr: | [0;m[38;5;43m20221210073217632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073217632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073217632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073217633 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073217633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073217634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073217634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:18.998419 run osmo-stp_10.42.42.5(pid=11712): stdout: | (launched: 2022-12-10_07:32:17.460626) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:19.116826 run osmo-stp_10.42.42.5(pid=11712): stderr: | [0;m[38;5;43m20221210073217632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073217632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073217632 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073217633 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073217633 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073217634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073217634 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:19.258546 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11712): Process ended prematurely: osmo-stp_10.42.42.5(pid=11712) [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11712)] [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:32:19.267466 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 07:32:19.295264 run osmo-hlr_10.42.42.2(pid=11709): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11709)] 07:32:19.343561 run osmo-hlr_10.42.42.2(pid=11709): stdout: | (launched: 2022-12-10_07:32:16.256105) 07:32:19.393583 run osmo-hlr_10.42.42.2(pid=11709): stderr: | [0;m[1;31m20221210073216690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073216690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073216690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073216690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073216690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073216690 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073216710 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073216738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073216738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073216738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:32:19.463145 run osmo-msc_10.42.42.6(pid=11715): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11715)] 07:32:19.511368 run osmo-msc_10.42.42.6(pid=11715): stdout: | (launched: 2022-12-10_07:32:18.404776) 07:32:19.561331 run osmo-msc_10.42.42.6(pid=11715): stderr: | [0;m[38;5;43m20221210073218674 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073218675 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fddcdb36c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073218675 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073218675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073218675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073218675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073218677 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073218678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073218678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073218678 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:32:19.611189 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11708): Terminating (SIGTERM) 07:32:19.651392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11711): Terminating (SIGTERM) 07:32:19.691490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11714): Terminating (SIGTERM) 07:32:19.731793 --- ParallelTerminationStrategy: PID 11708 died... 07:32:19.750899 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11708): Terminated: ok {rc=0} 07:32:19.796017 --- ParallelTerminationStrategy: PID 11711 died... 07:32:19.814687 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11711): Terminated: ok {rc=0} 07:32:19.859770 --- ParallelTerminationStrategy: PID 11714 died... 07:32:19.878228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11714): Terminated: ok {rc=0} 07:32:19.965576 bus /sierra_3: Setting Powered False 07:32:21.064750 bus /sierra_3: Setting Powered False 07:32:22.181551 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:32:23.432287 tst voice:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:32:23.438466 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:32:23.472398 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 07:32:23.499606 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 07:32:23.552236 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:32:23.585710 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 07:32:23.613091 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 07:32:24.162204 tst voice:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 07:32:24.213834 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:32:24.225460 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:32:24.296753 tst mo_mt_call.py: using LAC 26828 07:32:24.421203 tst mo_mt_call.py: using RAC 53 07:32:24.550075 tst mo_mt_call.py: using CellId 26828 07:32:24.666794 tst mo_mt_call.py: using BVCI 26829 07:32:24.773689 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:32:24.784559 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:32:24.795303 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:32:24.806388 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:32:24.817628 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:32:24.828473 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:32:24.943061 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:32:25.057910 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:32:25.517396 run create_hlr_db(pid=11720): Launched 07:32:25.631518 bus /sierra_2: Setting Powered False 07:32:26.690522 run create_hlr_db(pid=11720): Terminated: ok {rc=0} 07:32:27.104537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11722): Launched 07:32:27.402636 run osmo-hlr_10.42.42.2(pid=11723): Launched 07:32:27.516151 run osmo-stp_10.42.42.5: Starting osmo-stp 07:32:28.039512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11725): Launched 07:32:28.336291 run osmo-stp_10.42.42.5(pid=11726): Launched 07:32:28.449958 run osmo-msc_10.42.42.6: Starting osmo-msc 07:32:28.985415 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11728): Launched 07:32:29.282267 run osmo-msc_10.42.42.6(pid=11729): Launched 07:32:29.448888 run osmo-stp_10.42.42.5(pid=11726): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11726)] 07:32:29.574975 run osmo-stp_10.42.42.5(pid=11726): stdout: | (launched: 2022-12-10_07:32:28.282300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:29.700843 run osmo-stp_10.42.42.5(pid=11726): stderr: | [0;m[38;5;43m20221210073228450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073228450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073228451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073228451 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073228453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073228453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073228453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:29.824168 run osmo-stp_10.42.42.5(pid=11726): stdout: | (launched: 2022-12-10_07:32:28.282300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:29.942236 run osmo-stp_10.42.42.5(pid=11726): stderr: | [0;m[38;5;43m20221210073228450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073228450 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073228451 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073228451 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073228453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073228453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073228453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:30.083779 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11726): Process ended prematurely: osmo-stp_10.42.42.5(pid=11726) [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11726)] [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 07:32:30.092739 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 07:32:30.119833 run osmo-hlr_10.42.42.2(pid=11723): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11723)] 07:32:30.167774 run osmo-hlr_10.42.42.2(pid=11723): stdout: | (launched: 2022-12-10_07:32:27.347904) 07:32:30.217213 run osmo-hlr_10.42.42.2(pid=11723): stderr: | [0;m[1;31m20221210073227522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073227522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073227522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073227522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073227522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073227522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073227533 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073227542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073227542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073227542 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:32:30.286482 run osmo-msc_10.42.42.6(pid=11729): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11729)] 07:32:30.334397 run osmo-msc_10.42.42.6(pid=11729): stdout: | (launched: 2022-12-10_07:32:29.228009) 07:32:30.383413 run osmo-msc_10.42.42.6(pid=11729): stderr: | [0;m[38;5;43m20221210073229497 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073229497 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5de2c55c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073229497 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073229497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073229497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073229498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073229500 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073229500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073229500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073229500 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:32:30.433577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11722): Terminating (SIGTERM) 07:32:30.473275 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11725): Terminating (SIGTERM) 07:32:30.513040 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11728): Terminating (SIGTERM) 07:32:30.553665 --- ParallelTerminationStrategy: PID 11722 died... 07:32:30.572792 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11722): Terminated: ok {rc=0} 07:32:30.618251 --- ParallelTerminationStrategy: PID 11725 died... 07:32:30.636792 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11725): Terminated: ok {rc=0} 07:32:30.681547 --- ParallelTerminationStrategy: PID 11728 died... 07:32:30.700405 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11728): Terminated: ok {rc=0} 07:32:30.787189 bus /sierra_3: Setting Powered False 07:32:31.894880 bus /sierra_3: Setting Powered False 07:32:33.012295 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 07:32:34.161821 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:32:34.173904 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:32:34.246909 tst mo_mt_call_osmux.py: using LAC 26829 07:32:34.373458 tst mo_mt_call_osmux.py: using RAC 54 07:32:34.499865 tst mo_mt_call_osmux.py: using CellId 26829 07:32:34.624921 tst mo_mt_call_osmux.py: using BVCI 26830 07:32:34.740154 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:32:34.751434 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:32:34.762665 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:32:34.773816 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:32:34.784875 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:32:34.796078 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:32:34.911591 tst voice:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:32:35.028247 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:32:35.487097 run create_hlr_db(pid=11731): Launched 07:32:35.601678 bus /sierra_2: Setting Powered False 07:32:36.661054 run create_hlr_db(pid=11731): Terminated: ok {rc=0} 07:32:37.094551 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11733): Launched 07:32:37.412551 run osmo-hlr_10.42.42.2(pid=11734): Launched 07:32:37.536260 run osmo-stp_10.42.42.5: Starting osmo-stp 07:32:38.084487 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11736): Launched 07:32:38.403671 run osmo-stp_10.42.42.5(pid=11737): Launched 07:32:38.525493 run osmo-msc_10.42.42.6: Starting osmo-msc 07:32:39.105038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11739): Launched 07:32:39.423413 run osmo-msc_10.42.42.6(pid=11740): Launched 07:32:39.602011 run osmo-stp_10.42.42.5(pid=11737): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11737)] 07:32:39.735917 run osmo-stp_10.42.42.5(pid=11737): stdout: | (launched: 2022-12-10_07:32:38.345499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:39.869854 run osmo-stp_10.42.42.5(pid=11737): stderr: | [0;m[38;5;43m20221210073238538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073238539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073238539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073238539 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073238540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073238540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073238540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:40.004195 run osmo-stp_10.42.42.5(pid=11737): stdout: | (launched: 2022-12-10_07:32:38.345499) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:40.131539 run osmo-stp_10.42.42.5(pid=11737): stderr: | [0;m[38;5;43m20221210073238538 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073238539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073238539 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073238539 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073238540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073238540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073238540 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:40.284016 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11737): Process ended prematurely: osmo-stp_10.42.42.5(pid=11737) [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11737)] [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 07:32:40.293682 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:32:40.321891 run osmo-hlr_10.42.42.2(pid=11734): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11734)] 07:32:40.372679 run osmo-hlr_10.42.42.2(pid=11734): stdout: | (launched: 2022-12-10_07:32:37.355140) 07:32:40.424526 run osmo-hlr_10.42.42.2(pid=11734): stderr: | [0;m[1;31m20221210073237553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073237553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073237553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073237553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073237553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073237553 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073237565 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-umtrx+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073237573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073237573 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073237574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:32:40.496585 run osmo-msc_10.42.42.6(pid=11740): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11740)] 07:32:40.546551 run osmo-msc_10.42.42.6(pid=11740): stdout: | (launched: 2022-12-10_07:32:39.365786) 07:32:40.597885 run osmo-msc_10.42.42.6(pid=11740): stderr: | [0;m[38;5;43m20221210073239689 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073239689 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3f1ea6ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073239689 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073239689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073239689 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073239690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073239691 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073239692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073239692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073239692 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:32:40.649660 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11733): Terminating (SIGTERM) 07:32:40.691358 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11736): Terminating (SIGTERM) 07:32:40.733211 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11739): Terminating (SIGTERM) 07:32:40.775536 --- ParallelTerminationStrategy: PID 11733 died... 07:32:40.795465 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11733): Terminated: ok {rc=0} 07:32:40.841925 --- ParallelTerminationStrategy: PID 11736 died... 07:32:40.861544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11736): Terminated: ok {rc=0} 07:32:40.907697 --- ParallelTerminationStrategy: PID 11739 died... 07:32:40.927337 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11739): Terminated: ok {rc=0} 07:32:41.014354 bus /sierra_3: Setting Powered False 07:32:42.113568 bus /sierra_3: Setting Powered False 07:32:43.231161 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 07:32:44.474811 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:32:44.480924 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 07:32:44.513443 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 07:32:44.540182 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 07:32:44.591486 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 07:32:44.623462 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 07:32:44.649729 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 07:32:45.201454 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 07:32:45.249379 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:32:45.260583 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:32:45.311965 tst mo_mt_call.py: using LAC 26830 07:32:45.432876 tst mo_mt_call.py: using RAC 55 07:32:45.548542 tst mo_mt_call.py: using CellId 26830 07:32:45.662901 tst mo_mt_call.py: using BVCI 26831 07:32:45.779738 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:32:45.791839 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:32:45.803498 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:32:45.815102 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:32:45.826691 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:32:45.838175 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:32:45.970231 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:32:46.095701 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:32:46.602394 run create_hlr_db(pid=11745): Launched 07:32:46.758065 bus /sierra_2: Setting Powered False 07:32:47.817763 run create_hlr_db(pid=11745): Terminated: ok {rc=0} 07:32:48.253117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11747): Launched 07:32:48.571418 run osmo-hlr_10.42.42.2(pid=11748): Launched 07:32:48.693195 run osmo-stp_10.42.42.5: Starting osmo-stp 07:32:49.241457 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11750): Launched 07:32:49.558954 run osmo-stp_10.42.42.5(pid=11751): Launched 07:32:49.681112 run osmo-msc_10.42.42.6: Starting osmo-msc 07:32:50.255600 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11753): Launched 07:32:50.573583 run osmo-msc_10.42.42.6(pid=11754): Launched 07:32:50.750283 run osmo-stp_10.42.42.5(pid=11751): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11751)] 07:32:50.883729 run osmo-stp_10.42.42.5(pid=11751): stdout: | (launched: 2022-12-10_07:32:49.501287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:51.018156 run osmo-stp_10.42.42.5(pid=11751): stderr: | [0;m[38;5;43m20221210073249692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073249692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073249692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073249692 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073249695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073249695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073249695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:51.151721 run osmo-stp_10.42.42.5(pid=11751): stdout: | (launched: 2022-12-10_07:32:49.501287) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:32:51.277842 run osmo-stp_10.42.42.5(pid=11751): stderr: | [0;m[38;5;43m20221210073249692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073249692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073249692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073249692 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073249695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073249695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073249695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:32:51.429139 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11751): Process ended prematurely: osmo-stp_10.42.42.5(pid=11751) [trial-2371↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11751)] [trial-2371↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 07:32:51.438645 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:32:51.466179 run osmo-hlr_10.42.42.2(pid=11748): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11748)] 07:32:51.515710 run osmo-hlr_10.42.42.2(pid=11748): stdout: | (launched: 2022-12-10_07:32:48.513813) 07:32:51.567160 run osmo-hlr_10.42.42.2(pid=11748): stderr: | [0;m[1;31m20221210073248711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073248711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073248711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073248711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073248711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073248711 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073248723 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073248731 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073248732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073248732 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:32:51.638953 run osmo-msc_10.42.42.6(pid=11754): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11754)] 07:32:51.688397 run osmo-msc_10.42.42.6(pid=11754): stdout: | (launched: 2022-12-10_07:32:50.516025) 07:32:51.739248 run osmo-msc_10.42.42.6(pid=11754): stderr: | [0;m[38;5;43m20221210073250838 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073250838 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa7a9e28c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073250839 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073250839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073250839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073250839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073250841 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073250841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073250841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073250841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:32:51.790265 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11747): Terminating (SIGTERM) 07:32:51.831558 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11750): Terminating (SIGTERM) 07:32:51.873011 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11753): Terminating (SIGTERM) 07:32:51.914905 --- ParallelTerminationStrategy: PID 11747 died... 07:32:51.934889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11747): Terminated: ok {rc=0} 07:32:51.980883 --- ParallelTerminationStrategy: PID 11750 died... 07:32:52.001368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11750): Terminated: ok {rc=0} 07:32:52.046993 --- ParallelTerminationStrategy: PID 11753 died... 07:32:52.066658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11753): Terminated: ok {rc=0} 07:32:52.154427 bus /sierra_3: Setting Powered False 07:32:53.253621 bus /sierra_3: Setting Powered False 07:32:54.371190 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 07:32:55.517914 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:32:55.529913 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:32:55.582283 tst mo_mt_call_osmux.py: using LAC 26831 07:32:55.700732 tst mo_mt_call_osmux.py: using RAC 56 07:32:55.817439 tst mo_mt_call_osmux.py: using CellId 26831 07:32:55.943886 tst mo_mt_call_osmux.py: using BVCI 26832 07:32:56.059357 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:32:56.070970 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:32:56.082407 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:32:56.093931 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:32:56.105505 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 07:32:56.116848 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:32:56.234640 tst voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 07:32:56.350297 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:32:56.809723 run create_hlr_db(pid=11756): Launched 07:32:56.923952 bus /sierra_2: Setting Powered False 07:32:57.983780 run create_hlr_db(pid=11756): Terminated: ok {rc=0} 07:32:58.417287 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11758): Launched 07:32:58.735897 run osmo-hlr_10.42.42.2(pid=11759): Launched 07:32:58.858261 run osmo-stp_10.42.42.5: Starting osmo-stp 07:32:59.409327 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11761): Launched 07:32:59.726554 run osmo-stp_10.42.42.5(pid=11762): Launched 07:32:59.847563 run osmo-msc_10.42.42.6: Starting osmo-msc 07:33:00.419917 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11764): Launched 07:33:00.738449 run osmo-msc_10.42.42.6(pid=11765): Launched 07:33:00.946726 run osmo-stp_10.42.42.5(pid=11762): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11762)] 07:33:01.120902 run osmo-stp_10.42.42.5(pid=11762): stdout: | (launched: 2022-12-10_07:32:59.669234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:01.420391 run osmo-stp_10.42.42.5(pid=11762): stderr: | [0;m[38;5;43m20221210073259860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073259860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073259860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073259861 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073259861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073259861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073259861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:01.685860 run osmo-stp_10.42.42.5(pid=11762): stdout: | (launched: 2022-12-10_07:32:59.669234) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:01.825173 run osmo-stp_10.42.42.5(pid=11762): stderr: | [0;m[38;5;43m20221210073259860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073259860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073259860 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073259861 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073259861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073259861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073259861 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:01.980405 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11762): Process ended prematurely: osmo-stp_10.42.42.5(pid=11762) [trial-2371↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11762)] [trial-2371↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 07:33:01.990435 tst mo_mt_call_osmux.py:8: Test FAILED (6.5 sec) 07:33:02.018789 run osmo-hlr_10.42.42.2(pid=11759): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11759)] 07:33:02.069465 run osmo-hlr_10.42.42.2(pid=11759): stdout: | (launched: 2022-12-10_07:32:58.678496) 07:33:02.121607 run osmo-hlr_10.42.42.2(pid=11759): stderr: | [0;m[1;31m20221210073258876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073258876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073258876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073258876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073258876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073258876 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073258890 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073258898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073258898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073258898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:33:02.194782 run osmo-msc_10.42.42.6(pid=11765): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11765)] 07:33:02.256384 run osmo-msc_10.42.42.6(pid=11765): stdout: | (launched: 2022-12-10_07:33:00.680757) 07:33:02.318725 run osmo-msc_10.42.42.6(pid=11765): stderr: | [0;m[38;5;43m20221210073301245 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073301245 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f09bd3c9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073301246 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073301246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073301246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073301246 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073301251 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073301252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073301252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073301252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:33:02.372372 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11758): Terminating (SIGTERM) 07:33:02.415291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11761): Terminating (SIGTERM) 07:33:02.458332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11764): Terminating (SIGTERM) 07:33:02.502923 --- ParallelTerminationStrategy: PID 11758 died... 07:33:02.523092 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11758): Terminated: ok {rc=0} 07:33:02.569136 --- ParallelTerminationStrategy: PID 11761 died... 07:33:02.588633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11761): Terminated: ok {rc=0} 07:33:02.634360 --- ParallelTerminationStrategy: PID 11764 died... 07:33:02.653853 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11764): Terminated: ok {rc=0} 07:33:02.741745 bus /sierra_3: Setting Powered False 07:33:03.840002 bus /sierra_3: Setting Powered False 07:33:04.955926 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 emergency:trx-umtrx --------------------------------------------------------------------- 07:33:06.209513 tst emergency:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:33:06.214152 tst emergency:trx-umtrx: Verifying 1 x bts (candidates: 11) 07:33:06.246964 tst emergency:trx-umtrx: Verifying 6 x ip_address (candidates: 9) 07:33:06.273915 tst emergency:trx-umtrx: Verifying 4 x modem (candidates: 12) 07:33:06.360878 tst emergency:trx-umtrx: Reserving 1 x bts (candidates: 11) 07:33:06.394590 tst emergency:trx-umtrx: Reserving 6 x ip_address (candidates: 9) 07:33:06.421655 tst emergency:trx-umtrx: Reserving 4 x modem (candidates: 12) 07:33:07.004178 tst emergency:trx-umtrx: RESERVED RESOURCES for emergency: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2371 emergency:trx-umtrx emergency_mo_mt_call.py ---------------------------------------------- 07:33:07.009644 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:07.020518 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 07:33:07.070161 tst emergency_mo_mt_call.py: using LAC 26832 07:33:07.192684 tst emergency_mo_mt_call.py: using RAC 57 07:33:07.314625 tst emergency_mo_mt_call.py: using CellId 26832 07:33:07.438268 tst emergency_mo_mt_call.py: using BVCI 26833 07:33:07.552793 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:07.563889 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:07.574740 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:07.585692 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:07.596520 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:07.607297 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 07:33:07.722483 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 07:33:07.843861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:33:08.327561 run create_hlr_db(pid=11773): Launched 07:33:08.455390 bus /sierra_2: Setting Powered False 07:33:09.517300 run create_hlr_db(pid=11773): Terminated: ok {rc=0} 07:33:09.934304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11775): Launched 07:33:10.225655 run osmo-hlr_10.42.42.2(pid=11776): Launched 07:33:10.337338 run osmo-stp_10.42.42.5: Starting osmo-stp 07:33:10.851583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11778): Launched 07:33:11.142953 run osmo-stp_10.42.42.5(pid=11779): Launched 07:33:11.269245 tst emergency_mo_mt_call.py: using MSISDN 7615 07:33:11.430393 run osmo-msc_10.42.42.6: Starting osmo-msc 07:33:11.954681 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11781): Launched 07:33:12.247180 run osmo-msc_10.42.42.6(pid=11782): Launched 07:33:12.411641 run osmo-stp_10.42.42.5(pid=11779): ERR: Terminated: ERROR {rc=1} [trial-2371↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11779)] 07:33:12.535731 run osmo-stp_10.42.42.5(pid=11779): stdout: | (launched: 2022-12-10_07:33:11.089331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:12.660603 run osmo-stp_10.42.42.5(pid=11779): stderr: | [0;m[38;5;43m20221210073311258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073311258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073311258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073311259 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073311261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073311262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073311262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:12.782234 run osmo-stp_10.42.42.5(pid=11779): stdout: | (launched: 2022-12-10_07:33:11.089331) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:12.899094 run osmo-stp_10.42.42.5(pid=11779): stderr: | [0;m[38;5;43m20221210073311258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073311258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073311258 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073311259 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073311261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073311262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073311262 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:13.038866 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=11779): Process ended prematurely: osmo-stp_10.42.42.5(pid=11779) [trial-2371↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11779)] [trial-2371↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19] 07:33:13.047093 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 07:33:13.073408 run osmo-hlr_10.42.42.2(pid=11776): ERR: Terminated: ERROR {rc=237} [trial-2371↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11776)] 07:33:13.121158 run osmo-hlr_10.42.42.2(pid=11776): stdout: | (launched: 2022-12-10_07:33:10.172509) 07:33:13.170528 run osmo-hlr_10.42.42.2(pid=11776): stderr: | [0;m[1;31m20221210073310345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073310345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073310345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073310345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073310345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073310345 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073310357 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/emergency:trx-umtrx/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073310365 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073310366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073310366 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:33:13.239193 run osmo-msc_10.42.42.6(pid=11782): ERR: Terminated: ERROR {rc=2} [trial-2371↪emergency:trx-umtrx↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11782)] 07:33:13.286867 run osmo-msc_10.42.42.6(pid=11782): stdout: | (launched: 2022-12-10_07:33:12.193427) 07:33:13.335867 run osmo-msc_10.42.42.6(pid=11782): stderr: | [0;m[38;5;43m20221210073312462 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073312462 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb85ebeac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073312462 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073312462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073312462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073312463 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073312464 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073312465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073312465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073312465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:33:13.385407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11775): Terminating (SIGTERM) 07:33:13.425022 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11778): Terminating (SIGTERM) 07:33:13.464636 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11781): Terminating (SIGTERM) 07:33:13.504593 --- ParallelTerminationStrategy: PID 11775 died... 07:33:13.523678 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11775): Terminated: ok {rc=0} 07:33:13.568328 --- ParallelTerminationStrategy: PID 11778 died... 07:33:13.586751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11778): Terminated: ok {rc=0} 07:33:13.631167 --- ParallelTerminationStrategy: PID 11781 died... 07:33:13.649669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11781): Terminated: ok {rc=0} 07:33:13.733363 bus /sierra_3: Setting Powered False 07:33:14.828212 bus /sierra_3: Setting Powered False 07:33:15.952086 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 emergency:trx-umtrx emergency_preemptive_call.py ---------------------------------------------- 07:33:17.060848 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:17.072934 tst emergency:trx-umtrx: Using 1 x bts (candidates: 1) 07:33:17.126101 tst emergency_preemptive_call.py: using LAC 26833 07:33:17.256230 tst emergency_preemptive_call.py: using RAC 58 07:33:17.376530 tst emergency_preemptive_call.py: using CellId 26833 07:33:17.500637 tst emergency_preemptive_call.py: using BVCI 26834 07:33:17.613727 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:17.624921 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:17.635972 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:17.647490 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:17.658671 tst emergency:trx-umtrx: Using 1 x ip_address (candidates: 6) 07:33:17.669695 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 07:33:17.785295 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 07:33:17.905701 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 07:33:18.022955 tst emergency:trx-umtrx: Using 1 x modem (candidates: 4) 07:33:18.140509 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:33:18.593137 run create_hlr_db(pid=11784): Launched 07:33:18.706078 bus /sierra_2: Setting Powered False 07:33:19.768742 run create_hlr_db(pid=11784): Terminated: ok {rc=0} 07:33:20.186629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11786): Launched 07:33:20.478698 run osmo-hlr_10.42.42.2(pid=11787): Launched 07:33:20.590647 run osmo-stp_10.42.42.5: Starting osmo-stp 07:33:21.106463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11789): Launched 07:33:21.398620 run osmo-stp_10.42.42.5(pid=11790): Launched 07:33:21.520872 tst emergency_preemptive_call.py: using MSISDN 7616 07:33:21.670760 run osmo-msc_10.42.42.6: Starting osmo-msc 07:33:22.193736 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11792): Launched 07:33:22.485082 run osmo-msc_10.42.42.6(pid=11793): Launched 07:33:22.649488 run osmo-stp_10.42.42.5(pid=11790): ERR: Terminated: ERROR {rc=1} [trial-2371↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11790)] 07:33:22.774470 run osmo-stp_10.42.42.5(pid=11790): stdout: | (launched: 2022-12-10_07:33:21.345300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:22.899912 run osmo-stp_10.42.42.5(pid=11790): stderr: | [0;m[38;5;43m20221210073321511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073321512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073321512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073321512 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073321514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073321514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073321514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:23.021572 run osmo-stp_10.42.42.5(pid=11790): stdout: | (launched: 2022-12-10_07:33:21.345300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:23.137953 run osmo-stp_10.42.42.5(pid=11790): stderr: | [0;m[38;5;43m20221210073321511 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073321512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073321512 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073321512 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073321514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073321514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073321514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:23.276720 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=11790): Process ended prematurely: osmo-stp_10.42.42.5(pid=11790) [trial-2371↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11790)] [trial-2371↪emergency:trx-umtrx↪emergency_preemptive_call.py:32] 07:33:23.285245 tst emergency_preemptive_call.py:32: Test FAILED (6.2 sec) 07:33:23.311709 run osmo-hlr_10.42.42.2(pid=11787): ERR: Terminated: ERROR {rc=237} [trial-2371↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11787)] 07:33:23.359882 run osmo-hlr_10.42.42.2(pid=11787): stdout: | (launched: 2022-12-10_07:33:20.425434) 07:33:23.409454 run osmo-hlr_10.42.42.2(pid=11787): stderr: | [0;m[1;31m20221210073320598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073320598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073320598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073320598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073320598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073320598 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073320611 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/emergency:trx-umtrx/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073320619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073320619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073320619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:33:23.478268 run osmo-msc_10.42.42.6(pid=11793): ERR: Terminated: ERROR {rc=2} [trial-2371↪emergency:trx-umtrx↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=11793)] 07:33:23.525766 run osmo-msc_10.42.42.6(pid=11793): stdout: | (launched: 2022-12-10_07:33:22.431503) 07:33:23.574946 run osmo-msc_10.42.42.6(pid=11793): stderr: | [0;m[38;5;43m20221210073322703 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073322704 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6ed14b7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073322704 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073322704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073322704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073322704 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073322706 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073322707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073322707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073322707 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:33:23.624193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11786): Terminating (SIGTERM) 07:33:23.663892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11789): Terminating (SIGTERM) 07:33:23.703658 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11792): Terminating (SIGTERM) 07:33:23.743515 --- ParallelTerminationStrategy: PID 11786 died... 07:33:23.762554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11786): Terminated: ok {rc=0} 07:33:23.807103 --- ParallelTerminationStrategy: PID 11789 died... 07:33:23.826073 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11789): Terminated: ok {rc=0} 07:33:23.870109 --- ParallelTerminationStrategy: PID 11792 died... 07:33:23.888650 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=11792): Terminated: ok {rc=0} 07:33:23.975083 bus /sierra_9: Setting Powered False 07:33:25.074816 bus /sierra_9: Setting Powered False 07:33:26.189996 bus /sierra_8: Setting Powered False 07:33:27.287566 bus /sierra_8: Setting Powered False 07:33:28.403381 bus /sierra_3: Setting Powered False 07:33:29.500516 bus /sierra_3: Setting Powered False 07:33:30.616590 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 emergency:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-umtrx --------------------------------------------------------------------- 07:33:31.920703 tst gprs:trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:33:31.924911 tst gprs:trx-umtrx: Verifying 1 x bts (candidates: 11) 07:33:31.965281 tst gprs:trx-umtrx: Verifying 9 x ip_address (candidates: 9) 07:33:32.012357 tst gprs:trx-umtrx: Verifying 4 x modem (candidates: 12) 07:33:32.115025 tst gprs:trx-umtrx: Reserving 1 x bts (candidates: 11) 07:33:32.155063 tst gprs:trx-umtrx: Reserving 9 x ip_address (candidates: 9) 07:33:32.195867 tst gprs:trx-umtrx: Reserving 4 x modem (candidates: 12) 07:33:32.776797 tst gprs:trx-umtrx: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-umtrx cs_paging_gprs_active.py ---------------------------------------------- 07:33:32.827814 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:32.838411 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 07:33:32.886302 tst cs_paging_gprs_active.py: using LAC 26834 07:33:33.003741 tst cs_paging_gprs_active.py: using RAC 59 07:33:33.121281 tst cs_paging_gprs_active.py: using CellId 26834 07:33:33.248915 tst cs_paging_gprs_active.py: using BVCI 26835 07:33:33.364345 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:33.375525 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:33.386275 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:33.397224 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:33.408071 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:33.418716 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:33.429585 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:33.440367 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:33.451251 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:33:33.567778 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:33:33.682376 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:33:33.882974 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:33:34.182799 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11798): Launched 07:33:34.441670 run iperf3-srv_10.42.42.10(pid=11799): Launched 07:33:34.553538 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:33:34.752379 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:33:35.050507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11800): Launched 07:33:35.309244 run iperf3-srv_10.42.42.10(pid=11801): Launched 07:33:35.421142 tst cs_paging_gprs_active.py:38: start network... 07:33:35.619844 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:33:36.078910 run create_hlr_db(pid=11802): Launched 07:33:36.194180 bus /sierra_2: Setting Powered False 07:33:37.254176 run create_hlr_db(pid=11802): Terminated: ok {rc=0} 07:33:37.690291 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11804): Launched 07:33:38.008044 run osmo-hlr_10.42.42.2(pid=11805): Launched 07:33:38.130761 run osmo-stp_10.42.42.5: Starting osmo-stp 07:33:38.678533 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11807): Launched 07:33:38.997188 run osmo-stp_10.42.42.5(pid=11808): Launched 07:33:39.120759 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:33:39.670209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11810): Launched 07:33:39.792144 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:33:40.060461 run patchelf(pid=11811): Launched 07:33:40.237799 run osmo-stp_10.42.42.5(pid=11808): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11808)] 07:33:40.372341 run osmo-stp_10.42.42.5(pid=11808): stdout: | (launched: 2022-12-10_07:33:38.939544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:40.508647 run osmo-stp_10.42.42.5(pid=11808): stderr: | [0;m[38;5;43m20221210073339131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073339131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073339132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073339132 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073339133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073339133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073339133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:40.645088 run osmo-stp_10.42.42.5(pid=11808): stdout: | (launched: 2022-12-10_07:33:38.939544) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:40.774909 run osmo-stp_10.42.42.5(pid=11808): stderr: | [0;m[38;5;43m20221210073339131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073339131 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073339132 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073339132 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073339133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073339133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073339133 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:40.929674 run patchelf(pid=11811): Terminating (SIGINT) 07:33:41.109180 run patchelf(pid=11811): Terminated: ok {rc=0} 07:33:41.238437 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11808): Process ended prematurely: osmo-stp_10.42.42.5(pid=11808) [trial-2371↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11808)] [trial-2371↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38] 07:33:41.248333 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 07:33:41.276579 run osmo-hlr_10.42.42.2(pid=11805): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11805)] 07:33:41.326338 run osmo-hlr_10.42.42.2(pid=11805): stdout: | (launched: 2022-12-10_07:33:37.950571) 07:33:41.377708 run osmo-hlr_10.42.42.2(pid=11805): stderr: | [0;m[1;31m20221210073338145 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073338146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073338146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073338146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073338146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073338146 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073338158 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073338166 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073338167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073338167 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:33:41.429441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11798): Terminating (SIGTERM) 07:33:41.470828 run iperf3-srv_10.42.42.10(pid=11799): Terminating (SIGTERM) 07:33:41.512064 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11800): Terminating (SIGTERM) 07:33:41.553487 run iperf3-srv_10.42.42.10(pid=11801): Terminating (SIGTERM) 07:33:41.594741 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11804): Terminating (SIGTERM) 07:33:41.636064 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11807): Terminating (SIGTERM) 07:33:41.677312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11810): Terminating (SIGTERM) 07:33:41.718872 --- ParallelTerminationStrategy: PID 11798 died... 07:33:41.738707 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11798): Terminated: ok {rc=0} 07:33:41.784622 --- ParallelTerminationStrategy: PID 11799 died... 07:33:41.803991 run iperf3-srv_10.42.42.10(pid=11799): Terminated {rc=256} 07:33:41.849964 --- ParallelTerminationStrategy: PID 11800 died... 07:33:41.869409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11800): Terminated: ok {rc=0} 07:33:41.915329 --- ParallelTerminationStrategy: PID 11801 died... 07:33:41.934698 run iperf3-srv_10.42.42.10(pid=11801): Terminated {rc=256} 07:33:41.980708 --- ParallelTerminationStrategy: PID 11804 died... 07:33:42.000219 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11804): Terminated: ok {rc=0} 07:33:42.046931 --- ParallelTerminationStrategy: PID 11807 died... 07:33:42.066432 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11807): Terminated: ok {rc=0} 07:33:42.112449 --- ParallelTerminationStrategy: PID 11810 died... 07:33:42.131958 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11810): Terminated: ok {rc=0} 07:33:42.218449 bus /gobi_0: Setting Powered False 07:33:43.317948 bus /gobi_0: Setting Powered False 07:33:44.432913 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-umtrx iperf3.py ---------------------------------------------- 07:33:45.581269 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:45.592781 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 07:33:45.645345 tst iperf3.py: using LAC 26835 07:33:45.773318 tst iperf3.py: using RAC 60 07:33:45.907769 tst iperf3.py: using CellId 26835 07:33:46.034271 tst iperf3.py: using BVCI 26836 07:33:46.152448 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:46.164117 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:46.175540 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:46.187437 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:46.199185 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:46.210959 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:46.223020 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:46.234781 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:46.247680 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:33:46.364225 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:33:46.573248 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:33:46.892781 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11812): Launched 07:33:47.213734 run iperf3-srv_10.42.42.10(pid=11813): Launched 07:33:47.341282 tst iperf3.py:8: start network... 07:33:47.556785 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:33:48.049480 run create_hlr_db(pid=11814): Launched 07:33:48.179973 bus /gobi_6: Setting Powered False 07:33:49.243661 run create_hlr_db(pid=11814): Terminated: ok {rc=0} 07:33:49.667508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11816): Launched 07:33:49.965462 run osmo-hlr_10.42.42.2(pid=11817): Launched 07:33:50.079569 run osmo-stp_10.42.42.5: Starting osmo-stp 07:33:50.608185 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11819): Launched 07:33:50.904402 run osmo-stp_10.42.42.5(pid=11820): Launched 07:33:51.017766 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:33:51.528349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11822): Launched 07:33:51.652000 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:33:51.920477 run patchelf(pid=11823): Launched 07:33:52.087811 run osmo-stp_10.42.42.5(pid=11820): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11820)] 07:33:52.213808 run osmo-stp_10.42.42.5(pid=11820): stdout: | (launched: 2022-12-10_07:33:50.849856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:52.341551 run osmo-stp_10.42.42.5(pid=11820): stderr: | [0;m[38;5;43m20221210073351023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073351023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073351023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073351024 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073351024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073351024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073351024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:52.469561 run osmo-stp_10.42.42.5(pid=11820): stdout: | (launched: 2022-12-10_07:33:50.849856) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:33:52.591597 run osmo-stp_10.42.42.5(pid=11820): stderr: | [0;m[38;5;43m20221210073351023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073351023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073351023 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073351024 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073351024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073351024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073351024 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:33:52.736144 run patchelf(pid=11823): Terminating (SIGINT) 07:33:52.903385 run patchelf(pid=11823): Terminated: ok {rc=0} 07:33:53.024523 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11820): Process ended prematurely: osmo-stp_10.42.42.5(pid=11820) [trial-2371↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11820)] [trial-2371↪gprs:trx-umtrx↪iperf3.py:8] 07:33:53.033808 tst iperf3.py:8: Test FAILED (7.5 sec) 07:33:53.061112 run osmo-hlr_10.42.42.2(pid=11817): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11817)] 07:33:53.108650 run osmo-hlr_10.42.42.2(pid=11817): stdout: | (launched: 2022-12-10_07:33:49.911245) 07:33:53.157973 run osmo-hlr_10.42.42.2(pid=11817): stderr: | [0;m[1;31m20221210073350088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073350088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073350088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073350088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073350088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073350088 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073350100 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073350110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073350110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073350110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:33:53.207580 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11812): Terminating (SIGTERM) 07:33:53.247170 run iperf3-srv_10.42.42.10(pid=11813): Terminating (SIGTERM) 07:33:53.286999 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11816): Terminating (SIGTERM) 07:33:53.326744 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11819): Terminating (SIGTERM) 07:33:53.366405 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11822): Terminating (SIGTERM) 07:33:53.406631 --- ParallelTerminationStrategy: PID 11812 died... 07:33:53.425670 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11812): Terminated: ok {rc=0} 07:33:53.470303 --- ParallelTerminationStrategy: PID 11813 died... 07:33:53.488813 run iperf3-srv_10.42.42.10(pid=11813): Terminated {rc=256} 07:33:53.533217 --- ParallelTerminationStrategy: PID 11816 died... 07:33:53.551803 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11816): Terminated: ok {rc=0} 07:33:53.596794 --- ParallelTerminationStrategy: PID 11819 died... 07:33:53.615893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11819): Terminated: ok {rc=0} 07:33:53.660222 --- ParallelTerminationStrategy: PID 11822 died... 07:33:53.678921 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11822): Terminated: ok {rc=0} 07:33:53.764775 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-umtrx iperf3m4.py ---------------------------------------------- 07:33:54.911250 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:54.922642 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 07:33:54.974017 tst iperf3m4.py: using LAC 26836 07:33:55.090810 tst iperf3m4.py: using RAC 61 07:33:55.214285 tst iperf3m4.py: using CellId 26836 07:33:55.341388 tst iperf3m4.py: using BVCI 26837 07:33:55.458379 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:55.469402 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:55.480141 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:55.490991 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:55.501743 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:55.512382 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:55.523345 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:55.534146 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:33:55.544901 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:33:55.664300 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:33:55.788806 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:33:55.908372 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:33:56.024732 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:33:56.225492 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:33:56.524154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11824): Launched 07:33:56.783798 run iperf3-srv_10.42.42.10(pid=11825): Launched 07:33:56.896084 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:33:57.095702 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:33:57.393346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11826): Launched 07:33:57.651882 run iperf3-srv_10.42.42.10(pid=11827): Launched 07:33:57.763645 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:33:57.961706 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:33:58.258253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11828): Launched 07:33:58.515609 run iperf3-srv_10.42.42.10(pid=11829): Launched 07:33:58.627079 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:33:58.825735 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:33:59.139058 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11830): Launched 07:33:59.416420 run iperf3-srv_10.42.42.10(pid=11831): Launched 07:33:59.535982 tst iperf3m4.py:8: start network... 07:33:59.751045 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:34:00.244396 run create_hlr_db(pid=11832): Launched 07:34:00.374156 bus /gobi_6: Setting Powered False 07:34:01.435850 run create_hlr_db(pid=11832): Terminated: ok {rc=0} 07:34:01.925049 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11834): Launched 07:34:02.254255 run osmo-hlr_10.42.42.2(pid=11835): Launched 07:34:02.391235 run osmo-stp_10.42.42.5: Starting osmo-stp 07:34:02.943805 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11837): Launched 07:34:03.264188 run osmo-stp_10.42.42.5(pid=11838): Launched 07:34:03.386187 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:34:03.936584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11840): Launched 07:34:04.059380 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:34:04.328876 run patchelf(pid=11841): Launched 07:34:04.506832 run osmo-stp_10.42.42.5(pid=11838): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11838)] 07:34:04.641783 run osmo-stp_10.42.42.5(pid=11838): stdout: | (launched: 2022-12-10_07:34:03.206269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:04.778763 run osmo-stp_10.42.42.5(pid=11838): stderr: | [0;m[38;5;43m20221210073403398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073403398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073403398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073403398 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073403399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073403399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073403399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:04.915582 run osmo-stp_10.42.42.5(pid=11838): stdout: | (launched: 2022-12-10_07:34:03.206269) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:05.047370 run osmo-stp_10.42.42.5(pid=11838): stderr: | [0;m[38;5;43m20221210073403398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073403398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073403398 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073403398 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073403399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073403399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073403399 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:05.202619 run patchelf(pid=11841): Terminating (SIGINT) 07:34:05.381572 run patchelf(pid=11841): Terminated: ok {rc=0} 07:34:05.510703 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11838): Process ended prematurely: osmo-stp_10.42.42.5(pid=11838) [trial-2371↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11838)] [trial-2371↪gprs:trx-umtrx↪iperf3m4.py:8] 07:34:05.520576 tst iperf3m4.py:8: Test FAILED (10.6 sec) 07:34:05.549693 run osmo-hlr_10.42.42.2(pid=11835): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11835)] 07:34:05.599886 run osmo-hlr_10.42.42.2(pid=11835): stdout: | (launched: 2022-12-10_07:34:02.194196) 07:34:05.651763 run osmo-hlr_10.42.42.2(pid=11835): stderr: | [0;m[1;31m20221210073402410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073402410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073402410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073402410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073402410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073402410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073402422 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073402430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073402430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073402430 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:34:05.703943 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11824): Terminating (SIGTERM) 07:34:05.745884 run iperf3-srv_10.42.42.10(pid=11825): Terminating (SIGTERM) 07:34:05.787896 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11826): Terminating (SIGTERM) 07:34:05.830078 run iperf3-srv_10.42.42.10(pid=11827): Terminating (SIGTERM) 07:34:05.872005 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11828): Terminating (SIGTERM) 07:34:05.914505 run iperf3-srv_10.42.42.10(pid=11829): Terminating (SIGTERM) 07:34:05.956376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11830): Terminating (SIGTERM) 07:34:05.998324 run iperf3-srv_10.42.42.10(pid=11831): Terminating (SIGTERM) 07:34:06.040400 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11834): Terminating (SIGTERM) 07:34:06.082530 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11837): Terminating (SIGTERM) 07:34:06.124634 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11840): Terminating (SIGTERM) 07:34:06.166852 --- ParallelTerminationStrategy: PID 11824 died... 07:34:06.186906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11824): Terminated: ok {rc=0} 07:34:06.233252 --- ParallelTerminationStrategy: PID 11825 died... 07:34:06.252611 run iperf3-srv_10.42.42.10(pid=11825): Terminated {rc=256} 07:34:06.298745 --- ParallelTerminationStrategy: PID 11826 died... 07:34:06.318262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11826): Terminated: ok {rc=0} 07:34:06.364130 --- ParallelTerminationStrategy: PID 11827 died... 07:34:06.383589 run iperf3-srv_10.42.42.10(pid=11827): Terminated {rc=256} 07:34:06.429479 --- ParallelTerminationStrategy: PID 11828 died... 07:34:06.448925 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11828): Terminated: ok {rc=0} 07:34:06.494800 --- ParallelTerminationStrategy: PID 11829 died... 07:34:06.514344 run iperf3-srv_10.42.42.10(pid=11829): Terminated {rc=256} 07:34:06.560042 --- ParallelTerminationStrategy: PID 11830 died... 07:34:06.579544 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11830): Terminated: ok {rc=0} 07:34:06.625529 --- ParallelTerminationStrategy: PID 11831 died... 07:34:06.644848 run iperf3-srv_10.42.42.10(pid=11831): Terminated {rc=256} 07:34:06.690897 --- ParallelTerminationStrategy: PID 11834 died... 07:34:06.710507 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11834): Terminated: ok {rc=0} 07:34:06.756300 --- ParallelTerminationStrategy: PID 11837 died... 07:34:06.775908 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11837): Terminated: ok {rc=0} 07:34:06.822522 --- ParallelTerminationStrategy: PID 11840 died... 07:34:06.842054 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11840): Terminated: ok {rc=0} 07:34:06.930453 bus /gobi_4: Setting Powered False 07:34:08.030514 bus /gobi_4: Setting Powered False 07:34:09.146384 bus /gobi_1: Setting Powered False 07:34:10.244700 bus /gobi_1: Setting Powered False 07:34:11.360218 bus /gobi_0: Setting Powered False 07:34:12.457972 bus /gobi_0: Setting Powered False 07:34:13.572655 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-umtrx ping.py ---------------------------------------------- 07:34:14.674893 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:14.686152 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 07:34:14.734192 tst ping.py: using LAC 26837 07:34:14.851167 tst ping.py: using RAC 62 07:34:14.974675 tst ping.py: using CellId 26837 07:34:15.099503 tst ping.py: using BVCI 26838 07:34:15.214890 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:15.226072 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:15.236835 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:15.247818 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:15.258581 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:15.269291 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:15.280163 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:15.290980 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:34:15.404603 tst ping.py:19: start network... 07:34:15.600528 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:34:16.071590 run create_hlr_db(pid=11842): Launched 07:34:16.239169 bus /gobi_6: Setting Powered False 07:34:17.307041 run create_hlr_db(pid=11842): Terminated: ok {rc=0} 07:34:17.757069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11844): Launched 07:34:18.069437 run osmo-hlr_10.42.42.2(pid=11845): Launched 07:34:18.189419 run osmo-stp_10.42.42.5: Starting osmo-stp 07:34:18.729523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11847): Launched 07:34:19.041240 run osmo-stp_10.42.42.5(pid=11848): Launched 07:34:19.162102 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:34:19.705241 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11850): Launched 07:34:19.824422 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:34:20.088154 run patchelf(pid=11851): Launched 07:34:20.263021 run osmo-stp_10.42.42.5(pid=11848): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11848)] 07:34:20.395067 run osmo-stp_10.42.42.5(pid=11848): stdout: | (launched: 2022-12-10_07:34:18.984351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:20.529866 run osmo-stp_10.42.42.5(pid=11848): stderr: | [0;m[38;5;43m20221210073419174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073419174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073419174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073419174 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073419177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073419177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073419177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:20.663403 run osmo-stp_10.42.42.5(pid=11848): stdout: | (launched: 2022-12-10_07:34:18.984351) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:20.791036 run osmo-stp_10.42.42.5(pid=11848): stderr: | [0;m[38;5;43m20221210073419174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073419174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073419174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073419174 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073419177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073419177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073419177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:20.942544 run patchelf(pid=11851): Terminating (SIGINT) 07:34:21.118473 run patchelf(pid=11851): Terminated: ok {rc=0} 07:34:21.245693 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11848): Process ended prematurely: osmo-stp_10.42.42.5(pid=11848) [trial-2371↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11848)] [trial-2371↪gprs:trx-umtrx↪ping.py:22] 07:34:21.254895 tst ping.py:22: Test FAILED (6.6 sec) 07:34:21.282514 run osmo-hlr_10.42.42.2(pid=11845): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11845)] 07:34:21.331817 run osmo-hlr_10.42.42.2(pid=11845): stdout: | (launched: 2022-12-10_07:34:18.012300) 07:34:21.382925 run osmo-hlr_10.42.42.2(pid=11845): stderr: | [0;m[1;31m20221210073418209 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073418209 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073418209 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073418209 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073418209 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073418209 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073418254 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073418264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073418264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073418264 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:34:21.434232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11844): Terminating (SIGTERM) 07:34:21.475419 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11847): Terminating (SIGTERM) 07:34:21.516631 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11850): Terminating (SIGTERM) 07:34:21.558186 --- ParallelTerminationStrategy: PID 11844 died... 07:34:21.578038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11844): Terminated: ok {rc=0} 07:34:21.623901 --- ParallelTerminationStrategy: PID 11847 died... 07:34:21.643425 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11847): Terminated: ok {rc=0} 07:34:21.688794 --- ParallelTerminationStrategy: PID 11850 died... 07:34:21.708526 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11850): Terminated: ok {rc=0} 07:34:21.795207 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-umtrx ping_idle_ping.py ---------------------------------------------- 07:34:22.882080 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:22.893700 tst gprs:trx-umtrx: Using 1 x bts (candidates: 1) 07:34:22.943611 tst ping_idle_ping.py: using LAC 26838 07:34:23.061515 tst ping_idle_ping.py: using RAC 63 07:34:23.188396 tst ping_idle_ping.py: using CellId 26838 07:34:23.313232 tst ping_idle_ping.py: using BVCI 26839 07:34:23.428318 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:23.439392 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:23.450239 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:23.461149 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:23.471762 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:23.482530 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:23.493389 tst gprs:trx-umtrx: Using 1 x ip_address (candidates: 9) 07:34:23.504096 tst gprs:trx-umtrx: Using 1 x modem (candidates: 4) 07:34:23.617354 tst ping_idle_ping.py:24: start network... 07:34:23.812854 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:34:24.267016 run create_hlr_db(pid=11852): Launched 07:34:24.379805 bus /gobi_6: Setting Powered False 07:34:25.439560 run create_hlr_db(pid=11852): Terminated: ok {rc=0} 07:34:25.870337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11854): Launched 07:34:26.184357 run osmo-hlr_10.42.42.2(pid=11855): Launched 07:34:26.304647 run osmo-stp_10.42.42.5: Starting osmo-stp 07:34:26.851997 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11857): Launched 07:34:27.166064 run osmo-stp_10.42.42.5(pid=11858): Launched 07:34:27.287083 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:34:27.828680 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11860): Launched 07:34:27.948507 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:34:28.213689 run patchelf(pid=11861): Launched 07:34:28.388664 run osmo-stp_10.42.42.5(pid=11858): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11858)] 07:34:28.521252 run osmo-stp_10.42.42.5(pid=11858): stdout: | (launched: 2022-12-10_07:34:27.109115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:28.655523 run osmo-stp_10.42.42.5(pid=11858): stderr: | [0;m[38;5;43m20221210073427300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073427300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073427301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073427301 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073427302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073427302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073427302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:28.790342 run osmo-stp_10.42.42.5(pid=11858): stdout: | (launched: 2022-12-10_07:34:27.109115) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:28.918905 run osmo-stp_10.42.42.5(pid=11858): stderr: | [0;m[38;5;43m20221210073427300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073427300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073427301 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073427301 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073427302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073427302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073427302 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:29.071986 run patchelf(pid=11861): Terminating (SIGINT) 07:34:29.249428 run patchelf(pid=11861): Terminated: ok {rc=0} 07:34:29.376678 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11858): Process ended prematurely: osmo-stp_10.42.42.5(pid=11858) [trial-2371↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11858)] [trial-2371↪gprs:trx-umtrx↪ping_idle_ping.py:27] 07:34:29.386056 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 07:34:29.413821 run osmo-hlr_10.42.42.2(pid=11855): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11855)] 07:34:29.463349 run osmo-hlr_10.42.42.2(pid=11855): stdout: | (launched: 2022-12-10_07:34:26.127442) 07:34:29.514890 run osmo-hlr_10.42.42.2(pid=11855): stderr: | [0;m[1;31m20221210073426325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073426325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073426325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073426325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073426325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073426325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073426338 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073426348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073426348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073426348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:34:29.566939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11854): Terminating (SIGTERM) 07:34:29.608636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11857): Terminating (SIGTERM) 07:34:29.650373 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11860): Terminating (SIGTERM) 07:34:29.692439 --- ParallelTerminationStrategy: PID 11854 died... 07:34:29.712357 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11854): Terminated: ok {rc=0} 07:34:29.758998 --- ParallelTerminationStrategy: PID 11857 died... 07:34:29.778769 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11857): Terminated: ok {rc=0} 07:34:29.825126 --- ParallelTerminationStrategy: PID 11860 died... 07:34:29.844841 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11860): Terminated: ok {rc=0} 07:34:29.933364 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-egprs --------------------------------------------------------------------- 07:34:31.240517 tst gprs:trx-umtrx+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:34:31.247356 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:34:31.282627 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:34:31.322965 tst gprs:trx-umtrx+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:34:31.416135 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:34:31.465844 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:34:31.522064 tst gprs:trx-umtrx+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:34:32.105481 tst gprs:trx-umtrx+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:34:32.157135 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:32.168678 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:34:32.220213 tst cs_paging_gprs_active.py: using LAC 26839 07:34:32.347464 tst cs_paging_gprs_active.py: using RAC 64 07:34:32.471179 tst cs_paging_gprs_active.py: using CellId 26839 07:34:32.588184 tst cs_paging_gprs_active.py: using BVCI 26840 07:34:32.706037 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:32.717553 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:32.728817 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:32.740684 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:32.752505 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:32.764290 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:32.776137 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:32.787440 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:32.799195 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:34:32.916593 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:34:33.031897 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:34:33.232650 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:34:33.531154 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11865): Launched 07:34:33.789920 run iperf3-srv_10.42.42.10(pid=11866): Launched 07:34:33.901966 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:34:34.113428 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:34:34.436774 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11870): Launched 07:34:34.715655 run iperf3-srv_10.42.42.10(pid=11871): Launched 07:34:34.836279 tst cs_paging_gprs_active.py:38: start network... 07:34:35.052835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:34:35.548077 run create_hlr_db(pid=11872): Launched 07:34:35.678478 bus /gobi_6: Setting Powered False 07:34:36.742012 run create_hlr_db(pid=11872): Terminated: ok {rc=0} 07:34:37.186358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11874): Launched 07:34:37.506623 run osmo-hlr_10.42.42.2(pid=11875): Launched 07:34:37.628557 run osmo-stp_10.42.42.5: Starting osmo-stp 07:34:38.176196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11877): Launched 07:34:38.494499 run osmo-stp_10.42.42.5(pid=11878): Launched 07:34:38.616511 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:34:39.167106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11880): Launched 07:34:39.290390 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:34:39.558840 run patchelf(pid=11881): Launched 07:34:39.735998 run osmo-stp_10.42.42.5(pid=11878): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11878)] 07:34:39.870457 run osmo-stp_10.42.42.5(pid=11878): stdout: | (launched: 2022-12-10_07:34:38.436573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:40.006917 run osmo-stp_10.42.42.5(pid=11878): stderr: | [0;m[38;5;43m20221210073438628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073438628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073438628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073438629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073438631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073438631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073438631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:40.143848 run osmo-stp_10.42.42.5(pid=11878): stdout: | (launched: 2022-12-10_07:34:38.436573) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:40.273866 run osmo-stp_10.42.42.5(pid=11878): stderr: | [0;m[38;5;43m20221210073438628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073438628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073438628 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073438629 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073438631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073438631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073438631 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:40.428189 run patchelf(pid=11881): Terminating (SIGINT) 07:34:40.607532 run patchelf(pid=11881): Terminated: ok {rc=0} 07:34:40.737212 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11878): Process ended prematurely: osmo-stp_10.42.42.5(pid=11878) [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11878)] [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:34:40.747056 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 07:34:40.775309 run osmo-hlr_10.42.42.2(pid=11875): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11875)] 07:34:40.824642 run osmo-hlr_10.42.42.2(pid=11875): stdout: | (launched: 2022-12-10_07:34:37.448477) 07:34:40.875711 run osmo-hlr_10.42.42.2(pid=11875): stderr: | [0;m[1;31m20221210073437646 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073437647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073437647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073437647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073437647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073437647 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073437659 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073437668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073437668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073437668 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:34:40.927047 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11865): Terminating (SIGTERM) 07:34:40.968414 run iperf3-srv_10.42.42.10(pid=11866): Terminating (SIGTERM) 07:34:41.009589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11870): Terminating (SIGTERM) 07:34:41.050730 run iperf3-srv_10.42.42.10(pid=11871): Terminating (SIGTERM) 07:34:41.092119 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11874): Terminating (SIGTERM) 07:34:41.133632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11877): Terminating (SIGTERM) 07:34:41.174643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11880): Terminating (SIGTERM) 07:34:41.216034 --- ParallelTerminationStrategy: PID 11865 died... 07:34:41.235968 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11865): Terminated: ok {rc=0} 07:34:41.282151 --- ParallelTerminationStrategy: PID 11866 died... 07:34:41.301787 run iperf3-srv_10.42.42.10(pid=11866): Terminated {rc=256} 07:34:41.347417 --- ParallelTerminationStrategy: PID 11870 died... 07:34:41.366930 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11870): Terminated: ok {rc=0} 07:34:41.412288 --- ParallelTerminationStrategy: PID 11871 died... 07:34:41.431673 run iperf3-srv_10.42.42.10(pid=11871): Terminated {rc=256} 07:34:41.476900 --- ParallelTerminationStrategy: PID 11874 died... 07:34:41.496690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11874): Terminated: ok {rc=0} 07:34:41.541888 --- ParallelTerminationStrategy: PID 11877 died... 07:34:41.561347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11877): Terminated: ok {rc=0} 07:34:41.606644 --- ParallelTerminationStrategy: PID 11880 died... 07:34:41.625983 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11880): Terminated: ok {rc=0} 07:34:41.712177 bus /gobi_0: Setting Powered False 07:34:42.811089 bus /gobi_0: Setting Powered False 07:34:43.925600 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:34:45.074247 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:45.086004 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:34:45.139300 tst iperf3.py: using LAC 26840 07:34:45.266484 tst iperf3.py: using RAC 65 07:34:45.394023 tst iperf3.py: using CellId 26840 07:34:45.520430 tst iperf3.py: using BVCI 26841 07:34:45.637800 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:45.649087 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:45.660095 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:45.671199 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:45.682239 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:45.693337 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:45.704521 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:45.715450 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:45.726817 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:34:45.851935 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:34:46.080145 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:34:46.410192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11882): Launched 07:34:46.701162 run iperf3-srv_10.42.42.10(pid=11883): Launched 07:34:46.835977 tst iperf3.py:8: start network... 07:34:47.055175 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:34:47.553690 run create_hlr_db(pid=11884): Launched 07:34:47.679147 bus /gobi_6: Setting Powered False 07:34:48.738108 run create_hlr_db(pid=11884): Terminated: ok {rc=0} 07:34:49.149885 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11886): Launched 07:34:49.445598 run osmo-hlr_10.42.42.2(pid=11887): Launched 07:34:49.559731 run osmo-stp_10.42.42.5: Starting osmo-stp 07:34:50.090551 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11889): Launched 07:34:50.388366 run osmo-stp_10.42.42.5(pid=11890): Launched 07:34:50.502985 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:34:51.016834 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11892): Launched 07:34:51.131142 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:34:51.383621 run patchelf(pid=11893): Launched 07:34:51.549828 run osmo-stp_10.42.42.5(pid=11890): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11890)] 07:34:51.675650 run osmo-stp_10.42.42.5(pid=11890): stdout: | (launched: 2022-12-10_07:34:50.333883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:51.803215 run osmo-stp_10.42.42.5(pid=11890): stderr: | [0;m[38;5;43m20221210073450503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073450503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073450503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073450504 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073450504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073450504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073450505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:51.931042 run osmo-stp_10.42.42.5(pid=11890): stdout: | (launched: 2022-12-10_07:34:50.333883) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:34:52.052601 run osmo-stp_10.42.42.5(pid=11890): stderr: | [0;m[38;5;43m20221210073450503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073450503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073450503 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073450504 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073450504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073450504 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073450505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:34:52.197350 run patchelf(pid=11893): Terminating (SIGINT) 07:34:52.365407 run patchelf(pid=11893): Terminated: ok {rc=0} 07:34:52.486601 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11890): Process ended prematurely: osmo-stp_10.42.42.5(pid=11890) [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11890)] [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8] 07:34:52.495788 tst iperf3.py:8: Test FAILED (7.5 sec) 07:34:52.523396 run osmo-hlr_10.42.42.2(pid=11887): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11887)] 07:34:52.571138 run osmo-hlr_10.42.42.2(pid=11887): stdout: | (launched: 2022-12-10_07:34:49.391652) 07:34:52.620512 run osmo-hlr_10.42.42.2(pid=11887): stderr: | [0;m[1;31m20221210073449565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073449565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073449565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073449565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073449565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073449565 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073449577 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073449585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073449585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073449585 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:34:52.670374 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11882): Terminating (SIGTERM) 07:34:52.710288 run iperf3-srv_10.42.42.10(pid=11883): Terminating (SIGTERM) 07:34:52.750070 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11886): Terminating (SIGTERM) 07:34:52.790169 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11889): Terminating (SIGTERM) 07:34:52.830113 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11892): Terminating (SIGTERM) 07:34:52.870365 --- ParallelTerminationStrategy: PID 11882 died... 07:34:52.889569 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11882): Terminated: ok {rc=0} 07:34:52.934278 --- ParallelTerminationStrategy: PID 11883 died... 07:34:52.952845 run iperf3-srv_10.42.42.10(pid=11883): Terminated {rc=256} 07:34:52.997578 --- ParallelTerminationStrategy: PID 11886 died... 07:34:53.016409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11886): Terminated: ok {rc=0} 07:34:53.060737 --- ParallelTerminationStrategy: PID 11889 died... 07:34:53.079615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11889): Terminated: ok {rc=0} 07:34:53.124061 --- ParallelTerminationStrategy: PID 11892 died... 07:34:53.142887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11892): Terminated: ok {rc=0} 07:34:53.229308 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:34:54.375361 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:54.386635 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:34:54.438065 tst iperf3m4.py: using LAC 26841 07:34:54.555362 tst iperf3m4.py: using RAC 66 07:34:54.673387 tst iperf3m4.py: using CellId 26841 07:34:54.801213 tst iperf3m4.py: using BVCI 26842 07:34:54.917630 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:54.929098 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:54.940305 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:54.951892 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:54.963366 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:54.974694 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:54.986396 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:54.997769 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:34:55.009225 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:34:55.128221 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:34:55.247391 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:34:55.363048 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:34:55.478371 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:34:55.678524 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:34:55.976740 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11894): Launched 07:34:56.235816 run iperf3-srv_10.42.42.10(pid=11895): Launched 07:34:56.347727 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:34:56.546370 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:34:56.843557 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11896): Launched 07:34:57.101792 run iperf3-srv_10.42.42.10(pid=11897): Launched 07:34:57.213103 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:34:57.411590 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:34:57.709301 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11898): Launched 07:34:57.968165 run iperf3-srv_10.42.42.10(pid=11899): Launched 07:34:58.080409 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:34:58.278958 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:34:58.576215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11900): Launched 07:34:58.834304 run iperf3-srv_10.42.42.10(pid=11901): Launched 07:34:58.945751 tst iperf3m4.py:8: start network... 07:34:59.144502 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:34:59.603603 run create_hlr_db(pid=11902): Launched 07:34:59.717892 bus /gobi_6: Setting Powered False 07:35:00.777564 run create_hlr_db(pid=11902): Terminated: ok {rc=0} 07:35:01.247556 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11904): Launched 07:35:01.608198 run osmo-hlr_10.42.42.2(pid=11905): Launched 07:35:01.803508 run osmo-stp_10.42.42.5: Starting osmo-stp 07:35:02.656706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11910): Launched 07:35:02.976470 run osmo-stp_10.42.42.5(pid=11911): Launched 07:35:03.098816 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:35:03.648328 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11913): Launched 07:35:03.770984 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:35:04.039823 run patchelf(pid=11914): Launched 07:35:04.218429 run osmo-stp_10.42.42.5(pid=11911): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11911)] 07:35:04.353458 run osmo-stp_10.42.42.5(pid=11911): stdout: | (launched: 2022-12-10_07:35:02.918546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:04.490249 run osmo-stp_10.42.42.5(pid=11911): stderr: | [0;m[38;5;43m20221210073503109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073503109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073503109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073503109 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073503110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073503110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073503110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:04.627015 run osmo-stp_10.42.42.5(pid=11911): stdout: | (launched: 2022-12-10_07:35:02.918546) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:04.757772 run osmo-stp_10.42.42.5(pid=11911): stderr: | [0;m[38;5;43m20221210073503109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073503109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073503109 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073503109 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073503110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073503110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073503110 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:04.913153 run patchelf(pid=11914): Terminating (SIGINT) 07:35:05.092406 run patchelf(pid=11914): Terminated: ok {rc=0} 07:35:05.222112 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11911): Process ended prematurely: osmo-stp_10.42.42.5(pid=11911) [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11911)] [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8] 07:35:05.232043 tst iperf3m4.py:8: Test FAILED (10.9 sec) 07:35:05.260660 run osmo-hlr_10.42.42.2(pid=11905): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11905)] 07:35:05.310208 run osmo-hlr_10.42.42.2(pid=11905): stdout: | (launched: 2022-12-10_07:35:01.533501) 07:35:05.361426 run osmo-hlr_10.42.42.2(pid=11905): stderr: | [0;m[1;31m20221210073501891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073501891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073501891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073501891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073501891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073501891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073501913 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073501932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073501932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073501932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:35:05.412920 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11894): Terminating (SIGTERM) 07:35:05.454448 run iperf3-srv_10.42.42.10(pid=11895): Terminating (SIGTERM) 07:35:05.496221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11896): Terminating (SIGTERM) 07:35:05.537943 run iperf3-srv_10.42.42.10(pid=11897): Terminating (SIGTERM) 07:35:05.579226 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11898): Terminating (SIGTERM) 07:35:05.620880 run iperf3-srv_10.42.42.10(pid=11899): Terminating (SIGTERM) 07:35:05.663394 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11900): Terminating (SIGTERM) 07:35:05.706359 run iperf3-srv_10.42.42.10(pid=11901): Terminating (SIGTERM) 07:35:05.746613 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11904): Terminating (SIGTERM) 07:35:05.787350 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11910): Terminating (SIGTERM) 07:35:05.827829 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11913): Terminating (SIGTERM) 07:35:05.868524 --- ParallelTerminationStrategy: PID 11894 died... 07:35:05.887713 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11894): Terminated: ok {rc=0} 07:35:05.933569 --- ParallelTerminationStrategy: PID 11895 died... 07:35:05.952193 run iperf3-srv_10.42.42.10(pid=11895): Terminated {rc=256} 07:35:05.997687 --- ParallelTerminationStrategy: PID 11896 died... 07:35:06.016423 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11896): Terminated: ok {rc=0} 07:35:06.062032 --- ParallelTerminationStrategy: PID 11897 died... 07:35:06.080559 run iperf3-srv_10.42.42.10(pid=11897): Terminated {rc=256} 07:35:06.126132 --- ParallelTerminationStrategy: PID 11898 died... 07:35:06.144931 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11898): Terminated: ok {rc=0} 07:35:06.190423 --- ParallelTerminationStrategy: PID 11899 died... 07:35:06.208906 run iperf3-srv_10.42.42.10(pid=11899): Terminated {rc=256} 07:35:06.254342 --- ParallelTerminationStrategy: PID 11900 died... 07:35:06.273089 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11900): Terminated: ok {rc=0} 07:35:06.318564 --- ParallelTerminationStrategy: PID 11901 died... 07:35:06.337225 run iperf3-srv_10.42.42.10(pid=11901): Terminated {rc=256} 07:35:06.382508 --- ParallelTerminationStrategy: PID 11904 died... 07:35:06.401229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11904): Terminated: ok {rc=0} 07:35:06.446879 --- ParallelTerminationStrategy: PID 11910 died... 07:35:06.465684 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11910): Terminated: ok {rc=0} 07:35:06.511247 --- ParallelTerminationStrategy: PID 11913 died... 07:35:06.530056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11913): Terminated: ok {rc=0} 07:35:06.616358 bus /gobi_4: Setting Powered False 07:35:07.714688 bus /gobi_4: Setting Powered False 07:35:08.831653 bus /gobi_1: Setting Powered False 07:35:09.929448 bus /gobi_1: Setting Powered False 07:35:11.045199 bus /gobi_0: Setting Powered False 07:35:12.139956 bus /gobi_0: Setting Powered False 07:35:13.256052 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-egprs ping.py ---------------------------------------------- 07:35:14.358293 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:14.369699 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:35:14.419778 tst ping.py: using LAC 26842 07:35:14.535643 tst ping.py: using RAC 67 07:35:14.653422 tst ping.py: using CellId 26842 07:35:14.777132 tst ping.py: using BVCI 26843 07:35:14.890941 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:14.902315 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:14.913685 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:14.925000 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:14.936235 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:14.947582 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:14.959169 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:14.970442 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:35:15.083030 tst ping.py:19: start network... 07:35:15.277797 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:35:15.730821 run create_hlr_db(pid=11915): Launched 07:35:15.857999 bus /gobi_6: Setting Powered False 07:35:16.919702 run create_hlr_db(pid=11915): Terminated: ok {rc=0} 07:35:17.364055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11917): Launched 07:35:17.677823 run osmo-hlr_10.42.42.2(pid=11918): Launched 07:35:17.797887 run osmo-stp_10.42.42.5: Starting osmo-stp 07:35:18.339233 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11920): Launched 07:35:18.651059 run osmo-stp_10.42.42.5(pid=11921): Launched 07:35:18.770310 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:35:19.308319 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11923): Launched 07:35:19.427987 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:35:19.691869 run patchelf(pid=11924): Launched 07:35:19.866553 run osmo-stp_10.42.42.5(pid=11921): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11921)] 07:35:19.998473 run osmo-stp_10.42.42.5(pid=11921): stdout: | (launched: 2022-12-10_07:35:18.594244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:20.132712 run osmo-stp_10.42.42.5(pid=11921): stderr: | [0;m[38;5;43m20221210073518783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073518783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073518783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073518784 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073518784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073518784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073518785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:20.266673 run osmo-stp_10.42.42.5(pid=11921): stdout: | (launched: 2022-12-10_07:35:18.594244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:20.394480 run osmo-stp_10.42.42.5(pid=11921): stderr: | [0;m[38;5;43m20221210073518783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073518783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073518783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073518784 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073518784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073518784 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073518785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:20.546239 run patchelf(pid=11924): Terminating (SIGINT) 07:35:20.721505 run patchelf(pid=11924): Terminated: ok {rc=0} 07:35:20.847850 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11921): Process ended prematurely: osmo-stp_10.42.42.5(pid=11921) [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11921)] [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22] 07:35:20.857308 tst ping.py:22: Test FAILED (6.5 sec) 07:35:20.885113 run osmo-hlr_10.42.42.2(pid=11918): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11918)] 07:35:20.934064 run osmo-hlr_10.42.42.2(pid=11918): stdout: | (launched: 2022-12-10_07:35:17.621252) 07:35:20.985171 run osmo-hlr_10.42.42.2(pid=11918): stderr: | [0;m[1;31m20221210073517818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073517818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073517818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073517819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073517819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073517819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073517831 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073517839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073517839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073517839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:35:21.036546 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11917): Terminating (SIGTERM) 07:35:21.078512 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11920): Terminating (SIGTERM) 07:35:21.120056 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11923): Terminating (SIGTERM) 07:35:21.161988 --- ParallelTerminationStrategy: PID 11917 died... 07:35:21.182014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11917): Terminated: ok {rc=0} 07:35:21.227681 --- ParallelTerminationStrategy: PID 11920 died... 07:35:21.247209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11920): Terminated: ok {rc=0} 07:35:21.292748 --- ParallelTerminationStrategy: PID 11923 died... 07:35:21.312323 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11923): Terminated: ok {rc=0} 07:35:21.398733 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:35:22.486966 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:22.499353 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:35:22.551845 tst ping_idle_ping.py: using LAC 26843 07:35:22.669042 tst ping_idle_ping.py: using RAC 68 07:35:22.785293 tst ping_idle_ping.py: using CellId 26843 07:35:22.900435 tst ping_idle_ping.py: using BVCI 26844 07:35:23.006345 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:23.017342 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:23.027991 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:23.039146 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:23.050416 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:23.061220 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:23.072205 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:35:23.083124 tst gprs:trx-umtrx+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:35:23.198093 tst ping_idle_ping.py:24: start network... 07:35:23.394376 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:35:23.850359 run create_hlr_db(pid=11925): Launched 07:35:23.962266 bus /gobi_6: Setting Powered False 07:35:25.021684 run create_hlr_db(pid=11925): Terminated: ok {rc=0} 07:35:25.431441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11927): Launched 07:35:25.725086 run osmo-hlr_10.42.42.2(pid=11928): Launched 07:35:25.838240 run osmo-stp_10.42.42.5: Starting osmo-stp 07:35:26.341942 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11930): Launched 07:35:26.634529 run osmo-stp_10.42.42.5(pid=11931): Launched 07:35:26.747058 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:35:27.251305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11933): Launched 07:35:27.363557 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:35:27.610285 run patchelf(pid=11934): Launched 07:35:27.773611 run osmo-stp_10.42.42.5(pid=11931): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11931)] 07:35:27.897270 run osmo-stp_10.42.42.5(pid=11931): stdout: | (launched: 2022-12-10_07:35:26.580610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:28.022826 run osmo-stp_10.42.42.5(pid=11931): stderr: | [0;m[38;5;43m20221210073526747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073526747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073526747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073526748 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073526750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073526750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073526750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:28.148482 run osmo-stp_10.42.42.5(pid=11931): stdout: | (launched: 2022-12-10_07:35:26.580610) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:28.268027 run osmo-stp_10.42.42.5(pid=11931): stderr: | [0;m[38;5;43m20221210073526747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073526747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073526747 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073526748 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073526750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073526750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073526750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:28.409989 run patchelf(pid=11934): Terminating (SIGINT) 07:35:28.575554 run patchelf(pid=11934): Terminated: ok {rc=0} 07:35:28.694774 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=11931): Process ended prematurely: osmo-stp_10.42.42.5(pid=11931) [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11931)] [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27] 07:35:28.703613 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 07:35:28.730608 run osmo-hlr_10.42.42.2(pid=11928): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11928)] 07:35:28.778121 run osmo-hlr_10.42.42.2(pid=11928): stdout: | (launched: 2022-12-10_07:35:25.671384) 07:35:28.827553 run osmo-hlr_10.42.42.2(pid=11928): stderr: | [0;m[1;31m20221210073525849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073525849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073525849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073525849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073525849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073525849 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073525861 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073525869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073525869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073525869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:35:28.877221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11927): Terminating (SIGTERM) 07:35:28.917184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11930): Terminating (SIGTERM) 07:35:28.956987 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11933): Terminating (SIGTERM) 07:35:28.996933 --- ParallelTerminationStrategy: PID 11927 died... 07:35:29.016073 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11927): Terminated: ok {rc=0} 07:35:29.060689 --- ParallelTerminationStrategy: PID 11930 died... 07:35:29.079450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11930): Terminated: ok {rc=0} 07:35:29.123733 --- ParallelTerminationStrategy: PID 11933 died... 07:35:29.142381 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11933): Terminated: ok {rc=0} 07:35:29.228457 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:35:30.537120 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:35:30.543704 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:35:30.576309 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:35:30.614882 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:35:30.700380 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:35:30.734653 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:35:30.773817 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:35:31.394105 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:35:31.452895 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:31.465284 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:35:31.535713 tst cs_paging_gprs_active.py: using LAC 26844 07:35:31.663248 tst cs_paging_gprs_active.py: using RAC 69 07:35:31.828599 tst cs_paging_gprs_active.py: using CellId 26844 07:35:31.991977 tst cs_paging_gprs_active.py: using BVCI 26845 07:35:32.105924 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:32.117769 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:32.129828 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:32.143578 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:32.155132 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:32.167457 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:32.181356 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:32.193929 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:32.205704 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:35:32.327326 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:35:32.447992 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:35:32.650776 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:35:32.949711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11938): Launched 07:35:33.209458 run iperf3-srv_10.42.42.10(pid=11939): Launched 07:35:33.322009 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:35:33.521221 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:35:33.820233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11940): Launched 07:35:34.079276 run iperf3-srv_10.42.42.10(pid=11941): Launched 07:35:34.191253 tst cs_paging_gprs_active.py:38: start network... 07:35:34.390571 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:35:34.850156 run create_hlr_db(pid=11942): Launched 07:35:34.965319 bus /gobi_6: Setting Powered False 07:35:36.025332 run create_hlr_db(pid=11942): Terminated: ok {rc=0} 07:35:36.461749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11944): Launched 07:35:36.781737 run osmo-hlr_10.42.42.2(pid=11945): Launched 07:35:36.903475 run osmo-stp_10.42.42.5: Starting osmo-stp 07:35:37.452816 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11947): Launched 07:35:37.772000 run osmo-stp_10.42.42.5(pid=11949): Launched 07:35:37.894312 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:35:38.443616 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11951): Launched 07:35:38.565788 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:35:38.841530 run patchelf(pid=11952): Launched 07:35:39.020512 run osmo-stp_10.42.42.5(pid=11949): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11949)] 07:35:39.156576 run osmo-stp_10.42.42.5(pid=11949): stdout: | (launched: 2022-12-10_07:35:37.713592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:39.293912 run osmo-stp_10.42.42.5(pid=11949): stderr: | [0;m[38;5;43m20221210073537906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073537906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073537906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073537906 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073537909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073537909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073537909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:39.431342 run osmo-stp_10.42.42.5(pid=11949): stdout: | (launched: 2022-12-10_07:35:37.713592) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:39.562463 run osmo-stp_10.42.42.5(pid=11949): stderr: | [0;m[38;5;43m20221210073537906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073537906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073537906 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073537906 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073537909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073537909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073537909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:39.717844 run patchelf(pid=11952): Terminating (SIGINT) 07:35:39.899027 run patchelf(pid=11952): Terminated: ok {rc=0} 07:35:40.030178 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=11949): Process ended prematurely: osmo-stp_10.42.42.5(pid=11949) [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11949)] [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:35:40.040218 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 07:35:40.069029 run osmo-hlr_10.42.42.2(pid=11945): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11945)] 07:35:40.119211 run osmo-hlr_10.42.42.2(pid=11945): stdout: | (launched: 2022-12-10_07:35:36.723751) 07:35:40.170819 run osmo-hlr_10.42.42.2(pid=11945): stderr: | [0;m[1;31m20221210073536922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073536922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073536922 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073536923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073536923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073536923 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073536935 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073536943 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073536944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073536944 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:35:40.223192 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11938): Terminating (SIGTERM) 07:35:40.264636 run iperf3-srv_10.42.42.10(pid=11939): Terminating (SIGTERM) 07:35:40.306254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11940): Terminating (SIGTERM) 07:35:40.348072 run iperf3-srv_10.42.42.10(pid=11941): Terminating (SIGTERM) 07:35:40.389574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11944): Terminating (SIGTERM) 07:35:40.431044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11947): Terminating (SIGTERM) 07:35:40.472488 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11951): Terminating (SIGTERM) 07:35:40.514470 --- ParallelTerminationStrategy: PID 11938 died... 07:35:40.534653 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11938): Terminated: ok {rc=0} 07:35:40.580857 --- ParallelTerminationStrategy: PID 11939 died... 07:35:40.600215 run iperf3-srv_10.42.42.10(pid=11939): Terminated {rc=256} 07:35:40.646185 --- ParallelTerminationStrategy: PID 11940 died... 07:35:40.665863 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11940): Terminated: ok {rc=0} 07:35:40.711790 --- ParallelTerminationStrategy: PID 11941 died... 07:35:40.731348 run iperf3-srv_10.42.42.10(pid=11941): Terminated {rc=256} 07:35:40.777105 --- ParallelTerminationStrategy: PID 11944 died... 07:35:40.796665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11944): Terminated: ok {rc=0} 07:35:40.842573 --- ParallelTerminationStrategy: PID 11947 died... 07:35:40.862251 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11947): Terminated: ok {rc=0} 07:35:40.908409 --- ParallelTerminationStrategy: PID 11951 died... 07:35:40.928038 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11951): Terminated: ok {rc=0} 07:35:41.015480 bus /gobi_0: Setting Powered False 07:35:42.115195 bus /gobi_0: Setting Powered False 07:35:43.232128 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:35:44.380892 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:44.392668 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:35:44.463286 tst iperf3.py: using LAC 26845 07:35:44.587921 tst iperf3.py: using RAC 70 07:35:44.713986 tst iperf3.py: using CellId 26845 07:35:44.839449 tst iperf3.py: using BVCI 26846 07:35:44.956834 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:44.968171 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:44.979175 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:44.990267 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:45.001288 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:45.012372 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:45.023560 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:45.034546 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:45.045732 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:35:45.160939 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:35:45.361576 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:35:45.659686 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11953): Launched 07:35:45.934786 run iperf3-srv_10.42.42.10(pid=11954): Launched 07:35:46.051235 tst iperf3.py:8: start network... 07:35:46.254694 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:35:46.779144 run create_hlr_db(pid=11955): Launched 07:35:46.956570 bus /gobi_6: Setting Powered False 07:35:48.016632 run create_hlr_db(pid=11955): Terminated: ok {rc=0} 07:35:48.433030 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11957): Launched 07:35:48.731704 run osmo-hlr_10.42.42.2(pid=11958): Launched 07:35:48.845546 run osmo-stp_10.42.42.5: Starting osmo-stp 07:35:49.472368 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11960): Launched 07:35:49.763574 run osmo-stp_10.42.42.5(pid=11961): Launched 07:35:49.875483 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:35:50.379831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11963): Launched 07:35:50.492357 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:35:50.738255 run patchelf(pid=11964): Launched 07:35:50.901697 run osmo-stp_10.42.42.5(pid=11961): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11961)] 07:35:51.025425 run osmo-stp_10.42.42.5(pid=11961): stdout: | (launched: 2022-12-10_07:35:49.710605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:51.151221 run osmo-stp_10.42.42.5(pid=11961): stderr: | [0;m[38;5;43m20221210073549880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073549881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073549881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073549881 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073549882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073549882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073549882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:51.276903 run osmo-stp_10.42.42.5(pid=11961): stdout: | (launched: 2022-12-10_07:35:49.710605) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:35:51.396296 run osmo-stp_10.42.42.5(pid=11961): stderr: | [0;m[38;5;43m20221210073549880 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073549881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073549881 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073549881 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073549882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073549882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073549882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:35:51.537901 run patchelf(pid=11964): Terminating (SIGINT) 07:35:51.703000 run patchelf(pid=11964): Terminated: ok {rc=0} 07:35:51.822583 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11961): Process ended prematurely: osmo-stp_10.42.42.5(pid=11961) [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11961)] [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8] 07:35:51.831634 tst iperf3.py:8: Test FAILED (7.5 sec) 07:35:51.859263 run osmo-hlr_10.42.42.2(pid=11958): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11958)] 07:35:51.907311 run osmo-hlr_10.42.42.2(pid=11958): stdout: | (launched: 2022-12-10_07:35:48.677358) 07:35:51.956408 run osmo-hlr_10.42.42.2(pid=11958): stderr: | [0;m[1;31m20221210073548852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073548852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073548852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073548852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073548852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073548852 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073548863 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073548873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073548873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073548873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:35:52.005838 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11953): Terminating (SIGTERM) 07:35:52.045156 run iperf3-srv_10.42.42.10(pid=11954): Terminating (SIGTERM) 07:35:52.084390 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11957): Terminating (SIGTERM) 07:35:52.123726 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11960): Terminating (SIGTERM) 07:35:52.162962 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11963): Terminating (SIGTERM) 07:35:52.202691 --- ParallelTerminationStrategy: PID 11953 died... 07:35:52.221700 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11953): Terminated: ok {rc=0} 07:35:52.266096 --- ParallelTerminationStrategy: PID 11954 died... 07:35:52.284721 run iperf3-srv_10.42.42.10(pid=11954): Terminated {rc=256} 07:35:52.329143 --- ParallelTerminationStrategy: PID 11957 died... 07:35:52.347713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11957): Terminated: ok {rc=0} 07:35:52.392123 --- ParallelTerminationStrategy: PID 11960 died... 07:35:52.410611 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11960): Terminated: ok {rc=0} 07:35:52.454844 --- ParallelTerminationStrategy: PID 11963 died... 07:35:52.473384 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11963): Terminated: ok {rc=0} 07:35:52.559198 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:35:53.704117 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:53.715588 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:35:53.785257 tst iperf3m4.py: using LAC 26846 07:35:53.902399 tst iperf3m4.py: using RAC 71 07:35:54.017661 tst iperf3m4.py: using CellId 26846 07:35:54.140723 tst iperf3m4.py: using BVCI 26847 07:35:54.255987 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:54.267291 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:54.278425 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:54.289592 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:54.300658 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:54.311711 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:54.322825 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:54.333689 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:35:54.344825 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:35:54.463662 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:35:54.580041 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:35:54.696653 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:35:54.813110 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:35:55.008604 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:35:55.301146 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11965): Launched 07:35:55.555199 run iperf3-srv_10.42.42.10(pid=11966): Launched 07:35:55.664599 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:35:55.858705 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:35:56.171591 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11967): Launched 07:35:56.442561 run iperf3-srv_10.42.42.10(pid=11968): Launched 07:35:56.559704 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:35:56.769420 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:35:57.081625 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11969): Launched 07:35:57.353522 run iperf3-srv_10.42.42.10(pid=11970): Launched 07:35:57.470503 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:35:57.680023 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:35:57.993371 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11971): Launched 07:35:58.264745 run iperf3-srv_10.42.42.10(pid=11972): Launched 07:35:58.381457 tst iperf3m4.py:8: start network... 07:35:58.590452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:35:59.073394 run create_hlr_db(pid=11973): Launched 07:35:59.200814 bus /gobi_6: Setting Powered False 07:36:00.262561 run create_hlr_db(pid=11973): Terminated: ok {rc=0} 07:36:00.680158 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11975): Launched 07:36:00.983295 run osmo-hlr_10.42.42.2(pid=11976): Launched 07:36:01.136263 run osmo-stp_10.42.42.5: Starting osmo-stp 07:36:01.896372 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11978): Launched 07:36:02.215888 run osmo-stp_10.42.42.5(pid=11979): Launched 07:36:02.361384 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:36:02.904440 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11981): Launched 07:36:03.024111 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:36:03.287337 run patchelf(pid=11982): Launched 07:36:03.461120 run osmo-stp_10.42.42.5(pid=11979): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11979)] 07:36:03.592665 run osmo-stp_10.42.42.5(pid=11979): stdout: | (launched: 2022-12-10_07:36:02.148374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:03.726346 run osmo-stp_10.42.42.5(pid=11979): stderr: | [0;m[38;5;43m20221210073602361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073602361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073602361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073602362 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073602362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073602362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073602362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:03.859860 run osmo-stp_10.42.42.5(pid=11979): stdout: | (launched: 2022-12-10_07:36:02.148374) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:03.987842 run osmo-stp_10.42.42.5(pid=11979): stderr: | [0;m[38;5;43m20221210073602361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073602361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073602361 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073602362 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073602362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073602362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073602362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:04.139325 run patchelf(pid=11982): Terminating (SIGINT) 07:36:04.314365 run patchelf(pid=11982): Terminated: ok {rc=0} 07:36:04.440488 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=11979): Process ended prematurely: osmo-stp_10.42.42.5(pid=11979) [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11979)] [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:36:04.450613 tst iperf3m4.py:8: Test FAILED (10.8 sec) 07:36:04.478989 run osmo-hlr_10.42.42.2(pid=11976): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11976)] 07:36:04.528590 run osmo-hlr_10.42.42.2(pid=11976): stdout: | (launched: 2022-12-10_07:36:00.922686) 07:36:04.579581 run osmo-hlr_10.42.42.2(pid=11976): stderr: | [0;m[1;31m20221210073601267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073601267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073601267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073601267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073601267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073601267 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073601286 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073601295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073601295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073601295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:36:04.631262 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11965): Terminating (SIGTERM) 07:36:04.672592 run iperf3-srv_10.42.42.10(pid=11966): Terminating (SIGTERM) 07:36:04.713944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11967): Terminating (SIGTERM) 07:36:04.755282 run iperf3-srv_10.42.42.10(pid=11968): Terminating (SIGTERM) 07:36:04.796408 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11969): Terminating (SIGTERM) 07:36:04.837683 run iperf3-srv_10.42.42.10(pid=11970): Terminating (SIGTERM) 07:36:04.878795 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11971): Terminating (SIGTERM) 07:36:04.919836 run iperf3-srv_10.42.42.10(pid=11972): Terminating (SIGTERM) 07:36:04.960783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11975): Terminating (SIGTERM) 07:36:05.002633 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11978): Terminating (SIGTERM) 07:36:05.043735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11981): Terminating (SIGTERM) 07:36:05.085184 --- ParallelTerminationStrategy: PID 11965 died... 07:36:05.105372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11965): Terminated: ok {rc=0} 07:36:05.151053 --- ParallelTerminationStrategy: PID 11966 died... 07:36:05.170228 run iperf3-srv_10.42.42.10(pid=11966): Terminated {rc=256} 07:36:05.215211 --- ParallelTerminationStrategy: PID 11967 died... 07:36:05.234441 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11967): Terminated: ok {rc=0} 07:36:05.279679 --- ParallelTerminationStrategy: PID 11968 died... 07:36:05.298895 run iperf3-srv_10.42.42.10(pid=11968): Terminated {rc=256} 07:36:05.344147 --- ParallelTerminationStrategy: PID 11969 died... 07:36:05.363370 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11969): Terminated: ok {rc=0} 07:36:05.408538 --- ParallelTerminationStrategy: PID 11970 died... 07:36:05.427718 run iperf3-srv_10.42.42.10(pid=11970): Terminated {rc=256} 07:36:05.473048 --- ParallelTerminationStrategy: PID 11971 died... 07:36:05.492279 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=11971): Terminated: ok {rc=0} 07:36:05.537707 --- ParallelTerminationStrategy: PID 11972 died... 07:36:05.556872 run iperf3-srv_10.42.42.10(pid=11972): Terminated {rc=256} 07:36:05.602109 --- ParallelTerminationStrategy: PID 11975 died... 07:36:05.621385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11975): Terminated: ok {rc=0} 07:36:05.666595 --- ParallelTerminationStrategy: PID 11978 died... 07:36:05.685841 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11978): Terminated: ok {rc=0} 07:36:05.730921 --- ParallelTerminationStrategy: PID 11981 died... 07:36:05.750136 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11981): Terminated: ok {rc=0} 07:36:05.836991 bus /gobi_4: Setting Powered False 07:36:06.934414 bus /gobi_4: Setting Powered False 07:36:08.049949 bus /gobi_1: Setting Powered False 07:36:09.148011 bus /gobi_1: Setting Powered False 07:36:10.262157 bus /gobi_0: Setting Powered False 07:36:11.360659 bus /gobi_0: Setting Powered False 07:36:12.475908 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:36:13.577467 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:13.589185 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:36:13.659291 tst ping.py: using LAC 26847 07:36:13.781023 tst ping.py: using RAC 72 07:36:13.900661 tst ping.py: using CellId 26847 07:36:14.020712 tst ping.py: using BVCI 26848 07:36:14.132424 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:14.143696 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:14.154837 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:14.165867 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:14.176705 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:14.187800 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:14.198926 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:14.209970 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:36:14.326181 tst ping.py:19: start network... 07:36:14.532438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:36:15.010090 run create_hlr_db(pid=11984): Launched 07:36:15.134934 bus /gobi_6: Setting Powered False 07:36:16.204250 run create_hlr_db(pid=11984): Terminated: ok {rc=0} 07:36:16.713788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11986): Launched 07:36:17.031569 run osmo-hlr_10.42.42.2(pid=11987): Launched 07:36:17.241027 run osmo-stp_10.42.42.5: Starting osmo-stp 07:36:17.770960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11989): Launched 07:36:18.077636 run osmo-stp_10.42.42.5(pid=11990): Launched 07:36:18.195180 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:36:18.725641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11992): Launched 07:36:18.843102 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:36:19.102164 run patchelf(pid=11993): Launched 07:36:19.273455 run osmo-stp_10.42.42.5(pid=11990): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11990)] 07:36:19.403460 run osmo-stp_10.42.42.5(pid=11990): stdout: | (launched: 2022-12-10_07:36:18.021408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:19.535162 run osmo-stp_10.42.42.5(pid=11990): stderr: | [0;m[38;5;43m20221210073618212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073618212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073618213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073618213 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073618214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073618214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073618214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:19.666960 run osmo-stp_10.42.42.5(pid=11990): stdout: | (launched: 2022-12-10_07:36:18.021408) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:19.793101 run osmo-stp_10.42.42.5(pid=11990): stderr: | [0;m[38;5;43m20221210073618212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073618212 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073618213 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073618213 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073618214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073618214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073618214 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:19.942279 run patchelf(pid=11993): Terminating (SIGINT) 07:36:20.116132 run patchelf(pid=11993): Terminated: ok {rc=0} 07:36:20.240880 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=11990): Process ended prematurely: osmo-stp_10.42.42.5(pid=11990) [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11990)] [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22] 07:36:20.250375 tst ping.py:22: Test FAILED (6.7 sec) 07:36:20.278029 run osmo-hlr_10.42.42.2(pid=11987): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11987)] 07:36:20.327535 run osmo-hlr_10.42.42.2(pid=11987): stdout: | (launched: 2022-12-10_07:36:16.963130) 07:36:20.378748 run osmo-hlr_10.42.42.2(pid=11987): stderr: | [0;m[1;31m20221210073617262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073617262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073617262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073617262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073617262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073617262 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073617275 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073617283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073617283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073617283 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:36:20.430230 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11986): Terminating (SIGTERM) 07:36:20.471683 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11989): Terminating (SIGTERM) 07:36:20.513367 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11992): Terminating (SIGTERM) 07:36:20.555037 --- ParallelTerminationStrategy: PID 11986 died... 07:36:20.574786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11986): Terminated: ok {rc=0} 07:36:20.620367 --- ParallelTerminationStrategy: PID 11989 died... 07:36:20.639703 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11989): Terminated: ok {rc=0} 07:36:20.685096 --- ParallelTerminationStrategy: PID 11992 died... 07:36:20.704482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=11992): Terminated: ok {rc=0} 07:36:20.791562 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:36:21.875871 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:21.887476 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:36:21.960454 tst ping_idle_ping.py: using LAC 26848 07:36:22.074669 tst ping_idle_ping.py: using RAC 73 07:36:22.190410 tst ping_idle_ping.py: using CellId 26848 07:36:22.307990 tst ping_idle_ping.py: using BVCI 26849 07:36:22.413622 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:22.424418 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:22.435188 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:22.446419 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:22.457619 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:22.468641 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:22.479631 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:36:22.490453 tst gprs:trx-umtrx+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:36:22.605267 tst ping_idle_ping.py:24: start network... 07:36:22.798151 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:36:23.242592 run create_hlr_db(pid=11994): Launched 07:36:23.354452 bus /gobi_6: Setting Powered False 07:36:24.412748 run create_hlr_db(pid=11994): Terminated: ok {rc=0} 07:36:24.833512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11996): Launched 07:36:25.141548 run osmo-hlr_10.42.42.2(pid=11997): Launched 07:36:25.259767 run osmo-stp_10.42.42.5: Starting osmo-stp 07:36:25.789255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11999): Launched 07:36:26.097037 run osmo-stp_10.42.42.5(pid=12000): Launched 07:36:26.216338 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:36:26.747329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12002): Launched 07:36:26.864684 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:36:27.124007 run patchelf(pid=12003): Launched 07:36:27.295058 run osmo-stp_10.42.42.5(pid=12000): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12000)] 07:36:27.425427 run osmo-stp_10.42.42.5(pid=12000): stdout: | (launched: 2022-12-10_07:36:26.041066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:27.557812 run osmo-stp_10.42.42.5(pid=12000): stderr: | [0;m[38;5;43m20221210073626230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073626230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073626230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073626231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073626231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073626231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073626231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:27.690268 run osmo-stp_10.42.42.5(pid=12000): stdout: | (launched: 2022-12-10_07:36:26.041066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:27.816361 run osmo-stp_10.42.42.5(pid=12000): stderr: | [0;m[38;5;43m20221210073626230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073626230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073626230 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073626231 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073626231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073626231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073626231 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:27.966128 run patchelf(pid=12003): Terminating (SIGINT) 07:36:28.139927 run patchelf(pid=12003): Terminated: ok {rc=0} 07:36:28.265522 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12000): Process ended prematurely: osmo-stp_10.42.42.5(pid=12000) [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12000)] [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 07:36:28.274936 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 07:36:28.302569 run osmo-hlr_10.42.42.2(pid=11997): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=11997)] 07:36:28.351879 run osmo-hlr_10.42.42.2(pid=11997): stdout: | (launched: 2022-12-10_07:36:25.085299) 07:36:28.402979 run osmo-hlr_10.42.42.2(pid=11997): stderr: | [0;m[1;31m20221210073625282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073625282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073625282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073625282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073625283 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073625283 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073625295 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073625303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073625304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073625304 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:36:28.454749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11996): Terminating (SIGTERM) 07:36:28.496399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11999): Terminating (SIGTERM) 07:36:28.537840 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12002): Terminating (SIGTERM) 07:36:28.579382 --- ParallelTerminationStrategy: PID 11996 died... 07:36:28.599118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=11996): Terminated: ok {rc=0} 07:36:28.644557 --- ParallelTerminationStrategy: PID 11999 died... 07:36:28.663799 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=11999): Terminated: ok {rc=0} 07:36:28.709099 --- ParallelTerminationStrategy: PID 12002 died... 07:36:28.728275 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12002): Terminated: ok {rc=0} 07:36:28.815499 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:36:30.125172 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:36:30.132049 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:36:30.165739 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 07:36:30.205036 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 07:36:30.293812 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:36:30.327338 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 07:36:30.366572 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 07:36:30.981483 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 07:36:31.036787 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:31.048715 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:36:31.121460 tst cs_paging_gprs_active.py: using LAC 26849 07:36:31.245387 tst cs_paging_gprs_active.py: using RAC 74 07:36:31.365241 tst cs_paging_gprs_active.py: using CellId 26849 07:36:31.489901 tst cs_paging_gprs_active.py: using BVCI 26850 07:36:31.607901 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:31.620421 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:31.632679 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:31.645506 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:31.657472 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:31.669256 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:31.681169 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:31.692779 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:31.704845 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:36:31.827010 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:36:31.954902 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:36:32.176212 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:36:32.493496 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12008): Launched 07:36:32.766825 run iperf3-srv_10.42.42.10(pid=12009): Launched 07:36:32.884444 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:36:33.096479 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:36:33.412007 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12010): Launched 07:36:33.685452 run iperf3-srv_10.42.42.10(pid=12011): Launched 07:36:33.803144 tst cs_paging_gprs_active.py:38: start network... 07:36:34.013861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:36:34.499456 run create_hlr_db(pid=12012): Launched 07:36:34.628054 bus /gobi_6: Setting Powered False 07:36:35.689725 run create_hlr_db(pid=12012): Terminated: ok {rc=0} 07:36:36.126310 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12014): Launched 07:36:36.440594 run osmo-hlr_10.42.42.2(pid=12015): Launched 07:36:36.560782 run osmo-stp_10.42.42.5: Starting osmo-stp 07:36:37.099324 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12017): Launched 07:36:37.412445 run osmo-stp_10.42.42.5(pid=12018): Launched 07:36:37.532259 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:36:38.072489 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12020): Launched 07:36:38.193319 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:36:38.459628 run patchelf(pid=12021): Launched 07:36:38.634062 run osmo-stp_10.42.42.5(pid=12018): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12018)] 07:36:38.766821 run osmo-stp_10.42.42.5(pid=12018): stdout: | (launched: 2022-12-10_07:36:37.355692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:38.901439 run osmo-stp_10.42.42.5(pid=12018): stderr: | [0;m[38;5;43m20221210073637546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073637546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073637546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073637547 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073637547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073637547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073637547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:39.036018 run osmo-stp_10.42.42.5(pid=12018): stdout: | (launched: 2022-12-10_07:36:37.355692) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:39.165088 run osmo-stp_10.42.42.5(pid=12018): stderr: | [0;m[38;5;43m20221210073637546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073637546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073637546 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073637547 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073637547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073637547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073637547 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:39.317516 run patchelf(pid=12021): Terminating (SIGINT) 07:36:39.493927 run patchelf(pid=12021): Terminated: ok {rc=0} 07:36:39.621750 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12018): Process ended prematurely: osmo-stp_10.42.42.5(pid=12018) [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12018)] [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 07:36:39.631645 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 07:36:39.659863 run osmo-hlr_10.42.42.2(pid=12015): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12015)] 07:36:39.709429 run osmo-hlr_10.42.42.2(pid=12015): stdout: | (launched: 2022-12-10_07:36:36.383740) 07:36:39.760751 run osmo-hlr_10.42.42.2(pid=12015): stderr: | [0;m[1;31m20221210073636580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073636580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073636580 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073636581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073636581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073636581 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073636593 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073636601 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073636602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073636602 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:36:39.812512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12008): Terminating (SIGTERM) 07:36:39.854058 run iperf3-srv_10.42.42.10(pid=12009): Terminating (SIGTERM) 07:36:39.895411 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12010): Terminating (SIGTERM) 07:36:39.936699 run iperf3-srv_10.42.42.10(pid=12011): Terminating (SIGTERM) 07:36:39.978017 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12014): Terminating (SIGTERM) 07:36:40.019355 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12017): Terminating (SIGTERM) 07:36:40.060661 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12020): Terminating (SIGTERM) 07:36:40.102583 --- ParallelTerminationStrategy: PID 12008 died... 07:36:40.122780 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12008): Terminated: ok {rc=0} 07:36:40.168689 --- ParallelTerminationStrategy: PID 12009 died... 07:36:40.188030 run iperf3-srv_10.42.42.10(pid=12009): Terminated {rc=256} 07:36:40.233822 --- ParallelTerminationStrategy: PID 12010 died... 07:36:40.253469 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12010): Terminated: ok {rc=0} 07:36:40.299233 --- ParallelTerminationStrategy: PID 12011 died... 07:36:40.318653 run iperf3-srv_10.42.42.10(pid=12011): Terminated {rc=256} 07:36:40.364295 --- ParallelTerminationStrategy: PID 12014 died... 07:36:40.383891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12014): Terminated: ok {rc=0} 07:36:40.429368 --- ParallelTerminationStrategy: PID 12017 died... 07:36:40.448691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12017): Terminated: ok {rc=0} 07:36:40.494306 --- ParallelTerminationStrategy: PID 12020 died... 07:36:40.513773 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12020): Terminated: ok {rc=0} 07:36:40.600281 bus /gobi_0: Setting Powered False 07:36:41.700016 bus /gobi_0: Setting Powered False 07:36:42.814838 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 07:36:43.956386 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:43.967951 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:36:44.037316 tst iperf3.py: using LAC 26850 07:36:44.154788 tst iperf3.py: using RAC 75 07:36:44.272000 tst iperf3.py: using CellId 26850 07:36:44.387533 tst iperf3.py: using BVCI 26851 07:36:44.495089 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:44.505998 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:44.516561 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:44.527423 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:44.538129 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:44.548906 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:44.559969 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:44.570718 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:44.582008 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:36:44.694623 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:36:44.891694 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:36:45.185564 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12022): Launched 07:36:45.441114 run iperf3-srv_10.42.42.10(pid=12023): Launched 07:36:45.551213 tst iperf3.py:8: start network... 07:36:45.747013 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:36:46.230610 run create_hlr_db(pid=12024): Launched 07:36:46.376130 bus /gobi_6: Setting Powered False 07:36:47.434987 run create_hlr_db(pid=12024): Terminated: ok {rc=0} 07:36:47.843900 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12026): Launched 07:36:48.135551 run osmo-hlr_10.42.42.2(pid=12027): Launched 07:36:48.248019 run osmo-stp_10.42.42.5: Starting osmo-stp 07:36:48.753768 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12029): Launched 07:36:49.047295 run osmo-stp_10.42.42.5(pid=12030): Launched 07:36:49.159562 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:36:49.664782 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12032): Launched 07:36:49.777731 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:36:50.024884 run patchelf(pid=12033): Launched 07:36:50.188424 run osmo-stp_10.42.42.5(pid=12030): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12030)] 07:36:50.312798 run osmo-stp_10.42.42.5(pid=12030): stdout: | (launched: 2022-12-10_07:36:48.992572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:50.439423 run osmo-stp_10.42.42.5(pid=12030): stderr: | [0;m[38;5;43m20221210073649162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073649162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073649162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073649163 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073649163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073649163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073649163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:50.565663 run osmo-stp_10.42.42.5(pid=12030): stdout: | (launched: 2022-12-10_07:36:48.992572) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:36:50.686229 run osmo-stp_10.42.42.5(pid=12030): stderr: | [0;m[38;5;43m20221210073649162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073649162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073649162 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073649163 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073649163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073649163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073649163 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:36:50.828880 run patchelf(pid=12033): Terminating (SIGINT) 07:36:50.994908 run patchelf(pid=12033): Terminated: ok {rc=0} 07:36:51.114836 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12030): Process ended prematurely: osmo-stp_10.42.42.5(pid=12030) [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12030)] [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8] 07:36:51.124060 tst iperf3.py:8: Test FAILED (7.2 sec) 07:36:51.151439 run osmo-hlr_10.42.42.2(pid=12027): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12027)] 07:36:51.199527 run osmo-hlr_10.42.42.2(pid=12027): stdout: | (launched: 2022-12-10_07:36:48.082403) 07:36:51.248932 run osmo-hlr_10.42.42.2(pid=12027): stderr: | [0;m[1;31m20221210073648258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073648258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073648258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073648258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073648258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073648258 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073648271 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073648280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073648280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073648280 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:36:51.298782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12022): Terminating (SIGTERM) 07:36:51.338970 run iperf3-srv_10.42.42.10(pid=12023): Terminating (SIGTERM) 07:36:51.379002 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12026): Terminating (SIGTERM) 07:36:51.419079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12029): Terminating (SIGTERM) 07:36:51.459219 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12032): Terminating (SIGTERM) 07:36:51.499327 --- ParallelTerminationStrategy: PID 12022 died... 07:36:51.518484 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12022): Terminated: ok {rc=0} 07:36:51.563088 --- ParallelTerminationStrategy: PID 12023 died... 07:36:51.581687 run iperf3-srv_10.42.42.10(pid=12023): Terminated {rc=256} 07:36:51.625921 --- ParallelTerminationStrategy: PID 12026 died... 07:36:51.644477 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12026): Terminated: ok {rc=0} 07:36:51.688745 --- ParallelTerminationStrategy: PID 12029 died... 07:36:51.707526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12029): Terminated: ok {rc=0} 07:36:51.752181 --- ParallelTerminationStrategy: PID 12032 died... 07:36:51.771312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12032): Terminated: ok {rc=0} 07:36:51.854825 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 07:36:53.003399 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:53.015731 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:36:53.089459 tst iperf3m4.py: using LAC 26851 07:36:53.214536 tst iperf3m4.py: using RAC 76 07:36:53.339829 tst iperf3m4.py: using CellId 26851 07:36:53.465420 tst iperf3m4.py: using BVCI 26852 07:36:53.580573 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:53.591974 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:53.603153 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:53.614531 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:53.625881 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:53.637252 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:53.648649 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:53.659902 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:36:53.671343 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:36:53.790276 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:36:53.906518 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:36:54.024244 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:36:54.142656 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:36:54.354430 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:36:54.668175 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12034): Launched 07:36:54.940302 run iperf3-srv_10.42.42.10(pid=12035): Launched 07:36:55.058184 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:36:55.269474 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:36:55.583127 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12036): Launched 07:36:55.854392 run iperf3-srv_10.42.42.10(pid=12037): Launched 07:36:55.971704 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:36:56.182710 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:36:56.497200 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12038): Launched 07:36:56.768660 run iperf3-srv_10.42.42.10(pid=12039): Launched 07:36:56.885944 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:36:57.096243 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:36:57.410456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12040): Launched 07:36:57.682397 run iperf3-srv_10.42.42.10(pid=12041): Launched 07:36:57.799321 tst iperf3m4.py:8: start network... 07:36:58.009705 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:36:58.494024 run create_hlr_db(pid=12042): Launched 07:36:58.623024 bus /gobi_6: Setting Powered False 07:36:59.685548 run create_hlr_db(pid=12042): Terminated: ok {rc=0} 07:37:00.104785 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12044): Launched 07:37:00.399240 run osmo-hlr_10.42.42.2(pid=12045): Launched 07:37:00.510858 run osmo-stp_10.42.42.5: Starting osmo-stp 07:37:01.041628 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12047): Launched 07:37:01.376098 run osmo-stp_10.42.42.5(pid=12048): Launched 07:37:01.671375 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:37:02.223605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12050): Launched 07:37:02.344884 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:37:02.610465 run patchelf(pid=12051): Launched 07:37:02.785325 run osmo-stp_10.42.42.5(pid=12048): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12048)] 07:37:02.918738 run osmo-stp_10.42.42.5(pid=12048): stdout: | (launched: 2022-12-10_07:37:01.314299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:03.053835 run osmo-stp_10.42.42.5(pid=12048): stderr: | [0;m[38;5;43m20221210073701547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073701547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073701548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073701548 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073701549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073701549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073701549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:03.189791 run osmo-stp_10.42.42.5(pid=12048): stdout: | (launched: 2022-12-10_07:37:01.314299) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:03.318700 run osmo-stp_10.42.42.5(pid=12048): stderr: | [0;m[38;5;43m20221210073701547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073701547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073701548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073701548 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073701549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073701549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073701549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:03.471250 run patchelf(pid=12051): Terminating (SIGINT) 07:37:03.647797 run patchelf(pid=12051): Terminated: ok {rc=0} 07:37:03.775361 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12048): Process ended prematurely: osmo-stp_10.42.42.5(pid=12048) [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12048)] [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8] 07:37:03.785804 tst iperf3m4.py:8: Test FAILED (10.8 sec) 07:37:03.814673 run osmo-hlr_10.42.42.2(pid=12045): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12045)] 07:37:03.864504 run osmo-hlr_10.42.42.2(pid=12045): stdout: | (launched: 2022-12-10_07:37:00.345247) 07:37:03.916170 run osmo-hlr_10.42.42.2(pid=12045): stderr: | [0;m[1;31m20221210073700521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073700521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073700521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073700521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073700521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073700521 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073700540 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073700549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073700549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073700549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:37:03.967944 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12034): Terminating (SIGTERM) 07:37:04.010002 run iperf3-srv_10.42.42.10(pid=12035): Terminating (SIGTERM) 07:37:04.052228 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12036): Terminating (SIGTERM) 07:37:04.094565 run iperf3-srv_10.42.42.10(pid=12037): Terminating (SIGTERM) 07:37:04.136747 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12038): Terminating (SIGTERM) 07:37:04.178757 run iperf3-srv_10.42.42.10(pid=12039): Terminating (SIGTERM) 07:37:04.220711 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12040): Terminating (SIGTERM) 07:37:04.262651 run iperf3-srv_10.42.42.10(pid=12041): Terminating (SIGTERM) 07:37:04.304786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12044): Terminating (SIGTERM) 07:37:04.346610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12047): Terminating (SIGTERM) 07:37:04.388579 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12050): Terminating (SIGTERM) 07:37:04.430990 --- ParallelTerminationStrategy: PID 12034 died... 07:37:04.451334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12034): Terminated: ok {rc=0} 07:37:04.497783 --- ParallelTerminationStrategy: PID 12035 died... 07:37:04.517254 run iperf3-srv_10.42.42.10(pid=12035): Terminated {rc=256} 07:37:04.562884 --- ParallelTerminationStrategy: PID 12036 died... 07:37:04.582472 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12036): Terminated: ok {rc=0} 07:37:04.628216 --- ParallelTerminationStrategy: PID 12037 died... 07:37:04.647724 run iperf3-srv_10.42.42.10(pid=12037): Terminated {rc=256} 07:37:04.693419 --- ParallelTerminationStrategy: PID 12038 died... 07:37:04.712746 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12038): Terminated: ok {rc=0} 07:37:04.758590 --- ParallelTerminationStrategy: PID 12039 died... 07:37:04.778088 run iperf3-srv_10.42.42.10(pid=12039): Terminated {rc=256} 07:37:04.823956 --- ParallelTerminationStrategy: PID 12040 died... 07:37:04.843530 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12040): Terminated: ok {rc=0} 07:37:04.889401 --- ParallelTerminationStrategy: PID 12041 died... 07:37:04.908933 run iperf3-srv_10.42.42.10(pid=12041): Terminated {rc=256} 07:37:04.955054 --- ParallelTerminationStrategy: PID 12044 died... 07:37:04.974770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12044): Terminated: ok {rc=0} 07:37:05.020602 --- ParallelTerminationStrategy: PID 12047 died... 07:37:05.040209 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12047): Terminated: ok {rc=0} 07:37:05.085987 --- ParallelTerminationStrategy: PID 12050 died... 07:37:05.105614 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12050): Terminated: ok {rc=0} 07:37:05.193683 bus /gobi_4: Setting Powered False 07:37:06.292302 bus /gobi_4: Setting Powered False 07:37:07.408249 bus /gobi_1: Setting Powered False 07:37:08.506983 bus /gobi_1: Setting Powered False 07:37:09.622284 bus /gobi_0: Setting Powered False 07:37:10.720746 bus /gobi_0: Setting Powered False 07:37:11.837347 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 07:37:12.940728 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:12.952553 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:37:13.026977 tst ping.py: using LAC 26852 07:37:13.148161 tst ping.py: using RAC 77 07:37:13.267684 tst ping.py: using CellId 26852 07:37:13.386722 tst ping.py: using BVCI 26853 07:37:13.497821 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:13.509016 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:13.520090 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:13.531214 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:13.542299 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:13.553631 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:13.564775 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:13.575871 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:37:13.691235 tst ping.py:19: start network... 07:37:13.883465 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:37:14.329237 run create_hlr_db(pid=12052): Launched 07:37:14.439933 bus /gobi_6: Setting Powered False 07:37:15.501262 run create_hlr_db(pid=12052): Terminated: ok {rc=0} 07:37:15.941790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12054): Launched 07:37:16.259114 run osmo-hlr_10.42.42.2(pid=12055): Launched 07:37:16.490344 run osmo-stp_10.42.42.5: Starting osmo-stp 07:37:17.143868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12057): Launched 07:37:17.435804 run osmo-stp_10.42.42.5(pid=12058): Launched 07:37:17.547863 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:37:18.043605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12060): Launched 07:37:18.153776 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:37:18.395492 run patchelf(pid=12061): Launched 07:37:18.556637 run osmo-stp_10.42.42.5(pid=12058): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12058)] 07:37:18.679416 run osmo-stp_10.42.42.5(pid=12058): stdout: | (launched: 2022-12-10_07:37:17.383243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:18.803653 run osmo-stp_10.42.42.5(pid=12058): stderr: | [0;m[38;5;43m20221210073717548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073717549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073717549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073717549 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073717550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073717550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073717550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:18.927984 run osmo-stp_10.42.42.5(pid=12058): stdout: | (launched: 2022-12-10_07:37:17.383243) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:19.046577 run osmo-stp_10.42.42.5(pid=12058): stderr: | [0;m[38;5;43m20221210073717548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073717549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073717549 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073717549 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073717550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073717550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073717550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:19.187020 run patchelf(pid=12061): Terminating (SIGINT) 07:37:19.349677 run patchelf(pid=12061): Terminated: ok {rc=0} 07:37:19.466983 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12058): Process ended prematurely: osmo-stp_10.42.42.5(pid=12058) [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12058)] [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22] 07:37:19.475999 tst ping.py:22: Test FAILED (6.5 sec) 07:37:19.503566 run osmo-hlr_10.42.42.2(pid=12055): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12055)] 07:37:19.551919 run osmo-hlr_10.42.42.2(pid=12055): stdout: | (launched: 2022-12-10_07:37:16.191984) 07:37:19.601786 run osmo-hlr_10.42.42.2(pid=12055): stderr: | [0;m[1;31m20221210073716526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073716526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073716526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073716526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073716526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073716526 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073716546 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073716567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073716567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073716567 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:37:19.651950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12054): Terminating (SIGTERM) 07:37:19.692394 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12057): Terminating (SIGTERM) 07:37:19.732694 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12060): Terminating (SIGTERM) 07:37:19.773563 --- ParallelTerminationStrategy: PID 12054 died... 07:37:19.792795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12054): Terminated: ok {rc=0} 07:37:19.837842 --- ParallelTerminationStrategy: PID 12057 died... 07:37:19.856621 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12057): Terminated: ok {rc=0} 07:37:19.901498 --- ParallelTerminationStrategy: PID 12060 died... 07:37:19.920331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12060): Terminated: ok {rc=0} 07:37:20.007126 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 07:37:21.094482 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:21.106080 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:37:21.179050 tst ping_idle_ping.py: using LAC 26853 07:37:21.294454 tst ping_idle_ping.py: using RAC 78 07:37:21.409839 tst ping_idle_ping.py: using CellId 26853 07:37:21.536712 tst ping_idle_ping.py: using BVCI 26854 07:37:21.650664 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:21.662375 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:21.674014 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:21.685471 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:21.696604 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:21.707867 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:21.719259 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:37:21.730299 tst gprs:trx-umtrx+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:37:21.846031 tst ping_idle_ping.py:24: start network... 07:37:22.037795 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:37:22.482361 run create_hlr_db(pid=12062): Launched 07:37:22.593974 bus /gobi_6: Setting Powered False 07:37:23.652107 run create_hlr_db(pid=12062): Terminated: ok {rc=0} 07:37:24.074276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12064): Launched 07:37:24.383768 run osmo-hlr_10.42.42.2(pid=12065): Launched 07:37:24.502086 run osmo-stp_10.42.42.5: Starting osmo-stp 07:37:25.036021 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12067): Launched 07:37:25.346941 run osmo-stp_10.42.42.5(pid=12068): Launched 07:37:25.464758 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:37:25.996663 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12070): Launched 07:37:26.114750 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:37:26.376160 run patchelf(pid=12071): Launched 07:37:26.548453 run osmo-stp_10.42.42.5(pid=12068): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12068)] 07:37:26.680463 run osmo-stp_10.42.42.5(pid=12068): stdout: | (launched: 2022-12-10_07:37:25.290290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:26.813224 run osmo-stp_10.42.42.5(pid=12068): stderr: | [0;m[38;5;43m20221210073725479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073725480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073725480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073725480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073725483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073725483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073725483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:26.946199 run osmo-stp_10.42.42.5(pid=12068): stdout: | (launched: 2022-12-10_07:37:25.290290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:27.073081 run osmo-stp_10.42.42.5(pid=12068): stderr: | [0;m[38;5;43m20221210073725479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073725480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073725480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073725480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073725483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073725483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073725483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:27.223767 run patchelf(pid=12071): Terminating (SIGINT) 07:37:27.397962 run patchelf(pid=12071): Terminated: ok {rc=0} 07:37:27.523751 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12068): Process ended prematurely: osmo-stp_10.42.42.5(pid=12068) [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12068)] [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 07:37:27.533453 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 07:37:27.561378 run osmo-hlr_10.42.42.2(pid=12065): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12065)] 07:37:27.610836 run osmo-hlr_10.42.42.2(pid=12065): stdout: | (launched: 2022-12-10_07:37:24.327371) 07:37:27.662695 run osmo-hlr_10.42.42.2(pid=12065): stderr: | [0;m[1;31m20221210073724522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073724522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073724522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073724522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073724522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073724522 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073724535 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073724543 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073724544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073724544 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:37:27.714525 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12064): Terminating (SIGTERM) 07:37:27.756202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12067): Terminating (SIGTERM) 07:37:27.797788 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12070): Terminating (SIGTERM) 07:37:27.839812 --- ParallelTerminationStrategy: PID 12064 died... 07:37:27.859784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12064): Terminated: ok {rc=0} 07:37:27.905912 --- ParallelTerminationStrategy: PID 12067 died... 07:37:27.925481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12067): Terminated: ok {rc=0} 07:37:27.971611 --- ParallelTerminationStrategy: PID 12070 died... 07:37:27.991312 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12070): Terminated: ok {rc=0} 07:37:28.078459 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 07:37:29.389444 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:37:29.396384 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 07:37:29.429253 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 07:37:29.468801 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 07:37:29.558634 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 07:37:29.592191 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 07:37:29.631491 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 07:37:30.236496 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 07:37:30.287268 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:30.299407 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:37:30.354957 tst cs_paging_gprs_active.py: using LAC 26854 07:37:30.477983 tst cs_paging_gprs_active.py: using RAC 79 07:37:30.598908 tst cs_paging_gprs_active.py: using CellId 26854 07:37:30.725286 tst cs_paging_gprs_active.py: using BVCI 26855 07:37:30.849509 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:30.862902 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:30.876919 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:30.891581 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:30.904215 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:30.917674 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:30.930724 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:30.943380 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:30.956652 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:37:31.117633 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:37:31.264087 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:37:31.536331 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:37:31.871934 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12075): Launched 07:37:32.149501 run iperf3-srv_10.42.42.10(pid=12076): Launched 07:37:32.264749 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:37:32.465445 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:37:32.761290 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12077): Launched 07:37:33.016721 run iperf3-srv_10.42.42.10(pid=12078): Launched 07:37:33.127269 tst cs_paging_gprs_active.py:38: start network... 07:37:33.323331 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:37:33.776659 run create_hlr_db(pid=12079): Launched 07:37:33.890879 bus /gobi_6: Setting Powered False 07:37:34.953553 run create_hlr_db(pid=12079): Terminated: ok {rc=0} 07:37:35.391827 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12081): Launched 07:37:35.706373 run osmo-hlr_10.42.42.2(pid=12082): Launched 07:37:35.826433 run osmo-stp_10.42.42.5: Starting osmo-stp 07:37:36.371141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12086): Launched 07:37:36.685643 run osmo-stp_10.42.42.5(pid=12087): Launched 07:37:36.806330 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:37:37.349937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12089): Launched 07:37:37.464066 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:37:37.712041 run patchelf(pid=12090): Launched 07:37:37.875900 run osmo-stp_10.42.42.5(pid=12087): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12087)] 07:37:38.000458 run osmo-stp_10.42.42.5(pid=12087): stdout: | (launched: 2022-12-10_07:37:36.628791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:38.127161 run osmo-stp_10.42.42.5(pid=12087): stderr: | [0;m[38;5;43m20221210073736821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073736821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073736821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073736822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073736822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073736822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073736822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:38.253671 run osmo-stp_10.42.42.5(pid=12087): stdout: | (launched: 2022-12-10_07:37:36.628791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:38.374440 run osmo-stp_10.42.42.5(pid=12087): stderr: | [0;m[38;5;43m20221210073736821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073736821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073736821 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073736822 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073736822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073736822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073736822 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:38.517068 run patchelf(pid=12090): Terminating (SIGINT) 07:37:38.683184 run patchelf(pid=12090): Terminated: ok {rc=0} 07:37:38.803886 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12087): Process ended prematurely: osmo-stp_10.42.42.5(pid=12087) [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12087)] [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 07:37:38.813294 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 07:37:38.840275 run osmo-hlr_10.42.42.2(pid=12082): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12082)] 07:37:38.888339 run osmo-hlr_10.42.42.2(pid=12082): stdout: | (launched: 2022-12-10_07:37:35.649363) 07:37:38.937692 run osmo-hlr_10.42.42.2(pid=12082): stderr: | [0;m[1;31m20221210073735845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073735845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073735845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073735845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073735845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073735845 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073735861 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073735871 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073735872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073735872 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:37:38.987618 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12075): Terminating (SIGTERM) 07:37:39.027528 run iperf3-srv_10.42.42.10(pid=12076): Terminating (SIGTERM) 07:37:39.067410 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12077): Terminating (SIGTERM) 07:37:39.107357 run iperf3-srv_10.42.42.10(pid=12078): Terminating (SIGTERM) 07:37:39.147199 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12081): Terminating (SIGTERM) 07:37:39.187085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12086): Terminating (SIGTERM) 07:37:39.226831 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12089): Terminating (SIGTERM) 07:37:39.266733 --- ParallelTerminationStrategy: PID 12075 died... 07:37:39.285856 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12075): Terminated: ok {rc=0} 07:37:39.329779 --- ParallelTerminationStrategy: PID 12076 died... 07:37:39.348384 run iperf3-srv_10.42.42.10(pid=12076): Terminated {rc=256} 07:37:39.392082 --- ParallelTerminationStrategy: PID 12077 died... 07:37:39.410808 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12077): Terminated: ok {rc=0} 07:37:39.454368 --- ParallelTerminationStrategy: PID 12078 died... 07:37:39.472877 run iperf3-srv_10.42.42.10(pid=12078): Terminated {rc=256} 07:37:39.516363 --- ParallelTerminationStrategy: PID 12081 died... 07:37:39.535126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12081): Terminated: ok {rc=0} 07:37:39.578675 --- ParallelTerminationStrategy: PID 12086 died... 07:37:39.597709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12086): Terminated: ok {rc=0} 07:37:39.641488 --- ParallelTerminationStrategy: PID 12089 died... 07:37:39.660166 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12089): Terminated: ok {rc=0} 07:37:39.743905 bus /gobi_0: Setting Powered False 07:37:40.838016 bus /gobi_0: Setting Powered False 07:37:41.952473 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 07:37:43.102271 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:43.114670 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:37:43.173713 tst iperf3.py: using LAC 26855 07:37:43.297093 tst iperf3.py: using RAC 80 07:37:43.418395 tst iperf3.py: using CellId 26855 07:37:43.541373 tst iperf3.py: using BVCI 26856 07:37:43.655254 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:43.667163 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:43.678893 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:43.690345 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:43.701787 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:43.713460 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:43.725122 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:43.736520 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:43.748347 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:37:43.867171 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:37:44.078973 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:37:44.394497 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12091): Launched 07:37:44.668194 run iperf3-srv_10.42.42.10(pid=12092): Launched 07:37:44.787088 tst iperf3.py:8: start network... 07:37:44.999097 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:37:45.486017 run create_hlr_db(pid=12093): Launched 07:37:45.614371 bus /gobi_6: Setting Powered False 07:37:46.677779 run create_hlr_db(pid=12093): Terminated: ok {rc=0} 07:37:47.131098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12095): Launched 07:37:47.446097 run osmo-hlr_10.42.42.2(pid=12096): Launched 07:37:47.567680 run osmo-stp_10.42.42.5: Starting osmo-stp 07:37:48.109722 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12098): Launched 07:37:48.422857 run osmo-stp_10.42.42.5(pid=12099): Launched 07:37:48.542970 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:37:49.084065 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12101): Launched 07:37:49.205678 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:37:49.470826 run patchelf(pid=12102): Launched 07:37:49.645784 run osmo-stp_10.42.42.5(pid=12099): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12099)] 07:37:49.779198 run osmo-stp_10.42.42.5(pid=12099): stdout: | (launched: 2022-12-10_07:37:48.366114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:49.914391 run osmo-stp_10.42.42.5(pid=12099): stderr: | [0;m[38;5;43m20221210073748555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073748555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073748556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073748556 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073748557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073748557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073748557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:50.049485 run osmo-stp_10.42.42.5(pid=12099): stdout: | (launched: 2022-12-10_07:37:48.366114) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:37:50.179446 run osmo-stp_10.42.42.5(pid=12099): stderr: | [0;m[38;5;43m20221210073748555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073748555 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073748556 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073748556 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073748557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073748557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073748557 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:37:50.332201 run patchelf(pid=12102): Terminating (SIGINT) 07:37:50.511144 run patchelf(pid=12102): Terminated: ok {rc=0} 07:37:50.639171 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12099): Process ended prematurely: osmo-stp_10.42.42.5(pid=12099) [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12099)] [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 07:37:50.649477 tst iperf3.py:8: Test FAILED (7.6 sec) 07:37:50.677724 run osmo-hlr_10.42.42.2(pid=12096): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12096)] 07:37:50.727583 run osmo-hlr_10.42.42.2(pid=12096): stdout: | (launched: 2022-12-10_07:37:47.389424) 07:37:50.779195 run osmo-hlr_10.42.42.2(pid=12096): stderr: | [0;m[1;31m20221210073747587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073747587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073747587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073747587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073747587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073747587 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073747600 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073747610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073747610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073747610 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:37:50.831198 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12091): Terminating (SIGTERM) 07:37:50.872640 run iperf3-srv_10.42.42.10(pid=12092): Terminating (SIGTERM) 07:37:50.914223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12095): Terminating (SIGTERM) 07:37:50.955893 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12098): Terminating (SIGTERM) 07:37:50.997600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12101): Terminating (SIGTERM) 07:37:51.039475 --- ParallelTerminationStrategy: PID 12091 died... 07:37:51.059502 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12091): Terminated: ok {rc=0} 07:37:51.105683 --- ParallelTerminationStrategy: PID 12092 died... 07:37:51.125310 run iperf3-srv_10.42.42.10(pid=12092): Terminated {rc=256} 07:37:51.171454 --- ParallelTerminationStrategy: PID 12095 died... 07:37:51.191146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12095): Terminated: ok {rc=0} 07:37:51.236837 --- ParallelTerminationStrategy: PID 12098 died... 07:37:51.256761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12098): Terminated: ok {rc=0} 07:37:51.302526 --- ParallelTerminationStrategy: PID 12101 died... 07:37:51.322293 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12101): Terminated: ok {rc=0} 07:37:51.409157 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 07:37:52.555807 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:52.568722 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:37:52.623494 tst iperf3m4.py: using LAC 26856 07:37:52.740728 tst iperf3m4.py: using RAC 81 07:37:52.865347 tst iperf3m4.py: using CellId 26856 07:37:52.988028 tst iperf3m4.py: using BVCI 26857 07:37:53.103617 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:53.115368 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:53.126975 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:53.138677 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:53.151204 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:53.163154 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:53.175242 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:53.187140 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:37:53.199423 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:37:53.319837 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:37:53.441304 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:37:53.558741 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:37:53.677110 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:37:53.889353 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:37:54.205235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12103): Launched 07:37:54.478226 run iperf3-srv_10.42.42.10(pid=12104): Launched 07:37:54.596522 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:37:54.808384 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:37:55.123754 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12105): Launched 07:37:55.396109 run iperf3-srv_10.42.42.10(pid=12106): Launched 07:37:55.514408 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:37:55.725688 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:37:56.039636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12107): Launched 07:37:56.312807 run iperf3-srv_10.42.42.10(pid=12108): Launched 07:37:56.430503 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:37:56.641341 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:37:56.955786 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12109): Launched 07:37:57.228051 run iperf3-srv_10.42.42.10(pid=12110): Launched 07:37:57.342600 tst iperf3m4.py:8: start network... 07:37:57.538089 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:37:57.990589 run create_hlr_db(pid=12111): Launched 07:37:58.103566 bus /gobi_6: Setting Powered False 07:37:59.161953 run create_hlr_db(pid=12111): Terminated: ok {rc=0} 07:37:59.572337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12113): Launched 07:37:59.865673 run osmo-hlr_10.42.42.2(pid=12114): Launched 07:37:59.978675 run osmo-stp_10.42.42.5: Starting osmo-stp 07:38:00.498134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12116): Launched 07:38:00.791284 run osmo-stp_10.42.42.5(pid=12117): Launched 07:38:00.994382 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:38:01.661734 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12119): Launched 07:38:01.789454 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:38:02.077805 run patchelf(pid=12120): Launched 07:38:02.260747 run osmo-stp_10.42.42.5(pid=12117): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12117)] 07:38:02.393935 run osmo-stp_10.42.42.5(pid=12117): stdout: | (launched: 2022-12-10_07:38:00.737982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:02.528792 run osmo-stp_10.42.42.5(pid=12117): stderr: | [0;m[38;5;43m20221210073800994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073800994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073800994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073800995 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073800995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073800995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073800995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:02.663417 run osmo-stp_10.42.42.5(pid=12117): stdout: | (launched: 2022-12-10_07:38:00.737982) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:02.791699 run osmo-stp_10.42.42.5(pid=12117): stderr: | [0;m[38;5;43m20221210073800994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073800994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073800994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073800995 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073800995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073800995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073800995 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:02.944397 run patchelf(pid=12120): Terminating (SIGINT) 07:38:03.121785 run patchelf(pid=12120): Terminated: ok {rc=0} 07:38:03.249992 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12117): Process ended prematurely: osmo-stp_10.42.42.5(pid=12117) [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12117)] [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 07:38:03.260255 tst iperf3m4.py:8: Test FAILED (10.7 sec) 07:38:03.288940 run osmo-hlr_10.42.42.2(pid=12114): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12114)] 07:38:03.338675 run osmo-hlr_10.42.42.2(pid=12114): stdout: | (launched: 2022-12-10_07:37:59.811943) 07:38:03.390294 run osmo-hlr_10.42.42.2(pid=12114): stderr: | [0;m[1;31m20221210073759988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073759988 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073759989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073759989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073759989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073759989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073800001 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073800009 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073800009 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073800010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:38:03.442063 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12103): Terminating (SIGTERM) 07:38:03.483476 run iperf3-srv_10.42.42.10(pid=12104): Terminating (SIGTERM) 07:38:03.524826 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12105): Terminating (SIGTERM) 07:38:03.566904 run iperf3-srv_10.42.42.10(pid=12106): Terminating (SIGTERM) 07:38:03.608589 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12107): Terminating (SIGTERM) 07:38:03.650202 run iperf3-srv_10.42.42.10(pid=12108): Terminating (SIGTERM) 07:38:03.691587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12109): Terminating (SIGTERM) 07:38:03.733028 run iperf3-srv_10.42.42.10(pid=12110): Terminating (SIGTERM) 07:38:03.774538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12113): Terminating (SIGTERM) 07:38:03.816027 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12116): Terminating (SIGTERM) 07:38:03.857568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12119): Terminating (SIGTERM) 07:38:03.899421 --- ParallelTerminationStrategy: PID 12103 died... 07:38:03.919428 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12103): Terminated: ok {rc=0} 07:38:03.965681 --- ParallelTerminationStrategy: PID 12104 died... 07:38:03.985237 run iperf3-srv_10.42.42.10(pid=12104): Terminated {rc=256} 07:38:04.031201 --- ParallelTerminationStrategy: PID 12105 died... 07:38:04.050864 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12105): Terminated: ok {rc=0} 07:38:04.096739 --- ParallelTerminationStrategy: PID 12106 died... 07:38:04.116195 run iperf3-srv_10.42.42.10(pid=12106): Terminated {rc=256} 07:38:04.162321 --- ParallelTerminationStrategy: PID 12107 died... 07:38:04.182294 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12107): Terminated: ok {rc=0} 07:38:04.228204 --- ParallelTerminationStrategy: PID 12108 died... 07:38:04.247803 run iperf3-srv_10.42.42.10(pid=12108): Terminated {rc=256} 07:38:04.293599 --- ParallelTerminationStrategy: PID 12109 died... 07:38:04.313390 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12109): Terminated: ok {rc=0} 07:38:04.359103 --- ParallelTerminationStrategy: PID 12110 died... 07:38:04.378572 run iperf3-srv_10.42.42.10(pid=12110): Terminated {rc=256} 07:38:04.424220 --- ParallelTerminationStrategy: PID 12113 died... 07:38:04.444229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12113): Terminated: ok {rc=0} 07:38:04.490006 --- ParallelTerminationStrategy: PID 12116 died... 07:38:04.509510 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12116): Terminated: ok {rc=0} 07:38:04.555279 --- ParallelTerminationStrategy: PID 12119 died... 07:38:04.574796 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12119): Terminated: ok {rc=0} 07:38:04.661947 bus /gobi_4: Setting Powered False 07:38:05.760905 bus /gobi_4: Setting Powered False 07:38:06.876383 bus /gobi_1: Setting Powered False 07:38:07.973198 bus /gobi_1: Setting Powered False 07:38:09.087167 bus /gobi_0: Setting Powered False 07:38:10.185821 bus /gobi_0: Setting Powered False 07:38:11.301950 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 07:38:12.404398 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:12.416796 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:38:12.470993 tst ping.py: using LAC 26857 07:38:12.592442 tst ping.py: using RAC 82 07:38:12.713065 tst ping.py: using CellId 26857 07:38:12.832887 tst ping.py: using BVCI 26858 07:38:12.944267 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:12.955998 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:12.967521 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:12.979239 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:12.990857 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:13.002529 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:13.014175 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:13.025662 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:38:13.142354 tst ping.py:19: start network... 07:38:13.349544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:38:13.824554 run create_hlr_db(pid=12121): Launched 07:38:13.950430 bus /gobi_6: Setting Powered False 07:38:15.011841 run create_hlr_db(pid=12121): Terminated: ok {rc=0} 07:38:15.422089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12123): Launched 07:38:15.709392 run osmo-hlr_10.42.42.2(pid=12124): Launched 07:38:15.819387 run osmo-stp_10.42.42.5: Starting osmo-stp 07:38:16.567740 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12150): Launched 07:38:16.930765 run osmo-stp_10.42.42.5(pid=12163): Launched 07:38:17.228885 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:38:17.839106 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12198): Launched 07:38:18.004340 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:38:18.297625 run patchelf(pid=12217): Launched 07:38:18.514881 run osmo-stp_10.42.42.5(pid=12163): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12163)] 07:38:18.664823 run osmo-stp_10.42.42.5(pid=12163): stdout: | (launched: 2022-12-10_07:38:16.868767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:18.829067 run osmo-stp_10.42.42.5(pid=12163): stderr: | [0;m[38;5;43m20221210073817081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073817081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073817082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073817082 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073817084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073817084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073817085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:18.997727 run osmo-stp_10.42.42.5(pid=12163): stdout: | (launched: 2022-12-10_07:38:16.868767) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:19.151695 run osmo-stp_10.42.42.5(pid=12163): stderr: | [0;m[38;5;43m20221210073817081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073817081 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073817082 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073817082 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073817084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073817084 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073817085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:19.338480 run patchelf(pid=12217): Terminating (SIGINT) 07:38:19.562813 run patchelf(pid=12217): Terminated: ok {rc=0} 07:38:19.720116 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12163): Process ended prematurely: osmo-stp_10.42.42.5(pid=12163) [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12163)] [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 07:38:19.734690 tst ping.py:22: Test FAILED (7.3 sec) 07:38:19.767948 run osmo-hlr_10.42.42.2(pid=12124): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12124)] 07:38:19.831382 run osmo-hlr_10.42.42.2(pid=12124): stdout: | (launched: 2022-12-10_07:38:15.656602) 07:38:19.884617 run osmo-hlr_10.42.42.2(pid=12124): stderr: | [0;m[1;31m20221210073815830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073815830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073815830 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073815831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073815831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073815831 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073815852 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073815865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073815865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073815865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:38:19.937469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12123): Terminating (SIGTERM) 07:38:19.980527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12150): Terminating (SIGTERM) 07:38:20.030584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12198): Terminating (SIGTERM) 07:38:20.074867 --- ParallelTerminationStrategy: PID 12123 died... 07:38:20.095042 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12123): Terminated: ok {rc=0} 07:38:20.142946 --- ParallelTerminationStrategy: PID 12150 died... 07:38:20.163170 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12150): Terminated: ok {rc=0} 07:38:20.209804 --- ParallelTerminationStrategy: PID 12198 died... 07:38:20.229781 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12198): Terminated: ok {rc=0} 07:38:20.319802 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 07:38:21.407779 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:21.420607 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 07:38:21.479970 tst ping_idle_ping.py: using LAC 26858 07:38:21.599041 tst ping_idle_ping.py: using RAC 83 07:38:21.717266 tst ping_idle_ping.py: using CellId 26858 07:38:21.832685 tst ping_idle_ping.py: using BVCI 26859 07:38:21.941111 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:21.953485 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:21.965462 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:21.978395 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:21.992265 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:22.005438 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:22.018909 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 07:38:22.030776 tst gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 07:38:22.149426 tst ping_idle_ping.py:24: start network... 07:38:22.347616 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:38:22.816936 run create_hlr_db(pid=12402): Launched 07:38:22.970369 bus /gobi_6: Setting Powered False 07:38:24.028922 run create_hlr_db(pid=12402): Terminated: ok {rc=0} 07:38:24.453358 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12404): Launched 07:38:24.779054 run osmo-hlr_10.42.42.2(pid=12405): Launched 07:38:25.007665 run osmo-stp_10.42.42.5: Starting osmo-stp 07:38:25.727117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12407): Launched 07:38:26.049728 run osmo-stp_10.42.42.5(pid=12408): Launched 07:38:26.286873 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:38:26.913887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12410): Launched 07:38:27.043536 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:38:27.314861 run patchelf(pid=12411): Launched 07:38:27.503600 run osmo-stp_10.42.42.5(pid=12408): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12408)] 07:38:27.637675 run osmo-stp_10.42.42.5(pid=12408): stdout: | (launched: 2022-12-10_07:38:25.984167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:27.773398 run osmo-stp_10.42.42.5(pid=12408): stderr: | [0;m[38;5;43m20221210073826274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073826275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073826275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073826275 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073826277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073826278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073826278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:27.909164 run osmo-stp_10.42.42.5(pid=12408): stdout: | (launched: 2022-12-10_07:38:25.984167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:28.038908 run osmo-stp_10.42.42.5(pid=12408): stderr: | [0;m[38;5;43m20221210073826274 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073826275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073826275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073826275 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073826277 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073826278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073826278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:28.192904 run patchelf(pid=12411): Terminating (SIGINT) 07:38:28.370930 run patchelf(pid=12411): Terminated: ok {rc=0} 07:38:28.499171 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12408): Process ended prematurely: osmo-stp_10.42.42.5(pid=12408) [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12408)] [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 07:38:28.509551 tst ping_idle_ping.py:27: Test FAILED (7.1 sec) 07:38:28.538868 run osmo-hlr_10.42.42.2(pid=12405): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12405)] 07:38:28.590044 run osmo-hlr_10.42.42.2(pid=12405): stdout: | (launched: 2022-12-10_07:38:24.707103) 07:38:28.642926 run osmo-hlr_10.42.42.2(pid=12405): stderr: | [0;m[1;31m20221210073825054 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073825054 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073825054 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073825054 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073825054 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073825054 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073825074 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073825083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073825083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073825083 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:38:28.696395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12404): Terminating (SIGTERM) 07:38:28.739356 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12407): Terminating (SIGTERM) 07:38:28.782496 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12410): Terminating (SIGTERM) 07:38:28.826523 --- ParallelTerminationStrategy: PID 12404 died... 07:38:28.847376 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12404): Terminated: ok {rc=0} 07:38:28.896368 --- ParallelTerminationStrategy: PID 12407 died... 07:38:28.916885 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12407): Terminated: ok {rc=0} 07:38:28.964258 --- ParallelTerminationStrategy: PID 12410 died... 07:38:28.984848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12410): Terminated: ok {rc=0} 07:38:29.075260 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:38:30.387699 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:38:30.395222 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:38:30.432529 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 07:38:30.470453 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:38:30.523890 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:38:30.558615 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 07:38:30.595939 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:38:31.208533 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2371 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 07:38:31.213966 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:38:31.227454 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:38:31.315859 tst switch_tch_pdch.py: using LAC 26859 07:38:31.464526 tst switch_tch_pdch.py: using RAC 84 07:38:31.616256 tst switch_tch_pdch.py: using CellId 26859 07:38:31.760777 tst switch_tch_pdch.py: using BVCI 26860 07:38:31.924325 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:38:31.940741 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:38:31.953220 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:38:31.970429 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:38:31.987916 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:38:32.000943 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:38:32.019278 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:38:32.034580 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:38:32.180810 tst dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:38:32.318572 tst switch_tch_pdch.py:51: start network... 07:38:32.575411 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:38:33.161716 run create_hlr_db(pid=12415): Launched 07:38:33.342537 bus /gobi_6: Setting Powered False 07:38:34.405304 run create_hlr_db(pid=12415): Terminated: ok {rc=0} 07:38:34.856054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12417): Launched 07:38:35.191054 run osmo-hlr_10.42.42.2(pid=12418): Launched 07:38:35.431867 run osmo-stp_10.42.42.5: Starting osmo-stp 07:38:36.087575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12420): Launched 07:38:36.420546 run osmo-stp_10.42.42.5(pid=12421): Launched 07:38:36.664204 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:38:37.299750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12423): Launched 07:38:37.431379 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:38:37.717808 run patchelf(pid=12424): Launched 07:38:37.900436 run osmo-stp_10.42.42.5(pid=12421): ERR: Terminated: ERROR {rc=1} [trial-2371↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12421)] 07:38:38.035558 run osmo-stp_10.42.42.5(pid=12421): stdout: | (launched: 2022-12-10_07:38:36.359011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:38.173343 run osmo-stp_10.42.42.5(pid=12421): stderr: | [0;m[38;5;43m20221210073836661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073836661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073836661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073836662 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073836667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073836667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073836667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:38.311093 run osmo-stp_10.42.42.5(pid=12421): stdout: | (launched: 2022-12-10_07:38:36.359011) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:38.442566 run osmo-stp_10.42.42.5(pid=12421): stderr: | [0;m[38;5;43m20221210073836661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073836661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073836661 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073836662 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073836667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073836667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073836667 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:38.599111 run patchelf(pid=12424): Terminating (SIGINT) 07:38:38.778733 run patchelf(pid=12424): Terminated: ok {rc=0} 07:38:38.908819 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12421): Process ended prematurely: osmo-stp_10.42.42.5(pid=12421) [trial-2371↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12421)] [trial-2371↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 07:38:38.919671 tst switch_tch_pdch.py:54: Test FAILED (7.7 sec) 07:38:38.949165 run osmo-hlr_10.42.42.2(pid=12418): ERR: Terminated: ERROR {rc=237} [trial-2371↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12418)] 07:38:39.001109 run osmo-hlr_10.42.42.2(pid=12418): stdout: | (launched: 2022-12-10_07:38:35.127009) 07:38:39.055152 run osmo-hlr_10.42.42.2(pid=12418): stderr: | [0;m[1;31m20221210073835438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073835438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073835438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073835438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073835438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073835438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073835458 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073835476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073835476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073835476 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:38:39.108925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12417): Terminating (SIGTERM) 07:38:39.152674 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12420): Terminating (SIGTERM) 07:38:39.199088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12423): Terminating (SIGTERM) 07:38:39.244561 --- ParallelTerminationStrategy: PID 12417 died... 07:38:39.266495 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12417): Terminated: ok {rc=0} 07:38:39.315766 --- ParallelTerminationStrategy: PID 12420 died... 07:38:39.336627 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12420): Terminated: ok {rc=0} 07:38:39.384681 --- ParallelTerminationStrategy: PID 12423 died... 07:38:39.405522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12423): Terminated: ok {rc=0} 07:38:39.497396 bus /gobi_0: Setting Powered False 07:38:40.601869 bus /gobi_0: Setting Powered False 07:38:41.720440 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 dynts:trx-umtrx+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 07:38:42.968731 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:38:42.974589 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 07:38:43.007146 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 07:38:43.041121 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 07:38:43.093964 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 07:38:43.126504 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 07:38:43.160332 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 07:38:43.712371 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2371 dynts:trx-umtrx+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 07:38:43.718952 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:38:43.730884 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 07:38:43.801387 tst switch_tch_pdch.py: using LAC 26860 07:38:43.922543 tst switch_tch_pdch.py: using RAC 85 07:38:44.043272 tst switch_tch_pdch.py: using CellId 26860 07:38:44.163820 tst switch_tch_pdch.py: using BVCI 26861 07:38:44.275782 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:38:44.287044 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:38:44.298247 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:38:44.309550 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:38:44.320724 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:38:44.332123 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:38:44.343701 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:38:44.354950 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:38:44.468733 tst dynts:trx-umtrx+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:38:44.583280 tst switch_tch_pdch.py:51: start network... 07:38:44.774655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:38:45.193716 run create_hlr_db(pid=12430): Launched 07:38:45.305353 bus /gobi_6: Setting Powered False 07:38:46.364632 run create_hlr_db(pid=12430): Terminated: ok {rc=0} 07:38:46.753996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12432): Launched 07:38:47.064930 run osmo-hlr_10.42.42.2(pid=12433): Launched 07:38:47.253927 run osmo-stp_10.42.42.5: Starting osmo-stp 07:38:47.758317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12435): Launched 07:38:48.065789 run osmo-stp_10.42.42.5(pid=12436): Launched 07:38:48.184493 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:38:48.688144 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12438): Launched 07:38:48.806663 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:38:49.066030 run patchelf(pid=12439): Launched 07:38:49.237827 run osmo-stp_10.42.42.5(pid=12436): ERR: Terminated: ERROR {rc=1} [trial-2371↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12436)] 07:38:49.369168 run osmo-stp_10.42.42.5(pid=12436): stdout: | (launched: 2022-12-10_07:38:48.009780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:49.501650 run osmo-stp_10.42.42.5(pid=12436): stderr: | [0;m[38;5;43m20221210073848201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073848201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073848201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073848201 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073848202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073848202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073848202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:49.634417 run osmo-stp_10.42.42.5(pid=12436): stdout: | (launched: 2022-12-10_07:38:48.009780) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:38:49.761143 run osmo-stp_10.42.42.5(pid=12436): stderr: | [0;m[38;5;43m20221210073848201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073848201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073848201 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073848201 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073848202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073848202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073848202 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:38:49.910846 run patchelf(pid=12439): Terminating (SIGINT) 07:38:50.083987 run patchelf(pid=12439): Terminated: ok {rc=0} 07:38:50.209777 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12436): Process ended prematurely: osmo-stp_10.42.42.5(pid=12436) [trial-2371↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12436)] [trial-2371↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 07:38:50.219290 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 07:38:50.247903 run osmo-hlr_10.42.42.2(pid=12433): ERR: Terminated: ERROR {rc=237} [trial-2371↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12433)] 07:38:50.298208 run osmo-hlr_10.42.42.2(pid=12433): stdout: | (launched: 2022-12-10_07:38:47.004424) 07:38:50.350041 run osmo-hlr_10.42.42.2(pid=12433): stderr: | [0;m[1;31m20221210073847272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073847272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073847272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073847272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073847272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073847272 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073847285 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/dynts:trx-umtrx+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073847293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073847293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073847293 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:38:50.402396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12432): Terminating (SIGTERM) 07:38:50.444543 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12435): Terminating (SIGTERM) 07:38:50.486456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12438): Terminating (SIGTERM) 07:38:50.528654 --- ParallelTerminationStrategy: PID 12432 died... 07:38:50.548521 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12432): Terminated: ok {rc=0} 07:38:50.595362 --- ParallelTerminationStrategy: PID 12435 died... 07:38:50.614701 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12435): Terminated: ok {rc=0} 07:38:50.661428 --- ParallelTerminationStrategy: PID 12438 died... 07:38:50.680707 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12438): Terminated: ok {rc=0} 07:38:50.768447 bus /gobi_0: Setting Powered False 07:38:51.866723 bus /gobi_0: Setting Powered False 07:38:52.982654 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 dynts:trx-umtrx+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 nitb_sms:trx-lms --------------------------------------------------------------------- 07:38:54.226960 tst nitb_sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:38:54.230655 tst nitb_sms:trx-lms: Verifying 1 x bts (candidates: 11) 07:38:54.264193 tst nitb_sms:trx-lms: Verifying 1 x ip_address (candidates: 9) 07:38:54.270838 tst nitb_sms:trx-lms: Verifying 2 x modem (candidates: 12) 07:38:54.323627 tst nitb_sms:trx-lms: Reserving 1 x bts (candidates: 11) 07:38:54.356583 tst nitb_sms:trx-lms: Reserving 1 x ip_address (candidates: 9) 07:38:54.363195 tst nitb_sms:trx-lms: Reserving 2 x modem (candidates: 12) 07:38:54.898830 tst nitb_sms:trx-lms: RESERVED RESOURCES for nitb_sms: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 nitb_sms:trx-lms mo_mt_sms.py ---------------------------------------------- 07:38:54.903682 tst nitb_sms:trx-lms: Using 1 x ip_address (candidates: 1) 07:38:54.914262 tst nitb_sms:trx-lms: Using 1 x bts (candidates: 1) 07:38:54.961129 tst mo_mt_sms.py: using LAC 26861 07:38:55.079051 tst mo_mt_sms.py: using RAC 86 07:38:55.192901 tst mo_mt_sms.py: using CellId 26861 07:38:55.314325 tst mo_mt_sms.py: using BVCI 26862 07:38:55.426064 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 07:38:55.539979 tst nitb_sms:trx-lms: Using 1 x modem (candidates: 2) 07:38:55.652380 tst mo_mt_sms.py:9: start nitb and bts... 07:38:55.845494 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:38:56.432785 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12444): Launched 07:38:56.720831 run osmo-nitb_10.42.42.2(pid=12445): Launched 07:38:56.881395 run osmo-nitb_10.42.42.2(pid=12445): ERR: Terminated: ERROR {rc=2} [trial-2371↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12445)] 07:38:57.010975 run osmo-nitb_10.42.42.2(pid=12445): stdout: | (launched: 2022-12-10_07:38:56.668175) 07:38:57.142256 run osmo-nitb_10.42.42.2(pid=12445): stderr: | (launched: 2022-12-10_07:38:56.710826) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:38:57.273486 run osmo-nitb_10.42.42.2(pid=12445): stdout: | (launched: 2022-12-10_07:38:56.668175) 07:38:57.399840 run osmo-nitb_10.42.42.2(pid=12445): stderr: | (launched: 2022-12-10_07:38:56.710826) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f5483dba268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12445): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12445) [trial-2371↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12445)] 07:38:57.830692 tst osmo-nitb_10.42.42.2(pid=12445): stdout: | (launched: 2022-12-10_07:38:56.668175) 07:38:57.947727 tst osmo-nitb_10.42.42.2(pid=12445): stderr: | (launched: 2022-12-10_07:38:56.710826) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:38:58.085309 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=12445): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12445) [trial-2371↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12445)] [trial-2371↪nitb_sms:trx-lms↪mo_mt_sms.py:11] 07:38:58.093498 tst mo_mt_sms.py:11: Test FAILED (3.2 sec) 07:38:58.100049 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12444): Terminating (SIGTERM) 07:38:58.310510 --- ParallelTerminationStrategy: PID 12444 died... 07:38:58.331412 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12444): Terminated: ok {rc=0} 07:38:58.417897 bus /sierra_3: Setting Powered False 07:38:59.516929 bus /sierra_3: Setting Powered False 07:39:00.634715 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 nitb_sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 sms:trx-lms --------------------------------------------------------------------- 07:39:01.844193 tst sms:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:39:01.851674 tst sms:trx-lms: Verifying 1 x bts (candidates: 11) 07:39:01.896197 tst sms:trx-lms: Verifying 6 x ip_address (candidates: 9) 07:39:01.927594 tst sms:trx-lms: Verifying 2 x modem (candidates: 12) 07:39:01.979053 tst sms:trx-lms: Reserving 1 x bts (candidates: 11) 07:39:02.013967 tst sms:trx-lms: Reserving 6 x ip_address (candidates: 9) 07:39:02.042396 tst sms:trx-lms: Reserving 2 x modem (candidates: 12) 07:39:02.589393 tst sms:trx-lms: RESERVED RESOURCES for sms: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 sms:trx-lms mo_mt_sms.py ---------------------------------------------- 07:39:02.594693 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 07:39:02.605590 tst sms:trx-lms: Using 1 x bts (candidates: 1) 07:39:02.654667 tst mo_mt_sms.py: using LAC 26862 07:39:02.775713 tst mo_mt_sms.py: using RAC 87 07:39:02.895393 tst mo_mt_sms.py: using CellId 26862 07:39:03.015555 tst mo_mt_sms.py: using BVCI 26863 07:39:03.128201 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 07:39:03.139227 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 07:39:03.150059 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 07:39:03.160752 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 07:39:03.171552 tst sms:trx-lms: Using 1 x ip_address (candidates: 6) 07:39:03.182644 tst sms:trx-lms: Using 1 x modem (candidates: 2) 07:39:03.297112 tst sms:trx-lms: Using 1 x modem (candidates: 2) 07:39:03.413137 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:39:03.857672 run create_hlr_db(pid=12450): Launched 07:39:03.969918 bus /sierra_2: Setting Powered False 07:39:05.031910 run create_hlr_db(pid=12450): Terminated: ok {rc=0} 07:39:05.446355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12452): Launched 07:39:05.734184 run osmo-hlr_10.42.42.2(pid=12453): Launched 07:39:05.844866 run osmo-stp_10.42.42.5: Starting osmo-stp 07:39:06.352868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12455): Launched 07:39:06.640505 run osmo-stp_10.42.42.5(pid=12456): Launched 07:39:06.750616 run osmo-msc_10.42.42.6: Starting osmo-msc 07:39:07.272668 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12458): Launched 07:39:07.561481 run osmo-msc_10.42.42.6(pid=12459): Launched 07:39:07.723711 run osmo-stp_10.42.42.5(pid=12456): ERR: Terminated: ERROR {rc=1} [trial-2371↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12456)] 07:39:07.846245 run osmo-stp_10.42.42.5(pid=12456): stdout: | (launched: 2022-12-10_07:39:06.587693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:07.970425 run osmo-stp_10.42.42.5(pid=12456): stderr: | [0;m[38;5;43m20221210073906756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073906756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073906757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073906757 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073906757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073906758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073906758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:08.090639 run osmo-stp_10.42.42.5(pid=12456): stdout: | (launched: 2022-12-10_07:39:06.587693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:08.205683 run osmo-stp_10.42.42.5(pid=12456): stderr: | [0;m[38;5;43m20221210073906756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073906756 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073906757 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073906757 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073906757 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073906758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073906758 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:08.342586 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=12456): Process ended prematurely: osmo-stp_10.42.42.5(pid=12456) [trial-2371↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12456)] [trial-2371↪sms:trx-lms↪mo_mt_sms.py:16] 07:39:08.350807 tst mo_mt_sms.py:16: Test FAILED (5.7 sec) 07:39:08.376908 run osmo-hlr_10.42.42.2(pid=12453): ERR: Terminated: ERROR {rc=237} [trial-2371↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12453)] 07:39:08.424619 run osmo-hlr_10.42.42.2(pid=12453): stdout: | (launched: 2022-12-10_07:39:05.681532) 07:39:08.473765 run osmo-hlr_10.42.42.2(pid=12453): stderr: | [0;m[1;31m20221210073905854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073905854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073905854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073905854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073905854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073905854 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073905867 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/sms:trx-lms/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073905878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073905878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073905878 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:39:08.542401 run osmo-msc_10.42.42.6(pid=12459): ERR: Terminated: ERROR {rc=2} [trial-2371↪sms:trx-lms↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12459)] 07:39:08.590050 run osmo-msc_10.42.42.6(pid=12459): stdout: | (launched: 2022-12-10_07:39:07.508332) 07:39:08.639164 run osmo-msc_10.42.42.6(pid=12459): stderr: | [0;m[38;5;43m20221210073907777 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073907777 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f54ea6f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073907778 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073907778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073907778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073907778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073907780 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073907780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073907780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073907780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:39:08.689274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12452): Terminating (SIGTERM) 07:39:08.728917 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12455): Terminating (SIGTERM) 07:39:08.768811 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12458): Terminating (SIGTERM) 07:39:08.808663 --- ParallelTerminationStrategy: PID 12452 died... 07:39:08.827625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12452): Terminated: ok {rc=0} 07:39:08.872160 --- ParallelTerminationStrategy: PID 12455 died... 07:39:08.890825 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12455): Terminated: ok {rc=0} 07:39:08.935391 --- ParallelTerminationStrategy: PID 12458 died... 07:39:08.953812 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12458): Terminated: ok {rc=0} 07:39:09.039563 bus /sierra_3: Setting Powered False 07:39:10.139763 bus /sierra_3: Setting Powered False 07:39:11.255211 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 sms:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 nitb_ussd:trx-lms --------------------------------------------------------------------- 07:39:12.483995 tst nitb_ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:39:12.487722 tst nitb_ussd:trx-lms: Verifying 1 x bts (candidates: 11) 07:39:12.520844 tst nitb_ussd:trx-lms: Verifying 1 x ip_address (candidates: 9) 07:39:12.527500 tst nitb_ussd:trx-lms: Verifying 1 x modem (candidates: 12) 07:39:12.561992 tst nitb_ussd:trx-lms: Reserving 1 x bts (candidates: 11) 07:39:12.595185 tst nitb_ussd:trx-lms: Reserving 1 x ip_address (candidates: 9) 07:39:12.601869 tst nitb_ussd:trx-lms: Reserving 1 x modem (candidates: 12) 07:39:13.120250 tst nitb_ussd:trx-lms: RESERVED RESOURCES for nitb_ussd: bts LimeSDR-USB ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2371 nitb_ussd:trx-lms assert_extension.py ---------------------------------------------- 07:39:13.125474 tst nitb_ussd:trx-lms: Using 1 x ip_address (candidates: 1) 07:39:13.136015 tst nitb_ussd:trx-lms: Using 1 x bts (candidates: 1) 07:39:13.184498 tst assert_extension.py: using LAC 26863 07:39:13.298450 tst assert_extension.py: using RAC 88 07:39:13.414120 tst assert_extension.py: using CellId 26863 07:39:13.529867 tst assert_extension.py: using BVCI 26864 07:39:13.635961 tst nitb_ussd:trx-lms: Using 1 x modem (candidates: 1) 07:39:13.747715 tst assert_extension.py:10: start nitb and bts... 07:39:13.939748 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:39:14.528731 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12464): Launched 07:39:14.816503 run osmo-nitb_10.42.42.2(pid=12465): Launched 07:39:14.976921 run osmo-nitb_10.42.42.2(pid=12465): ERR: Terminated: ERROR {rc=2} [trial-2371↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12465)] 07:39:15.106962 run osmo-nitb_10.42.42.2(pid=12465): stdout: | (launched: 2022-12-10_07:39:14.763688) 07:39:15.238423 run osmo-nitb_10.42.42.2(pid=12465): stderr: | (launched: 2022-12-10_07:39:14.806472) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:39:15.369382 run osmo-nitb_10.42.42.2(pid=12465): stdout: | (launched: 2022-12-10_07:39:14.763688) 07:39:15.495691 run osmo-nitb_10.42.42.2(pid=12465): stderr: | (launched: 2022-12-10_07:39:14.806472) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f5483dba268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=12465): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12465) [trial-2371↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12465)] 07:39:15.926166 tst osmo-nitb_10.42.42.2(pid=12465): stdout: | (launched: 2022-12-10_07:39:14.763688) 07:39:16.052509 tst osmo-nitb_10.42.42.2(pid=12465): stderr: | (launched: 2022-12-10_07:39:14.806472) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:39:16.194431 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=12465): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12465) [trial-2371↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12465)] [trial-2371↪nitb_ussd:trx-lms↪assert_extension.py:12] 07:39:16.203712 tst assert_extension.py:12: Test FAILED (3.1 sec) 07:39:16.211233 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12464): Terminating (SIGTERM) 07:39:16.424573 --- ParallelTerminationStrategy: PID 12464 died... 07:39:16.444293 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=12464): Terminated: ok {rc=0} 07:39:16.532165 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 nitb_ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 ussd:trx-lms --------------------------------------------------------------------- 07:39:17.707727 tst ussd:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:39:17.711550 tst ussd:trx-lms: Verifying 1 x bts (candidates: 11) 07:39:17.744558 tst ussd:trx-lms: Verifying 6 x ip_address (candidates: 9) 07:39:17.770867 tst ussd:trx-lms: Verifying 1 x modem (candidates: 12) 07:39:17.806116 tst ussd:trx-lms: Reserving 1 x bts (candidates: 11) 07:39:17.840559 tst ussd:trx-lms: Reserving 6 x ip_address (candidates: 9) 07:39:17.868212 tst ussd:trx-lms: Reserving 1 x modem (candidates: 12) 07:39:18.392264 tst ussd:trx-lms: RESERVED RESOURCES for ussd: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2371 ussd:trx-lms assert_extension.py ---------------------------------------------- 07:39:18.397531 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 07:39:18.407761 tst ussd:trx-lms: Using 1 x bts (candidates: 1) 07:39:18.457195 tst assert_extension.py: using LAC 26864 07:39:18.570411 tst assert_extension.py: using RAC 89 07:39:18.685795 tst assert_extension.py: using CellId 26864 07:39:18.801471 tst assert_extension.py: using BVCI 26865 07:39:18.914056 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 07:39:18.925015 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 07:39:18.936045 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 07:39:18.947439 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 07:39:18.958824 tst ussd:trx-lms: Using 1 x ip_address (candidates: 6) 07:39:18.970153 tst ussd:trx-lms: Using 1 x modem (candidates: 1) 07:39:19.089228 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:39:19.568238 run create_hlr_db(pid=12469): Launched 07:39:19.695877 bus /sierra_2: Setting Powered False 07:39:20.758335 run create_hlr_db(pid=12469): Terminated: ok {rc=0} 07:39:21.171262 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12471): Launched 07:39:21.480229 run osmo-hlr_10.42.42.2(pid=12472): Launched 07:39:21.599702 run osmo-stp_10.42.42.5: Starting osmo-stp 07:39:22.132376 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12474): Launched 07:39:22.441297 run osmo-stp_10.42.42.5(pid=12475): Launched 07:39:22.560006 run osmo-msc_10.42.42.6: Starting osmo-msc 07:39:23.118586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12477): Launched 07:39:23.427341 run osmo-msc_10.42.42.6(pid=12478): Launched 07:39:23.600839 run osmo-stp_10.42.42.5(pid=12475): ERR: Terminated: ERROR {rc=1} [trial-2371↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12475)] 07:39:23.731252 run osmo-stp_10.42.42.5(pid=12475): stdout: | (launched: 2022-12-10_07:39:22.385378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:23.862014 run osmo-stp_10.42.42.5(pid=12475): stderr: | [0;m[38;5;43m20221210073922575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073922575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073922576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073922576 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073922577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073922577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073922577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:23.993511 run osmo-stp_10.42.42.5(pid=12475): stdout: | (launched: 2022-12-10_07:39:22.385378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:24.116624 run osmo-stp_10.42.42.5(pid=12475): stderr: | [0;m[38;5;43m20221210073922575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073922575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073922576 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073922576 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073922577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073922577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073922577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:24.264154 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=12475): Process ended prematurely: osmo-stp_10.42.42.5(pid=12475) [trial-2371↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12475)] [trial-2371↪ussd:trx-lms↪assert_extension.py:17] 07:39:24.273100 tst assert_extension.py:17: Test FAILED (5.9 sec) 07:39:24.300499 run osmo-hlr_10.42.42.2(pid=12472): ERR: Terminated: ERROR {rc=237} [trial-2371↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12472)] 07:39:24.350706 run osmo-hlr_10.42.42.2(pid=12472): stdout: | (launched: 2022-12-10_07:39:21.424203) 07:39:24.402485 run osmo-hlr_10.42.42.2(pid=12472): stderr: | [0;m[1;31m20221210073921622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073921622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073921622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073921622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073921622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073921622 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073921635 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/ussd:trx-lms/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073921645 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073921646 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073921647 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:39:24.474423 run osmo-msc_10.42.42.6(pid=12478): ERR: Terminated: ERROR {rc=2} [trial-2371↪ussd:trx-lms↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12478)] 07:39:24.524044 run osmo-msc_10.42.42.6(pid=12478): stdout: | (launched: 2022-12-10_07:39:23.371042) 07:39:24.575369 run osmo-msc_10.42.42.6(pid=12478): stderr: | [0;m[38;5;43m20221210073923692 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073923692 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd7c3289c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073923692 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073923692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073923692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073923692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073923694 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073923695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073923695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073923695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:39:24.627240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12471): Terminating (SIGTERM) 07:39:24.668900 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12474): Terminating (SIGTERM) 07:39:24.710770 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12477): Terminating (SIGTERM) 07:39:24.752745 --- ParallelTerminationStrategy: PID 12471 died... 07:39:24.772748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12471): Terminated: ok {rc=0} 07:39:24.818853 --- ParallelTerminationStrategy: PID 12474 died... 07:39:24.838494 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12474): Terminated: ok {rc=0} 07:39:24.884518 --- ParallelTerminationStrategy: PID 12477 died... 07:39:24.904179 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12477): Terminated: ok {rc=0} 07:39:24.992358 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 ussd:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 07:39:26.208316 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:39:26.215794 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 07:39:26.250046 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 07:39:26.277197 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 07:39:26.330859 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 07:39:26.364779 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 07:39:26.391792 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 07:39:26.943029 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 07:39:26.994335 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:39:27.005710 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:39:27.076570 tst mo_mt_call.py: using LAC 26865 07:39:27.201057 tst mo_mt_call.py: using RAC 90 07:39:27.324931 tst mo_mt_call.py: using CellId 26865 07:39:27.446938 tst mo_mt_call.py: using BVCI 26866 07:39:27.560225 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:39:27.571780 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:39:27.583206 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:39:27.594494 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:39:27.605954 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:39:27.617109 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:39:27.733603 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:39:27.853426 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:39:28.339574 run create_hlr_db(pid=12483): Launched 07:39:28.467195 bus /sierra_2: Setting Powered False 07:39:29.529812 run create_hlr_db(pid=12483): Terminated: ok {rc=0} 07:39:29.967599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12485): Launched 07:39:30.281917 run osmo-hlr_10.42.42.2(pid=12486): Launched 07:39:30.402030 run osmo-stp_10.42.42.5: Starting osmo-stp 07:39:30.977752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12488): Launched 07:39:31.318755 run osmo-stp_10.42.42.5(pid=12489): Launched 07:39:31.556820 run osmo-msc_10.42.42.6: Starting osmo-msc 07:39:32.198696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12491): Launched 07:39:32.512067 run osmo-msc_10.42.42.6(pid=12492): Launched 07:39:32.688712 run osmo-stp_10.42.42.5(pid=12489): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12489)] 07:39:32.824248 run osmo-stp_10.42.42.5(pid=12489): stdout: | (launched: 2022-12-10_07:39:31.253800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:32.957428 run osmo-stp_10.42.42.5(pid=12489): stderr: | [0;m[38;5;43m20221210073931548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073931548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073931548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073931549 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073931549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073931549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073931549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:33.089198 run osmo-stp_10.42.42.5(pid=12489): stdout: | (launched: 2022-12-10_07:39:31.253800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:33.214677 run osmo-stp_10.42.42.5(pid=12489): stderr: | [0;m[38;5;43m20221210073931548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073931548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073931548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073931549 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073931549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073931549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073931549 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:33.364349 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12489): Process ended prematurely: osmo-stp_10.42.42.5(pid=12489) [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12489)] [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:39:33.374070 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 07:39:33.401778 run osmo-hlr_10.42.42.2(pid=12486): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12486)] 07:39:33.451319 run osmo-hlr_10.42.42.2(pid=12486): stdout: | (launched: 2022-12-10_07:39:30.225059) 07:39:33.502645 run osmo-hlr_10.42.42.2(pid=12486): stderr: | [0;m[1;31m20221210073930422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073930422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073930422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073930422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073930422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073930422 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073930435 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073930443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073930444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073930444 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:39:33.574012 run osmo-msc_10.42.42.6(pid=12492): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12492)] 07:39:33.623831 run osmo-msc_10.42.42.6(pid=12492): stdout: | (launched: 2022-12-10_07:39:32.455483) 07:39:33.675181 run osmo-msc_10.42.42.6(pid=12492): stderr: | [0;m[38;5;43m20221210073932775 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073932775 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1026bf1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073932775 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073932776 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073932776 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073932776 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073932778 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073932778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073932778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073932778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:39:33.726574 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12485): Terminating (SIGTERM) 07:39:33.767635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12488): Terminating (SIGTERM) 07:39:33.808716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12491): Terminating (SIGTERM) 07:39:33.850370 --- ParallelTerminationStrategy: PID 12485 died... 07:39:33.870309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12485): Terminated: ok {rc=0} 07:39:33.916089 --- ParallelTerminationStrategy: PID 12488 died... 07:39:33.935468 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12488): Terminated: ok {rc=0} 07:39:33.981415 --- ParallelTerminationStrategy: PID 12491 died... 07:39:34.001177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12491): Terminated: ok {rc=0} 07:39:34.089079 bus /sierra_3: Setting Powered False 07:39:35.188222 bus /sierra_3: Setting Powered False 07:39:36.303949 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:39:37.450663 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:39:37.462980 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:39:37.534652 tst mo_mt_call_osmux.py: using LAC 26866 07:39:37.660374 tst mo_mt_call_osmux.py: using RAC 91 07:39:37.783689 tst mo_mt_call_osmux.py: using CellId 26866 07:39:37.907639 tst mo_mt_call_osmux.py: using BVCI 26867 07:39:38.021186 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:39:38.032583 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:39:38.043839 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:39:38.055148 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:39:38.066473 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:39:38.077743 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:39:38.191369 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:39:38.312205 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:39:38.799988 run create_hlr_db(pid=12494): Launched 07:39:38.928156 bus /sierra_2: Setting Powered False 07:39:39.991285 run create_hlr_db(pid=12494): Terminated: ok {rc=0} 07:39:40.412901 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12496): Launched 07:39:40.707672 run osmo-hlr_10.42.42.2(pid=12497): Launched 07:39:40.819826 run osmo-stp_10.42.42.5: Starting osmo-stp 07:39:41.326071 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12499): Launched 07:39:41.620192 run osmo-stp_10.42.42.5(pid=12500): Launched 07:39:41.733106 run osmo-msc_10.42.42.6: Starting osmo-msc 07:39:42.265087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12502): Launched 07:39:42.559157 run osmo-msc_10.42.42.6(pid=12503): Launched 07:39:42.724388 run osmo-stp_10.42.42.5(pid=12500): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12500)] 07:39:42.849826 run osmo-stp_10.42.42.5(pid=12500): stdout: | (launched: 2022-12-10_07:39:41.566419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:42.975241 run osmo-stp_10.42.42.5(pid=12500): stderr: | [0;m[38;5;43m20221210073941735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073941735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073941735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073941736 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073941736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073941736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073941737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:43.097919 run osmo-stp_10.42.42.5(pid=12500): stdout: | (launched: 2022-12-10_07:39:41.566419) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:43.215295 run osmo-stp_10.42.42.5(pid=12500): stderr: | [0;m[38;5;43m20221210073941735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073941735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073941735 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073941736 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073941736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073941736 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073941737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:43.355999 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12500): Process ended prematurely: osmo-stp_10.42.42.5(pid=12500) [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12500)] [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:39:43.364889 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 07:39:43.392097 run osmo-hlr_10.42.42.2(pid=12497): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12497)] 07:39:43.439979 run osmo-hlr_10.42.42.2(pid=12497): stdout: | (launched: 2022-12-10_07:39:40.654168) 07:39:43.490144 run osmo-hlr_10.42.42.2(pid=12497): stderr: | [0;m[1;31m20221210073940829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073940829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073940829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073940829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073940829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073940829 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073940842 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073940853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073940853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073940853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:39:43.558873 run osmo-msc_10.42.42.6(pid=12503): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12503)] 07:39:43.606402 run osmo-msc_10.42.42.6(pid=12503): stdout: | (launched: 2022-12-10_07:39:42.505592) 07:39:43.655270 run osmo-msc_10.42.42.6(pid=12503): stderr: | [0;m[38;5;43m20221210073942776 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073942776 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5636accc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073942776 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073942776 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073942776 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073942777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073942778 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073942779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073942779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073942779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:39:43.704763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12496): Terminating (SIGTERM) 07:39:43.744430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12499): Terminating (SIGTERM) 07:39:43.784223 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12502): Terminating (SIGTERM) 07:39:43.824212 --- ParallelTerminationStrategy: PID 12496 died... 07:39:43.843276 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12496): Terminated: ok {rc=0} 07:39:43.887586 --- ParallelTerminationStrategy: PID 12499 died... 07:39:43.906215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12499): Terminated: ok {rc=0} 07:39:43.950110 --- ParallelTerminationStrategy: PID 12502 died... 07:39:43.968672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12502): Terminated: ok {rc=0} 07:39:44.055022 bus /sierra_3: Setting Powered False 07:39:45.154507 bus /sierra_3: Setting Powered False 07:39:46.283485 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:39:47.540415 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:39:47.546698 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:39:47.579910 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:39:47.606131 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:39:47.658823 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:39:47.692588 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:39:47.719656 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:39:48.272048 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:39:48.322530 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:39:48.334187 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:39:48.404488 tst mo_mt_call.py: using LAC 26867 07:39:48.526789 tst mo_mt_call.py: using RAC 92 07:39:48.653580 tst mo_mt_call.py: using CellId 26867 07:39:48.775910 tst mo_mt_call.py: using BVCI 26868 07:39:48.889037 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:39:48.900390 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:39:48.911842 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:39:48.923174 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:39:48.934755 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:39:48.946211 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:39:49.060617 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:39:49.176684 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:39:49.662938 run create_hlr_db(pid=12508): Launched 07:39:49.790715 bus /sierra_2: Setting Powered False 07:39:50.853170 run create_hlr_db(pid=12508): Terminated: ok {rc=0} 07:39:51.273246 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12510): Launched 07:39:51.567997 run osmo-hlr_10.42.42.2(pid=12511): Launched 07:39:51.681169 run osmo-stp_10.42.42.5: Starting osmo-stp 07:39:52.205093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12513): Launched 07:39:52.498794 run osmo-stp_10.42.42.5(pid=12514): Launched 07:39:52.611402 run osmo-msc_10.42.42.6: Starting osmo-msc 07:39:53.143673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12516): Launched 07:39:53.437520 run osmo-msc_10.42.42.6(pid=12517): Launched 07:39:53.603367 run osmo-stp_10.42.42.5(pid=12514): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12514)] 07:39:53.728857 run osmo-stp_10.42.42.5(pid=12514): stdout: | (launched: 2022-12-10_07:39:52.445241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:53.854417 run osmo-stp_10.42.42.5(pid=12514): stderr: | [0;m[38;5;43m20221210073952614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073952614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073952614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073952615 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073952615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073952615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073952615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:53.976530 run osmo-stp_10.42.42.5(pid=12514): stdout: | (launched: 2022-12-10_07:39:52.445241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:39:54.093701 run osmo-stp_10.42.42.5(pid=12514): stderr: | [0;m[38;5;43m20221210073952614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210073952614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210073952614 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210073952615 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210073952615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210073952615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210073952615 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:39:54.233560 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12514): Process ended prematurely: osmo-stp_10.42.42.5(pid=12514) [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12514)] [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:39:54.242243 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 07:39:54.268992 run osmo-hlr_10.42.42.2(pid=12511): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12511)] 07:39:54.316725 run osmo-hlr_10.42.42.2(pid=12511): stdout: | (launched: 2022-12-10_07:39:51.514079) 07:39:54.366004 run osmo-hlr_10.42.42.2(pid=12511): stderr: | [0;m[1;31m20221210073951687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210073951687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210073951687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210073951687 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210073951688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210073951688 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210073951699 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210073951708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210073951709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210073951709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:39:54.434557 run osmo-msc_10.42.42.6(pid=12517): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12517)] 07:39:54.482296 run osmo-msc_10.42.42.6(pid=12517): stdout: | (launched: 2022-12-10_07:39:53.383674) 07:39:54.531167 run osmo-msc_10.42.42.6(pid=12517): stderr: | [0;m[38;5;43m20221210073953654 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210073953654 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc7646f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210073953654 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210073953654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210073953654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210073953655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210073953656 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210073953657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210073953657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210073953657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:39:54.580550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12510): Terminating (SIGTERM) 07:39:54.620001 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12513): Terminating (SIGTERM) 07:39:54.659533 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12516): Terminating (SIGTERM) 07:39:54.699329 --- ParallelTerminationStrategy: PID 12510 died... 07:39:54.718285 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12510): Terminated: ok {rc=0} 07:39:54.762273 --- ParallelTerminationStrategy: PID 12513 died... 07:39:54.780523 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12513): Terminated: ok {rc=0} 07:39:54.824760 --- ParallelTerminationStrategy: PID 12516 died... 07:39:54.843232 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12516): Terminated: ok {rc=0} 07:39:54.929633 bus /sierra_3: Setting Powered False 07:39:56.027194 bus /sierra_3: Setting Powered False 07:39:57.141870 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:39:58.286740 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:39:58.298268 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:39:58.367137 tst mo_mt_call_osmux.py: using LAC 26868 07:39:58.485357 tst mo_mt_call_osmux.py: using RAC 93 07:39:58.598591 tst mo_mt_call_osmux.py: using CellId 26868 07:39:58.711554 tst mo_mt_call_osmux.py: using BVCI 26869 07:39:58.817455 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:39:58.828376 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:39:58.839051 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:39:58.850035 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:39:58.861118 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:39:58.871931 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:39:58.990295 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:39:59.106248 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:39:59.561098 run create_hlr_db(pid=12519): Launched 07:39:59.673720 bus /sierra_2: Setting Powered False 07:40:00.732792 run create_hlr_db(pid=12519): Terminated: ok {rc=0} 07:40:01.178154 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12521): Launched 07:40:01.492242 run osmo-hlr_10.42.42.2(pid=12522): Launched 07:40:01.805143 run osmo-stp_10.42.42.5: Starting osmo-stp 07:40:02.366348 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12527): Launched 07:40:02.664362 run osmo-stp_10.42.42.5(pid=12528): Launched 07:40:02.777262 run osmo-msc_10.42.42.6: Starting osmo-msc 07:40:03.310594 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12530): Launched 07:40:03.604739 run osmo-msc_10.42.42.6(pid=12531): Launched 07:40:03.769773 run osmo-stp_10.42.42.5(pid=12528): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12528)] 07:40:03.894793 run osmo-stp_10.42.42.5(pid=12528): stdout: | (launched: 2022-12-10_07:40:02.610369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:04.020146 run osmo-stp_10.42.42.5(pid=12528): stderr: | [0;m[38;5;43m20221210074002778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074002778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074002779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074002779 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074002780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074002780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074002780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:04.142716 run osmo-stp_10.42.42.5(pid=12528): stdout: | (launched: 2022-12-10_07:40:02.610369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:04.259985 run osmo-stp_10.42.42.5(pid=12528): stderr: | [0;m[38;5;43m20221210074002778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074002778 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074002779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074002779 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074002780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074002780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074002780 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:04.399916 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12528): Process ended prematurely: osmo-stp_10.42.42.5(pid=12528) [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12528)] [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:40:04.408681 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:40:04.435361 run osmo-hlr_10.42.42.2(pid=12522): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12522)] 07:40:04.483896 run osmo-hlr_10.42.42.2(pid=12522): stdout: | (launched: 2022-12-10_07:40:01.435160) 07:40:04.533261 run osmo-hlr_10.42.42.2(pid=12522): stderr: | [0;m[1;31m20221210074001636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074001636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074001636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074001636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074001636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074001636 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074001649 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074001659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074001660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074001660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:40:04.602173 run osmo-msc_10.42.42.6(pid=12531): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12531)] 07:40:04.649907 run osmo-msc_10.42.42.6(pid=12531): stdout: | (launched: 2022-12-10_07:40:03.551125) 07:40:04.699138 run osmo-msc_10.42.42.6(pid=12531): stderr: | [0;m[38;5;43m20221210074003822 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074003823 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb03da40c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074003823 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074003823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074003823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074003823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074003825 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074003825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074003826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074003826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:40:04.748823 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12521): Terminating (SIGTERM) 07:40:04.788734 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12527): Terminating (SIGTERM) 07:40:04.828577 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12530): Terminating (SIGTERM) 07:40:04.868732 --- ParallelTerminationStrategy: PID 12521 died... 07:40:04.887897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12521): Terminated: ok {rc=0} 07:40:04.933022 --- ParallelTerminationStrategy: PID 12527 died... 07:40:04.951642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12527): Terminated: ok {rc=0} 07:40:04.996309 --- ParallelTerminationStrategy: PID 12530 died... 07:40:05.015000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12530): Terminated: ok {rc=0} 07:40:05.099444 bus /sierra_3: Setting Powered False 07:40:06.197586 bus /sierra_3: Setting Powered False 07:40:07.317810 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:40:08.564670 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:40:08.571120 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:40:08.604816 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:40:08.631083 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:40:08.682557 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:40:08.716024 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:40:08.743129 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:40:09.295182 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:40:09.344339 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:40:09.355523 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:40:09.423224 tst mo_mt_call.py: using LAC 26869 07:40:09.537875 tst mo_mt_call.py: using RAC 94 07:40:09.653707 tst mo_mt_call.py: using CellId 26869 07:40:09.778480 tst mo_mt_call.py: using BVCI 26870 07:40:09.892563 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:40:09.904164 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:40:09.915580 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:40:09.926922 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:40:09.938383 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:40:09.949632 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:40:10.063939 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:40:10.181553 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:40:10.638721 run create_hlr_db(pid=12536): Launched 07:40:10.752108 bus /sierra_2: Setting Powered False 07:40:11.810515 run create_hlr_db(pid=12536): Terminated: ok {rc=0} 07:40:12.242723 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12538): Launched 07:40:12.559006 run osmo-hlr_10.42.42.2(pid=12539): Launched 07:40:12.680478 run osmo-stp_10.42.42.5: Starting osmo-stp 07:40:13.224215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12541): Launched 07:40:13.539034 run osmo-stp_10.42.42.5(pid=12542): Launched 07:40:13.660295 run osmo-msc_10.42.42.6: Starting osmo-msc 07:40:14.231893 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12544): Launched 07:40:14.546147 run osmo-msc_10.42.42.6(pid=12545): Launched 07:40:14.722659 run osmo-stp_10.42.42.5(pid=12542): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12542)] 07:40:14.854505 run osmo-stp_10.42.42.5(pid=12542): stdout: | (launched: 2022-12-10_07:40:13.482266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:14.987085 run osmo-stp_10.42.42.5(pid=12542): stderr: | [0;m[38;5;43m20221210074013675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074013675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074013676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074013676 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074013677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074013677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074013677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:15.119074 run osmo-stp_10.42.42.5(pid=12542): stdout: | (launched: 2022-12-10_07:40:13.482266) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:15.244541 run osmo-stp_10.42.42.5(pid=12542): stderr: | [0;m[38;5;43m20221210074013675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074013675 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074013676 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074013676 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074013677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074013677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074013677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:15.394740 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12542): Process ended prematurely: osmo-stp_10.42.42.5(pid=12542) [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12542)] [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:40:15.404135 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:40:15.431945 run osmo-hlr_10.42.42.2(pid=12539): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12539)] 07:40:15.482087 run osmo-hlr_10.42.42.2(pid=12539): stdout: | (launched: 2022-12-10_07:40:12.501922) 07:40:15.533859 run osmo-hlr_10.42.42.2(pid=12539): stderr: | [0;m[1;31m20221210074012698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074012698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074012698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074012698 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074012699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074012699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074012711 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074012719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074012719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074012719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:40:15.605774 run osmo-msc_10.42.42.6(pid=12545): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12545)] 07:40:15.655743 run osmo-msc_10.42.42.6(pid=12545): stdout: | (launched: 2022-12-10_07:40:14.489321) 07:40:15.706970 run osmo-msc_10.42.42.6(pid=12545): stderr: | [0;m[38;5;43m20221210074014810 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074014811 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f412a36bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074014811 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074014811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074014811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074014811 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074014813 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074014813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074014813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074014813 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:40:15.758894 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12538): Terminating (SIGTERM) 07:40:15.800326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12541): Terminating (SIGTERM) 07:40:15.845637 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12544): Terminating (SIGTERM) 07:40:15.889468 --- ParallelTerminationStrategy: PID 12538 died... 07:40:15.909942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12538): Terminated: ok {rc=0} 07:40:15.971827 --- ParallelTerminationStrategy: PID 12541 died... 07:40:15.992126 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12541): Terminated: ok {rc=0} 07:40:16.040766 --- ParallelTerminationStrategy: PID 12544 died... 07:40:16.061488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12544): Terminated: ok {rc=0} 07:40:16.152333 bus /sierra_3: Setting Powered False 07:40:17.259672 bus /sierra_3: Setting Powered False 07:40:18.377749 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:40:19.523283 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:40:19.535111 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:40:19.604897 tst mo_mt_call_osmux.py: using LAC 26870 07:40:19.721596 tst mo_mt_call_osmux.py: using RAC 95 07:40:19.845141 tst mo_mt_call_osmux.py: using CellId 26870 07:40:19.968579 tst mo_mt_call_osmux.py: using BVCI 26871 07:40:20.082830 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:40:20.094305 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:40:20.105604 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:40:20.117133 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:40:20.128400 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:40:20.139616 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:40:20.259942 tst voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:40:20.380086 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:40:20.865935 run create_hlr_db(pid=12547): Launched 07:40:20.993148 bus /sierra_2: Setting Powered False 07:40:22.056087 run create_hlr_db(pid=12547): Terminated: ok {rc=0} 07:40:22.476215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12549): Launched 07:40:22.771456 run osmo-hlr_10.42.42.2(pid=12550): Launched 07:40:22.884162 run osmo-stp_10.42.42.5: Starting osmo-stp 07:40:23.389402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12552): Launched 07:40:23.682778 run osmo-stp_10.42.42.5(pid=12553): Launched 07:40:23.796343 run osmo-msc_10.42.42.6: Starting osmo-msc 07:40:24.329394 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12555): Launched 07:40:24.624101 run osmo-msc_10.42.42.6(pid=12556): Launched 07:40:24.789308 run osmo-stp_10.42.42.5(pid=12553): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12553)] 07:40:24.913998 run osmo-stp_10.42.42.5(pid=12553): stdout: | (launched: 2022-12-10_07:40:23.629423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:25.039102 run osmo-stp_10.42.42.5(pid=12553): stderr: | [0;m[38;5;43m20221210074023797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074023797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074023797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074023798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074023798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074023798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074023798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:25.161904 run osmo-stp_10.42.42.5(pid=12553): stdout: | (launched: 2022-12-10_07:40:23.629423) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:25.278758 run osmo-stp_10.42.42.5(pid=12553): stderr: | [0;m[38;5;43m20221210074023797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074023797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074023797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074023798 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074023798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074023798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074023798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:25.419127 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12553): Process ended prematurely: osmo-stp_10.42.42.5(pid=12553) [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12553)] [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:40:25.427885 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 07:40:25.454420 run osmo-hlr_10.42.42.2(pid=12550): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12550)] 07:40:25.502047 run osmo-hlr_10.42.42.2(pid=12550): stdout: | (launched: 2022-12-10_07:40:22.717642) 07:40:25.551458 run osmo-hlr_10.42.42.2(pid=12550): stderr: | [0;m[1;31m20221210074022892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074022892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074022892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074022892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074022892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074022892 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074022909 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074022918 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074022919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074022919 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:40:25.619926 run osmo-msc_10.42.42.6(pid=12556): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12556)] 07:40:25.667571 run osmo-msc_10.42.42.6(pid=12556): stdout: | (launched: 2022-12-10_07:40:24.570452) 07:40:25.716714 run osmo-msc_10.42.42.6(pid=12556): stderr: | [0;m[38;5;43m20221210074024841 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074024842 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7eff8fe96c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074024842 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074024842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074024842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074024842 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074024845 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074024846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074024846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074024846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:40:25.766163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12549): Terminating (SIGTERM) 07:40:25.805884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12552): Terminating (SIGTERM) 07:40:25.845549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12555): Terminating (SIGTERM) 07:40:25.885376 --- ParallelTerminationStrategy: PID 12549 died... 07:40:25.904137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12549): Terminated: ok {rc=0} 07:40:25.948251 --- ParallelTerminationStrategy: PID 12552 died... 07:40:25.966839 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12552): Terminated: ok {rc=0} 07:40:26.010809 --- ParallelTerminationStrategy: PID 12555 died... 07:40:26.029424 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12555): Terminated: ok {rc=0} 07:40:26.112755 bus /sierra_3: Setting Powered False 07:40:27.210371 bus /sierra_3: Setting Powered False 07:40:28.326343 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 07:40:29.575978 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:40:29.583290 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 07:40:29.616326 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 07:40:29.642569 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 07:40:29.698886 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 07:40:29.732089 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 07:40:29.758449 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 07:40:30.308306 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 07:40:30.357761 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:40:30.368647 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:40:30.436021 tst mo_mt_call.py: using LAC 26871 07:40:30.549375 tst mo_mt_call.py: using RAC 96 07:40:30.663083 tst mo_mt_call.py: using CellId 26871 07:40:30.776161 tst mo_mt_call.py: using BVCI 26872 07:40:30.898887 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:40:30.910684 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:40:30.922200 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:40:30.933857 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:40:30.945674 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:40:30.956786 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:40:31.082125 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:40:31.197178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:40:31.761006 run create_hlr_db(pid=12561): Launched 07:40:31.924883 bus /sierra_2: Setting Powered False 07:40:32.987390 run create_hlr_db(pid=12561): Terminated: ok {rc=0} 07:40:33.408508 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12563): Launched 07:40:33.702444 run osmo-hlr_10.42.42.2(pid=12564): Launched 07:40:33.815078 run osmo-stp_10.42.42.5: Starting osmo-stp 07:40:34.330945 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12566): Launched 07:40:34.623942 run osmo-stp_10.42.42.5(pid=12567): Launched 07:40:34.735969 run osmo-msc_10.42.42.6: Starting osmo-msc 07:40:35.267580 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12569): Launched 07:40:35.561531 run osmo-msc_10.42.42.6(pid=12570): Launched 07:40:35.726635 run osmo-stp_10.42.42.5(pid=12567): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12567)] 07:40:35.851216 run osmo-stp_10.42.42.5(pid=12567): stdout: | (launched: 2022-12-10_07:40:34.570545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:35.976310 run osmo-stp_10.42.42.5(pid=12567): stderr: | [0;m[38;5;43m20221210074034739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074034740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074034740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074034740 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074034741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074034741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074034741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:36.098644 run osmo-stp_10.42.42.5(pid=12567): stdout: | (launched: 2022-12-10_07:40:34.570545) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:36.215877 run osmo-stp_10.42.42.5(pid=12567): stderr: | [0;m[38;5;43m20221210074034739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074034740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074034740 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074034740 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074034741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074034741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074034741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:36.355376 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12567): Process ended prematurely: osmo-stp_10.42.42.5(pid=12567) [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12567)] [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 07:40:36.364151 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 07:40:36.390982 run osmo-hlr_10.42.42.2(pid=12564): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12564)] 07:40:36.438719 run osmo-hlr_10.42.42.2(pid=12564): stdout: | (launched: 2022-12-10_07:40:33.648516) 07:40:36.488279 run osmo-hlr_10.42.42.2(pid=12564): stderr: | [0;m[1;31m20221210074033820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074033820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074033820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074033820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074033820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074033820 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074033832 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074033840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074033841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074033841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:40:36.556731 run osmo-msc_10.42.42.6(pid=12570): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12570)] 07:40:36.604860 run osmo-msc_10.42.42.6(pid=12570): stdout: | (launched: 2022-12-10_07:40:35.507587) 07:40:36.654049 run osmo-msc_10.42.42.6(pid=12570): stderr: | [0;m[38;5;43m20221210074035779 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074035779 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f41177adc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074035779 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074035779 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074035780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074035780 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074035782 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074035782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074035782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074035782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:40:36.703554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12563): Terminating (SIGTERM) 07:40:36.743107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12566): Terminating (SIGTERM) 07:40:36.782549 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12569): Terminating (SIGTERM) 07:40:36.822232 --- ParallelTerminationStrategy: PID 12563 died... 07:40:36.841209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12563): Terminated: ok {rc=0} 07:40:36.885248 --- ParallelTerminationStrategy: PID 12566 died... 07:40:36.904242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12566): Terminated: ok {rc=0} 07:40:36.949109 --- ParallelTerminationStrategy: PID 12569 died... 07:40:36.967631 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12569): Terminated: ok {rc=0} 07:40:37.051962 bus /sierra_3: Setting Powered False 07:40:38.149844 bus /sierra_3: Setting Powered False 07:40:39.268038 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 07:40:40.412502 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:40:40.424215 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:40:40.494734 tst mo_mt_call_osmux.py: using LAC 26872 07:40:40.610233 tst mo_mt_call_osmux.py: using RAC 97 07:40:40.725794 tst mo_mt_call_osmux.py: using CellId 26872 07:40:40.841988 tst mo_mt_call_osmux.py: using BVCI 26873 07:40:40.948632 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:40:40.959836 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:40:40.970873 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:40:40.982868 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:40:40.994605 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:40:41.008265 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:40:41.125371 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:40:41.239934 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:40:41.728530 run create_hlr_db(pid=12572): Launched 07:40:41.857608 bus /sierra_2: Setting Powered False 07:40:42.920257 run create_hlr_db(pid=12572): Terminated: ok {rc=0} 07:40:43.361335 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12574): Launched 07:40:43.657718 run osmo-hlr_10.42.42.2(pid=12575): Launched 07:40:43.770211 run osmo-stp_10.42.42.5: Starting osmo-stp 07:40:44.281545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12577): Launched 07:40:44.576471 run osmo-stp_10.42.42.5(pid=12578): Launched 07:40:44.689159 run osmo-msc_10.42.42.6: Starting osmo-msc 07:40:45.222604 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12580): Launched 07:40:45.518861 run osmo-msc_10.42.42.6(pid=12581): Launched 07:40:45.684485 run osmo-stp_10.42.42.5(pid=12578): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12578)] 07:40:45.809814 run osmo-stp_10.42.42.5(pid=12578): stdout: | (launched: 2022-12-10_07:40:44.522562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:45.992307 run osmo-stp_10.42.42.5(pid=12578): stderr: | [0;m[38;5;43m20221210074044693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074044693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074044693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074044693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074044694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074044694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074044694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:46.141150 run osmo-stp_10.42.42.5(pid=12578): stdout: | (launched: 2022-12-10_07:40:44.522562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:46.272723 run osmo-stp_10.42.42.5(pid=12578): stderr: | [0;m[38;5;43m20221210074044693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074044693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074044693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074044693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074044694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074044694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074044694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:46.428126 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12578): Process ended prematurely: osmo-stp_10.42.42.5(pid=12578) [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12578)] [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 07:40:46.438325 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 07:40:46.468688 run osmo-hlr_10.42.42.2(pid=12575): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12575)] 07:40:46.520690 run osmo-hlr_10.42.42.2(pid=12575): stdout: | (launched: 2022-12-10_07:40:43.602926) 07:40:46.574721 run osmo-hlr_10.42.42.2(pid=12575): stderr: | [0;m[1;31m20221210074043778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074043779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074043779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074043779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074043779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074043779 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074043791 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074043802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074043802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074043802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:40:46.649312 run osmo-msc_10.42.42.6(pid=12581): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12581)] 07:40:46.702488 run osmo-msc_10.42.42.6(pid=12581): stdout: | (launched: 2022-12-10_07:40:45.464749) 07:40:46.755947 run osmo-msc_10.42.42.6(pid=12581): stderr: | [0;m[38;5;43m20221210074045737 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074045738 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f90fd2f2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074045738 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074045738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074045738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074045738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074045740 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074045740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074045740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074045740 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:40:46.809193 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12574): Terminating (SIGTERM) 07:40:46.853809 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12577): Terminating (SIGTERM) 07:40:46.899850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12580): Terminating (SIGTERM) 07:40:46.945582 --- ParallelTerminationStrategy: PID 12574 died... 07:40:46.966366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12574): Terminated: ok {rc=0} 07:40:47.015473 --- ParallelTerminationStrategy: PID 12577 died... 07:40:47.035720 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12577): Terminated: ok {rc=0} 07:40:47.084201 --- ParallelTerminationStrategy: PID 12580 died... 07:40:47.105140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12580): Terminated: ok {rc=0} 07:40:47.194463 bus /sierra_3: Setting Powered False 07:40:48.295129 bus /sierra_3: Setting Powered False 07:40:49.412553 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:40:50.664542 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:40:50.670896 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:40:50.703769 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:40:50.730044 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:40:50.782270 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:40:50.815121 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:40:50.840900 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:40:51.389486 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:40:51.437243 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:40:51.448196 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:40:51.515716 tst mo_mt_call.py: using LAC 26873 07:40:51.630528 tst mo_mt_call.py: using RAC 98 07:40:51.747254 tst mo_mt_call.py: using CellId 26873 07:40:51.864273 tst mo_mt_call.py: using BVCI 26874 07:40:51.970502 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:40:51.981508 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:40:51.992519 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:40:52.003531 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:40:52.014622 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:40:52.025843 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:40:52.142732 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:40:52.257958 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:40:52.746377 run create_hlr_db(pid=12586): Launched 07:40:52.875435 bus /sierra_2: Setting Powered False 07:40:53.937667 run create_hlr_db(pid=12586): Terminated: ok {rc=0} 07:40:54.360043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12588): Launched 07:40:54.653945 run osmo-hlr_10.42.42.2(pid=12589): Launched 07:40:54.766339 run osmo-stp_10.42.42.5: Starting osmo-stp 07:40:55.272316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12591): Launched 07:40:55.566911 run osmo-stp_10.42.42.5(pid=12592): Launched 07:40:55.679039 run osmo-msc_10.42.42.6: Starting osmo-msc 07:40:56.209263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12594): Launched 07:40:56.503695 run osmo-msc_10.42.42.6(pid=12595): Launched 07:40:56.668862 run osmo-stp_10.42.42.5(pid=12592): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12592)] 07:40:56.793756 run osmo-stp_10.42.42.5(pid=12592): stdout: | (launched: 2022-12-10_07:40:55.513385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:56.918799 run osmo-stp_10.42.42.5(pid=12592): stderr: | [0;m[38;5;43m20221210074055682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074055682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074055682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074055683 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074055685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074055685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074055685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:57.041185 run osmo-stp_10.42.42.5(pid=12592): stdout: | (launched: 2022-12-10_07:40:55.513385) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:40:57.158033 run osmo-stp_10.42.42.5(pid=12592): stderr: | [0;m[38;5;43m20221210074055682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074055682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074055682 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074055683 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074055685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074055685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074055685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:40:57.298167 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12592): Process ended prematurely: osmo-stp_10.42.42.5(pid=12592) [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12592)] [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:40:57.306734 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 07:40:57.333080 run osmo-hlr_10.42.42.2(pid=12589): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12589)] 07:40:57.380739 run osmo-hlr_10.42.42.2(pid=12589): stdout: | (launched: 2022-12-10_07:40:54.600596) 07:40:57.430036 run osmo-hlr_10.42.42.2(pid=12589): stderr: | [0;m[1;31m20221210074054776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074054776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074054776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074054776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074054776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074054776 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074054789 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074054797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074054797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074054797 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:40:57.498471 run osmo-msc_10.42.42.6(pid=12595): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12595)] 07:40:57.545986 run osmo-msc_10.42.42.6(pid=12595): stdout: | (launched: 2022-12-10_07:40:56.450072) 07:40:57.595024 run osmo-msc_10.42.42.6(pid=12595): stderr: | [0;m[38;5;43m20221210074056722 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074056722 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0a4707cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074056722 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074056722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074056722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074056722 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074056726 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074056726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074056727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074056727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:40:57.644505 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12588): Terminating (SIGTERM) 07:40:57.683906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12591): Terminating (SIGTERM) 07:40:57.723350 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12594): Terminating (SIGTERM) 07:40:57.763416 --- ParallelTerminationStrategy: PID 12588 died... 07:40:57.782279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12588): Terminated: ok {rc=0} 07:40:57.826368 --- ParallelTerminationStrategy: PID 12591 died... 07:40:57.844612 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12591): Terminated: ok {rc=0} 07:40:57.888808 --- ParallelTerminationStrategy: PID 12594 died... 07:40:57.907744 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12594): Terminated: ok {rc=0} 07:40:57.993650 bus /sierra_3: Setting Powered False 07:40:59.092285 bus /sierra_3: Setting Powered False 07:41:00.204214 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 07:41:01.366899 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:41:01.379987 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:41:01.453237 tst mo_mt_call_osmux.py: using LAC 26874 07:41:01.602189 tst mo_mt_call_osmux.py: using RAC 99 07:41:01.728331 tst mo_mt_call_osmux.py: using CellId 26874 07:41:01.853940 tst mo_mt_call_osmux.py: using BVCI 26875 07:41:01.967051 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:41:01.979239 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:41:01.991390 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:41:02.004167 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:41:02.017085 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:41:02.031275 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:41:02.149506 tst voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:41:02.266720 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:41:02.722793 run create_hlr_db(pid=12597): Launched 07:41:02.836389 bus /sierra_2: Setting Powered False 07:41:03.895347 run create_hlr_db(pid=12597): Terminated: ok {rc=0} 07:41:04.306203 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12599): Launched 07:41:04.600926 run osmo-hlr_10.42.42.2(pid=12600): Launched 07:41:04.713816 run osmo-stp_10.42.42.5: Starting osmo-stp 07:41:05.229316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12602): Launched 07:41:05.522753 run osmo-stp_10.42.42.5(pid=12603): Launched 07:41:05.635229 run osmo-msc_10.42.42.6: Starting osmo-msc 07:41:06.166450 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12605): Launched 07:41:06.461490 run osmo-msc_10.42.42.6(pid=12606): Launched 07:41:06.627344 run osmo-stp_10.42.42.5(pid=12603): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12603)] 07:41:06.752289 run osmo-stp_10.42.42.5(pid=12603): stdout: | (launched: 2022-12-10_07:41:05.469244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:06.877432 run osmo-stp_10.42.42.5(pid=12603): stderr: | [0;m[38;5;43m20221210074105637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074105637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074105637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074105638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074105638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074105638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074105638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:07.000307 run osmo-stp_10.42.42.5(pid=12603): stdout: | (launched: 2022-12-10_07:41:05.469244) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:07.117482 run osmo-stp_10.42.42.5(pid=12603): stderr: | [0;m[38;5;43m20221210074105637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074105637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074105637 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074105638 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074105638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074105638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074105638 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:07.257647 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12603): Process ended prematurely: osmo-stp_10.42.42.5(pid=12603) [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12603)] [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 07:41:07.266471 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 07:41:07.293494 run osmo-hlr_10.42.42.2(pid=12600): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12600)] 07:41:07.341673 run osmo-hlr_10.42.42.2(pid=12600): stdout: | (launched: 2022-12-10_07:41:04.547426) 07:41:07.391537 run osmo-hlr_10.42.42.2(pid=12600): stderr: | [0;m[1;31m20221210074104720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074104720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074104720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074104720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074104720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074104720 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074104732 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074104741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074104741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074104741 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:41:07.460640 run osmo-msc_10.42.42.6(pid=12606): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12606)] 07:41:07.508390 run osmo-msc_10.42.42.6(pid=12606): stdout: | (launched: 2022-12-10_07:41:06.407828) 07:41:07.557829 run osmo-msc_10.42.42.6(pid=12606): stderr: | [0;m[38;5;43m20221210074106677 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074106677 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f48f1df9c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074106677 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074106677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074106677 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074106678 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074106679 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074106680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074106680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074106680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:41:07.607807 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12599): Terminating (SIGTERM) 07:41:07.647617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12602): Terminating (SIGTERM) 07:41:07.687481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12605): Terminating (SIGTERM) 07:41:07.727604 --- ParallelTerminationStrategy: PID 12599 died... 07:41:07.746635 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12599): Terminated: ok {rc=0} 07:41:07.791565 --- ParallelTerminationStrategy: PID 12602 died... 07:41:07.810248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12602): Terminated: ok {rc=0} 07:41:07.854474 --- ParallelTerminationStrategy: PID 12605 died... 07:41:07.873475 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12605): Terminated: ok {rc=0} 07:41:07.959539 bus /sierra_3: Setting Powered False 07:41:09.059225 bus /sierra_3: Setting Powered False 07:41:10.175288 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:41:11.423756 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:41:11.430103 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:41:11.463420 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 07:41:11.489963 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:41:11.542281 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:41:11.575457 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 07:41:11.601889 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:41:12.150707 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 07:41:12.198716 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:41:12.209812 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:41:12.280756 tst mo_mt_call.py: using LAC 26875 07:41:12.398471 tst mo_mt_call.py: using RAC 100 07:41:12.523259 tst mo_mt_call.py: using CellId 26875 07:41:12.648766 tst mo_mt_call.py: using BVCI 26876 07:41:12.764124 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:41:12.775742 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:41:12.787055 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:41:12.798550 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:41:12.810032 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:41:12.821268 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:41:12.936233 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:41:13.050207 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:41:13.506806 run create_hlr_db(pid=12611): Launched 07:41:13.621287 bus /sierra_2: Setting Powered False 07:41:14.680426 run create_hlr_db(pid=12611): Terminated: ok {rc=0} 07:41:15.112209 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12613): Launched 07:41:15.428843 run osmo-hlr_10.42.42.2(pid=12614): Launched 07:41:15.549612 run osmo-stp_10.42.42.5: Starting osmo-stp 07:41:16.111174 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12616): Launched 07:41:16.438905 run osmo-stp_10.42.42.5(pid=12617): Launched 07:41:16.676756 run osmo-msc_10.42.42.6: Starting osmo-msc 07:41:17.329102 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12619): Launched 07:41:17.644003 run osmo-msc_10.42.42.6(pid=12620): Launched 07:41:17.819594 run osmo-stp_10.42.42.5(pid=12617): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12617)] 07:41:17.952321 run osmo-stp_10.42.42.5(pid=12617): stdout: | (launched: 2022-12-10_07:41:16.376470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:18.085662 run osmo-stp_10.42.42.5(pid=12617): stderr: | [0;m[38;5;43m20221210074116653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074116653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074116654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074116654 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074116655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074116655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074116655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:18.218278 run osmo-stp_10.42.42.5(pid=12617): stdout: | (launched: 2022-12-10_07:41:16.376470) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:18.344452 run osmo-stp_10.42.42.5(pid=12617): stderr: | [0;m[38;5;43m20221210074116653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074116653 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074116654 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074116654 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074116655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074116655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074116655 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:18.495106 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12617): Process ended prematurely: osmo-stp_10.42.42.5(pid=12617) [trial-2371↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12617)] [trial-2371↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:41:18.504601 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 07:41:18.531997 run osmo-hlr_10.42.42.2(pid=12614): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12614)] 07:41:18.581655 run osmo-hlr_10.42.42.2(pid=12614): stdout: | (launched: 2022-12-10_07:41:15.372016) 07:41:18.633111 run osmo-hlr_10.42.42.2(pid=12614): stderr: | [0;m[1;31m20221210074115570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074115570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074115570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074115570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074115570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074115570 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074115583 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074115592 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074115593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074115593 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:41:18.704635 run osmo-msc_10.42.42.6(pid=12620): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12620)] 07:41:18.754246 run osmo-msc_10.42.42.6(pid=12620): stdout: | (launched: 2022-12-10_07:41:17.586952) 07:41:18.805403 run osmo-msc_10.42.42.6(pid=12620): stderr: | [0;m[38;5;43m20221210074117911 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074117911 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f52e60c3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074117911 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074117911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074117911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074117911 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074117913 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074117914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074117914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074117914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:41:18.856720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12613): Terminating (SIGTERM) 07:41:18.897961 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12616): Terminating (SIGTERM) 07:41:18.939134 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12619): Terminating (SIGTERM) 07:41:18.980431 --- ParallelTerminationStrategy: PID 12613 died... 07:41:19.000267 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12613): Terminated: ok {rc=0} 07:41:19.046817 --- ParallelTerminationStrategy: PID 12616 died... 07:41:19.066399 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12616): Terminated: ok {rc=0} 07:41:19.111746 --- ParallelTerminationStrategy: PID 12619 died... 07:41:19.131164 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12619): Terminated: ok {rc=0} 07:41:19.218498 bus /sierra_3: Setting Powered False 07:41:20.315292 bus /sierra_3: Setting Powered False 07:41:21.430821 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:41:22.575940 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:41:22.587641 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:41:22.658683 tst mo_mt_call_osmux.py: using LAC 26876 07:41:22.783628 tst mo_mt_call_osmux.py: using RAC 101 07:41:22.906952 tst mo_mt_call_osmux.py: using CellId 26876 07:41:23.030252 tst mo_mt_call_osmux.py: using BVCI 26877 07:41:23.145830 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:41:23.157584 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:41:23.168872 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:41:23.180242 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:41:23.191757 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:41:23.203086 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:41:23.318266 tst voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:41:23.432853 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:41:23.889517 run create_hlr_db(pid=12623): Launched 07:41:24.002516 bus /sierra_2: Setting Powered False 07:41:25.061183 run create_hlr_db(pid=12623): Terminated: ok {rc=0} 07:41:25.493751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12625): Launched 07:41:25.809623 run osmo-hlr_10.42.42.2(pid=12626): Launched 07:41:25.930422 run osmo-stp_10.42.42.5: Starting osmo-stp 07:41:26.477796 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12628): Launched 07:41:26.793298 run osmo-stp_10.42.42.5(pid=12629): Launched 07:41:26.913723 run osmo-msc_10.42.42.6: Starting osmo-msc 07:41:27.490243 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12631): Launched 07:41:27.805804 run osmo-msc_10.42.42.6(pid=12632): Launched 07:41:27.982114 run osmo-stp_10.42.42.5(pid=12629): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12629)] 07:41:28.115164 run osmo-stp_10.42.42.5(pid=12629): stdout: | (launched: 2022-12-10_07:41:26.735920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:28.248818 run osmo-stp_10.42.42.5(pid=12629): stderr: | [0;m[38;5;43m20221210074126926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074126927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074126927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074126927 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074126928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074126928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074126928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:28.382545 run osmo-stp_10.42.42.5(pid=12629): stdout: | (launched: 2022-12-10_07:41:26.735920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:28.507893 run osmo-stp_10.42.42.5(pid=12629): stderr: | [0;m[38;5;43m20221210074126926 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074126927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074126927 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074126927 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074126928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074126928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074126928 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:28.658642 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12629): Process ended prematurely: osmo-stp_10.42.42.5(pid=12629) [trial-2371↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12629)] [trial-2371↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:41:28.668103 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 07:41:28.695731 run osmo-hlr_10.42.42.2(pid=12626): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12626)] 07:41:28.745133 run osmo-hlr_10.42.42.2(pid=12626): stdout: | (launched: 2022-12-10_07:41:25.752557) 07:41:28.796218 run osmo-hlr_10.42.42.2(pid=12626): stderr: | [0;m[1;31m20221210074125952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074125952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074125952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074125952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074125952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074125952 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074125963 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074125971 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074125972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074125972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:41:28.867538 run osmo-msc_10.42.42.6(pid=12632): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12632)] 07:41:28.916845 run osmo-msc_10.42.42.6(pid=12632): stdout: | (launched: 2022-12-10_07:41:27.748664) 07:41:28.967745 run osmo-msc_10.42.42.6(pid=12632): stderr: | [0;m[38;5;43m20221210074128069 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074128070 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe2c4503c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074128070 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074128070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074128070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074128070 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074128072 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074128072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074128072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074128072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:41:29.019035 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12625): Terminating (SIGTERM) 07:41:29.060090 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12628): Terminating (SIGTERM) 07:41:29.101500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12631): Terminating (SIGTERM) 07:41:29.143125 --- ParallelTerminationStrategy: PID 12625 died... 07:41:29.163140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12625): Terminated: ok {rc=0} 07:41:29.209168 --- ParallelTerminationStrategy: PID 12628 died... 07:41:29.228693 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12628): Terminated: ok {rc=0} 07:41:29.274551 --- ParallelTerminationStrategy: PID 12631 died... 07:41:29.294194 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12631): Terminated: ok {rc=0} 07:41:29.381839 bus /sierra_3: Setting Powered False 07:41:30.480348 bus /sierra_3: Setting Powered False 07:41:31.600873 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:41:32.857308 tst voice:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:41:32.863330 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:41:32.896851 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 07:41:32.923974 tst voice:trx-lms+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 07:41:32.978537 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:41:33.013621 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 07:41:33.040555 tst voice:trx-lms+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 07:41:33.587286 tst voice:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 07:41:33.638695 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:41:33.649952 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:41:33.721033 tst mo_mt_call.py: using LAC 26877 07:41:33.844436 tst mo_mt_call.py: using RAC 102 07:41:33.968640 tst mo_mt_call.py: using CellId 26877 07:41:34.092313 tst mo_mt_call.py: using BVCI 26878 07:41:34.206408 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:41:34.217640 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:41:34.228632 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:41:34.239808 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:41:34.250897 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:41:34.262312 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:41:34.377742 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:41:34.497672 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:41:34.985908 run create_hlr_db(pid=12638): Launched 07:41:35.105633 bus /sierra_2: Setting Powered False 07:41:36.165213 run create_hlr_db(pid=12638): Terminated: ok {rc=0} 07:41:36.576694 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12640): Launched 07:41:36.872940 run osmo-hlr_10.42.42.2(pid=12641): Launched 07:41:36.986579 run osmo-stp_10.42.42.5: Starting osmo-stp 07:41:37.508514 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12643): Launched 07:41:37.802958 run osmo-stp_10.42.42.5(pid=12644): Launched 07:41:37.916302 run osmo-msc_10.42.42.6: Starting osmo-msc 07:41:38.463257 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12646): Launched 07:41:38.759070 run osmo-msc_10.42.42.6(pid=12647): Launched 07:41:38.925158 run osmo-stp_10.42.42.5(pid=12644): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12644)] 07:41:39.050190 run osmo-stp_10.42.42.5(pid=12644): stdout: | (launched: 2022-12-10_07:41:37.749344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:39.175471 run osmo-stp_10.42.42.5(pid=12644): stderr: | [0;m[38;5;43m20221210074137917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074137917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074137918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074137918 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074137920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074137920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074137920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:39.298149 run osmo-stp_10.42.42.5(pid=12644): stdout: | (launched: 2022-12-10_07:41:37.749344) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:39.415965 run osmo-stp_10.42.42.5(pid=12644): stderr: | [0;m[38;5;43m20221210074137917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074137917 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074137918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074137918 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074137920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074137920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074137920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:39.556600 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12644): Process ended prematurely: osmo-stp_10.42.42.5(pid=12644) [trial-2371↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12644)] [trial-2371↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 07:41:39.565883 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 07:41:39.592366 run osmo-hlr_10.42.42.2(pid=12641): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12641)] 07:41:39.639909 run osmo-hlr_10.42.42.2(pid=12641): stdout: | (launched: 2022-12-10_07:41:36.819104) 07:41:39.689257 run osmo-hlr_10.42.42.2(pid=12641): stderr: | [0;m[1;31m20221210074136994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074136994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074136994 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074136995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074136995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074136995 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074137007 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074137015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074137016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074137016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:41:39.757867 run osmo-msc_10.42.42.6(pid=12647): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12647)] 07:41:39.805343 run osmo-msc_10.42.42.6(pid=12647): stdout: | (launched: 2022-12-10_07:41:38.705272) 07:41:39.854667 run osmo-msc_10.42.42.6(pid=12647): stderr: | [0;m[38;5;43m20221210074138976 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074138976 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f02450cec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074138976 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074138976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074138976 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074138977 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074138978 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074138979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074138979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074138979 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:41:39.904253 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12640): Terminating (SIGTERM) 07:41:39.943588 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12643): Terminating (SIGTERM) 07:41:39.983227 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12646): Terminating (SIGTERM) 07:41:40.022919 --- ParallelTerminationStrategy: PID 12640 died... 07:41:40.041897 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12640): Terminated: ok {rc=0} 07:41:40.085948 --- ParallelTerminationStrategy: PID 12643 died... 07:41:40.104444 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12643): Terminated: ok {rc=0} 07:41:40.148522 --- ParallelTerminationStrategy: PID 12646 died... 07:41:40.167058 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12646): Terminated: ok {rc=0} 07:41:40.253896 bus /sierra_3: Setting Powered False 07:41:41.353384 bus /sierra_3: Setting Powered False 07:41:42.470184 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 07:41:43.613639 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:41:43.624831 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:41:43.694958 tst mo_mt_call_osmux.py: using LAC 26878 07:41:43.809614 tst mo_mt_call_osmux.py: using RAC 103 07:41:43.927773 tst mo_mt_call_osmux.py: using CellId 26878 07:41:44.045293 tst mo_mt_call_osmux.py: using BVCI 26879 07:41:44.161094 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:41:44.172903 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:41:44.184175 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:41:44.195996 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:41:44.207793 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:41:44.219535 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:41:44.340885 tst voice:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:41:44.454683 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:41:44.912560 run create_hlr_db(pid=12649): Launched 07:41:45.026851 bus /sierra_2: Setting Powered False 07:41:46.085786 run create_hlr_db(pid=12649): Terminated: ok {rc=0} 07:41:46.554878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12651): Launched 07:41:46.893332 run osmo-hlr_10.42.42.2(pid=12652): Launched 07:41:47.178935 run osmo-stp_10.42.42.5: Starting osmo-stp 07:41:47.755859 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12654): Launched 07:41:48.069383 run osmo-stp_10.42.42.5(pid=12655): Launched 07:41:48.189448 run osmo-msc_10.42.42.6: Starting osmo-msc 07:41:48.758031 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12657): Launched 07:41:49.071765 run osmo-msc_10.42.42.6(pid=12658): Launched 07:41:49.248098 run osmo-stp_10.42.42.5(pid=12655): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12655)] 07:41:49.381769 run osmo-stp_10.42.42.5(pid=12655): stdout: | (launched: 2022-12-10_07:41:48.012301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:49.519836 run osmo-stp_10.42.42.5(pid=12655): stderr: | [0;m[38;5;43m20221210074148202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074148202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074148203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074148203 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074148204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074148204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074148204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:49.650678 run osmo-stp_10.42.42.5(pid=12655): stdout: | (launched: 2022-12-10_07:41:48.012301) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:41:49.775476 run osmo-stp_10.42.42.5(pid=12655): stderr: | [0;m[38;5;43m20221210074148202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074148202 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074148203 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074148203 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074148204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074148204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074148204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:41:49.924883 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12655): Process ended prematurely: osmo-stp_10.42.42.5(pid=12655) [trial-2371↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12655)] [trial-2371↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 07:41:49.934310 tst mo_mt_call_osmux.py:8: Test FAILED (6.4 sec) 07:41:49.961974 run osmo-hlr_10.42.42.2(pid=12652): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12652)] 07:41:50.011766 run osmo-hlr_10.42.42.2(pid=12652): stdout: | (launched: 2022-12-10_07:41:46.824045) 07:41:50.063187 run osmo-hlr_10.42.42.2(pid=12652): stderr: | [0;m[1;31m20221210074147162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074147162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074147162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074147162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074147162 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074147163 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074147180 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074147195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074147195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074147195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:41:50.134955 run osmo-msc_10.42.42.6(pid=12658): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12658)] 07:41:50.184607 run osmo-msc_10.42.42.6(pid=12658): stdout: | (launched: 2022-12-10_07:41:49.014911) 07:41:50.235920 run osmo-msc_10.42.42.6(pid=12658): stderr: | [0;m[38;5;43m20221210074149333 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074149333 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1f8d683c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074149334 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074149334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074149334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074149334 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074149337 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074149338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074149338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074149338 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:41:50.287970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12651): Terminating (SIGTERM) 07:41:50.329589 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12654): Terminating (SIGTERM) 07:41:50.371125 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12657): Terminating (SIGTERM) 07:41:50.412809 --- ParallelTerminationStrategy: PID 12651 died... 07:41:50.432770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12651): Terminated: ok {rc=0} 07:41:50.478791 --- ParallelTerminationStrategy: PID 12654 died... 07:41:50.498207 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12654): Terminated: ok {rc=0} 07:41:50.543923 --- ParallelTerminationStrategy: PID 12657 died... 07:41:50.563484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12657): Terminated: ok {rc=0} 07:41:50.651393 bus /sierra_3: Setting Powered False 07:41:51.751976 bus /sierra_3: Setting Powered False 07:41:52.867970 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 emergency:trx-lms --------------------------------------------------------------------- 07:41:54.116223 tst emergency:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:41:54.120521 tst emergency:trx-lms: Verifying 1 x bts (candidates: 11) 07:41:54.153834 tst emergency:trx-lms: Verifying 6 x ip_address (candidates: 9) 07:41:54.180328 tst emergency:trx-lms: Verifying 4 x modem (candidates: 12) 07:41:54.265020 tst emergency:trx-lms: Reserving 1 x bts (candidates: 11) 07:41:54.298246 tst emergency:trx-lms: Reserving 6 x ip_address (candidates: 9) 07:41:54.324910 tst emergency:trx-lms: Reserving 4 x modem (candidates: 12) 07:41:54.909349 tst emergency:trx-lms: RESERVED RESOURCES for emergency: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2371 emergency:trx-lms emergency_mo_mt_call.py ---------------------------------------------- 07:41:54.914732 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:41:54.925944 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 07:41:54.978520 tst emergency_mo_mt_call.py: using LAC 26879 07:41:55.102318 tst emergency_mo_mt_call.py: using RAC 104 07:41:55.225293 tst emergency_mo_mt_call.py: using CellId 26879 07:41:55.347179 tst emergency_mo_mt_call.py: using BVCI 26880 07:41:55.460824 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:41:55.472244 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:41:55.483352 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:41:55.494451 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:41:55.505558 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:41:55.516469 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 07:41:55.630300 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 07:41:55.749345 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:41:56.229219 run create_hlr_db(pid=12663): Launched 07:41:56.356155 bus /sierra_2: Setting Powered False 07:41:57.414817 run create_hlr_db(pid=12663): Terminated: ok {rc=0} 07:41:57.846427 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12665): Launched 07:41:58.154691 run osmo-hlr_10.42.42.2(pid=12666): Launched 07:41:58.272852 run osmo-stp_10.42.42.5: Starting osmo-stp 07:41:58.807560 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12668): Launched 07:41:59.117167 run osmo-stp_10.42.42.5(pid=12669): Launched 07:41:59.244649 tst emergency_mo_mt_call.py: using MSISDN 7617 07:41:59.403480 run osmo-msc_10.42.42.6: Starting osmo-msc 07:41:59.960932 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12671): Launched 07:42:00.270499 run osmo-msc_10.42.42.6(pid=12672): Launched 07:42:00.444009 run osmo-stp_10.42.42.5(pid=12669): ERR: Terminated: ERROR {rc=1} [trial-2371↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12669)] 07:42:00.574618 run osmo-stp_10.42.42.5(pid=12669): stdout: | (launched: 2022-12-10_07:41:59.060619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:00.705574 run osmo-stp_10.42.42.5(pid=12669): stderr: | [0;m[38;5;43m20221210074159252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074159252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074159253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074159253 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074159253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074159253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074159254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:00.840658 run osmo-stp_10.42.42.5(pid=12669): stdout: | (launched: 2022-12-10_07:41:59.060619) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:01.000166 run osmo-stp_10.42.42.5(pid=12669): stderr: | [0;m[38;5;43m20221210074159252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074159252 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074159253 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074159253 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074159253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074159253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074159254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:01.203722 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=12669): Process ended prematurely: osmo-stp_10.42.42.5(pid=12669) [trial-2371↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12669)] [trial-2371↪emergency:trx-lms↪emergency_mo_mt_call.py:19] 07:42:01.212389 tst emergency_mo_mt_call.py:19: Test FAILED (6.3 sec) 07:42:01.241328 run osmo-hlr_10.42.42.2(pid=12666): ERR: Terminated: ERROR {rc=237} [trial-2371↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12666)] 07:42:01.293462 run osmo-hlr_10.42.42.2(pid=12666): stdout: | (launched: 2022-12-10_07:41:58.098373) 07:42:01.345881 run osmo-hlr_10.42.42.2(pid=12666): stderr: | [0;m[1;31m20221210074158295 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074158296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074158296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074158296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074158296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074158296 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074158309 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/emergency:trx-lms/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074158317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074158317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074158317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:42:01.418285 run osmo-msc_10.42.42.6(pid=12672): ERR: Terminated: ERROR {rc=2} [trial-2371↪emergency:trx-lms↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12672)] 07:42:01.469507 run osmo-msc_10.42.42.6(pid=12672): stdout: | (launched: 2022-12-10_07:42:00.214516) 07:42:01.521332 run osmo-msc_10.42.42.6(pid=12672): stderr: | [0;m[38;5;43m20221210074200535 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074200535 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc01c51bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074200536 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074200536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074200536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074200536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074200538 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074200538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074200538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074200538 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:42:01.573750 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12665): Terminating (SIGTERM) 07:42:01.616539 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12668): Terminating (SIGTERM) 07:42:01.661552 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12671): Terminating (SIGTERM) 07:42:01.707754 --- ParallelTerminationStrategy: PID 12665 died... 07:42:01.727837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12665): Terminated: ok {rc=0} 07:42:01.776834 --- ParallelTerminationStrategy: PID 12668 died... 07:42:01.796515 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12668): Terminated: ok {rc=0} 07:42:01.844039 --- ParallelTerminationStrategy: PID 12671 died... 07:42:01.863792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12671): Terminated: ok {rc=0} 07:42:01.952296 bus /sierra_3: Setting Powered False 07:42:03.049377 bus /sierra_3: Setting Powered False 07:42:04.164726 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 emergency:trx-lms emergency_preemptive_call.py ---------------------------------------------- 07:42:05.249310 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:42:05.260390 tst emergency:trx-lms: Using 1 x bts (candidates: 1) 07:42:05.310601 tst emergency_preemptive_call.py: using LAC 26880 07:42:05.429063 tst emergency_preemptive_call.py: using RAC 105 07:42:05.542652 tst emergency_preemptive_call.py: using CellId 26880 07:42:05.654687 tst emergency_preemptive_call.py: using BVCI 26881 07:42:05.759424 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:42:05.770062 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:42:05.780302 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:42:05.790997 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:42:05.801682 tst emergency:trx-lms: Using 1 x ip_address (candidates: 6) 07:42:05.812142 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 07:42:05.928205 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 07:42:06.049159 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 07:42:06.165102 tst emergency:trx-lms: Using 1 x modem (candidates: 4) 07:42:06.280573 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:42:06.762959 run create_hlr_db(pid=12679): Launched 07:42:06.890259 bus /sierra_2: Setting Powered False 07:42:07.951890 run create_hlr_db(pid=12679): Terminated: ok {rc=0} 07:42:08.366711 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12681): Launched 07:42:08.655467 run osmo-hlr_10.42.42.2(pid=12682): Launched 07:42:08.766760 run osmo-stp_10.42.42.5: Starting osmo-stp 07:42:09.263280 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12684): Launched 07:42:09.551492 run osmo-stp_10.42.42.5(pid=12685): Launched 07:42:09.670891 tst emergency_preemptive_call.py: using MSISDN 7618 07:42:09.830133 run osmo-msc_10.42.42.6: Starting osmo-msc 07:42:10.385439 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12687): Launched 07:42:10.694282 run osmo-msc_10.42.42.6(pid=12688): Launched 07:42:10.866214 run osmo-stp_10.42.42.5(pid=12685): ERR: Terminated: ERROR {rc=1} [trial-2371↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12685)] 07:42:10.996084 run osmo-stp_10.42.42.5(pid=12685): stdout: | (launched: 2022-12-10_07:42:09.498359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:11.126804 run osmo-stp_10.42.42.5(pid=12685): stderr: | [0;m[38;5;43m20221210074209667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074209667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074209668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074209669 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074209669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074209670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074209670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:11.256878 run osmo-stp_10.42.42.5(pid=12685): stdout: | (launched: 2022-12-10_07:42:09.498359) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:11.380758 run osmo-stp_10.42.42.5(pid=12685): stderr: | [0;m[38;5;43m20221210074209667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074209667 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074209668 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074209669 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074209669 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074209670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074209670 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:11.528168 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=12685): Process ended prematurely: osmo-stp_10.42.42.5(pid=12685) [trial-2371↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12685)] [trial-2371↪emergency:trx-lms↪emergency_preemptive_call.py:32] 07:42:11.537079 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 07:42:11.564315 run osmo-hlr_10.42.42.2(pid=12682): ERR: Terminated: ERROR {rc=237} [trial-2371↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12682)] 07:42:11.614081 run osmo-hlr_10.42.42.2(pid=12682): stdout: | (launched: 2022-12-10_07:42:08.602670) 07:42:11.665644 run osmo-hlr_10.42.42.2(pid=12682): stderr: | [0;m[1;31m20221210074208777 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074208778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074208778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074208778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074208778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074208778 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074208790 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/emergency:trx-lms/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074208798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074208798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074208798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:42:11.737532 run osmo-msc_10.42.42.6(pid=12688): ERR: Terminated: ERROR {rc=2} [trial-2371↪emergency:trx-lms↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=12688)] 07:42:11.787090 run osmo-msc_10.42.42.6(pid=12688): stdout: | (launched: 2022-12-10_07:42:10.638092) 07:42:11.838345 run osmo-msc_10.42.42.6(pid=12688): stderr: | [0;m[38;5;43m20221210074210958 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074210958 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f44187fec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074210958 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074210958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074210958 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074210959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074210960 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074210961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074210961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074210961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:42:11.890028 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12681): Terminating (SIGTERM) 07:42:11.931349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12684): Terminating (SIGTERM) 07:42:11.972829 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12687): Terminating (SIGTERM) 07:42:12.014701 --- ParallelTerminationStrategy: PID 12681 died... 07:42:12.034789 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12681): Terminated: ok {rc=0} 07:42:12.081127 --- ParallelTerminationStrategy: PID 12684 died... 07:42:12.100821 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12684): Terminated: ok {rc=0} 07:42:12.146940 --- ParallelTerminationStrategy: PID 12687 died... 07:42:12.166654 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=12687): Terminated: ok {rc=0} 07:42:12.254611 bus /sierra_9: Setting Powered False 07:42:13.354216 bus /sierra_9: Setting Powered False 07:42:14.469924 bus /sierra_8: Setting Powered False 07:42:15.567400 bus /sierra_8: Setting Powered False 07:42:16.687781 bus /sierra_3: Setting Powered False 07:42:17.787878 bus /sierra_3: Setting Powered False 07:42:18.905473 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 emergency:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-lms --------------------------------------------------------------------- 07:42:20.185281 tst gprs:trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:42:20.189882 tst gprs:trx-lms: Verifying 1 x bts (candidates: 11) 07:42:20.223741 tst gprs:trx-lms: Verifying 9 x ip_address (candidates: 9) 07:42:20.262695 tst gprs:trx-lms: Verifying 4 x modem (candidates: 12) 07:42:20.351098 tst gprs:trx-lms: Reserving 1 x bts (candidates: 11) 07:42:20.384758 tst gprs:trx-lms: Reserving 9 x ip_address (candidates: 9) 07:42:20.424226 tst gprs:trx-lms: Reserving 4 x modem (candidates: 12) 07:42:21.015364 tst gprs:trx-lms: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-lms cs_paging_gprs_active.py ---------------------------------------------- 07:42:21.066876 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:21.077926 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 07:42:21.127933 tst cs_paging_gprs_active.py: using LAC 26881 07:42:21.252582 tst cs_paging_gprs_active.py: using RAC 106 07:42:21.379261 tst cs_paging_gprs_active.py: using CellId 26881 07:42:21.504802 tst cs_paging_gprs_active.py: using BVCI 26882 07:42:21.619068 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:21.630073 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:21.640841 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:21.651649 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:21.662407 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:21.673115 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:21.683975 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:21.694836 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:21.705674 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:42:21.823097 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:42:21.941304 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:42:22.156296 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:42:22.474989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12693): Launched 07:42:22.750140 run iperf3-srv_10.42.42.10(pid=12694): Launched 07:42:22.868906 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:42:23.083533 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:42:23.400590 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12695): Launched 07:42:23.676010 run iperf3-srv_10.42.42.10(pid=12696): Launched 07:42:23.795117 tst cs_paging_gprs_active.py:38: start network... 07:42:24.008218 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:42:24.498012 run create_hlr_db(pid=12697): Launched 07:42:24.627408 bus /sierra_2: Setting Powered False 07:42:25.690286 run create_hlr_db(pid=12697): Terminated: ok {rc=0} 07:42:26.111758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12699): Launched 07:42:26.406336 run osmo-hlr_10.42.42.2(pid=12700): Launched 07:42:26.519686 run osmo-stp_10.42.42.5: Starting osmo-stp 07:42:27.042012 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12702): Launched 07:42:27.336757 run osmo-stp_10.42.42.5(pid=12703): Launched 07:42:27.449662 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:42:27.957541 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12705): Launched 07:42:28.070814 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:42:28.319528 run patchelf(pid=12706): Launched 07:42:28.483973 run osmo-stp_10.42.42.5(pid=12703): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12703)] 07:42:28.609256 run osmo-stp_10.42.42.5(pid=12703): stdout: | (launched: 2022-12-10_07:42:27.282940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:28.736273 run osmo-stp_10.42.42.5(pid=12703): stderr: | [0;m[38;5;43m20221210074227452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074227452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074227452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074227452 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074227453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074227453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074227453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:28.863078 run osmo-stp_10.42.42.5(pid=12703): stdout: | (launched: 2022-12-10_07:42:27.282940) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:28.983754 run osmo-stp_10.42.42.5(pid=12703): stderr: | [0;m[38;5;43m20221210074227452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074227452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074227452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074227452 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074227453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074227453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074227453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:29.127545 run patchelf(pid=12706): Terminating (SIGINT) 07:42:29.294409 run patchelf(pid=12706): Terminated: ok {rc=0} 07:42:29.414795 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12703): Process ended prematurely: osmo-stp_10.42.42.5(pid=12703) [trial-2371↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12703)] [trial-2371↪gprs:trx-lms↪cs_paging_gprs_active.py:38] 07:42:29.423829 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 07:42:29.451050 run osmo-hlr_10.42.42.2(pid=12700): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12700)] 07:42:29.498589 run osmo-hlr_10.42.42.2(pid=12700): stdout: | (launched: 2022-12-10_07:42:26.352687) 07:42:29.547571 run osmo-hlr_10.42.42.2(pid=12700): stderr: | [0;m[1;31m20221210074226528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074226528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074226528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074226528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074226528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074226528 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074226540 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074226550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074226551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074226551 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:42:29.597172 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12693): Terminating (SIGTERM) 07:42:29.637035 run iperf3-srv_10.42.42.10(pid=12694): Terminating (SIGTERM) 07:42:29.676655 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12695): Terminating (SIGTERM) 07:42:29.716454 run iperf3-srv_10.42.42.10(pid=12696): Terminating (SIGTERM) 07:42:29.755927 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12699): Terminating (SIGTERM) 07:42:29.795636 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12702): Terminating (SIGTERM) 07:42:29.835453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12705): Terminating (SIGTERM) 07:42:29.875538 --- ParallelTerminationStrategy: PID 12693 died... 07:42:29.894659 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12693): Terminated: ok {rc=0} 07:42:29.939114 --- ParallelTerminationStrategy: PID 12694 died... 07:42:29.957776 run iperf3-srv_10.42.42.10(pid=12694): Terminated {rc=256} 07:42:30.002448 --- ParallelTerminationStrategy: PID 12695 died... 07:42:30.021182 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12695): Terminated: ok {rc=0} 07:42:30.065124 --- ParallelTerminationStrategy: PID 12696 died... 07:42:30.083552 run iperf3-srv_10.42.42.10(pid=12696): Terminated {rc=256} 07:42:30.127182 --- ParallelTerminationStrategy: PID 12699 died... 07:42:30.145675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12699): Terminated: ok {rc=0} 07:42:30.189395 --- ParallelTerminationStrategy: PID 12702 died... 07:42:30.207881 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12702): Terminated: ok {rc=0} 07:42:30.251366 --- ParallelTerminationStrategy: PID 12705 died... 07:42:30.269916 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12705): Terminated: ok {rc=0} 07:42:30.357462 bus /gobi_0: Setting Powered False 07:42:31.461111 bus /gobi_0: Setting Powered False 07:42:32.593977 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms iperf3.py ---------------------------------------------- 07:42:33.737341 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:33.748315 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 07:42:33.799578 tst iperf3.py: using LAC 26882 07:42:33.914996 tst iperf3.py: using RAC 107 07:42:34.030033 tst iperf3.py: using CellId 26882 07:42:34.145309 tst iperf3.py: using BVCI 26883 07:42:34.252904 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:34.263424 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:34.273754 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:34.284239 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:34.294614 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:34.305005 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:34.315553 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:34.326138 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:34.336597 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:42:34.450484 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:42:34.647997 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:42:34.944622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12707): Launched 07:42:35.202603 run iperf3-srv_10.42.42.10(pid=12708): Launched 07:42:35.313862 tst iperf3.py:8: start network... 07:42:35.511015 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:42:35.968560 run create_hlr_db(pid=12710): Launched 07:42:36.081374 bus /gobi_6: Setting Powered False 07:42:37.140730 run create_hlr_db(pid=12710): Terminated: ok {rc=0} 07:42:37.573784 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12712): Launched 07:42:37.891296 run osmo-hlr_10.42.42.2(pid=12713): Launched 07:42:38.012290 run osmo-stp_10.42.42.5: Starting osmo-stp 07:42:38.561318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12715): Launched 07:42:38.876292 run osmo-stp_10.42.42.5(pid=12716): Launched 07:42:38.997422 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:42:39.541543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12718): Launched 07:42:39.662064 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:42:39.927656 run patchelf(pid=12719): Launched 07:42:40.094794 run osmo-stp_10.42.42.5(pid=12716): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12716)] 07:42:40.220726 run osmo-stp_10.42.42.5(pid=12716): stdout: | (launched: 2022-12-10_07:42:38.818791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:40.347476 run osmo-stp_10.42.42.5(pid=12716): stderr: | [0;m[38;5;43m20221210074239009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074239009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074239009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074239009 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074239010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074239010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074239010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:40.474156 run osmo-stp_10.42.42.5(pid=12716): stdout: | (launched: 2022-12-10_07:42:38.818791) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:40.595151 run osmo-stp_10.42.42.5(pid=12716): stderr: | [0;m[38;5;43m20221210074239009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074239009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074239009 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074239009 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074239010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074239010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074239010 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:40.737970 run patchelf(pid=12719): Terminating (SIGINT) 07:42:40.904788 run patchelf(pid=12719): Terminated: ok {rc=0} 07:42:41.025497 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12716): Process ended prematurely: osmo-stp_10.42.42.5(pid=12716) [trial-2371↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12716)] [trial-2371↪gprs:trx-lms↪iperf3.py:8] 07:42:41.034598 tst iperf3.py:8: Test FAILED (7.3 sec) 07:42:41.062114 run osmo-hlr_10.42.42.2(pid=12713): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12713)] 07:42:41.110038 run osmo-hlr_10.42.42.2(pid=12713): stdout: | (launched: 2022-12-10_07:42:37.833868) 07:42:41.159352 run osmo-hlr_10.42.42.2(pid=12713): stderr: | [0;m[1;31m20221210074238030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074238030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074238030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074238030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074238030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074238030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074238041 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074238050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074238050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074238050 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:42:41.209563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12707): Terminating (SIGTERM) 07:42:41.249612 run iperf3-srv_10.42.42.10(pid=12708): Terminating (SIGTERM) 07:42:41.289415 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12712): Terminating (SIGTERM) 07:42:41.329197 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12715): Terminating (SIGTERM) 07:42:41.368939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12718): Terminating (SIGTERM) 07:42:41.408880 --- ParallelTerminationStrategy: PID 12707 died... 07:42:41.428176 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12707): Terminated: ok {rc=0} 07:42:41.472932 --- ParallelTerminationStrategy: PID 12708 died... 07:42:41.491740 run iperf3-srv_10.42.42.10(pid=12708): Terminated {rc=256} 07:42:41.535883 --- ParallelTerminationStrategy: PID 12712 died... 07:42:41.554620 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12712): Terminated: ok {rc=0} 07:42:41.598804 --- ParallelTerminationStrategy: PID 12715 died... 07:42:41.617509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12715): Terminated: ok {rc=0} 07:42:41.661749 --- ParallelTerminationStrategy: PID 12718 died... 07:42:41.680556 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12718): Terminated: ok {rc=0} 07:42:41.766016 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms iperf3m4.py ---------------------------------------------- 07:42:42.912136 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:42.923238 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 07:42:42.973070 tst iperf3m4.py: using LAC 26883 07:42:43.090297 tst iperf3m4.py: using RAC 108 07:42:43.204777 tst iperf3m4.py: using CellId 26883 07:42:43.320371 tst iperf3m4.py: using BVCI 26884 07:42:43.426835 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:43.437516 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:43.447839 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:43.458389 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:43.468804 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:43.479630 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:43.490353 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:43.500814 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:42:43.511261 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:42:43.628125 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:42:43.749161 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:42:43.863076 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:42:43.977591 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:42:44.176792 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:42:44.474243 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12720): Launched 07:42:44.730806 run iperf3-srv_10.42.42.10(pid=12721): Launched 07:42:44.842000 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:42:45.039842 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:42:45.335759 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12722): Launched 07:42:45.592442 run iperf3-srv_10.42.42.10(pid=12723): Launched 07:42:45.703352 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:42:45.912040 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:42:46.237533 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12724): Launched 07:42:46.511214 run iperf3-srv_10.42.42.10(pid=12725): Launched 07:42:46.634494 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:42:46.836931 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:42:47.145644 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12726): Launched 07:42:47.413176 run iperf3-srv_10.42.42.10(pid=12727): Launched 07:42:47.523785 tst iperf3m4.py:8: start network... 07:42:47.720566 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:42:48.176322 run create_hlr_db(pid=12728): Launched 07:42:48.288804 bus /gobi_6: Setting Powered False 07:42:49.348054 run create_hlr_db(pid=12728): Terminated: ok {rc=0} 07:42:49.779939 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12730): Launched 07:42:50.096509 run osmo-hlr_10.42.42.2(pid=12731): Launched 07:42:50.218170 run osmo-stp_10.42.42.5: Starting osmo-stp 07:42:50.762609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12733): Launched 07:42:51.078448 run osmo-stp_10.42.42.5(pid=12734): Launched 07:42:51.199826 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:42:51.744016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12736): Launched 07:42:51.864346 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:42:52.129861 run patchelf(pid=12737): Launched 07:42:52.305504 run osmo-stp_10.42.42.5(pid=12734): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12734)] 07:42:52.438944 run osmo-stp_10.42.42.5(pid=12734): stdout: | (launched: 2022-12-10_07:42:51.021081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:52.574241 run osmo-stp_10.42.42.5(pid=12734): stderr: | [0;m[38;5;43m20221210074251210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074251210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074251210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074251211 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074251211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074251211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074251211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:52.709406 run osmo-stp_10.42.42.5(pid=12734): stdout: | (launched: 2022-12-10_07:42:51.021081) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:42:52.838382 run osmo-stp_10.42.42.5(pid=12734): stderr: | [0;m[38;5;43m20221210074251210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074251210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074251210 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074251211 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074251211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074251211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074251211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:42:52.991208 run patchelf(pid=12737): Terminating (SIGINT) 07:42:53.168309 run patchelf(pid=12737): Terminated: ok {rc=0} 07:42:53.296643 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12734): Process ended prematurely: osmo-stp_10.42.42.5(pid=12734) [trial-2371↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12734)] [trial-2371↪gprs:trx-lms↪iperf3m4.py:8] 07:42:53.306932 tst iperf3m4.py:8: Test FAILED (10.4 sec) 07:42:53.335598 run osmo-hlr_10.42.42.2(pid=12731): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12731)] 07:42:53.384862 run osmo-hlr_10.42.42.2(pid=12731): stdout: | (launched: 2022-12-10_07:42:50.038812) 07:42:53.435751 run osmo-hlr_10.42.42.2(pid=12731): stderr: | [0;m[1;31m20221210074250237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074250237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074250237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074250237 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074250238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074250238 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074250250 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074250259 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074250260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074250260 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:42:53.486935 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12720): Terminating (SIGTERM) 07:42:53.527983 run iperf3-srv_10.42.42.10(pid=12721): Terminating (SIGTERM) 07:42:53.570453 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12722): Terminating (SIGTERM) 07:42:53.612562 run iperf3-srv_10.42.42.10(pid=12723): Terminating (SIGTERM) 07:42:53.653971 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12724): Terminating (SIGTERM) 07:42:53.695140 run iperf3-srv_10.42.42.10(pid=12725): Terminating (SIGTERM) 07:42:53.736285 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12726): Terminating (SIGTERM) 07:42:53.777318 run iperf3-srv_10.42.42.10(pid=12727): Terminating (SIGTERM) 07:42:53.818325 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12730): Terminating (SIGTERM) 07:42:53.859603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12733): Terminating (SIGTERM) 07:42:53.900756 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12736): Terminating (SIGTERM) 07:42:53.942096 --- ParallelTerminationStrategy: PID 12720 died... 07:42:53.961999 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12720): Terminated: ok {rc=0} 07:42:54.007747 --- ParallelTerminationStrategy: PID 12721 died... 07:42:54.027205 run iperf3-srv_10.42.42.10(pid=12721): Terminated {rc=256} 07:42:54.072514 --- ParallelTerminationStrategy: PID 12722 died... 07:42:54.092027 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12722): Terminated: ok {rc=0} 07:42:54.137454 --- ParallelTerminationStrategy: PID 12723 died... 07:42:54.157007 run iperf3-srv_10.42.42.10(pid=12723): Terminated {rc=256} 07:42:54.202552 --- ParallelTerminationStrategy: PID 12724 died... 07:42:54.222036 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12724): Terminated: ok {rc=0} 07:42:54.267621 --- ParallelTerminationStrategy: PID 12725 died... 07:42:54.286947 run iperf3-srv_10.42.42.10(pid=12725): Terminated {rc=256} 07:42:54.332889 --- ParallelTerminationStrategy: PID 12726 died... 07:42:54.352890 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12726): Terminated: ok {rc=0} 07:42:54.398388 --- ParallelTerminationStrategy: PID 12727 died... 07:42:54.417833 run iperf3-srv_10.42.42.10(pid=12727): Terminated {rc=256} 07:42:54.463973 --- ParallelTerminationStrategy: PID 12730 died... 07:42:54.483583 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12730): Terminated: ok {rc=0} 07:42:54.529220 --- ParallelTerminationStrategy: PID 12733 died... 07:42:54.548595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12733): Terminated: ok {rc=0} 07:42:54.594273 --- ParallelTerminationStrategy: PID 12736 died... 07:42:54.613845 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12736): Terminated: ok {rc=0} 07:42:54.700623 bus /gobi_4: Setting Powered False 07:42:55.799847 bus /gobi_4: Setting Powered False 07:42:56.916232 bus /gobi_1: Setting Powered False 07:42:58.014662 bus /gobi_1: Setting Powered False 07:42:59.129598 bus /gobi_0: Setting Powered False 07:43:00.227086 bus /gobi_0: Setting Powered False 07:43:01.352718 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms ping.py ---------------------------------------------- 07:43:02.470576 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:02.482039 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 07:43:02.533340 tst ping.py: using LAC 26884 07:43:02.656105 tst ping.py: using RAC 109 07:43:02.778389 tst ping.py: using CellId 26884 07:43:02.901853 tst ping.py: using BVCI 26885 07:43:03.014225 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:03.025411 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:03.036253 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:03.047605 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:03.058276 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:03.068925 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:03.080939 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:03.092191 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:43:03.208679 tst ping.py:19: start network... 07:43:03.417961 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:43:03.896648 run create_hlr_db(pid=12738): Launched 07:43:04.022158 bus /gobi_6: Setting Powered False 07:43:05.083788 run create_hlr_db(pid=12738): Terminated: ok {rc=0} 07:43:05.516416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12740): Launched 07:43:05.825542 run osmo-hlr_10.42.42.2(pid=12741): Launched 07:43:05.943380 run osmo-stp_10.42.42.5: Starting osmo-stp 07:43:06.485206 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12743): Launched 07:43:06.795489 run osmo-stp_10.42.42.5(pid=12744): Launched 07:43:06.913281 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:43:07.452075 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12746): Launched 07:43:07.570702 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:43:07.832876 run patchelf(pid=12747): Launched 07:43:08.006632 run osmo-stp_10.42.42.5(pid=12744): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12744)] 07:43:08.138305 run osmo-stp_10.42.42.5(pid=12744): stdout: | (launched: 2022-12-10_07:43:06.738870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:08.271199 run osmo-stp_10.42.42.5(pid=12744): stderr: | [0;m[38;5;43m20221210074306931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074306931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074306932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074306932 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074306933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074306933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074306933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:08.405209 run osmo-stp_10.42.42.5(pid=12744): stdout: | (launched: 2022-12-10_07:43:06.738870) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:08.532120 run osmo-stp_10.42.42.5(pid=12744): stderr: | [0;m[38;5;43m20221210074306931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074306931 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074306932 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074306932 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074306933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074306933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074306933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:08.682776 run patchelf(pid=12747): Terminating (SIGINT) 07:43:08.857999 run patchelf(pid=12747): Terminated: ok {rc=0} 07:43:08.984143 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12744): Process ended prematurely: osmo-stp_10.42.42.5(pid=12744) [trial-2371↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12744)] [trial-2371↪gprs:trx-lms↪ping.py:22] 07:43:08.993599 tst ping.py:22: Test FAILED (6.5 sec) 07:43:09.021388 run osmo-hlr_10.42.42.2(pid=12741): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12741)] 07:43:09.071165 run osmo-hlr_10.42.42.2(pid=12741): stdout: | (launched: 2022-12-10_07:43:05.769367) 07:43:09.122560 run osmo-hlr_10.42.42.2(pid=12741): stderr: | [0;m[1;31m20221210074305965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074305965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074305965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074305965 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074305966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074305966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074305978 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074305987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074305987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074305987 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:43:09.174216 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12740): Terminating (SIGTERM) 07:43:09.215508 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12743): Terminating (SIGTERM) 07:43:09.257018 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12746): Terminating (SIGTERM) 07:43:09.298843 --- ParallelTerminationStrategy: PID 12740 died... 07:43:09.319105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12740): Terminated: ok {rc=0} 07:43:09.365797 --- ParallelTerminationStrategy: PID 12743 died... 07:43:09.385342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12743): Terminated: ok {rc=0} 07:43:09.431214 --- ParallelTerminationStrategy: PID 12746 died... 07:43:09.450855 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12746): Terminated: ok {rc=0} 07:43:09.538683 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms ping_idle_ping.py ---------------------------------------------- 07:43:10.626899 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:10.639082 tst gprs:trx-lms: Using 1 x bts (candidates: 1) 07:43:10.691653 tst ping_idle_ping.py: using LAC 26885 07:43:10.813624 tst ping_idle_ping.py: using RAC 110 07:43:10.935897 tst ping_idle_ping.py: using CellId 26885 07:43:11.057749 tst ping_idle_ping.py: using BVCI 26886 07:43:11.170361 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:11.181379 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:11.192246 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:11.203229 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:11.214057 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:11.224773 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:11.235814 tst gprs:trx-lms: Using 1 x ip_address (candidates: 9) 07:43:11.246753 tst gprs:trx-lms: Using 1 x modem (candidates: 4) 07:43:11.364365 tst ping_idle_ping.py:24: start network... 07:43:11.574831 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:43:12.058935 run create_hlr_db(pid=12748): Launched 07:43:12.186237 bus /gobi_6: Setting Powered False 07:43:13.248778 run create_hlr_db(pid=12748): Terminated: ok {rc=0} 07:43:13.684878 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12750): Launched 07:43:13.995368 run osmo-hlr_10.42.42.2(pid=12751): Launched 07:43:14.114540 run osmo-stp_10.42.42.5: Starting osmo-stp 07:43:14.651835 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12753): Launched 07:43:14.962372 run osmo-stp_10.42.42.5(pid=12754): Launched 07:43:15.081752 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:43:15.618869 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12756): Launched 07:43:15.737860 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:43:16.021481 run patchelf(pid=12757): Launched 07:43:16.199196 run osmo-stp_10.42.42.5(pid=12754): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12754)] 07:43:16.335147 run osmo-stp_10.42.42.5(pid=12754): stdout: | (launched: 2022-12-10_07:43:14.905674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:16.472937 run osmo-stp_10.42.42.5(pid=12754): stderr: | [0;m[38;5;43m20221210074315097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074315097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074315097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074315097 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074315098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074315098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074315098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:16.610328 run osmo-stp_10.42.42.5(pid=12754): stdout: | (launched: 2022-12-10_07:43:14.905674) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:16.740855 run osmo-stp_10.42.42.5(pid=12754): stderr: | [0;m[38;5;43m20221210074315097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074315097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074315097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074315097 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074315098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074315098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074315098 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:16.895102 run patchelf(pid=12757): Terminating (SIGINT) 07:43:17.072936 run patchelf(pid=12757): Terminated: ok {rc=0} 07:43:17.200413 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12754): Process ended prematurely: osmo-stp_10.42.42.5(pid=12754) [trial-2371↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12754)] [trial-2371↪gprs:trx-lms↪ping_idle_ping.py:27] 07:43:17.210095 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 07:43:17.238323 run osmo-hlr_10.42.42.2(pid=12751): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12751)] 07:43:17.288043 run osmo-hlr_10.42.42.2(pid=12751): stdout: | (launched: 2022-12-10_07:43:13.938648) 07:43:17.339690 run osmo-hlr_10.42.42.2(pid=12751): stderr: | [0;m[1;31m20221210074314135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074314135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074314135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074314135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074314135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074314135 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074314148 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074314158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074314158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074314158 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:43:17.391559 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12750): Terminating (SIGTERM) 07:43:17.433326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12753): Terminating (SIGTERM) 07:43:17.474935 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12756): Terminating (SIGTERM) 07:43:17.516540 --- ParallelTerminationStrategy: PID 12750 died... 07:43:17.536549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12750): Terminated: ok {rc=0} 07:43:17.582338 --- ParallelTerminationStrategy: PID 12753 died... 07:43:17.601903 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12753): Terminated: ok {rc=0} 07:43:17.647572 --- ParallelTerminationStrategy: PID 12756 died... 07:43:17.667245 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12756): Terminated: ok {rc=0} 07:43:17.753970 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-lms+mod-bts0-egprs --------------------------------------------------------------------- 07:43:19.057021 tst gprs:trx-lms+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:43:19.063324 tst gprs:trx-lms+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:43:19.097626 tst gprs:trx-lms+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:43:19.136600 tst gprs:trx-lms+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:43:19.226645 tst gprs:trx-lms+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:43:19.260650 tst gprs:trx-lms+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:43:19.299803 tst gprs:trx-lms+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:43:19.891553 tst gprs:trx-lms+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-lms+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:43:19.942524 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:19.953689 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:43:20.010405 tst cs_paging_gprs_active.py: using LAC 26886 07:43:20.134359 tst cs_paging_gprs_active.py: using RAC 111 07:43:20.258413 tst cs_paging_gprs_active.py: using CellId 26886 07:43:20.381019 tst cs_paging_gprs_active.py: using BVCI 26887 07:43:20.495796 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:20.506988 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:20.518055 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:20.529095 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:20.539954 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:20.550950 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:20.562130 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:20.572916 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:20.584053 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:43:20.699862 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:43:20.819743 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:43:21.033912 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:43:21.352073 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12761): Launched 07:43:21.629212 run iperf3-srv_10.42.42.10(pid=12762): Launched 07:43:21.748665 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:43:21.962786 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:43:22.281281 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12763): Launched 07:43:22.558152 run iperf3-srv_10.42.42.10(pid=12764): Launched 07:43:22.677111 tst cs_paging_gprs_active.py:38: start network... 07:43:22.890977 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:43:23.380417 run create_hlr_db(pid=12765): Launched 07:43:23.508891 bus /gobi_6: Setting Powered False 07:43:24.572012 run create_hlr_db(pid=12765): Terminated: ok {rc=0} 07:43:24.993438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12767): Launched 07:43:25.289299 run osmo-hlr_10.42.42.2(pid=12768): Launched 07:43:25.403267 run osmo-stp_10.42.42.5: Starting osmo-stp 07:43:25.915211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12770): Launched 07:43:26.209620 run osmo-stp_10.42.42.5(pid=12771): Launched 07:43:26.322145 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:43:26.831900 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12773): Launched 07:43:26.944936 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:43:27.194751 run patchelf(pid=12774): Launched 07:43:27.361700 run osmo-stp_10.42.42.5(pid=12771): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12771)] 07:43:27.487666 run osmo-stp_10.42.42.5(pid=12771): stdout: | (launched: 2022-12-10_07:43:26.155795) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:27.614918 run osmo-stp_10.42.42.5(pid=12771): stderr: | [0;m[38;5;43m20221210074326326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074326327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074326327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074326327 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074326328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074326328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074326328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:27.742116 run osmo-stp_10.42.42.5(pid=12771): stdout: | (launched: 2022-12-10_07:43:26.155795) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:27.863417 run osmo-stp_10.42.42.5(pid=12771): stderr: | [0;m[38;5;43m20221210074326326 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074326327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074326327 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074326327 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074326328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074326328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074326328 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:28.007174 run patchelf(pid=12774): Terminating (SIGINT) 07:43:28.175259 run patchelf(pid=12774): Terminated: ok {rc=0} 07:43:28.296519 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12771): Process ended prematurely: osmo-stp_10.42.42.5(pid=12771) [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12771)] [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:43:28.306558 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 07:43:28.334265 run osmo-hlr_10.42.42.2(pid=12768): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12768)] 07:43:28.382052 run osmo-hlr_10.42.42.2(pid=12768): stdout: | (launched: 2022-12-10_07:43:25.235005) 07:43:28.431309 run osmo-hlr_10.42.42.2(pid=12768): stderr: | [0;m[1;31m20221210074325409 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074325410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074325410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074325410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074325410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074325410 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074325422 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074325431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074325431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074325431 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:43:28.481521 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12761): Terminating (SIGTERM) 07:43:28.521286 run iperf3-srv_10.42.42.10(pid=12762): Terminating (SIGTERM) 07:43:28.560859 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12763): Terminating (SIGTERM) 07:43:28.600610 run iperf3-srv_10.42.42.10(pid=12764): Terminating (SIGTERM) 07:43:28.640354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12767): Terminating (SIGTERM) 07:43:28.680272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12770): Terminating (SIGTERM) 07:43:28.719747 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12773): Terminating (SIGTERM) 07:43:28.759603 --- ParallelTerminationStrategy: PID 12761 died... 07:43:28.778658 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12761): Terminated: ok {rc=0} 07:43:28.823584 --- ParallelTerminationStrategy: PID 12762 died... 07:43:28.842148 run iperf3-srv_10.42.42.10(pid=12762): Terminated {rc=256} 07:43:28.886094 --- ParallelTerminationStrategy: PID 12763 died... 07:43:28.904716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12763): Terminated: ok {rc=0} 07:43:28.948772 --- ParallelTerminationStrategy: PID 12764 died... 07:43:28.967424 run iperf3-srv_10.42.42.10(pid=12764): Terminated {rc=256} 07:43:29.011329 --- ParallelTerminationStrategy: PID 12767 died... 07:43:29.029864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12767): Terminated: ok {rc=0} 07:43:29.073712 --- ParallelTerminationStrategy: PID 12770 died... 07:43:29.092264 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12770): Terminated: ok {rc=0} 07:43:29.136074 --- ParallelTerminationStrategy: PID 12773 died... 07:43:29.154463 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12773): Terminated: ok {rc=0} 07:43:29.237259 bus /gobi_0: Setting Powered False 07:43:30.334807 bus /gobi_0: Setting Powered False 07:43:31.468175 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:43:32.619460 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:32.630828 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:43:32.681110 tst iperf3.py: using LAC 26887 07:43:32.798891 tst iperf3.py: using RAC 112 07:43:32.913970 tst iperf3.py: using CellId 26887 07:43:33.031205 tst iperf3.py: using BVCI 26888 07:43:33.138032 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:33.148822 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:33.159269 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:33.170116 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:33.180680 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:33.191335 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:33.202301 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:33.212887 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:33.223867 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:43:33.338135 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:43:33.538268 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:43:33.835794 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12775): Launched 07:43:34.092900 run iperf3-srv_10.42.42.10(pid=12776): Launched 07:43:34.204209 tst iperf3.py:8: start network... 07:43:34.402605 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:43:34.858557 run create_hlr_db(pid=12777): Launched 07:43:34.971056 bus /gobi_6: Setting Powered False 07:43:36.030058 run create_hlr_db(pid=12777): Terminated: ok {rc=0} 07:43:36.462383 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12779): Launched 07:43:36.779178 run osmo-hlr_10.42.42.2(pid=12780): Launched 07:43:36.900326 run osmo-stp_10.42.42.5: Starting osmo-stp 07:43:37.444196 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12782): Launched 07:43:37.761381 run osmo-stp_10.42.42.5(pid=12783): Launched 07:43:37.882608 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:43:38.429933 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12785): Launched 07:43:38.551023 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:43:38.816787 run patchelf(pid=12786): Launched 07:43:38.992514 run osmo-stp_10.42.42.5(pid=12783): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12783)] 07:43:39.125872 run osmo-stp_10.42.42.5(pid=12783): stdout: | (launched: 2022-12-10_07:43:37.703704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:39.260832 run osmo-stp_10.42.42.5(pid=12783): stderr: | [0;m[38;5;43m20221210074337894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074337894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074337894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074337894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074337895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074337895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074337895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:39.397292 run osmo-stp_10.42.42.5(pid=12783): stdout: | (launched: 2022-12-10_07:43:37.703704) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:39.526294 run osmo-stp_10.42.42.5(pid=12783): stderr: | [0;m[38;5;43m20221210074337894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074337894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074337894 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074337894 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074337895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074337895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074337895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:39.680090 run patchelf(pid=12786): Terminating (SIGINT) 07:43:39.857591 run patchelf(pid=12786): Terminated: ok {rc=0} 07:43:39.985836 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12783): Process ended prematurely: osmo-stp_10.42.42.5(pid=12783) [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12783)] [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8] 07:43:39.995710 tst iperf3.py:8: Test FAILED (7.4 sec) 07:43:40.023967 run osmo-hlr_10.42.42.2(pid=12780): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12780)] 07:43:40.073471 run osmo-hlr_10.42.42.2(pid=12780): stdout: | (launched: 2022-12-10_07:43:36.721915) 07:43:40.124539 run osmo-hlr_10.42.42.2(pid=12780): stderr: | [0;m[1;31m20221210074336919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074336919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074336920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074336920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074336920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074336920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074336932 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074336941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074336941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074336941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:43:40.176299 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12775): Terminating (SIGTERM) 07:43:40.217792 run iperf3-srv_10.42.42.10(pid=12776): Terminating (SIGTERM) 07:43:40.259134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12779): Terminating (SIGTERM) 07:43:40.300427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12782): Terminating (SIGTERM) 07:43:40.342348 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12785): Terminating (SIGTERM) 07:43:40.384259 --- ParallelTerminationStrategy: PID 12775 died... 07:43:40.404203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12775): Terminated: ok {rc=0} 07:43:40.450420 --- ParallelTerminationStrategy: PID 12776 died... 07:43:40.469986 run iperf3-srv_10.42.42.10(pid=12776): Terminated {rc=256} 07:43:40.515962 --- ParallelTerminationStrategy: PID 12779 died... 07:43:40.535535 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12779): Terminated: ok {rc=0} 07:43:40.581296 --- ParallelTerminationStrategy: PID 12782 died... 07:43:40.600574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12782): Terminated: ok {rc=0} 07:43:40.646454 --- ParallelTerminationStrategy: PID 12785 died... 07:43:40.665966 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12785): Terminated: ok {rc=0} 07:43:40.754189 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:43:41.904742 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:41.916756 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:43:41.969664 tst iperf3m4.py: using LAC 26888 07:43:42.094022 tst iperf3m4.py: using RAC 113 07:43:42.218200 tst iperf3m4.py: using CellId 26888 07:43:42.342296 tst iperf3m4.py: using BVCI 26889 07:43:42.458047 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:42.469265 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:42.480693 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:42.491925 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:42.503029 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:42.514170 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:42.525508 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:42.536600 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:43:42.547916 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:43:42.662509 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:43:42.782260 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:43:42.897485 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:43:43.014297 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:43:43.212338 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:43:43.508742 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12787): Launched 07:43:43.766398 run iperf3-srv_10.42.42.10(pid=12788): Launched 07:43:43.877913 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:43:44.075810 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:43:44.373447 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12789): Launched 07:43:44.630678 run iperf3-srv_10.42.42.10(pid=12790): Launched 07:43:44.741930 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:43:44.939085 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:43:45.235254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12791): Launched 07:43:45.492218 run iperf3-srv_10.42.42.10(pid=12792): Launched 07:43:45.603288 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:43:45.800915 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:43:46.147508 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12793): Launched 07:43:46.476132 run iperf3-srv_10.42.42.10(pid=12794): Launched 07:43:46.647828 tst iperf3m4.py:8: start network... 07:43:46.857732 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:43:47.331803 run create_hlr_db(pid=12795): Launched 07:43:47.470256 bus /gobi_6: Setting Powered False 07:43:48.530114 run create_hlr_db(pid=12795): Terminated: ok {rc=0} 07:43:48.942612 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12798): Launched 07:43:49.237354 run osmo-hlr_10.42.42.2(pid=12799): Launched 07:43:49.350069 run osmo-stp_10.42.42.5: Starting osmo-stp 07:43:49.857711 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12801): Launched 07:43:50.152157 run osmo-stp_10.42.42.5(pid=12802): Launched 07:43:50.265278 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:43:50.772148 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12804): Launched 07:43:50.886125 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:43:51.135229 run patchelf(pid=12805): Launched 07:43:51.299598 run osmo-stp_10.42.42.5(pid=12802): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12802)] 07:43:51.424621 run osmo-stp_10.42.42.5(pid=12802): stdout: | (launched: 2022-12-10_07:43:50.098110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:51.551983 run osmo-stp_10.42.42.5(pid=12802): stderr: | [0;m[38;5;43m20221210074350269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074350269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074350270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074350271 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074350271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074350271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074350271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:51.679505 run osmo-stp_10.42.42.5(pid=12802): stdout: | (launched: 2022-12-10_07:43:50.098110) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:43:51.800479 run osmo-stp_10.42.42.5(pid=12802): stderr: | [0;m[38;5;43m20221210074350269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074350269 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074350270 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074350271 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074350271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074350271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074350271 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:43:51.943385 run patchelf(pid=12805): Terminating (SIGINT) 07:43:52.110918 run patchelf(pid=12805): Terminated: ok {rc=0} 07:43:52.232008 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12802): Process ended prematurely: osmo-stp_10.42.42.5(pid=12802) [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12802)] [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8] 07:43:52.241540 tst iperf3m4.py:8: Test FAILED (10.4 sec) 07:43:52.269571 run osmo-hlr_10.42.42.2(pid=12799): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12799)] 07:43:52.317497 run osmo-hlr_10.42.42.2(pid=12799): stdout: | (launched: 2022-12-10_07:43:49.183257) 07:43:52.367098 run osmo-hlr_10.42.42.2(pid=12799): stderr: | [0;m[1;31m20221210074349357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074349357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074349357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074349357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074349357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074349357 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074349369 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074349379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074349379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074349379 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:43:52.417085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12787): Terminating (SIGTERM) 07:43:52.456940 run iperf3-srv_10.42.42.10(pid=12788): Terminating (SIGTERM) 07:43:52.496782 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12789): Terminating (SIGTERM) 07:43:52.536711 run iperf3-srv_10.42.42.10(pid=12790): Terminating (SIGTERM) 07:43:52.576818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12791): Terminating (SIGTERM) 07:43:52.616811 run iperf3-srv_10.42.42.10(pid=12792): Terminating (SIGTERM) 07:43:52.656466 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12793): Terminating (SIGTERM) 07:43:52.696488 run iperf3-srv_10.42.42.10(pid=12794): Terminating (SIGTERM) 07:43:52.736371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12798): Terminating (SIGTERM) 07:43:52.776414 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12801): Terminating (SIGTERM) 07:43:52.816128 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12804): Terminating (SIGTERM) 07:43:52.856133 --- ParallelTerminationStrategy: PID 12787 died... 07:43:52.875178 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12787): Terminated: ok {rc=0} 07:43:52.919647 --- ParallelTerminationStrategy: PID 12788 died... 07:43:52.938310 run iperf3-srv_10.42.42.10(pid=12788): Terminated {rc=256} 07:43:52.982408 --- ParallelTerminationStrategy: PID 12789 died... 07:43:53.001104 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12789): Terminated: ok {rc=0} 07:43:53.045315 --- ParallelTerminationStrategy: PID 12790 died... 07:43:53.063824 run iperf3-srv_10.42.42.10(pid=12790): Terminated {rc=256} 07:43:53.108674 --- ParallelTerminationStrategy: PID 12791 died... 07:43:53.127396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12791): Terminated: ok {rc=0} 07:43:53.171809 --- ParallelTerminationStrategy: PID 12792 died... 07:43:53.190444 run iperf3-srv_10.42.42.10(pid=12792): Terminated {rc=256} 07:43:53.234262 --- ParallelTerminationStrategy: PID 12793 died... 07:43:53.252783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12793): Terminated: ok {rc=0} 07:43:53.296843 --- ParallelTerminationStrategy: PID 12794 died... 07:43:53.315921 run iperf3-srv_10.42.42.10(pid=12794): Terminated {rc=256} 07:43:53.359831 --- ParallelTerminationStrategy: PID 12798 died... 07:43:53.378313 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12798): Terminated: ok {rc=0} 07:43:53.422079 --- ParallelTerminationStrategy: PID 12801 died... 07:43:53.440695 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12801): Terminated: ok {rc=0} 07:43:53.485081 --- ParallelTerminationStrategy: PID 12804 died... 07:43:53.503740 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12804): Terminated: ok {rc=0} 07:43:53.587684 bus /gobi_4: Setting Powered False 07:43:54.682863 bus /gobi_4: Setting Powered False 07:43:55.795399 bus /gobi_1: Setting Powered False 07:43:56.893376 bus /gobi_1: Setting Powered False 07:43:58.009462 bus /gobi_0: Setting Powered False 07:43:59.105435 bus /gobi_0: Setting Powered False 07:44:00.222768 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms+mod-bts0-egprs ping.py ---------------------------------------------- 07:44:01.325870 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:01.338925 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:44:01.391152 tst ping.py: using LAC 26889 07:44:01.545086 tst ping.py: using RAC 114 07:44:01.665066 tst ping.py: using CellId 26889 07:44:01.810228 tst ping.py: using BVCI 26890 07:44:01.918821 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:01.931090 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:01.942625 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:01.954859 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:01.968563 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:01.981312 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:01.994298 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:02.006922 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:44:02.123888 tst ping.py:19: start network... 07:44:02.320452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:44:02.769255 run create_hlr_db(pid=12806): Launched 07:44:02.880884 bus /gobi_6: Setting Powered False 07:44:03.940735 run create_hlr_db(pid=12806): Terminated: ok {rc=0} 07:44:04.344677 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12808): Launched 07:44:04.634172 run osmo-hlr_10.42.42.2(pid=12809): Launched 07:44:04.745902 run osmo-stp_10.42.42.5: Starting osmo-stp 07:44:05.245709 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12811): Launched 07:44:05.534636 run osmo-stp_10.42.42.5(pid=12812): Launched 07:44:05.645765 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:44:06.158502 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12814): Launched 07:44:06.269693 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:44:06.514067 run patchelf(pid=12815): Launched 07:44:06.675984 run osmo-stp_10.42.42.5(pid=12812): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12812)] 07:44:06.798974 run osmo-stp_10.42.42.5(pid=12812): stdout: | (launched: 2022-12-10_07:44:05.481659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:06.923722 run osmo-stp_10.42.42.5(pid=12812): stderr: | [0;m[38;5;43m20221210074405649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074405649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074405649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074405650 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074405651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074405651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074405651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:07.048340 run osmo-stp_10.42.42.5(pid=12812): stdout: | (launched: 2022-12-10_07:44:05.481659) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:07.167279 run osmo-stp_10.42.42.5(pid=12812): stderr: | [0;m[38;5;43m20221210074405649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074405649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074405649 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074405650 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074405651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074405651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074405651 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:07.308086 run patchelf(pid=12815): Terminating (SIGINT) 07:44:07.471842 run patchelf(pid=12815): Terminated: ok {rc=0} 07:44:07.590036 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12812): Process ended prematurely: osmo-stp_10.42.42.5(pid=12812) [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12812)] [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22] 07:44:07.598682 tst ping.py:22: Test FAILED (6.3 sec) 07:44:07.625863 run osmo-hlr_10.42.42.2(pid=12809): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12809)] 07:44:07.673747 run osmo-hlr_10.42.42.2(pid=12809): stdout: | (launched: 2022-12-10_07:44:04.580434) 07:44:07.723131 run osmo-hlr_10.42.42.2(pid=12809): stderr: | [0;m[1;31m20221210074404756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074404756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074404756 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074404757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074404757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074404757 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074404771 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074404781 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074404782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074404782 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:44:07.772892 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12808): Terminating (SIGTERM) 07:44:07.813310 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12811): Terminating (SIGTERM) 07:44:07.853608 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12814): Terminating (SIGTERM) 07:44:07.894036 --- ParallelTerminationStrategy: PID 12808 died... 07:44:07.913261 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12808): Terminated: ok {rc=0} 07:44:07.957991 --- ParallelTerminationStrategy: PID 12811 died... 07:44:07.976653 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12811): Terminated: ok {rc=0} 07:44:08.021369 --- ParallelTerminationStrategy: PID 12814 died... 07:44:08.039953 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12814): Terminated: ok {rc=0} 07:44:08.127162 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:44:09.216451 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:09.228297 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:44:09.281668 tst ping_idle_ping.py: using LAC 26890 07:44:09.396019 tst ping_idle_ping.py: using RAC 115 07:44:09.518751 tst ping_idle_ping.py: using CellId 26890 07:44:09.639272 tst ping_idle_ping.py: using BVCI 26891 07:44:09.754051 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:09.765634 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:09.776894 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:09.788374 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:09.799799 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:09.811248 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:09.822873 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:44:09.834244 tst gprs:trx-lms+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:44:09.951271 tst ping_idle_ping.py:24: start network... 07:44:10.161494 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:44:10.645123 run create_hlr_db(pid=12816): Launched 07:44:10.771804 bus /gobi_6: Setting Powered False 07:44:11.835218 run create_hlr_db(pid=12816): Terminated: ok {rc=0} 07:44:12.251117 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12818): Launched 07:44:12.542164 run osmo-hlr_10.42.42.2(pid=12819): Launched 07:44:12.654632 run osmo-stp_10.42.42.5: Starting osmo-stp 07:44:13.165692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12821): Launched 07:44:13.456438 run osmo-stp_10.42.42.5(pid=12822): Launched 07:44:13.569476 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:44:14.072813 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12824): Launched 07:44:14.184871 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:44:14.429915 run patchelf(pid=12825): Launched 07:44:14.591888 run osmo-stp_10.42.42.5(pid=12822): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12822)] 07:44:14.714541 run osmo-stp_10.42.42.5(pid=12822): stdout: | (launched: 2022-12-10_07:44:13.403066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:14.839454 run osmo-stp_10.42.42.5(pid=12822): stderr: | [0;m[38;5;43m20221210074413573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074413573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074413573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074413574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074413574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074413574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074413574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:14.964134 run osmo-stp_10.42.42.5(pid=12822): stdout: | (launched: 2022-12-10_07:44:13.403066) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:15.083459 run osmo-stp_10.42.42.5(pid=12822): stderr: | [0;m[38;5;43m20221210074413573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074413573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074413573 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074413574 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074413574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074413574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074413574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:15.224330 run patchelf(pid=12825): Terminating (SIGINT) 07:44:15.389230 run patchelf(pid=12825): Terminated: ok {rc=0} 07:44:15.507950 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12822): Process ended prematurely: osmo-stp_10.42.42.5(pid=12822) [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12822)] [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27] 07:44:15.516698 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 07:44:15.543900 run osmo-hlr_10.42.42.2(pid=12819): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12819)] 07:44:15.591723 run osmo-hlr_10.42.42.2(pid=12819): stdout: | (launched: 2022-12-10_07:44:12.488678) 07:44:15.641249 run osmo-hlr_10.42.42.2(pid=12819): stderr: | [0;m[1;31m20221210074412660 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074412661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074412661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074412661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074412661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074412661 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074412674 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074412682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074412683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074412683 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:44:15.690971 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12818): Terminating (SIGTERM) 07:44:15.730772 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12821): Terminating (SIGTERM) 07:44:15.770636 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12824): Terminating (SIGTERM) 07:44:15.810722 --- ParallelTerminationStrategy: PID 12818 died... 07:44:15.830187 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12818): Terminated: ok {rc=0} 07:44:15.877450 --- ParallelTerminationStrategy: PID 12821 died... 07:44:15.899333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12821): Terminated: ok {rc=0} 07:44:15.948493 --- ParallelTerminationStrategy: PID 12824 died... 07:44:15.968170 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12824): Terminated: ok {rc=0} 07:44:16.061883 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-lms+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-lms+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:44:17.363105 tst gprs:trx-lms+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:44:17.369037 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:44:17.402345 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:44:17.440104 tst gprs:trx-lms+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:44:17.525839 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:44:17.558527 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:44:17.596445 tst gprs:trx-lms+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:44:18.187299 tst gprs:trx-lms+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-lms+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:44:18.235672 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:18.246580 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:44:18.314791 tst cs_paging_gprs_active.py: using LAC 26891 07:44:18.434926 tst cs_paging_gprs_active.py: using RAC 116 07:44:18.548885 tst cs_paging_gprs_active.py: using CellId 26891 07:44:18.663042 tst cs_paging_gprs_active.py: using BVCI 26892 07:44:18.770321 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:18.781063 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:18.791651 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:18.802592 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:18.813602 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:18.824455 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:18.835519 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:18.846601 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:18.857663 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:44:18.976436 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:44:19.093424 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:44:19.292794 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:44:19.590666 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12829): Launched 07:44:19.849137 run iperf3-srv_10.42.42.10(pid=12830): Launched 07:44:19.960885 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:44:20.159210 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:44:20.455598 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12831): Launched 07:44:20.712719 run iperf3-srv_10.42.42.10(pid=12832): Launched 07:44:20.823977 tst cs_paging_gprs_active.py:38: start network... 07:44:21.021633 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:44:21.478518 run create_hlr_db(pid=12833): Launched 07:44:21.593777 bus /gobi_6: Setting Powered False 07:44:22.653789 run create_hlr_db(pid=12833): Terminated: ok {rc=0} 07:44:23.086348 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12835): Launched 07:44:23.403130 run osmo-hlr_10.42.42.2(pid=12836): Launched 07:44:23.524530 run osmo-stp_10.42.42.5: Starting osmo-stp 07:44:24.071738 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12838): Launched 07:44:24.388654 run osmo-stp_10.42.42.5(pid=12839): Launched 07:44:24.509953 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:44:25.058642 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12841): Launched 07:44:25.180502 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:44:25.455555 run patchelf(pid=12842): Launched 07:44:25.632868 run osmo-stp_10.42.42.5(pid=12839): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12839)] 07:44:25.767265 run osmo-stp_10.42.42.5(pid=12839): stdout: | (launched: 2022-12-10_07:44:24.330577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:25.903354 run osmo-stp_10.42.42.5(pid=12839): stderr: | [0;m[38;5;43m20221210074424523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074424523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074424523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074424524 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074424524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074424524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074424524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:26.040056 run osmo-stp_10.42.42.5(pid=12839): stdout: | (launched: 2022-12-10_07:44:24.330577) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:26.170363 run osmo-stp_10.42.42.5(pid=12839): stderr: | [0;m[38;5;43m20221210074424523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074424523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074424523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074424524 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074424524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074424524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074424524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:26.324712 run patchelf(pid=12842): Terminating (SIGINT) 07:44:26.504329 run patchelf(pid=12842): Terminated: ok {rc=0} 07:44:26.634101 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12839): Process ended prematurely: osmo-stp_10.42.42.5(pid=12839) [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12839)] [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:44:26.643993 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 07:44:26.672886 run osmo-hlr_10.42.42.2(pid=12836): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12836)] 07:44:26.722916 run osmo-hlr_10.42.42.2(pid=12836): stdout: | (launched: 2022-12-10_07:44:23.345647) 07:44:26.774805 run osmo-hlr_10.42.42.2(pid=12836): stderr: | [0;m[1;31m20221210074423542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074423542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074423542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074423542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074423542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074423542 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074423554 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074423562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074423562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074423562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:44:26.827349 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12829): Terminating (SIGTERM) 07:44:26.869433 run iperf3-srv_10.42.42.10(pid=12830): Terminating (SIGTERM) 07:44:26.911342 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12831): Terminating (SIGTERM) 07:44:26.953418 run iperf3-srv_10.42.42.10(pid=12832): Terminating (SIGTERM) 07:44:26.995096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12835): Terminating (SIGTERM) 07:44:27.036889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12838): Terminating (SIGTERM) 07:44:27.078771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12841): Terminating (SIGTERM) 07:44:27.120904 --- ParallelTerminationStrategy: PID 12829 died... 07:44:27.141111 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12829): Terminated: ok {rc=0} 07:44:27.187525 --- ParallelTerminationStrategy: PID 12830 died... 07:44:27.207383 run iperf3-srv_10.42.42.10(pid=12830): Terminated {rc=256} 07:44:27.253513 --- ParallelTerminationStrategy: PID 12831 died... 07:44:27.273159 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12831): Terminated: ok {rc=0} 07:44:27.319701 --- ParallelTerminationStrategy: PID 12832 died... 07:44:27.339350 run iperf3-srv_10.42.42.10(pid=12832): Terminated {rc=256} 07:44:27.386214 --- ParallelTerminationStrategy: PID 12835 died... 07:44:27.406123 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12835): Terminated: ok {rc=0} 07:44:27.452173 --- ParallelTerminationStrategy: PID 12838 died... 07:44:27.471853 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12838): Terminated: ok {rc=0} 07:44:27.518520 --- ParallelTerminationStrategy: PID 12841 died... 07:44:27.538255 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12841): Terminated: ok {rc=0} 07:44:27.626181 bus /gobi_0: Setting Powered False 07:44:28.726451 bus /gobi_0: Setting Powered False 07:44:29.840890 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:44:30.996873 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:31.009830 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:44:31.083882 tst iperf3.py: using LAC 26892 07:44:31.237312 tst iperf3.py: using RAC 117 07:44:31.363295 tst iperf3.py: using CellId 26892 07:44:31.516891 tst iperf3.py: using BVCI 26893 07:44:31.629515 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:31.641302 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:31.653897 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:31.667044 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:31.679522 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:31.692263 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:31.706075 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:31.717741 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:31.730093 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:44:31.857724 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:44:32.101689 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:44:32.419581 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12843): Launched 07:44:32.678620 run iperf3-srv_10.42.42.10(pid=12844): Launched 07:44:32.789681 tst iperf3.py:8: start network... 07:44:32.987706 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:44:33.445270 run create_hlr_db(pid=12845): Launched 07:44:33.558804 bus /gobi_6: Setting Powered False 07:44:34.617515 run create_hlr_db(pid=12845): Terminated: ok {rc=0} 07:44:35.029979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12847): Launched 07:44:35.324593 run osmo-hlr_10.42.42.2(pid=12848): Launched 07:44:35.437386 run osmo-stp_10.42.42.5: Starting osmo-stp 07:44:35.944221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12850): Launched 07:44:36.238663 run osmo-stp_10.42.42.5(pid=12851): Launched 07:44:36.352035 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:44:36.859605 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12853): Launched 07:44:36.972859 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:44:37.220861 run patchelf(pid=12854): Launched 07:44:37.385572 run osmo-stp_10.42.42.5(pid=12851): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12851)] 07:44:37.510500 run osmo-stp_10.42.42.5(pid=12851): stdout: | (launched: 2022-12-10_07:44:36.184908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:37.637187 run osmo-stp_10.42.42.5(pid=12851): stderr: | [0;m[38;5;43m20221210074436354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074436354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074436354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074436355 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074436355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074436355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074436355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:37.763952 run osmo-stp_10.42.42.5(pid=12851): stdout: | (launched: 2022-12-10_07:44:36.184908) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:37.884486 run osmo-stp_10.42.42.5(pid=12851): stderr: | [0;m[38;5;43m20221210074436354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074436354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074436354 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074436355 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074436355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074436355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074436355 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:38.027727 run patchelf(pid=12854): Terminating (SIGINT) 07:44:38.194482 run patchelf(pid=12854): Terminated: ok {rc=0} 07:44:38.315040 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12851): Process ended prematurely: osmo-stp_10.42.42.5(pid=12851) [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12851)] [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8] 07:44:38.324299 tst iperf3.py:8: Test FAILED (7.4 sec) 07:44:38.351633 run osmo-hlr_10.42.42.2(pid=12848): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12848)] 07:44:38.399394 run osmo-hlr_10.42.42.2(pid=12848): stdout: | (launched: 2022-12-10_07:44:35.270454) 07:44:38.448334 run osmo-hlr_10.42.42.2(pid=12848): stderr: | [0;m[1;31m20221210074435444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074435444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074435444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074435444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074435444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074435444 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074435456 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074435465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074435466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074435466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:44:38.497891 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12843): Terminating (SIGTERM) 07:44:38.537452 run iperf3-srv_10.42.42.10(pid=12844): Terminating (SIGTERM) 07:44:38.576918 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12847): Terminating (SIGTERM) 07:44:38.616479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12850): Terminating (SIGTERM) 07:44:38.655884 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12853): Terminating (SIGTERM) 07:44:38.695584 --- ParallelTerminationStrategy: PID 12843 died... 07:44:38.714563 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12843): Terminated: ok {rc=0} 07:44:38.758922 --- ParallelTerminationStrategy: PID 12844 died... 07:44:38.777144 run iperf3-srv_10.42.42.10(pid=12844): Terminated {rc=256} 07:44:38.820746 --- ParallelTerminationStrategy: PID 12847 died... 07:44:38.839282 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12847): Terminated: ok {rc=0} 07:44:38.883514 --- ParallelTerminationStrategy: PID 12850 died... 07:44:38.901947 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12850): Terminated: ok {rc=0} 07:44:38.945688 --- ParallelTerminationStrategy: PID 12853 died... 07:44:38.964252 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12853): Terminated: ok {rc=0} 07:44:39.049519 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:44:40.195587 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:40.207128 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:44:40.277453 tst iperf3m4.py: using LAC 26893 07:44:40.397690 tst iperf3m4.py: using RAC 118 07:44:40.522812 tst iperf3m4.py: using CellId 26893 07:44:40.645857 tst iperf3m4.py: using BVCI 26894 07:44:40.760859 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:40.772181 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:40.783416 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:40.795004 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:40.806573 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:40.818208 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:40.829858 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:40.841636 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:40.854044 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:44:40.970459 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:44:41.088545 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:44:41.206119 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:44:41.322352 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:44:41.521377 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:44:41.818688 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12855): Launched 07:44:42.078260 run iperf3-srv_10.42.42.10(pid=12856): Launched 07:44:42.190452 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:44:42.388696 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:44:42.685810 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12857): Launched 07:44:42.943323 run iperf3-srv_10.42.42.10(pid=12858): Launched 07:44:43.054907 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:44:43.252584 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:44:43.549162 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12859): Launched 07:44:43.806411 run iperf3-srv_10.42.42.10(pid=12860): Launched 07:44:43.917667 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:44:44.115949 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:44:44.411823 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12861): Launched 07:44:44.669206 run iperf3-srv_10.42.42.10(pid=12862): Launched 07:44:44.780314 tst iperf3m4.py:8: start network... 07:44:44.978281 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:44:45.435920 run create_hlr_db(pid=12863): Launched 07:44:45.550512 bus /gobi_6: Setting Powered False 07:44:46.629578 run create_hlr_db(pid=12863): Terminated: ok {rc=0} 07:44:47.125733 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12865): Launched 07:44:47.441694 run osmo-hlr_10.42.42.2(pid=12866): Launched 07:44:47.555149 run osmo-stp_10.42.42.5: Starting osmo-stp 07:44:48.065780 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12868): Launched 07:44:48.382977 run osmo-stp_10.42.42.5(pid=12869): Launched 07:44:48.503719 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:44:49.046461 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12871): Launched 07:44:49.167505 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:44:49.433556 run patchelf(pid=12872): Launched 07:44:49.609366 run osmo-stp_10.42.42.5(pid=12869): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12869)] 07:44:49.742541 run osmo-stp_10.42.42.5(pid=12869): stdout: | (launched: 2022-12-10_07:44:48.325312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:49.877295 run osmo-stp_10.42.42.5(pid=12869): stderr: | [0;m[38;5;43m20221210074448517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074448517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074448517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074448518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074448518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074448518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074448518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:50.012169 run osmo-stp_10.42.42.5(pid=12869): stdout: | (launched: 2022-12-10_07:44:48.325312) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:44:50.141677 run osmo-stp_10.42.42.5(pid=12869): stderr: | [0;m[38;5;43m20221210074448517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074448517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074448517 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074448518 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074448518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074448518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074448518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:44:50.295028 run patchelf(pid=12872): Terminating (SIGINT) 07:44:50.473865 run patchelf(pid=12872): Terminated: ok {rc=0} 07:44:50.602013 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12869): Process ended prematurely: osmo-stp_10.42.42.5(pid=12869) [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12869)] [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:44:50.611991 tst iperf3m4.py:8: Test FAILED (10.5 sec) 07:44:50.640720 run osmo-hlr_10.42.42.2(pid=12866): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12866)] 07:44:50.690358 run osmo-hlr_10.42.42.2(pid=12866): stdout: | (launched: 2022-12-10_07:44:47.387779) 07:44:50.741557 run osmo-hlr_10.42.42.2(pid=12866): stderr: | [0;m[1;31m20221210074447566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074447566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074447566 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074447567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074447567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074447567 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074447579 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074447587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074447587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074447587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:44:50.792854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12855): Terminating (SIGTERM) 07:44:50.834428 run iperf3-srv_10.42.42.10(pid=12856): Terminating (SIGTERM) 07:44:50.876044 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12857): Terminating (SIGTERM) 07:44:50.917593 run iperf3-srv_10.42.42.10(pid=12858): Terminating (SIGTERM) 07:44:50.958875 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12859): Terminating (SIGTERM) 07:44:51.000300 run iperf3-srv_10.42.42.10(pid=12860): Terminating (SIGTERM) 07:44:51.041571 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12861): Terminating (SIGTERM) 07:44:51.082900 run iperf3-srv_10.42.42.10(pid=12862): Terminating (SIGTERM) 07:44:51.124195 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12865): Terminating (SIGTERM) 07:44:51.165616 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12868): Terminating (SIGTERM) 07:44:51.206957 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12871): Terminating (SIGTERM) 07:44:51.248550 --- ParallelTerminationStrategy: PID 12855 died... 07:44:51.268560 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12855): Terminated: ok {rc=0} 07:44:51.314617 --- ParallelTerminationStrategy: PID 12856 died... 07:44:51.334260 run iperf3-srv_10.42.42.10(pid=12856): Terminated {rc=256} 07:44:51.380503 --- ParallelTerminationStrategy: PID 12857 died... 07:44:51.400084 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12857): Terminated: ok {rc=0} 07:44:51.445908 --- ParallelTerminationStrategy: PID 12858 died... 07:44:51.465303 run iperf3-srv_10.42.42.10(pid=12858): Terminated {rc=256} 07:44:51.510872 --- ParallelTerminationStrategy: PID 12859 died... 07:44:51.530396 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12859): Terminated: ok {rc=0} 07:44:51.576054 --- ParallelTerminationStrategy: PID 12860 died... 07:44:51.595487 run iperf3-srv_10.42.42.10(pid=12860): Terminated {rc=256} 07:44:51.641095 --- ParallelTerminationStrategy: PID 12861 died... 07:44:51.660506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12861): Terminated: ok {rc=0} 07:44:51.706296 --- ParallelTerminationStrategy: PID 12862 died... 07:44:51.725887 run iperf3-srv_10.42.42.10(pid=12862): Terminated {rc=256} 07:44:51.771579 --- ParallelTerminationStrategy: PID 12865 died... 07:44:51.790996 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12865): Terminated: ok {rc=0} 07:44:51.836497 --- ParallelTerminationStrategy: PID 12868 died... 07:44:51.860105 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12868): Terminated: ok {rc=0} 07:44:51.911404 --- ParallelTerminationStrategy: PID 12871 died... 07:44:51.931546 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12871): Terminated: ok {rc=0} 07:44:52.019678 bus /gobi_4: Setting Powered False 07:44:53.117214 bus /gobi_4: Setting Powered False 07:44:54.233083 bus /gobi_1: Setting Powered False 07:44:55.331847 bus /gobi_1: Setting Powered False 07:44:56.447729 bus /gobi_0: Setting Powered False 07:44:57.546436 bus /gobi_0: Setting Powered False 07:44:58.663416 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:44:59.765996 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:44:59.777451 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:44:59.846602 tst ping.py: using LAC 26894 07:44:59.961361 tst ping.py: using RAC 119 07:45:00.076497 tst ping.py: using CellId 26894 07:45:00.190608 tst ping.py: using BVCI 26895 07:45:00.296239 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:00.307537 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:00.318425 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:00.329741 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:00.340562 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:00.351757 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:00.362974 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:00.374156 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:45:00.490548 tst ping.py:19: start network... 07:45:00.683863 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:45:01.180105 run create_hlr_db(pid=12877): Launched 07:45:01.344593 bus /gobi_6: Setting Powered False 07:45:02.406079 run create_hlr_db(pid=12877): Terminated: ok {rc=0} 07:45:02.822770 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12882): Launched 07:45:03.112545 run osmo-hlr_10.42.42.2(pid=12883): Launched 07:45:03.224028 run osmo-stp_10.42.42.5: Starting osmo-stp 07:45:03.724107 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12885): Launched 07:45:04.013693 run osmo-stp_10.42.42.5(pid=12886): Launched 07:45:04.124089 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:45:04.623482 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12888): Launched 07:45:04.734572 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:45:04.978037 run patchelf(pid=12889): Launched 07:45:05.139339 run osmo-stp_10.42.42.5(pid=12886): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12886)] 07:45:05.261884 run osmo-stp_10.42.42.5(pid=12886): stdout: | (launched: 2022-12-10_07:45:03.960138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:05.386238 run osmo-stp_10.42.42.5(pid=12886): stderr: | [0;m[38;5;43m20221210074504128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074504128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074504128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074504129 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074504131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074504131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074504131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:05.510740 run osmo-stp_10.42.42.5(pid=12886): stdout: | (launched: 2022-12-10_07:45:03.960138) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:05.629869 run osmo-stp_10.42.42.5(pid=12886): stderr: | [0;m[38;5;43m20221210074504128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074504128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074504128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074504129 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074504131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074504131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074504131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:05.770236 run patchelf(pid=12889): Terminating (SIGINT) 07:45:05.934220 run patchelf(pid=12889): Terminated: ok {rc=0} 07:45:06.052166 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12886): Process ended prematurely: osmo-stp_10.42.42.5(pid=12886) [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12886)] [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22] 07:45:06.060927 tst ping.py:22: Test FAILED (6.3 sec) 07:45:06.088220 run osmo-hlr_10.42.42.2(pid=12883): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12883)] 07:45:06.135724 run osmo-hlr_10.42.42.2(pid=12883): stdout: | (launched: 2022-12-10_07:45:03.059090) 07:45:06.184902 run osmo-hlr_10.42.42.2(pid=12883): stderr: | [0;m[1;31m20221210074503233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074503233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074503234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074503234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074503234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074503234 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074503246 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074503254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074503255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074503255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:45:06.234772 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12882): Terminating (SIGTERM) 07:45:06.274641 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12885): Terminating (SIGTERM) 07:45:06.314181 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12888): Terminating (SIGTERM) 07:45:06.354046 --- ParallelTerminationStrategy: PID 12882 died... 07:45:06.373087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12882): Terminated: ok {rc=0} 07:45:06.417213 --- ParallelTerminationStrategy: PID 12885 died... 07:45:06.435566 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12885): Terminated: ok {rc=0} 07:45:06.480425 --- ParallelTerminationStrategy: PID 12888 died... 07:45:06.499027 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12888): Terminated: ok {rc=0} 07:45:06.583588 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:45:07.670797 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:07.683318 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:45:07.755961 tst ping_idle_ping.py: using LAC 26895 07:45:07.870815 tst ping_idle_ping.py: using RAC 120 07:45:07.987290 tst ping_idle_ping.py: using CellId 26895 07:45:08.102962 tst ping_idle_ping.py: using BVCI 26896 07:45:08.208558 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:08.219540 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:08.230452 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:08.241479 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:08.252236 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:08.263064 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:08.274166 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:45:08.284927 tst gprs:trx-lms+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:45:08.403950 tst ping_idle_ping.py:24: start network... 07:45:08.614280 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:45:09.099145 run create_hlr_db(pid=12890): Launched 07:45:09.226881 bus /gobi_6: Setting Powered False 07:45:10.289083 run create_hlr_db(pid=12890): Terminated: ok {rc=0} 07:45:10.708304 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12892): Launched 07:45:10.998696 run osmo-hlr_10.42.42.2(pid=12893): Launched 07:45:11.109937 run osmo-stp_10.42.42.5: Starting osmo-stp 07:45:11.610427 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12895): Launched 07:45:11.901470 run osmo-stp_10.42.42.5(pid=12896): Launched 07:45:12.012900 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:45:12.515600 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12898): Launched 07:45:12.626856 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:45:12.871971 run patchelf(pid=12899): Launched 07:45:13.034534 run osmo-stp_10.42.42.5(pid=12896): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12896)] 07:45:13.158004 run osmo-stp_10.42.42.5(pid=12896): stdout: | (launched: 2022-12-10_07:45:11.847044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:13.282749 run osmo-stp_10.42.42.5(pid=12896): stderr: | [0;m[38;5;43m20221210074512015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074512015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074512015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074512016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074512016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074512016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074512016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:13.408014 run osmo-stp_10.42.42.5(pid=12896): stdout: | (launched: 2022-12-10_07:45:11.847044) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:13.527226 run osmo-stp_10.42.42.5(pid=12896): stderr: | [0;m[38;5;43m20221210074512015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074512015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074512015 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074512016 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074512016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074512016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074512016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:13.668921 run patchelf(pid=12899): Terminating (SIGINT) 07:45:13.833139 run patchelf(pid=12899): Terminated: ok {rc=0} 07:45:13.951353 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12896): Process ended prematurely: osmo-stp_10.42.42.5(pid=12896) [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12896)] [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 07:45:13.960058 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 07:45:13.987213 run osmo-hlr_10.42.42.2(pid=12893): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12893)] 07:45:14.034702 run osmo-hlr_10.42.42.2(pid=12893): stdout: | (launched: 2022-12-10_07:45:10.945582) 07:45:14.083948 run osmo-hlr_10.42.42.2(pid=12893): stderr: | [0;m[1;31m20221210074511118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074511118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074511118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074511118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074511118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074511118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074511131 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074511141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074511141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074511141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:45:14.134104 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12892): Terminating (SIGTERM) 07:45:14.173707 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12895): Terminating (SIGTERM) 07:45:14.213570 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12898): Terminating (SIGTERM) 07:45:14.253634 --- ParallelTerminationStrategy: PID 12892 died... 07:45:14.272731 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12892): Terminated: ok {rc=0} 07:45:14.317653 --- ParallelTerminationStrategy: PID 12895 died... 07:45:14.336506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12895): Terminated: ok {rc=0} 07:45:14.381541 --- ParallelTerminationStrategy: PID 12898 died... 07:45:14.400260 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12898): Terminated: ok {rc=0} 07:45:14.483976 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-lms+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-lms+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:45:15.781498 tst gprs:trx-lms+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:45:15.787277 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:45:15.820473 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 07:45:15.876788 tst gprs:trx-lms+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 07:45:15.992142 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:45:16.033159 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 07:45:16.080671 tst gprs:trx-lms+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 07:45:16.687086 tst gprs:trx-lms+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-lms+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 07:45:16.754533 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:16.769287 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:45:16.850803 tst cs_paging_gprs_active.py: using LAC 26896 07:45:16.970502 tst cs_paging_gprs_active.py: using RAC 121 07:45:17.089092 tst cs_paging_gprs_active.py: using CellId 26896 07:45:17.250625 tst cs_paging_gprs_active.py: using BVCI 26897 07:45:17.372305 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:17.384009 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:17.395682 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:17.408166 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:17.419212 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:17.430791 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:17.442504 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:17.454305 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:17.466013 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:45:17.582551 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:45:17.701890 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:45:17.900411 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:45:18.197212 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12903): Launched 07:45:18.456074 run iperf3-srv_10.42.42.10(pid=12904): Launched 07:45:18.567290 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:45:18.765404 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:45:19.062316 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12905): Launched 07:45:19.319815 run iperf3-srv_10.42.42.10(pid=12906): Launched 07:45:19.431212 tst cs_paging_gprs_active.py:38: start network... 07:45:19.628621 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:45:20.085451 run create_hlr_db(pid=12907): Launched 07:45:20.199525 bus /gobi_6: Setting Powered False 07:45:21.259097 run create_hlr_db(pid=12907): Terminated: ok {rc=0} 07:45:21.692102 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12909): Launched 07:45:22.009446 run osmo-hlr_10.42.42.2(pid=12910): Launched 07:45:22.130770 run osmo-stp_10.42.42.5: Starting osmo-stp 07:45:22.677195 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12912): Launched 07:45:22.993631 run osmo-stp_10.42.42.5(pid=12913): Launched 07:45:23.115127 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:45:23.662299 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12915): Launched 07:45:23.783330 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:45:24.050366 run patchelf(pid=12916): Launched 07:45:24.227825 run osmo-stp_10.42.42.5(pid=12913): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12913)] 07:45:24.361901 run osmo-stp_10.42.42.5(pid=12913): stdout: | (launched: 2022-12-10_07:45:22.935958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:24.498808 run osmo-stp_10.42.42.5(pid=12913): stderr: | [0;m[38;5;43m20221210074523129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074523129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074523129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074523129 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074523130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074523130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074523130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:24.634768 run osmo-stp_10.42.42.5(pid=12913): stdout: | (launched: 2022-12-10_07:45:22.935958) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:24.764242 run osmo-stp_10.42.42.5(pid=12913): stderr: | [0;m[38;5;43m20221210074523129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074523129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074523129 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074523129 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074523130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074523130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074523130 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:24.917993 run patchelf(pid=12916): Terminating (SIGINT) 07:45:25.096296 run patchelf(pid=12916): Terminated: ok {rc=0} 07:45:25.225165 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=12913): Process ended prematurely: osmo-stp_10.42.42.5(pid=12913) [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12913)] [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 07:45:25.234992 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 07:45:25.263385 run osmo-hlr_10.42.42.2(pid=12910): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12910)] 07:45:25.312801 run osmo-hlr_10.42.42.2(pid=12910): stdout: | (launched: 2022-12-10_07:45:21.951827) 07:45:25.363969 run osmo-hlr_10.42.42.2(pid=12910): stderr: | [0;m[1;31m20221210074522147 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074522148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074522148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074522148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074522148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074522148 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074522194 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074522204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074522204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074522204 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:45:25.415813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12903): Terminating (SIGTERM) 07:45:25.456938 run iperf3-srv_10.42.42.10(pid=12904): Terminating (SIGTERM) 07:45:25.498397 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12905): Terminating (SIGTERM) 07:45:25.539392 run iperf3-srv_10.42.42.10(pid=12906): Terminating (SIGTERM) 07:45:25.580280 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12909): Terminating (SIGTERM) 07:45:25.621473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12912): Terminating (SIGTERM) 07:45:25.662296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12915): Terminating (SIGTERM) 07:45:25.703593 --- ParallelTerminationStrategy: PID 12903 died... 07:45:25.723326 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12903): Terminated: ok {rc=0} 07:45:25.768800 --- ParallelTerminationStrategy: PID 12904 died... 07:45:25.788481 run iperf3-srv_10.42.42.10(pid=12904): Terminated {rc=256} 07:45:25.833858 --- ParallelTerminationStrategy: PID 12905 died... 07:45:25.853319 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12905): Terminated: ok {rc=0} 07:45:25.898728 --- ParallelTerminationStrategy: PID 12906 died... 07:45:25.918037 run iperf3-srv_10.42.42.10(pid=12906): Terminated {rc=256} 07:45:25.963201 --- ParallelTerminationStrategy: PID 12909 died... 07:45:25.982631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12909): Terminated: ok {rc=0} 07:45:26.027824 --- ParallelTerminationStrategy: PID 12912 died... 07:45:26.047184 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12912): Terminated: ok {rc=0} 07:45:26.093482 --- ParallelTerminationStrategy: PID 12915 died... 07:45:26.112848 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12915): Terminated: ok {rc=0} 07:45:26.198939 bus /gobi_0: Setting Powered False 07:45:27.299395 bus /gobi_0: Setting Powered False 07:45:28.413423 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 07:45:29.561107 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:29.572894 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:45:29.645196 tst iperf3.py: using LAC 26897 07:45:29.770809 tst iperf3.py: using RAC 122 07:45:29.896540 tst iperf3.py: using CellId 26897 07:45:30.020554 tst iperf3.py: using BVCI 26898 07:45:30.134952 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:30.146198 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:30.157269 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:30.168310 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:30.179381 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:30.190468 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:30.201704 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:30.212562 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:30.223749 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:45:30.338081 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:45:30.538053 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:45:30.839235 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12917): Launched 07:45:31.123676 run iperf3-srv_10.42.42.10(pid=12918): Launched 07:45:31.253337 tst iperf3.py:8: start network... 07:45:31.458752 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:45:31.937751 run create_hlr_db(pid=12919): Launched 07:45:32.066277 bus /gobi_6: Setting Powered False 07:45:33.124525 run create_hlr_db(pid=12919): Terminated: ok {rc=0} 07:45:33.557661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12921): Launched 07:45:33.873487 run osmo-hlr_10.42.42.2(pid=12922): Launched 07:45:33.993815 run osmo-stp_10.42.42.5: Starting osmo-stp 07:45:34.544205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12924): Launched 07:45:34.860217 run osmo-stp_10.42.42.5(pid=12925): Launched 07:45:34.980483 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:45:35.526672 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12927): Launched 07:45:35.647684 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:45:35.914224 run patchelf(pid=12928): Launched 07:45:36.090331 run osmo-stp_10.42.42.5(pid=12925): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12925)] 07:45:36.223724 run osmo-stp_10.42.42.5(pid=12925): stdout: | (launched: 2022-12-10_07:45:34.802661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:36.357859 run osmo-stp_10.42.42.5(pid=12925): stderr: | [0;m[38;5;43m20221210074534995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074534996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074534996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074534996 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074534998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074534999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074534999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:36.486184 run osmo-stp_10.42.42.5(pid=12925): stdout: | (launched: 2022-12-10_07:45:34.802661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:36.607947 run osmo-stp_10.42.42.5(pid=12925): stderr: | [0;m[38;5;43m20221210074534995 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074534996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074534996 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074534996 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074534998 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074534999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074534999 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:36.751517 run patchelf(pid=12928): Terminating (SIGINT) 07:45:36.918518 run patchelf(pid=12928): Terminated: ok {rc=0} 07:45:37.039430 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12925): Process ended prematurely: osmo-stp_10.42.42.5(pid=12925) [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12925)] [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8] 07:45:37.048917 tst iperf3.py:8: Test FAILED (7.5 sec) 07:45:37.076798 run osmo-hlr_10.42.42.2(pid=12922): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12922)] 07:45:37.124363 run osmo-hlr_10.42.42.2(pid=12922): stdout: | (launched: 2022-12-10_07:45:33.815994) 07:45:37.173267 run osmo-hlr_10.42.42.2(pid=12922): stderr: | [0;m[1;31m20221210074534015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074534015 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074534016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074534016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074534016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074534016 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074534029 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074534037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074534037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074534037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:45:37.222743 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12917): Terminating (SIGTERM) 07:45:37.262459 run iperf3-srv_10.42.42.10(pid=12918): Terminating (SIGTERM) 07:45:37.302215 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12921): Terminating (SIGTERM) 07:45:37.342239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12924): Terminating (SIGTERM) 07:45:37.382052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12927): Terminating (SIGTERM) 07:45:37.422322 --- ParallelTerminationStrategy: PID 12917 died... 07:45:37.441477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12917): Terminated: ok {rc=0} 07:45:37.486268 --- ParallelTerminationStrategy: PID 12918 died... 07:45:37.505021 run iperf3-srv_10.42.42.10(pid=12918): Terminated {rc=256} 07:45:37.549772 --- ParallelTerminationStrategy: PID 12921 died... 07:45:37.568604 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12921): Terminated: ok {rc=0} 07:45:37.613067 --- ParallelTerminationStrategy: PID 12924 died... 07:45:37.631719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12924): Terminated: ok {rc=0} 07:45:37.676168 --- ParallelTerminationStrategy: PID 12927 died... 07:45:37.694938 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12927): Terminated: ok {rc=0} 07:45:37.781560 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 07:45:38.927327 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:38.938801 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:45:39.009375 tst iperf3m4.py: using LAC 26898 07:45:39.126789 tst iperf3m4.py: using RAC 123 07:45:39.244342 tst iperf3m4.py: using CellId 26898 07:45:39.371434 tst iperf3m4.py: using BVCI 26899 07:45:39.489537 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:39.500647 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:39.511719 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:39.524361 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:39.535783 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:39.546823 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:39.557873 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:39.568705 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:39.579743 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:45:39.694915 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:45:39.816754 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:45:39.934131 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:45:40.051043 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:45:40.249308 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:45:40.546809 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12929): Launched 07:45:40.804873 run iperf3-srv_10.42.42.10(pid=12930): Launched 07:45:40.916002 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:45:41.113278 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:45:41.409343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12931): Launched 07:45:41.666337 run iperf3-srv_10.42.42.10(pid=12932): Launched 07:45:41.777390 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:45:41.974335 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:45:42.270626 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12933): Launched 07:45:42.528509 run iperf3-srv_10.42.42.10(pid=12934): Launched 07:45:42.640097 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:45:42.836887 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:45:43.132506 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12935): Launched 07:45:43.390088 run iperf3-srv_10.42.42.10(pid=12936): Launched 07:45:43.500705 tst iperf3m4.py:8: start network... 07:45:43.697490 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:45:44.153972 run create_hlr_db(pid=12937): Launched 07:45:44.268005 bus /gobi_6: Setting Powered False 07:45:45.327769 run create_hlr_db(pid=12937): Terminated: ok {rc=0} 07:45:45.739595 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12939): Launched 07:45:46.075173 run osmo-hlr_10.42.42.2(pid=12940): Launched 07:45:46.330849 run osmo-stp_10.42.42.5: Starting osmo-stp 07:45:46.885869 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12942): Launched 07:45:47.209707 run osmo-stp_10.42.42.5(pid=12943): Launched 07:45:47.416178 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:45:47.965666 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12945): Launched 07:45:48.086220 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:45:48.352679 run patchelf(pid=12946): Launched 07:45:48.528371 run osmo-stp_10.42.42.5(pid=12943): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12943)] 07:45:48.662095 run osmo-stp_10.42.42.5(pid=12943): stdout: | (launched: 2022-12-10_07:45:47.140497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:48.796752 run osmo-stp_10.42.42.5(pid=12943): stderr: | [0;m[38;5;43m20221210074547394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074547394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074547394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074547394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074547397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074547397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074547397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:48.931891 run osmo-stp_10.42.42.5(pid=12943): stdout: | (launched: 2022-12-10_07:45:47.140497) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:45:49.060606 run osmo-stp_10.42.42.5(pid=12943): stderr: | [0;m[38;5;43m20221210074547394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074547394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074547394 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074547394 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074547397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074547397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074547397 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:45:49.213645 run patchelf(pid=12946): Terminating (SIGINT) 07:45:49.391504 run patchelf(pid=12946): Terminated: ok {rc=0} 07:45:49.519673 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=12943): Process ended prematurely: osmo-stp_10.42.42.5(pid=12943) [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12943)] [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8] 07:45:49.529563 tst iperf3m4.py:8: Test FAILED (10.6 sec) 07:45:49.557815 run osmo-hlr_10.42.42.2(pid=12940): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12940)] 07:45:49.607237 run osmo-hlr_10.42.42.2(pid=12940): stdout: | (launched: 2022-12-10_07:45:46.009588) 07:45:49.658243 run osmo-hlr_10.42.42.2(pid=12940): stderr: | [0;m[1;31m20221210074546241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074546241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074546241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074546241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074546241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074546241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074546268 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074546281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074546281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074546281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:45:49.709636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12929): Terminating (SIGTERM) 07:45:49.750554 run iperf3-srv_10.42.42.10(pid=12930): Terminating (SIGTERM) 07:45:49.791545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12931): Terminating (SIGTERM) 07:45:49.832736 run iperf3-srv_10.42.42.10(pid=12932): Terminating (SIGTERM) 07:45:49.873870 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12933): Terminating (SIGTERM) 07:45:49.915040 run iperf3-srv_10.42.42.10(pid=12934): Terminating (SIGTERM) 07:45:49.956098 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12935): Terminating (SIGTERM) 07:45:49.997751 run iperf3-srv_10.42.42.10(pid=12936): Terminating (SIGTERM) 07:45:50.039157 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12939): Terminating (SIGTERM) 07:45:50.080388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12942): Terminating (SIGTERM) 07:45:50.121554 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12945): Terminating (SIGTERM) 07:45:50.163071 --- ParallelTerminationStrategy: PID 12929 died... 07:45:50.183040 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12929): Terminated: ok {rc=0} 07:45:50.228808 --- ParallelTerminationStrategy: PID 12930 died... 07:45:50.248299 run iperf3-srv_10.42.42.10(pid=12930): Terminated {rc=256} 07:45:50.293818 --- ParallelTerminationStrategy: PID 12931 died... 07:45:50.313385 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12931): Terminated: ok {rc=0} 07:45:50.358905 --- ParallelTerminationStrategy: PID 12932 died... 07:45:50.378360 run iperf3-srv_10.42.42.10(pid=12932): Terminated {rc=256} 07:45:50.424026 --- ParallelTerminationStrategy: PID 12933 died... 07:45:50.443543 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12933): Terminated: ok {rc=0} 07:45:50.489109 --- ParallelTerminationStrategy: PID 12934 died... 07:45:50.508366 run iperf3-srv_10.42.42.10(pid=12934): Terminated {rc=256} 07:45:50.553785 --- ParallelTerminationStrategy: PID 12935 died... 07:45:50.573204 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=12935): Terminated: ok {rc=0} 07:45:50.619183 --- ParallelTerminationStrategy: PID 12936 died... 07:45:50.638707 run iperf3-srv_10.42.42.10(pid=12936): Terminated {rc=256} 07:45:50.684127 --- ParallelTerminationStrategy: PID 12939 died... 07:45:50.703567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12939): Terminated: ok {rc=0} 07:45:50.749196 --- ParallelTerminationStrategy: PID 12942 died... 07:45:50.768595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12942): Terminated: ok {rc=0} 07:45:50.814408 --- ParallelTerminationStrategy: PID 12945 died... 07:45:50.833911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12945): Terminated: ok {rc=0} 07:45:50.921200 bus /gobi_4: Setting Powered False 07:45:52.020609 bus /gobi_4: Setting Powered False 07:45:53.138054 bus /gobi_1: Setting Powered False 07:45:54.235891 bus /gobi_1: Setting Powered False 07:45:55.351342 bus /gobi_0: Setting Powered False 07:45:56.449463 bus /gobi_0: Setting Powered False 07:45:57.567132 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 07:45:58.669945 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:58.681436 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:45:58.753506 tst ping.py: using LAC 26899 07:45:58.876569 tst ping.py: using RAC 124 07:45:58.998759 tst ping.py: using CellId 26899 07:45:59.120312 tst ping.py: using BVCI 26900 07:45:59.232420 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:59.243705 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:59.254765 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:59.265815 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:59.276705 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:59.287869 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:59.298985 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:45:59.310080 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:45:59.422555 tst ping.py:19: start network... 07:45:59.616231 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:46:00.064789 run create_hlr_db(pid=12947): Launched 07:46:00.176917 bus /gobi_6: Setting Powered False 07:46:01.234752 run create_hlr_db(pid=12947): Terminated: ok {rc=0} 07:46:01.672876 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12949): Launched 07:46:01.981808 run osmo-hlr_10.42.42.2(pid=12950): Launched 07:46:02.215279 run osmo-stp_10.42.42.5: Starting osmo-stp 07:46:02.779507 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12952): Launched 07:46:03.069548 run osmo-stp_10.42.42.5(pid=12953): Launched 07:46:03.179994 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:46:03.679527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12955): Launched 07:46:03.790676 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:46:04.035628 run patchelf(pid=12956): Launched 07:46:04.197386 run osmo-stp_10.42.42.5(pid=12953): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12953)] 07:46:04.320136 run osmo-stp_10.42.42.5(pid=12953): stdout: | (launched: 2022-12-10_07:46:03.015736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:04.445185 run osmo-stp_10.42.42.5(pid=12953): stderr: | [0;m[38;5;43m20221210074603186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074603186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074603187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074603187 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074603188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074603188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074603188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:04.569832 run osmo-stp_10.42.42.5(pid=12953): stdout: | (launched: 2022-12-10_07:46:03.015736) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:04.688486 run osmo-stp_10.42.42.5(pid=12953): stderr: | [0;m[38;5;43m20221210074603186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074603186 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074603187 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074603187 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074603188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074603188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074603188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:04.829765 run patchelf(pid=12956): Terminating (SIGINT) 07:46:04.993949 run patchelf(pid=12956): Terminated: ok {rc=0} 07:46:05.112266 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=12953): Process ended prematurely: osmo-stp_10.42.42.5(pid=12953) [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12953)] [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22] 07:46:05.121006 tst ping.py:22: Test FAILED (6.4 sec) 07:46:05.148064 run osmo-hlr_10.42.42.2(pid=12950): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12950)] 07:46:05.195409 run osmo-hlr_10.42.42.2(pid=12950): stdout: | (launched: 2022-12-10_07:46:01.920116) 07:46:05.244596 run osmo-hlr_10.42.42.2(pid=12950): stderr: | [0;m[1;31m20221210074602260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074602260 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074602269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074602269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074602269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074602269 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074602286 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074602295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074602295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074602295 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:46:05.294225 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12949): Terminating (SIGTERM) 07:46:05.333959 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12952): Terminating (SIGTERM) 07:46:05.373602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12955): Terminating (SIGTERM) 07:46:05.413743 --- ParallelTerminationStrategy: PID 12949 died... 07:46:05.432714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12949): Terminated: ok {rc=0} 07:46:05.477452 --- ParallelTerminationStrategy: PID 12952 died... 07:46:05.496079 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12952): Terminated: ok {rc=0} 07:46:05.540484 --- ParallelTerminationStrategy: PID 12955 died... 07:46:05.559279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12955): Terminated: ok {rc=0} 07:46:05.644340 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 07:46:06.732907 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:06.744827 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:46:06.816051 tst ping_idle_ping.py: using LAC 26900 07:46:06.930850 tst ping_idle_ping.py: using RAC 125 07:46:07.055116 tst ping_idle_ping.py: using CellId 26900 07:46:07.169705 tst ping_idle_ping.py: using BVCI 26901 07:46:07.284355 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:07.295787 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:07.307152 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:07.318889 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:07.330243 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:07.341573 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:07.352724 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:46:07.364098 tst gprs:trx-lms+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:46:07.478026 tst ping_idle_ping.py:24: start network... 07:46:07.671832 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:46:08.124197 run create_hlr_db(pid=12957): Launched 07:46:08.237492 bus /gobi_6: Setting Powered False 07:46:09.296572 run create_hlr_db(pid=12957): Terminated: ok {rc=0} 07:46:09.724099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12959): Launched 07:46:10.036250 run osmo-hlr_10.42.42.2(pid=12960): Launched 07:46:10.155732 run osmo-stp_10.42.42.5: Starting osmo-stp 07:46:10.692365 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12962): Launched 07:46:11.003529 run osmo-stp_10.42.42.5(pid=12963): Launched 07:46:11.123322 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:46:11.660872 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12965): Launched 07:46:11.779702 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:46:12.043769 run patchelf(pid=12966): Launched 07:46:12.217227 run osmo-stp_10.42.42.5(pid=12963): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12963)] 07:46:12.348769 run osmo-stp_10.42.42.5(pid=12963): stdout: | (launched: 2022-12-10_07:46:10.946569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:12.482766 run osmo-stp_10.42.42.5(pid=12963): stderr: | [0;m[38;5;43m20221210074611136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074611136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074611136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074611136 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074611137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074611137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074611137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:12.616121 run osmo-stp_10.42.42.5(pid=12963): stdout: | (launched: 2022-12-10_07:46:10.946569) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:12.743855 run osmo-stp_10.42.42.5(pid=12963): stderr: | [0;m[38;5;43m20221210074611136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074611136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074611136 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074611136 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074611137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074611137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074611137 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:12.895633 run patchelf(pid=12966): Terminating (SIGINT) 07:46:13.070995 run patchelf(pid=12966): Terminated: ok {rc=0} 07:46:13.197170 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=12963): Process ended prematurely: osmo-stp_10.42.42.5(pid=12963) [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12963)] [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 07:46:13.206629 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 07:46:13.234966 run osmo-hlr_10.42.42.2(pid=12960): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12960)] 07:46:13.285185 run osmo-hlr_10.42.42.2(pid=12960): stdout: | (launched: 2022-12-10_07:46:09.979211) 07:46:13.337207 run osmo-hlr_10.42.42.2(pid=12960): stderr: | [0;m[1;31m20221210074610176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074610176 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074610177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074610177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074610177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074610177 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074610189 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074610197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074610197 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074610198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:46:13.389484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12959): Terminating (SIGTERM) 07:46:13.431956 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12962): Terminating (SIGTERM) 07:46:13.474658 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12965): Terminating (SIGTERM) 07:46:13.517363 --- ParallelTerminationStrategy: PID 12959 died... 07:46:13.537664 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12959): Terminated: ok {rc=0} 07:46:13.584900 --- ParallelTerminationStrategy: PID 12962 died... 07:46:13.604817 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12962): Terminated: ok {rc=0} 07:46:13.651478 --- ParallelTerminationStrategy: PID 12965 died... 07:46:13.671119 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12965): Terminated: ok {rc=0} 07:46:13.758060 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-lms+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:46:15.058064 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:46:15.066507 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:46:15.099971 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 07:46:15.135117 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:46:15.188893 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:46:15.222551 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 07:46:15.257295 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:46:15.815772 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2371 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 07:46:15.821291 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:46:15.838795 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:46:15.933887 tst switch_tch_pdch.py: using LAC 26901 07:46:16.078456 tst switch_tch_pdch.py: using RAC 126 07:46:16.198335 tst switch_tch_pdch.py: using CellId 26901 07:46:16.358182 tst switch_tch_pdch.py: using BVCI 26902 07:46:16.474352 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:46:16.487058 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:46:16.499380 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:46:16.511511 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:46:16.523894 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:46:16.536044 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:46:16.548328 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:46:16.561201 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:46:16.698057 tst dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:46:16.830938 tst switch_tch_pdch.py:51: start network... 07:46:17.058705 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:46:17.553749 run create_hlr_db(pid=12970): Launched 07:46:17.682428 bus /gobi_6: Setting Powered False 07:46:18.744900 run create_hlr_db(pid=12970): Terminated: ok {rc=0} 07:46:19.162274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12972): Launched 07:46:19.452421 run osmo-hlr_10.42.42.2(pid=12973): Launched 07:46:19.564102 run osmo-stp_10.42.42.5: Starting osmo-stp 07:46:20.077489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12975): Launched 07:46:20.368225 run osmo-stp_10.42.42.5(pid=12976): Launched 07:46:20.480029 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:46:20.981709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12978): Launched 07:46:21.092679 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:46:21.337236 run patchelf(pid=12979): Launched 07:46:21.499346 run osmo-stp_10.42.42.5(pid=12976): ERR: Terminated: ERROR {rc=1} [trial-2371↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12976)] 07:46:21.622359 run osmo-stp_10.42.42.5(pid=12976): stdout: | (launched: 2022-12-10_07:46:20.314748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:21.746898 run osmo-stp_10.42.42.5(pid=12976): stderr: | [0;m[38;5;43m20221210074620482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074620482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074620482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074620483 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074620483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074620483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074620483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:21.871224 run osmo-stp_10.42.42.5(pid=12976): stdout: | (launched: 2022-12-10_07:46:20.314748) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:21.990479 run osmo-stp_10.42.42.5(pid=12976): stderr: | [0;m[38;5;43m20221210074620482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074620482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074620482 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074620483 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074620483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074620483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074620483 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:22.131521 run patchelf(pid=12979): Terminating (SIGINT) 07:46:22.295171 run patchelf(pid=12979): Terminated: ok {rc=0} 07:46:22.413094 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12976): Process ended prematurely: osmo-stp_10.42.42.5(pid=12976) [trial-2371↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12976)] [trial-2371↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 07:46:22.421836 tst switch_tch_pdch.py:54: Test FAILED (6.6 sec) 07:46:22.448795 run osmo-hlr_10.42.42.2(pid=12973): ERR: Terminated: ERROR {rc=237} [trial-2371↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12973)] 07:46:22.496244 run osmo-hlr_10.42.42.2(pid=12973): stdout: | (launched: 2022-12-10_07:46:19.398739) 07:46:22.545522 run osmo-hlr_10.42.42.2(pid=12973): stderr: | [0;m[1;31m20221210074619574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074619574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074619574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074619574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074619574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074619574 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074619589 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074619597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074619598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074619598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:46:22.595080 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12972): Terminating (SIGTERM) 07:46:22.634829 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12975): Terminating (SIGTERM) 07:46:22.674646 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12978): Terminating (SIGTERM) 07:46:22.714635 --- ParallelTerminationStrategy: PID 12972 died... 07:46:22.733661 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12972): Terminated: ok {rc=0} 07:46:22.777728 --- ParallelTerminationStrategy: PID 12975 died... 07:46:22.796219 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12975): Terminated: ok {rc=0} 07:46:22.840290 --- ParallelTerminationStrategy: PID 12978 died... 07:46:22.859016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12978): Terminated: ok {rc=0} 07:46:22.943341 bus /gobi_0: Setting Powered False 07:46:24.041526 bus /gobi_0: Setting Powered False 07:46:25.158427 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 dynts:trx-lms+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 07:46:26.414087 tst dynts:trx-lms+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:46:26.420324 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 07:46:26.453911 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 07:46:26.488739 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 07:46:26.543189 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 07:46:26.576914 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 07:46:26.612045 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 07:46:27.166074 tst dynts:trx-lms+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2371 dynts:trx-lms+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 07:46:27.171336 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:46:27.182575 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 07:46:27.253286 tst switch_tch_pdch.py: using LAC 26902 07:46:27.374912 tst switch_tch_pdch.py: using RAC 127 07:46:27.496651 tst switch_tch_pdch.py: using CellId 26902 07:46:27.618555 tst switch_tch_pdch.py: using BVCI 26903 07:46:27.731273 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:46:27.742569 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:46:27.753739 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:46:27.764758 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:46:27.775722 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:46:27.786821 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:46:27.797977 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:46:27.809013 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:46:27.923766 tst dynts:trx-lms+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:46:28.038699 tst switch_tch_pdch.py:51: start network... 07:46:28.233065 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:46:28.657366 run create_hlr_db(pid=12985): Launched 07:46:28.769561 bus /gobi_6: Setting Powered False 07:46:29.828465 run create_hlr_db(pid=12985): Terminated: ok {rc=0} 07:46:30.227202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12987): Launched 07:46:30.538879 run osmo-hlr_10.42.42.2(pid=12988): Launched 07:46:30.659318 run osmo-stp_10.42.42.5: Starting osmo-stp 07:46:31.187511 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12990): Launched 07:46:31.510226 run osmo-stp_10.42.42.5(pid=12991): Launched 07:46:31.761715 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:46:32.309915 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12993): Launched 07:46:32.427415 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:46:32.686383 run patchelf(pid=12994): Launched 07:46:32.856811 run osmo-stp_10.42.42.5(pid=12991): ERR: Terminated: ERROR {rc=1} [trial-2371↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12991)] 07:46:32.986927 run osmo-stp_10.42.42.5(pid=12991): stdout: | (launched: 2022-12-10_07:46:31.448942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:33.118230 run osmo-stp_10.42.42.5(pid=12991): stderr: | [0;m[38;5;43m20221210074631690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074631690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074631690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074631691 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074631691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074631691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074631691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:33.249367 run osmo-stp_10.42.42.5(pid=12991): stdout: | (launched: 2022-12-10_07:46:31.448942) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:33.374727 run osmo-stp_10.42.42.5(pid=12991): stderr: | [0;m[38;5;43m20221210074631690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074631690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074631690 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074631691 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074631691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074631691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074631691 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:33.524095 run patchelf(pid=12994): Terminating (SIGINT) 07:46:33.697484 run patchelf(pid=12994): Terminated: ok {rc=0} 07:46:33.822350 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=12991): Process ended prematurely: osmo-stp_10.42.42.5(pid=12991) [trial-2371↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12991)] [trial-2371↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 07:46:33.831545 tst switch_tch_pdch.py:54: Test FAILED (6.7 sec) 07:46:33.859007 run osmo-hlr_10.42.42.2(pid=12988): ERR: Terminated: ERROR {rc=237} [trial-2371↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=12988)] 07:46:33.907917 run osmo-hlr_10.42.42.2(pid=12988): stdout: | (launched: 2022-12-10_07:46:30.482258) 07:46:33.958619 run osmo-hlr_10.42.42.2(pid=12988): stderr: | [0;m[1;31m20221210074630678 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074630679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074630679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074630679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074630679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074630679 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074630691 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/dynts:trx-lms+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074630700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074630700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074630700 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:46:34.009934 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12987): Terminating (SIGTERM) 07:46:34.050875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12990): Terminating (SIGTERM) 07:46:34.092000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12993): Terminating (SIGTERM) 07:46:34.133523 --- ParallelTerminationStrategy: PID 12987 died... 07:46:34.153089 run pcap-recorder_any(filters='host 10.42.42.2')(pid=12987): Terminated: ok {rc=0} 07:46:34.198424 --- ParallelTerminationStrategy: PID 12990 died... 07:46:34.217696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=12990): Terminated: ok {rc=0} 07:46:34.263174 --- ParallelTerminationStrategy: PID 12993 died... 07:46:34.282531 run pcap-recorder_any(filters='host 10.42.42.6')(pid=12993): Terminated: ok {rc=0} 07:46:34.369391 bus /gobi_0: Setting Powered False 07:46:35.468413 bus /gobi_0: Setting Powered False 07:46:36.584772 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 dynts:trx-lms+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 nitb_sms:trx-lms-limenet-micro --------------------------------------------------------------------- 07:46:37.841825 tst nitb_sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:46:37.845599 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 07:46:37.876621 tst nitb_sms:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 07:46:37.883643 tst nitb_sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 07:46:37.934485 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 07:46:37.963095 tst nitb_sms:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 07:46:37.969675 tst nitb_sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 07:46:38.507147 tst nitb_sms:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_sms: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 nitb_sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 07:46:38.511907 tst nitb_sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 07:46:38.522713 tst nitb_sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:46:38.565849 tst mo_mt_sms.py: using LAC 26903 07:46:38.679800 tst mo_mt_sms.py: using RAC 128 07:46:38.791665 tst mo_mt_sms.py: using CellId 26903 07:46:38.906231 tst mo_mt_sms.py: using BVCI 26904 07:46:39.010609 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 07:46:39.126089 tst nitb_sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 07:46:39.241069 tst mo_mt_sms.py:9: start nitb and bts... 07:46:39.448207 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:46:40.072939 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13001): Launched 07:46:40.378112 run osmo-nitb_10.42.42.2(pid=13002): Launched 07:46:40.548866 run osmo-nitb_10.42.42.2(pid=13002): ERR: Terminated: ERROR {rc=2} [trial-2371↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13002)] 07:46:40.686525 run osmo-nitb_10.42.42.2(pid=13002): stdout: | (launched: 2022-12-10_07:46:40.322536) 07:46:40.825218 run osmo-nitb_10.42.42.2(pid=13002): stderr: | (launched: 2022-12-10_07:46:40.368032) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:46:40.963964 run osmo-nitb_10.42.42.2(pid=13002): stdout: | (launched: 2022-12-10_07:46:40.322536) 07:46:41.098083 run osmo-nitb_10.42.42.2(pid=13002): stderr: | (launched: 2022-12-10_07:46:40.368032) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f5483dba268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13002): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13002) [trial-2371↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13002)] 07:46:41.495131 tst osmo-nitb_10.42.42.2(pid=13002): stdout: | (launched: 2022-12-10_07:46:40.322536) 07:46:41.619263 tst osmo-nitb_10.42.42.2(pid=13002): stderr: | (launched: 2022-12-10_07:46:40.368032) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:46:41.765153 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=13002): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13002) [trial-2371↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13002)] [trial-2371↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11] 07:46:41.773847 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 07:46:41.780579 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13001): Terminating (SIGTERM) 07:46:41.990639 --- ParallelTerminationStrategy: PID 13001 died... 07:46:42.012139 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13001): Terminated: ok {rc=0} 07:46:42.099344 bus /sierra_3: Setting Powered False 07:46:43.199661 bus /sierra_3: Setting Powered False 07:46:44.313190 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 nitb_sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 sms:trx-lms-limenet-micro --------------------------------------------------------------------- 07:46:45.499518 tst sms:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:46:45.503732 tst sms:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 07:46:45.533166 tst sms:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 07:46:45.558964 tst sms:trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 07:46:45.614418 tst sms:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 07:46:45.644180 tst sms:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 07:46:45.670560 tst sms:trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 07:46:46.216264 tst sms:trx-lms-limenet-micro: RESERVED RESOURCES for sms: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 sms:trx-lms-limenet-micro mo_mt_sms.py ---------------------------------------------- 07:46:46.224069 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:46:46.239054 tst sms:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:46:46.294548 tst mo_mt_sms.py: using LAC 26904 07:46:46.419878 tst mo_mt_sms.py: using RAC 129 07:46:46.580634 tst mo_mt_sms.py: using CellId 26904 07:46:46.743487 tst mo_mt_sms.py: using BVCI 26905 07:46:46.864535 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:46:46.876389 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:46:46.888007 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:46:46.900249 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:46:46.914050 tst sms:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:46:46.927256 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 07:46:47.043722 tst sms:trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 07:46:47.182614 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:46:47.661224 run create_hlr_db(pid=13006): Launched 07:46:47.786754 bus /sierra_2: Setting Powered False 07:46:48.848355 run create_hlr_db(pid=13006): Terminated: ok {rc=0} 07:46:49.259354 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13008): Launched 07:46:49.544291 run osmo-hlr_10.42.42.2(pid=13009): Launched 07:46:49.654250 run osmo-stp_10.42.42.5: Starting osmo-stp 07:46:50.156445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13011): Launched 07:46:50.441324 run osmo-stp_10.42.42.5(pid=13012): Launched 07:46:50.550385 run osmo-msc_10.42.42.6: Starting osmo-msc 07:46:51.070412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13014): Launched 07:46:51.357132 run osmo-msc_10.42.42.6(pid=13015): Launched 07:46:51.518130 run osmo-stp_10.42.42.5(pid=13012): ERR: Terminated: ERROR {rc=1} [trial-2371↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13012)] 07:46:51.639984 run osmo-stp_10.42.42.5(pid=13012): stdout: | (launched: 2022-12-10_07:46:50.388878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:51.762259 run osmo-stp_10.42.42.5(pid=13012): stderr: | [0;m[38;5;43m20221210074650559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074650559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074650559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074650559 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074650560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074650560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074650560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:51.881876 run osmo-stp_10.42.42.5(pid=13012): stdout: | (launched: 2022-12-10_07:46:50.388878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:46:51.996130 run osmo-stp_10.42.42.5(pid=13012): stderr: | [0;m[38;5;43m20221210074650559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074650559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074650559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074650559 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074650560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074650560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074650560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:46:52.132619 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=13012): Process ended prematurely: osmo-stp_10.42.42.5(pid=13012) [trial-2371↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13012)] [trial-2371↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16] 07:46:52.140691 tst mo_mt_sms.py:16: Test FAILED (5.9 sec) 07:46:52.166825 run osmo-hlr_10.42.42.2(pid=13009): ERR: Terminated: ERROR {rc=237} [trial-2371↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13009)] 07:46:52.214724 run osmo-hlr_10.42.42.2(pid=13009): stdout: | (launched: 2022-12-10_07:46:49.491791) 07:46:52.264097 run osmo-hlr_10.42.42.2(pid=13009): stderr: | [0;m[1;31m20221210074649666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074649666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074649666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074649666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074649666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074649666 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074649679 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/sms:trx-lms-limenet-micro/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074649689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074649689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074649689 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:46:52.332742 run osmo-msc_10.42.42.6(pid=13015): ERR: Terminated: ERROR {rc=2} [trial-2371↪sms:trx-lms-limenet-micro↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13015)] 07:46:52.380305 run osmo-msc_10.42.42.6(pid=13015): stdout: | (launched: 2022-12-10_07:46:51.304403) 07:46:52.429518 run osmo-msc_10.42.42.6(pid=13015): stderr: | [0;m[38;5;43m20221210074651574 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074651574 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff60f79ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074651574 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074651575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074651575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074651575 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074651577 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074651577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074651577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074651577 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:46:52.479143 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13008): Terminating (SIGTERM) 07:46:52.518730 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13011): Terminating (SIGTERM) 07:46:52.558091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13014): Terminating (SIGTERM) 07:46:52.597971 --- ParallelTerminationStrategy: PID 13008 died... 07:46:52.617014 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13008): Terminated: ok {rc=0} 07:46:52.661562 --- ParallelTerminationStrategy: PID 13011 died... 07:46:52.679967 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13011): Terminated: ok {rc=0} 07:46:52.724285 --- ParallelTerminationStrategy: PID 13014 died... 07:46:52.742888 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13014): Terminated: ok {rc=0} 07:46:52.831117 bus /sierra_3: Setting Powered False 07:46:53.930879 bus /sierra_3: Setting Powered False 07:46:55.043957 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 sms:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 nitb_ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 07:46:56.274457 tst nitb_ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:46:56.278952 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 07:46:56.309217 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x ip_address (candidates: 9) 07:46:56.316790 tst nitb_ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 07:46:56.349942 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 07:46:56.378888 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x ip_address (candidates: 9) 07:46:56.385513 tst nitb_ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 07:46:56.906031 tst nitb_ussd:trx-lms-limenet-micro: RESERVED RESOURCES for nitb_ussd: bts LimeNET-Micro ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2371 nitb_ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 07:46:56.911098 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 1) 07:46:56.921944 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:46:56.966402 tst assert_extension.py: using LAC 26905 07:46:57.078987 tst assert_extension.py: using RAC 130 07:46:57.190520 tst assert_extension.py: using CellId 26905 07:46:57.303624 tst assert_extension.py: using BVCI 26906 07:46:57.407381 tst nitb_ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 07:46:57.522522 tst assert_extension.py:10: start nitb and bts... 07:46:57.729109 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:46:58.356715 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13020): Launched 07:46:58.662927 run osmo-nitb_10.42.42.2(pid=13021): Launched 07:46:58.832759 run osmo-nitb_10.42.42.2(pid=13021): ERR: Terminated: ERROR {rc=2} [trial-2371↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13021)] 07:46:58.971039 run osmo-nitb_10.42.42.2(pid=13021): stdout: | (launched: 2022-12-10_07:46:58.607458) 07:46:59.111063 run osmo-nitb_10.42.42.2(pid=13021): stderr: | (launched: 2022-12-10_07:46:58.652924) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:46:59.251183 run osmo-nitb_10.42.42.2(pid=13021): stdout: | (launched: 2022-12-10_07:46:58.607458) 07:46:59.385780 run osmo-nitb_10.42.42.2(pid=13021): stderr: | (launched: 2022-12-10_07:46:58.652924) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f5483dba268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13021): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13021) [trial-2371↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13021)] 07:46:59.778419 tst osmo-nitb_10.42.42.2(pid=13021): stdout: | (launched: 2022-12-10_07:46:58.607458) 07:46:59.902349 tst osmo-nitb_10.42.42.2(pid=13021): stderr: | (launched: 2022-12-10_07:46:58.652924) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:47:00.048266 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=13021): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13021) [trial-2371↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13021)] [trial-2371↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12] 07:47:00.057068 tst assert_extension.py:12: Test FAILED (3.1 sec) 07:47:00.063910 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13020): Terminating (SIGTERM) 07:47:00.273905 --- ParallelTerminationStrategy: PID 13020 died... 07:47:00.295609 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13020): Terminated: ok {rc=0} 07:47:00.381947 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 nitb_ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 ussd:trx-lms-limenet-micro --------------------------------------------------------------------- 07:47:01.576184 tst ussd:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:47:01.581270 tst ussd:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 07:47:01.612464 tst ussd:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 07:47:01.641223 tst ussd:trx-lms-limenet-micro: Verifying 1 x modem (candidates: 12) 07:47:01.678211 tst ussd:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 07:47:01.713718 tst ussd:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 07:47:01.746959 tst ussd:trx-lms-limenet-micro: Reserving 1 x modem (candidates: 12) 07:47:02.262024 tst ussd:trx-lms-limenet-micro: RESERVED RESOURCES for ussd: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2371 ussd:trx-lms-limenet-micro assert_extension.py ---------------------------------------------- 07:47:02.267858 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:47:02.279278 tst ussd:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:47:02.325495 tst assert_extension.py: using LAC 26906 07:47:02.448458 tst assert_extension.py: using RAC 131 07:47:02.573456 tst assert_extension.py: using CellId 26906 07:47:02.688909 tst assert_extension.py: using BVCI 26907 07:47:02.792875 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:47:02.803600 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:47:02.814178 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:47:02.825326 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:47:02.836020 tst ussd:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:47:02.846965 tst ussd:trx-lms-limenet-micro: Using 1 x modem (candidates: 1) 07:47:02.958369 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:47:03.401732 run create_hlr_db(pid=13025): Launched 07:47:03.510738 bus /sierra_2: Setting Powered False 07:47:04.567796 run create_hlr_db(pid=13025): Terminated: ok {rc=0} 07:47:04.988672 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13027): Launched 07:47:05.295837 run osmo-hlr_10.42.42.2(pid=13028): Launched 07:47:05.413884 run osmo-stp_10.42.42.5: Starting osmo-stp 07:47:05.947767 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13030): Launched 07:47:06.254680 run osmo-stp_10.42.42.5(pid=13031): Launched 07:47:06.372395 run osmo-msc_10.42.42.6: Starting osmo-msc 07:47:06.925881 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13033): Launched 07:47:07.231680 run osmo-msc_10.42.42.6(pid=13034): Launched 07:47:07.403204 run osmo-stp_10.42.42.5(pid=13031): ERR: Terminated: ERROR {rc=1} [trial-2371↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13031)] 07:47:07.533871 run osmo-stp_10.42.42.5(pid=13031): stdout: | (launched: 2022-12-10_07:47:06.198913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:07.664193 run osmo-stp_10.42.42.5(pid=13031): stderr: | [0;m[38;5;43m20221210074706387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074706387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074706387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074706388 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074706388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074706388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074706389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:07.793426 run osmo-stp_10.42.42.5(pid=13031): stdout: | (launched: 2022-12-10_07:47:06.198913) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:07.915396 run osmo-stp_10.42.42.5(pid=13031): stderr: | [0;m[38;5;43m20221210074706387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074706387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074706387 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074706388 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074706388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074706388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074706389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:08.061594 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=13031): Process ended prematurely: osmo-stp_10.42.42.5(pid=13031) [trial-2371↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13031)] [trial-2371↪ussd:trx-lms-limenet-micro↪assert_extension.py:17] 07:47:08.070264 tst assert_extension.py:17: Test FAILED (5.8 sec) 07:47:08.097244 run osmo-hlr_10.42.42.2(pid=13028): ERR: Terminated: ERROR {rc=237} [trial-2371↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13028)] 07:47:08.146300 run osmo-hlr_10.42.42.2(pid=13028): stdout: | (launched: 2022-12-10_07:47:05.240114) 07:47:08.197144 run osmo-hlr_10.42.42.2(pid=13028): stderr: | [0;m[1;31m20221210074705438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074705438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074705438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074705438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074705438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074705438 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074705450 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/ussd:trx-lms-limenet-micro/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074705458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074705458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074705458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:47:08.268013 run osmo-msc_10.42.42.6(pid=13034): ERR: Terminated: ERROR {rc=2} [trial-2371↪ussd:trx-lms-limenet-micro↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13034)] 07:47:08.317131 run osmo-msc_10.42.42.6(pid=13034): stdout: | (launched: 2022-12-10_07:47:07.175675) 07:47:08.367969 run osmo-msc_10.42.42.6(pid=13034): stderr: | [0;m[38;5;43m20221210074707494 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074707494 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4d17228c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074707494 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074707494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074707495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074707495 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074707496 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074707497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074707497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074707497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:47:08.419025 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13027): Terminating (SIGTERM) 07:47:08.460582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13030): Terminating (SIGTERM) 07:47:08.501902 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13033): Terminating (SIGTERM) 07:47:08.543771 --- ParallelTerminationStrategy: PID 13027 died... 07:47:08.563626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13027): Terminated: ok {rc=0} 07:47:08.609240 --- ParallelTerminationStrategy: PID 13030 died... 07:47:08.628527 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13030): Terminated: ok {rc=0} 07:47:08.673926 --- ParallelTerminationStrategy: PID 13033 died... 07:47:08.693351 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13033): Terminated: ok {rc=0} 07:47:08.779820 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 ussd:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 07:47:09.984195 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:47:09.990991 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 07:47:10.020590 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 07:47:10.047417 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 07:47:10.099763 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 07:47:10.129333 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 07:47:10.156025 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 07:47:10.709350 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 07:47:10.760023 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:47:10.771502 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:47:10.837381 tst mo_mt_call.py: using LAC 26907 07:47:10.961434 tst mo_mt_call.py: using RAC 132 07:47:11.084125 tst mo_mt_call.py: using CellId 26907 07:47:11.206552 tst mo_mt_call.py: using BVCI 26908 07:47:11.319965 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:47:11.331414 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:47:11.342744 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:47:11.354048 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:47:11.365459 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:47:11.376632 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:47:11.490032 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:47:11.610139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:47:12.061637 run create_hlr_db(pid=13039): Launched 07:47:12.173587 bus /sierra_2: Setting Powered False 07:47:13.232369 run create_hlr_db(pid=13039): Terminated: ok {rc=0} 07:47:13.661769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13041): Launched 07:47:13.975816 run osmo-hlr_10.42.42.2(pid=13042): Launched 07:47:14.096570 run osmo-stp_10.42.42.5: Starting osmo-stp 07:47:14.641404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13044): Launched 07:47:14.954524 run osmo-stp_10.42.42.5(pid=13045): Launched 07:47:15.074654 run osmo-msc_10.42.42.6: Starting osmo-msc 07:47:15.641054 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13047): Launched 07:47:15.973643 run osmo-msc_10.42.42.6(pid=13048): Launched 07:47:16.263603 run osmo-stp_10.42.42.5(pid=13045): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13045)] 07:47:16.465663 run osmo-stp_10.42.42.5(pid=13045): stdout: | (launched: 2022-12-10_07:47:14.897844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:16.664428 run osmo-stp_10.42.42.5(pid=13045): stderr: | [0;m[38;5;43m20221210074715088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074715088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074715088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074715089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074715089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074715089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074715089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:16.807498 run osmo-stp_10.42.42.5(pid=13045): stdout: | (launched: 2022-12-10_07:47:14.897844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:16.931852 run osmo-stp_10.42.42.5(pid=13045): stderr: | [0;m[38;5;43m20221210074715088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074715088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074715088 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074715089 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074715089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074715089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074715089 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:17.077739 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13045): Process ended prematurely: osmo-stp_10.42.42.5(pid=13045) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13045)] [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:47:17.087536 tst mo_mt_call.py:8: Test FAILED (6.4 sec) 07:47:17.119092 run osmo-hlr_10.42.42.2(pid=13042): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13042)] 07:47:17.169965 run osmo-hlr_10.42.42.2(pid=13042): stdout: | (launched: 2022-12-10_07:47:13.918874) 07:47:17.221868 run osmo-hlr_10.42.42.2(pid=13042): stderr: | [0;m[1;31m20221210074714118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074714118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074714118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074714118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074714118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074714118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074714131 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074714140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074714140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074714140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:47:17.293498 run osmo-msc_10.42.42.6(pid=13048): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13048)] 07:47:17.344782 run osmo-msc_10.42.42.6(pid=13048): stdout: | (launched: 2022-12-10_07:47:15.898286) 07:47:17.396115 run osmo-msc_10.42.42.6(pid=13048): stderr: | [0;m[38;5;43m20221210074716495 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074716495 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f83adf80c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074716495 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074716496 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074716497 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074716498 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074716500 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074716501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074716501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074716501 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:47:17.448714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13041): Terminating (SIGTERM) 07:47:17.489665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13044): Terminating (SIGTERM) 07:47:17.530035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13047): Terminating (SIGTERM) 07:47:17.570571 --- ParallelTerminationStrategy: PID 13041 died... 07:47:17.589408 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13041): Terminated: ok {rc=0} 07:47:17.635017 --- ParallelTerminationStrategy: PID 13044 died... 07:47:17.653894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13044): Terminated: ok {rc=0} 07:47:17.699110 --- ParallelTerminationStrategy: PID 13047 died... 07:47:17.717867 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13047): Terminated: ok {rc=0} 07:47:17.804441 bus /sierra_3: Setting Powered False 07:47:18.903073 bus /sierra_3: Setting Powered False 07:47:20.018659 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:47:21.162274 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:47:21.174098 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:47:21.239540 tst mo_mt_call_osmux.py: using LAC 26908 07:47:21.365242 tst mo_mt_call_osmux.py: using RAC 133 07:47:21.490582 tst mo_mt_call_osmux.py: using CellId 26908 07:47:21.614585 tst mo_mt_call_osmux.py: using BVCI 26909 07:47:21.728653 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:47:21.740238 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:47:21.751810 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:47:21.763700 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:47:21.775671 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:47:21.787498 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:47:21.909341 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:47:22.025722 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:47:22.479060 run create_hlr_db(pid=13050): Launched 07:47:22.591671 bus /sierra_2: Setting Powered False 07:47:23.650392 run create_hlr_db(pid=13050): Terminated: ok {rc=0} 07:47:24.080087 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13052): Launched 07:47:24.393413 run osmo-hlr_10.42.42.2(pid=13053): Launched 07:47:24.514098 run osmo-stp_10.42.42.5: Starting osmo-stp 07:47:25.032892 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13055): Launched 07:47:25.324775 run osmo-stp_10.42.42.5(pid=13056): Launched 07:47:25.437745 run osmo-msc_10.42.42.6: Starting osmo-msc 07:47:25.969209 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13058): Launched 07:47:26.283700 run osmo-msc_10.42.42.6(pid=13059): Launched 07:47:26.458878 run osmo-stp_10.42.42.5(pid=13056): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13056)] 07:47:26.591768 run osmo-stp_10.42.42.5(pid=13056): stdout: | (launched: 2022-12-10_07:47:25.271542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:26.725199 run osmo-stp_10.42.42.5(pid=13056): stderr: | [0;m[38;5;43m20221210074725441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074725441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074725441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074725442 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074725442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074725442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074725442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:26.856493 run osmo-stp_10.42.42.5(pid=13056): stdout: | (launched: 2022-12-10_07:47:25.271542) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:26.981289 run osmo-stp_10.42.42.5(pid=13056): stderr: | [0;m[38;5;43m20221210074725441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074725441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074725441 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074725442 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074725442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074725442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074725442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:27.130699 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13056): Process ended prematurely: osmo-stp_10.42.42.5(pid=13056) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13056)] [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:47:27.139993 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 07:47:27.167558 run osmo-hlr_10.42.42.2(pid=13053): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13053)] 07:47:27.216545 run osmo-hlr_10.42.42.2(pid=13053): stdout: | (launched: 2022-12-10_07:47:24.336549) 07:47:27.267450 run osmo-hlr_10.42.42.2(pid=13053): stderr: | [0;m[1;31m20221210074724533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074724533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074724533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074724533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074724533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074724533 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074724546 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074724554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074724554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074724554 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:47:27.338685 run osmo-msc_10.42.42.6(pid=13059): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13059)] 07:47:27.388248 run osmo-msc_10.42.42.6(pid=13059): stdout: | (launched: 2022-12-10_07:47:26.226936) 07:47:27.439483 run osmo-msc_10.42.42.6(pid=13059): stderr: | [0;m[38;5;43m20221210074726549 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074726549 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f427309ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074726550 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074726550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074726550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074726550 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074726552 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074726552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074726552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074726552 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:47:27.490748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13052): Terminating (SIGTERM) 07:47:27.531964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13055): Terminating (SIGTERM) 07:47:27.573735 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13058): Terminating (SIGTERM) 07:47:27.615490 --- ParallelTerminationStrategy: PID 13052 died... 07:47:27.635361 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13052): Terminated: ok {rc=0} 07:47:27.680696 --- ParallelTerminationStrategy: PID 13055 died... 07:47:27.700133 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13055): Terminated: ok {rc=0} 07:47:27.745497 --- ParallelTerminationStrategy: PID 13058 died... 07:47:27.764790 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13058): Terminated: ok {rc=0} 07:47:27.851195 bus /sierra_3: Setting Powered False 07:47:28.949041 bus /sierra_3: Setting Powered False 07:47:30.064146 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:47:31.326462 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:47:31.332655 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:47:31.374272 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:47:31.410116 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:47:31.471770 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:47:31.516756 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:47:31.561178 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:47:32.077670 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:47:32.133444 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:47:32.145718 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:47:32.213072 tst mo_mt_call.py: using LAC 26909 07:47:32.335543 tst mo_mt_call.py: using RAC 134 07:47:32.452558 tst mo_mt_call.py: using CellId 26909 07:47:32.582057 tst mo_mt_call.py: using BVCI 26910 07:47:32.697475 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:47:32.708851 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:47:32.720316 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:47:32.732128 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:47:32.744006 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:47:32.755776 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:47:32.870235 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:47:32.989159 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:47:33.475015 run create_hlr_db(pid=13064): Launched 07:47:33.602892 bus /sierra_2: Setting Powered False 07:47:34.665070 run create_hlr_db(pid=13064): Terminated: ok {rc=0} 07:47:35.082788 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13066): Launched 07:47:35.374649 run osmo-hlr_10.42.42.2(pid=13067): Launched 07:47:35.486156 run osmo-stp_10.42.42.5: Starting osmo-stp 07:47:36.009755 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13069): Launched 07:47:36.323749 run osmo-stp_10.42.42.5(pid=13070): Launched 07:47:36.444556 run osmo-msc_10.42.42.6: Starting osmo-msc 07:47:37.010062 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13072): Launched 07:47:37.323202 run osmo-msc_10.42.42.6(pid=13073): Launched 07:47:37.500540 run osmo-stp_10.42.42.5(pid=13070): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13070)] 07:47:37.632585 run osmo-stp_10.42.42.5(pid=13070): stdout: | (launched: 2022-12-10_07:47:36.267057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:37.765265 run osmo-stp_10.42.42.5(pid=13070): stderr: | [0;m[38;5;43m20221210074736456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074736457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074736457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074736457 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074736458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074736458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074736458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:37.897097 run osmo-stp_10.42.42.5(pid=13070): stdout: | (launched: 2022-12-10_07:47:36.267057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:38.022371 run osmo-stp_10.42.42.5(pid=13070): stderr: | [0;m[38;5;43m20221210074736456 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074736457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074736457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074736457 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074736458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074736458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074736458 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:38.172146 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13070): Process ended prematurely: osmo-stp_10.42.42.5(pid=13070) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13070)] [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:47:38.181479 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:47:38.209182 run osmo-hlr_10.42.42.2(pid=13067): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13067)] 07:47:38.259504 run osmo-hlr_10.42.42.2(pid=13067): stdout: | (launched: 2022-12-10_07:47:35.321368) 07:47:38.311102 run osmo-hlr_10.42.42.2(pid=13067): stderr: | [0;m[1;31m20221210074735494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074735494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074735494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074735494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074735494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074735494 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074735506 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074735518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074735518 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074735519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:47:38.382907 run osmo-msc_10.42.42.6(pid=13073): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13073)] 07:47:38.432709 run osmo-msc_10.42.42.6(pid=13073): stdout: | (launched: 2022-12-10_07:47:37.266400) 07:47:38.484674 run osmo-msc_10.42.42.6(pid=13073): stderr: | [0;m[38;5;43m20221210074737587 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074737587 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc50bedbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074737587 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074737587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074737587 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074737588 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074737589 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074737590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074737590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074737590 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:47:38.536631 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13066): Terminating (SIGTERM) 07:47:38.578412 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13069): Terminating (SIGTERM) 07:47:38.620038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13072): Terminating (SIGTERM) 07:47:38.662123 --- ParallelTerminationStrategy: PID 13066 died... 07:47:38.681924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13066): Terminated: ok {rc=0} 07:47:38.728768 --- ParallelTerminationStrategy: PID 13069 died... 07:47:38.748181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13069): Terminated: ok {rc=0} 07:47:38.794435 --- ParallelTerminationStrategy: PID 13072 died... 07:47:38.813783 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13072): Terminated: ok {rc=0} 07:47:38.901480 bus /sierra_3: Setting Powered False 07:47:39.999361 bus /sierra_3: Setting Powered False 07:47:41.114670 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:47:42.259476 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:47:42.271336 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:47:42.336867 tst mo_mt_call_osmux.py: using LAC 26910 07:47:42.453340 tst mo_mt_call_osmux.py: using RAC 135 07:47:42.568608 tst mo_mt_call_osmux.py: using CellId 26910 07:47:42.683278 tst mo_mt_call_osmux.py: using BVCI 26911 07:47:42.789286 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:47:42.800410 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:47:42.811298 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:47:42.822527 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:47:42.834074 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:47:42.845318 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:47:42.959006 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:47:43.078782 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:47:43.567254 run create_hlr_db(pid=13075): Launched 07:47:43.695791 bus /sierra_2: Setting Powered False 07:47:44.759062 run create_hlr_db(pid=13075): Terminated: ok {rc=0} 07:47:45.196140 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13077): Launched 07:47:45.510194 run osmo-hlr_10.42.42.2(pid=13078): Launched 07:47:45.630128 run osmo-stp_10.42.42.5: Starting osmo-stp 07:47:46.174416 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13080): Launched 07:47:46.500400 run osmo-stp_10.42.42.5(pid=13081): Launched 07:47:46.735046 run osmo-msc_10.42.42.6: Starting osmo-msc 07:47:47.436420 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13083): Launched 07:47:47.730064 run osmo-msc_10.42.42.6(pid=13084): Launched 07:47:47.893922 run osmo-stp_10.42.42.5(pid=13081): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13081)] 07:47:48.017350 run osmo-stp_10.42.42.5(pid=13081): stdout: | (launched: 2022-12-10_07:47:46.429869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:48.141482 run osmo-stp_10.42.42.5(pid=13081): stderr: | [0;m[38;5;43m20221210074746760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074746760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074746761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074746761 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074746761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074746762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074746762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:48.263538 run osmo-stp_10.42.42.5(pid=13081): stdout: | (launched: 2022-12-10_07:47:46.429869) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:48.380549 run osmo-stp_10.42.42.5(pid=13081): stderr: | [0;m[38;5;43m20221210074746760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074746760 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074746761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074746761 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074746761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074746762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074746762 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:48.520320 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13081): Process ended prematurely: osmo-stp_10.42.42.5(pid=13081) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13081)] [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:47:48.529081 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 07:47:48.556575 run osmo-hlr_10.42.42.2(pid=13078): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13078)] 07:47:48.604119 run osmo-hlr_10.42.42.2(pid=13078): stdout: | (launched: 2022-12-10_07:47:45.452924) 07:47:48.653435 run osmo-hlr_10.42.42.2(pid=13078): stderr: | [0;m[1;31m20221210074745653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074745653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074745653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074745653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074745653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074745653 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074745666 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074745677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074745677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074745677 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:47:48.722049 run osmo-msc_10.42.42.6(pid=13084): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13084)] 07:47:48.769144 run osmo-msc_10.42.42.6(pid=13084): stdout: | (launched: 2022-12-10_07:47:47.676393) 07:47:48.818391 run osmo-msc_10.42.42.6(pid=13084): stderr: | [0;m[38;5;43m20221210074747946 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074747946 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f08e33fac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074747946 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074747946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074747946 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074747947 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074747949 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074747949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074747949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074747949 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:47:48.867933 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13077): Terminating (SIGTERM) 07:47:48.907234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13080): Terminating (SIGTERM) 07:47:48.946843 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13083): Terminating (SIGTERM) 07:47:48.986979 --- ParallelTerminationStrategy: PID 13077 died... 07:47:49.006055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13077): Terminated: ok {rc=0} 07:47:49.050689 --- ParallelTerminationStrategy: PID 13080 died... 07:47:49.069443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13080): Terminated: ok {rc=0} 07:47:49.113726 --- ParallelTerminationStrategy: PID 13083 died... 07:47:49.132513 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13083): Terminated: ok {rc=0} 07:47:49.218663 bus /sierra_3: Setting Powered False 07:47:50.317196 bus /sierra_3: Setting Powered False 07:47:51.431728 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:47:52.676180 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:47:52.682556 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:47:52.712228 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:47:52.738323 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:47:52.788865 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:47:52.817860 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:47:52.844111 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:47:53.395841 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:47:53.443660 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:47:53.454913 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:47:53.519289 tst mo_mt_call.py: using LAC 26911 07:47:53.633835 tst mo_mt_call.py: using RAC 136 07:47:53.748744 tst mo_mt_call.py: using CellId 26911 07:47:53.863560 tst mo_mt_call.py: using BVCI 26912 07:47:53.975844 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:47:53.987098 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:47:53.998287 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:47:54.009915 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:47:54.021402 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:47:54.032692 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:47:54.151634 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:47:54.265316 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:47:54.718800 run create_hlr_db(pid=13089): Launched 07:47:54.831644 bus /sierra_2: Setting Powered False 07:47:55.890484 run create_hlr_db(pid=13089): Terminated: ok {rc=0} 07:47:56.299407 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13091): Launched 07:47:56.593219 run osmo-hlr_10.42.42.2(pid=13092): Launched 07:47:56.705486 run osmo-stp_10.42.42.5: Starting osmo-stp 07:47:57.210540 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13094): Launched 07:47:57.502393 run osmo-stp_10.42.42.5(pid=13095): Launched 07:47:57.614320 run osmo-msc_10.42.42.6: Starting osmo-msc 07:47:58.146228 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13097): Launched 07:47:58.439245 run osmo-msc_10.42.42.6(pid=13098): Launched 07:47:58.605125 run osmo-stp_10.42.42.5(pid=13095): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13095)] 07:47:58.730143 run osmo-stp_10.42.42.5(pid=13095): stdout: | (launched: 2022-12-10_07:47:57.448806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:58.855483 run osmo-stp_10.42.42.5(pid=13095): stderr: | [0;m[38;5;43m20221210074757618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074757618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074757618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074757619 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074757619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074757619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074757619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:58.977982 run osmo-stp_10.42.42.5(pid=13095): stdout: | (launched: 2022-12-10_07:47:57.448806) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:47:59.094900 run osmo-stp_10.42.42.5(pid=13095): stderr: | [0;m[38;5;43m20221210074757618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074757618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074757618 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074757619 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074757619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074757619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074757619 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:47:59.235130 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13095): Process ended prematurely: osmo-stp_10.42.42.5(pid=13095) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13095)] [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:47:59.243966 tst mo_mt_call.py:8: Test FAILED (5.8 sec) 07:47:59.271228 run osmo-hlr_10.42.42.2(pid=13092): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13092)] 07:47:59.319281 run osmo-hlr_10.42.42.2(pid=13092): stdout: | (launched: 2022-12-10_07:47:56.539810) 07:47:59.368739 run osmo-hlr_10.42.42.2(pid=13092): stderr: | [0;m[1;31m20221210074756715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074756715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074756715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074756715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074756715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074756715 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074756727 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074756737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074756737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074756737 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:47:59.437980 run osmo-msc_10.42.42.6(pid=13098): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13098)] 07:47:59.485659 run osmo-msc_10.42.42.6(pid=13098): stdout: | (launched: 2022-12-10_07:47:58.385633) 07:47:59.534901 run osmo-msc_10.42.42.6(pid=13098): stderr: | [0;m[38;5;43m20221210074758657 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074758657 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3308c68c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074758657 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074758657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074758657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074758657 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074758659 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074758660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074758660 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074758661 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:47:59.584674 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13091): Terminating (SIGTERM) 07:47:59.624545 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13094): Terminating (SIGTERM) 07:47:59.664732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13097): Terminating (SIGTERM) 07:47:59.705353 --- ParallelTerminationStrategy: PID 13091 died... 07:47:59.724342 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13091): Terminated: ok {rc=0} 07:47:59.769538 --- ParallelTerminationStrategy: PID 13094 died... 07:47:59.788134 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13094): Terminated: ok {rc=0} 07:47:59.833147 --- ParallelTerminationStrategy: PID 13097 died... 07:47:59.851858 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13097): Terminated: ok {rc=0} 07:47:59.937551 bus /sierra_3: Setting Powered False 07:48:01.035966 bus /sierra_3: Setting Powered False 07:48:02.150597 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:48:03.293445 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:48:03.305323 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:48:03.373080 tst mo_mt_call_osmux.py: using LAC 26912 07:48:03.489715 tst mo_mt_call_osmux.py: using RAC 137 07:48:03.612411 tst mo_mt_call_osmux.py: using CellId 26912 07:48:03.734584 tst mo_mt_call_osmux.py: using BVCI 26913 07:48:03.847914 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:48:03.859556 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:48:03.870952 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:48:03.882338 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:48:03.893817 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:48:03.905182 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:48:04.018707 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:48:04.137473 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:48:04.624185 run create_hlr_db(pid=13100): Launched 07:48:04.751784 bus /sierra_2: Setting Powered False 07:48:05.814102 run create_hlr_db(pid=13100): Terminated: ok {rc=0} 07:48:06.251413 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13102): Launched 07:48:06.565120 run osmo-hlr_10.42.42.2(pid=13103): Launched 07:48:06.685087 run osmo-stp_10.42.42.5: Starting osmo-stp 07:48:07.224317 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13105): Launched 07:48:07.538876 run osmo-stp_10.42.42.5(pid=13106): Launched 07:48:07.659070 run osmo-msc_10.42.42.6: Starting osmo-msc 07:48:08.226240 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13108): Launched 07:48:08.539564 run osmo-msc_10.42.42.6(pid=13109): Launched 07:48:08.715407 run osmo-stp_10.42.42.5(pid=13106): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13106)] 07:48:08.847593 run osmo-stp_10.42.42.5(pid=13106): stdout: | (launched: 2022-12-10_07:48:07.481773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:08.980382 run osmo-stp_10.42.42.5(pid=13106): stderr: | [0;m[38;5;43m20221210074807672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074807672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074807672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074807673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074807673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074807673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074807674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:09.112765 run osmo-stp_10.42.42.5(pid=13106): stdout: | (launched: 2022-12-10_07:48:07.481773) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:09.237385 run osmo-stp_10.42.42.5(pid=13106): stderr: | [0;m[38;5;43m20221210074807672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074807672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074807672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074807673 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074807673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074807673 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074807674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:09.386896 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13106): Process ended prematurely: osmo-stp_10.42.42.5(pid=13106) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13106)] [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:48:09.396031 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 07:48:09.423473 run osmo-hlr_10.42.42.2(pid=13103): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13103)] 07:48:09.473209 run osmo-hlr_10.42.42.2(pid=13103): stdout: | (launched: 2022-12-10_07:48:06.508127) 07:48:09.524454 run osmo-hlr_10.42.42.2(pid=13103): stderr: | [0;m[1;31m20221210074806708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074806708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074806708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074806708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074806708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074806708 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074806722 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074806730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074806730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074806730 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:48:09.595956 run osmo-msc_10.42.42.6(pid=13109): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13109)] 07:48:09.645328 run osmo-msc_10.42.42.6(pid=13109): stdout: | (launched: 2022-12-10_07:48:08.482757) 07:48:09.696304 run osmo-msc_10.42.42.6(pid=13109): stderr: | [0;m[38;5;43m20221210074808803 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074808803 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7c301e5c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074808803 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074808804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074808804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074808804 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074808806 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074808806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074808806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074808806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:48:09.748217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13102): Terminating (SIGTERM) 07:48:09.789455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13105): Terminating (SIGTERM) 07:48:09.830563 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13108): Terminating (SIGTERM) 07:48:09.871954 --- ParallelTerminationStrategy: PID 13102 died... 07:48:09.891787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13102): Terminated: ok {rc=0} 07:48:09.938118 --- ParallelTerminationStrategy: PID 13105 died... 07:48:09.957656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13105): Terminated: ok {rc=0} 07:48:10.003169 --- ParallelTerminationStrategy: PID 13108 died... 07:48:10.022638 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13108): Terminated: ok {rc=0} 07:48:10.109436 bus /sierra_3: Setting Powered False 07:48:11.206426 bus /sierra_3: Setting Powered False 07:48:12.322434 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 --------------------------------------------------------------------- 07:48:13.568190 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:48:13.574551 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 1 x bts (candidates: 11) 07:48:13.604712 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 6 x ip_address (candidates: 9) 07:48:13.630968 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Verifying 2 x modem (candidates: 12) 07:48:13.682931 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 1 x bts (candidates: 11) 07:48:13.712245 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 6 x ip_address (candidates: 9) 07:48:13.739160 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Reserving 2 x modem (candidates: 12) 07:48:14.291050 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call.py ---------------------------------------------- 07:48:14.341310 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:48:14.353203 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:48:14.423110 tst mo_mt_call.py: using LAC 26913 07:48:14.544551 tst mo_mt_call.py: using RAC 138 07:48:14.666708 tst mo_mt_call.py: using CellId 26913 07:48:14.781181 tst mo_mt_call.py: using BVCI 26914 07:48:14.886629 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:48:14.897936 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:48:14.909111 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:48:14.920825 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:48:14.932432 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:48:14.943939 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:48:15.061898 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:48:15.177403 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:48:15.629787 run create_hlr_db(pid=13114): Launched 07:48:15.742010 bus /sierra_2: Setting Powered False 07:48:16.815688 run create_hlr_db(pid=13114): Terminated: ok {rc=0} 07:48:17.338213 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13116): Launched 07:48:17.630538 run osmo-hlr_10.42.42.2(pid=13117): Launched 07:48:17.742157 run osmo-stp_10.42.42.5: Starting osmo-stp 07:48:18.253314 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13119): Launched 07:48:18.545633 run osmo-stp_10.42.42.5(pid=13120): Launched 07:48:18.657186 run osmo-msc_10.42.42.6: Starting osmo-msc 07:48:19.185880 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13122): Launched 07:48:19.478662 run osmo-msc_10.42.42.6(pid=13123): Launched 07:48:19.643214 run osmo-stp_10.42.42.5(pid=13120): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13120)] 07:48:19.766822 run osmo-stp_10.42.42.5(pid=13120): stdout: | (launched: 2022-12-10_07:48:18.492099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:19.892383 run osmo-stp_10.42.42.5(pid=13120): stderr: | [0;m[38;5;43m20221210074818660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074818660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074818660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074818661 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074818663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074818663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074818663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:20.014561 run osmo-stp_10.42.42.5(pid=13120): stdout: | (launched: 2022-12-10_07:48:18.492099) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:20.131469 run osmo-stp_10.42.42.5(pid=13120): stderr: | [0;m[38;5;43m20221210074818660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074818660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074818660 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074818661 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074818663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074818663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074818663 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:20.271200 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13120): Process ended prematurely: osmo-stp_10.42.42.5(pid=13120) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13120)] [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8] 07:48:20.280093 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 07:48:20.306714 run osmo-hlr_10.42.42.2(pid=13117): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13117)] 07:48:20.354718 run osmo-hlr_10.42.42.2(pid=13117): stdout: | (launched: 2022-12-10_07:48:17.577591) 07:48:20.403893 run osmo-hlr_10.42.42.2(pid=13117): stderr: | [0;m[1;31m20221210074817752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074817752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074817752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074817752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074817752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074817752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074817764 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074817773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074817773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074817773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:48:20.472640 run osmo-msc_10.42.42.6(pid=13123): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13123)] 07:48:20.520026 run osmo-msc_10.42.42.6(pid=13123): stdout: | (launched: 2022-12-10_07:48:19.425316) 07:48:20.569118 run osmo-msc_10.42.42.6(pid=13123): stderr: | [0;m[38;5;43m20221210074819696 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074819696 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f15aaf95c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074819696 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074819696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074819696 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074819697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074819698 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074819699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074819699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074819699 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:48:20.619055 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13116): Terminating (SIGTERM) 07:48:20.658855 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13119): Terminating (SIGTERM) 07:48:20.698554 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13122): Terminating (SIGTERM) 07:48:20.738645 --- ParallelTerminationStrategy: PID 13116 died... 07:48:20.757810 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13116): Terminated: ok {rc=0} 07:48:20.802457 --- ParallelTerminationStrategy: PID 13119 died... 07:48:20.821258 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13119): Terminated: ok {rc=0} 07:48:20.865588 --- ParallelTerminationStrategy: PID 13122 died... 07:48:20.884300 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13122): Terminated: ok {rc=0} 07:48:20.968275 bus /sierra_3: Setting Powered False 07:48:22.065557 bus /sierra_3: Setting Powered False 07:48:23.181002 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 mo_mt_call_osmux.py ---------------------------------------------- 07:48:24.328070 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:48:24.340268 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x bts (candidates: 1) 07:48:24.407445 tst mo_mt_call_osmux.py: using LAC 26914 07:48:24.530437 tst mo_mt_call_osmux.py: using RAC 139 07:48:24.655381 tst mo_mt_call_osmux.py: using CellId 26914 07:48:24.778409 tst mo_mt_call_osmux.py: using BVCI 26915 07:48:24.893765 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:48:24.905362 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:48:24.916749 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:48:24.928315 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:48:24.939872 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x ip_address (candidates: 6) 07:48:24.951212 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:48:25.069245 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1: Using 1 x modem (candidates: 2) 07:48:25.189261 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:48:25.677480 run create_hlr_db(pid=13125): Launched 07:48:25.806036 bus /sierra_2: Setting Powered False 07:48:26.869620 run create_hlr_db(pid=13125): Terminated: ok {rc=0} 07:48:27.308114 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13127): Launched 07:48:27.622460 run osmo-hlr_10.42.42.2(pid=13128): Launched 07:48:27.742488 run osmo-stp_10.42.42.5: Starting osmo-stp 07:48:28.283884 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13130): Launched 07:48:28.599200 run osmo-stp_10.42.42.5(pid=13131): Launched 07:48:28.719318 run osmo-msc_10.42.42.6: Starting osmo-msc 07:48:29.286793 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13133): Launched 07:48:29.600726 run osmo-msc_10.42.42.6(pid=13134): Launched 07:48:29.777125 run osmo-stp_10.42.42.5(pid=13131): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13131)] 07:48:29.910760 run osmo-stp_10.42.42.5(pid=13131): stdout: | (launched: 2022-12-10_07:48:28.542241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:30.043767 run osmo-stp_10.42.42.5(pid=13131): stderr: | [0;m[38;5;43m20221210074828734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074828734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074828734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074828735 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074828735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074828735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074828735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:30.176427 run osmo-stp_10.42.42.5(pid=13131): stdout: | (launched: 2022-12-10_07:48:28.542241) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:30.301509 run osmo-stp_10.42.42.5(pid=13131): stderr: | [0;m[38;5;43m20221210074828734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074828734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074828734 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074828735 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074828735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074828735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074828735 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:30.451311 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13131): Process ended prematurely: osmo-stp_10.42.42.5(pid=13131) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13131)] [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8] 07:48:30.460523 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:48:30.488425 run osmo-hlr_10.42.42.2(pid=13128): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13128)] 07:48:30.538367 run osmo-hlr_10.42.42.2(pid=13128): stdout: | (launched: 2022-12-10_07:48:27.565553) 07:48:30.589783 run osmo-hlr_10.42.42.2(pid=13128): stderr: | [0;m[1;31m20221210074827764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074827764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074827764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074827764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074827764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074827764 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074827781 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074827792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074827792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074827792 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:48:30.661880 run osmo-msc_10.42.42.6(pid=13134): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13134)] 07:48:30.711781 run osmo-msc_10.42.42.6(pid=13134): stdout: | (launched: 2022-12-10_07:48:29.543630) 07:48:30.763287 run osmo-msc_10.42.42.6(pid=13134): stderr: | [0;m[38;5;43m20221210074829867 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074829867 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fafd1293c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074829867 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074829867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074829867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074829868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074829870 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074829870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074829870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074829870 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:48:30.815137 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13127): Terminating (SIGTERM) 07:48:30.864333 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13130): Terminating (SIGTERM) 07:48:30.914988 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13133): Terminating (SIGTERM) 07:48:30.958529 --- ParallelTerminationStrategy: PID 13127 died... 07:48:30.979227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13127): Terminated: ok {rc=0} 07:48:31.027011 --- ParallelTerminationStrategy: PID 13130 died... 07:48:31.047673 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13130): Terminated: ok {rc=0} 07:48:31.095583 --- ParallelTerminationStrategy: PID 13133 died... 07:48:31.116173 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13133): Terminated: ok {rc=0} 07:48:31.205751 bus /sierra_3: Setting Powered False 07:48:32.304076 bus /sierra_3: Setting Powered False 07:48:33.419612 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:48:34.663904 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:48:34.670276 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:48:34.700447 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:48:34.726939 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:48:34.779315 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:48:34.809291 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:48:34.835295 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:48:35.387861 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:48:35.439702 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:48:35.451290 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:48:35.518098 tst mo_mt_call.py: using LAC 26915 07:48:35.642017 tst mo_mt_call.py: using RAC 140 07:48:35.766790 tst mo_mt_call.py: using CellId 26915 07:48:35.889393 tst mo_mt_call.py: using BVCI 26916 07:48:36.003871 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:48:36.015367 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:48:36.026757 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:48:36.038171 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:48:36.049652 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:48:36.060900 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:48:36.180178 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:48:36.295602 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:48:36.752073 run create_hlr_db(pid=13139): Launched 07:48:36.864622 bus /sierra_2: Setting Powered False 07:48:37.924130 run create_hlr_db(pid=13139): Terminated: ok {rc=0} 07:48:38.354260 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13141): Launched 07:48:38.670012 run osmo-hlr_10.42.42.2(pid=13142): Launched 07:48:38.790413 run osmo-stp_10.42.42.5: Starting osmo-stp 07:48:39.335026 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13144): Launched 07:48:39.648845 run osmo-stp_10.42.42.5(pid=13145): Launched 07:48:39.769201 run osmo-msc_10.42.42.6: Starting osmo-msc 07:48:40.337940 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13147): Launched 07:48:40.652350 run osmo-msc_10.42.42.6(pid=13148): Launched 07:48:40.827850 run osmo-stp_10.42.42.5(pid=13145): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13145)] 07:48:40.959697 run osmo-stp_10.42.42.5(pid=13145): stdout: | (launched: 2022-12-10_07:48:39.591939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:41.092289 run osmo-stp_10.42.42.5(pid=13145): stderr: | [0;m[38;5;43m20221210074839783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074839783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074839784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074839784 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074839786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074839786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074839786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:41.224224 run osmo-stp_10.42.42.5(pid=13145): stdout: | (launched: 2022-12-10_07:48:39.591939) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:41.349256 run osmo-stp_10.42.42.5(pid=13145): stderr: | [0;m[38;5;43m20221210074839783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074839783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074839784 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074839784 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074839786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074839786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074839786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:41.499028 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13145): Process ended prematurely: osmo-stp_10.42.42.5(pid=13145) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13145)] [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:48:41.508386 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:48:41.536275 run osmo-hlr_10.42.42.2(pid=13142): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13142)] 07:48:41.585799 run osmo-hlr_10.42.42.2(pid=13142): stdout: | (launched: 2022-12-10_07:48:38.612751) 07:48:41.636714 run osmo-hlr_10.42.42.2(pid=13142): stderr: | [0;m[1;31m20221210074838810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074838810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074838810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074838810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074838810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074838810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074838822 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074838831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074838831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074838831 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:48:41.708047 run osmo-msc_10.42.42.6(pid=13148): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13148)] 07:48:41.757239 run osmo-msc_10.42.42.6(pid=13148): stdout: | (launched: 2022-12-10_07:48:40.595119) 07:48:41.808282 run osmo-msc_10.42.42.6(pid=13148): stderr: | [0;m[38;5;43m20221210074840919 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074840920 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff9d2f57c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074840920 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074840920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074840920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074840920 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074840922 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074840922 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074840923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074840923 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:48:41.859438 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13141): Terminating (SIGTERM) 07:48:41.900379 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13144): Terminating (SIGTERM) 07:48:41.941320 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13147): Terminating (SIGTERM) 07:48:41.983110 --- ParallelTerminationStrategy: PID 13141 died... 07:48:42.003105 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13141): Terminated: ok {rc=0} 07:48:42.049632 --- ParallelTerminationStrategy: PID 13144 died... 07:48:42.069230 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13144): Terminated: ok {rc=0} 07:48:42.114801 --- ParallelTerminationStrategy: PID 13147 died... 07:48:42.134208 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13147): Terminated: ok {rc=0} 07:48:42.220640 bus /sierra_3: Setting Powered False 07:48:43.317687 bus /sierra_3: Setting Powered False 07:48:44.432585 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 07:48:45.578361 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:48:45.590810 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:48:45.661049 tst mo_mt_call_osmux.py: using LAC 26916 07:48:45.785377 tst mo_mt_call_osmux.py: using RAC 141 07:48:45.926292 tst mo_mt_call_osmux.py: using CellId 26916 07:48:46.045400 tst mo_mt_call_osmux.py: using BVCI 26917 07:48:46.192355 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:48:46.207850 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:48:46.224166 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:48:46.240826 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:48:46.257683 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:48:46.274269 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:48:46.417069 tst voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:48:46.582098 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:48:47.078935 run create_hlr_db(pid=13150): Launched 07:48:47.225778 bus /sierra_2: Setting Powered False 07:48:48.285228 run create_hlr_db(pid=13150): Terminated: ok {rc=0} 07:48:48.715425 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13152): Launched 07:48:49.029411 run osmo-hlr_10.42.42.2(pid=13153): Launched 07:48:49.148632 run osmo-stp_10.42.42.5: Starting osmo-stp 07:48:49.689907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13155): Launched 07:48:50.003648 run osmo-stp_10.42.42.5(pid=13156): Launched 07:48:50.123771 run osmo-msc_10.42.42.6: Starting osmo-msc 07:48:50.693732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13158): Launched 07:48:51.008065 run osmo-msc_10.42.42.6(pid=13159): Launched 07:48:51.184261 run osmo-stp_10.42.42.5(pid=13156): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13156)] 07:48:51.317248 run osmo-stp_10.42.42.5(pid=13156): stdout: | (launched: 2022-12-10_07:48:49.946576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:51.450214 run osmo-stp_10.42.42.5(pid=13156): stderr: | [0;m[38;5;43m20221210074850138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074850138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074850138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074850139 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074850139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074850139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074850139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:51.583199 run osmo-stp_10.42.42.5(pid=13156): stdout: | (launched: 2022-12-10_07:48:49.946576) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:48:51.708221 run osmo-stp_10.42.42.5(pid=13156): stderr: | [0;m[38;5;43m20221210074850138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074850138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074850138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074850139 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074850139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074850139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074850139 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:48:51.858235 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13156): Process ended prematurely: osmo-stp_10.42.42.5(pid=13156) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13156)] [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 07:48:51.867371 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 07:48:51.894907 run osmo-hlr_10.42.42.2(pid=13153): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13153)] 07:48:51.944003 run osmo-hlr_10.42.42.2(pid=13153): stdout: | (launched: 2022-12-10_07:48:48.972381) 07:48:51.994785 run osmo-hlr_10.42.42.2(pid=13153): stderr: | [0;m[1;31m20221210074849172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074849172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074849172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074849172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074849172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074849172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074849185 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074849193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074849193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074849193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:48:52.066357 run osmo-msc_10.42.42.6(pid=13159): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13159)] 07:48:52.115694 run osmo-msc_10.42.42.6(pid=13159): stdout: | (launched: 2022-12-10_07:48:50.951006) 07:48:52.166300 run osmo-msc_10.42.42.6(pid=13159): stderr: | [0;m[38;5;43m20221210074851270 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074851271 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faafb5d4c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074851271 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074851271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074851271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074851271 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074851273 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074851273 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074851274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074851274 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:48:52.217435 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13152): Terminating (SIGTERM) 07:48:52.258305 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13155): Terminating (SIGTERM) 07:48:52.299229 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13158): Terminating (SIGTERM) 07:48:52.340716 --- ParallelTerminationStrategy: PID 13152 died... 07:48:52.360232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13152): Terminated: ok {rc=0} 07:48:52.406020 --- ParallelTerminationStrategy: PID 13155 died... 07:48:52.425443 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13155): Terminated: ok {rc=0} 07:48:52.470916 --- ParallelTerminationStrategy: PID 13158 died... 07:48:52.490738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13158): Terminated: ok {rc=0} 07:48:52.577761 bus /sierra_3: Setting Powered False 07:48:53.675274 bus /sierra_3: Setting Powered False 07:48:54.791876 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:48:56.038215 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:48:56.045199 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:48:56.074837 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 07:48:56.102072 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:48:56.155362 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:48:56.185265 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 07:48:56.212186 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:48:56.764412 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 07:48:56.815037 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:48:56.826704 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:48:56.894336 tst mo_mt_call.py: using LAC 26917 07:48:57.018782 tst mo_mt_call.py: using RAC 142 07:48:57.141672 tst mo_mt_call.py: using CellId 26917 07:48:57.263980 tst mo_mt_call.py: using BVCI 26918 07:48:57.373437 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:48:57.384873 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:48:57.396006 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:48:57.407984 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:48:57.419850 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:48:57.431650 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:48:57.553321 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:48:57.668438 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:48:58.125409 run create_hlr_db(pid=13166): Launched 07:48:58.237520 bus /sierra_2: Setting Powered False 07:48:59.296610 run create_hlr_db(pid=13166): Terminated: ok {rc=0} 07:48:59.728496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13168): Launched 07:49:00.044470 run osmo-hlr_10.42.42.2(pid=13169): Launched 07:49:00.166464 run osmo-stp_10.42.42.5: Starting osmo-stp 07:49:00.712417 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13171): Launched 07:49:01.054232 run osmo-stp_10.42.42.5(pid=13172): Launched 07:49:01.191241 run osmo-msc_10.42.42.6: Starting osmo-msc 07:49:01.968332 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13174): Launched 07:49:02.280068 run osmo-msc_10.42.42.6(pid=13175): Launched 07:49:02.447635 run osmo-stp_10.42.42.5(pid=13172): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13172)] 07:49:02.574897 run osmo-stp_10.42.42.5(pid=13172): stdout: | (launched: 2022-12-10_07:49:00.988056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:02.700648 run osmo-stp_10.42.42.5(pid=13172): stderr: | [0;m[38;5;43m20221210074901341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074901341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074901342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074901342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074901342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074901343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074901343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:02.824288 run osmo-stp_10.42.42.5(pid=13172): stdout: | (launched: 2022-12-10_07:49:00.988056) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:02.942325 run osmo-stp_10.42.42.5(pid=13172): stderr: | [0;m[38;5;43m20221210074901341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074901341 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074901342 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074901342 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074901342 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074901343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074901343 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:03.083171 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13172): Process ended prematurely: osmo-stp_10.42.42.5(pid=13172) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13172)] [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:49:03.092291 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 07:49:03.119021 run osmo-hlr_10.42.42.2(pid=13169): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13169)] 07:49:03.166995 run osmo-hlr_10.42.42.2(pid=13169): stdout: | (launched: 2022-12-10_07:48:59.986768) 07:49:03.216127 run osmo-hlr_10.42.42.2(pid=13169): stderr: | [0;m[1;31m20221210074900186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074900186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074900186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074900186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074900186 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074900187 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074900199 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074900208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074900208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074900208 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:49:03.284739 run osmo-msc_10.42.42.6(pid=13175): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13175)] 07:49:03.332075 run osmo-msc_10.42.42.6(pid=13175): stdout: | (launched: 2022-12-10_07:49:02.226709) 07:49:03.381357 run osmo-msc_10.42.42.6(pid=13175): stderr: | [0;m[38;5;43m20221210074902494 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074902494 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fda776d8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074902494 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074902494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074902494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074902494 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074902496 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074902496 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074902497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074902497 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:49:03.430942 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13168): Terminating (SIGTERM) 07:49:03.470497 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13171): Terminating (SIGTERM) 07:49:03.510023 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13174): Terminating (SIGTERM) 07:49:03.550209 --- ParallelTerminationStrategy: PID 13168 died... 07:49:03.569405 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13168): Terminated: ok {rc=0} 07:49:03.614382 --- ParallelTerminationStrategy: PID 13171 died... 07:49:03.632706 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13171): Terminated: ok {rc=0} 07:49:03.677200 --- ParallelTerminationStrategy: PID 13174 died... 07:49:03.695601 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13174): Terminated: ok {rc=0} 07:49:03.781477 bus /sierra_3: Setting Powered False 07:49:04.881111 bus /sierra_3: Setting Powered False 07:49:05.996686 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:49:07.144164 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:49:07.156870 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:49:07.225362 tst mo_mt_call_osmux.py: using LAC 26918 07:49:07.350467 tst mo_mt_call_osmux.py: using RAC 143 07:49:07.476438 tst mo_mt_call_osmux.py: using CellId 26918 07:49:07.602415 tst mo_mt_call_osmux.py: using BVCI 26919 07:49:07.718441 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:49:07.730317 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:49:07.742071 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:49:07.753614 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:49:07.765291 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:49:07.776704 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:49:07.895542 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:49:08.018342 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:49:08.509287 run create_hlr_db(pid=13177): Launched 07:49:08.637700 bus /sierra_2: Setting Powered False 07:49:09.700663 run create_hlr_db(pid=13177): Terminated: ok {rc=0} 07:49:10.137564 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13179): Launched 07:49:10.453527 run osmo-hlr_10.42.42.2(pid=13180): Launched 07:49:10.574725 run osmo-stp_10.42.42.5: Starting osmo-stp 07:49:11.121642 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13182): Launched 07:49:11.438112 run osmo-stp_10.42.42.5(pid=13183): Launched 07:49:11.558396 run osmo-msc_10.42.42.6: Starting osmo-msc 07:49:12.128692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13185): Launched 07:49:12.443594 run osmo-msc_10.42.42.6(pid=13186): Launched 07:49:12.620031 run osmo-stp_10.42.42.5(pid=13183): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13183)] 07:49:12.752143 run osmo-stp_10.42.42.5(pid=13183): stdout: | (launched: 2022-12-10_07:49:11.380483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:12.885940 run osmo-stp_10.42.42.5(pid=13183): stderr: | [0;m[38;5;43m20221210074911572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074911572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074911572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074911573 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074911575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074911575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074911575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:13.017930 run osmo-stp_10.42.42.5(pid=13183): stdout: | (launched: 2022-12-10_07:49:11.380483) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:13.143883 run osmo-stp_10.42.42.5(pid=13183): stderr: | [0;m[38;5;43m20221210074911572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074911572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074911572 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074911573 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074911575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074911575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074911575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:13.294488 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13183): Process ended prematurely: osmo-stp_10.42.42.5(pid=13183) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13183)] [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:49:13.303852 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:49:13.331872 run osmo-hlr_10.42.42.2(pid=13180): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13180)] 07:49:13.381822 run osmo-hlr_10.42.42.2(pid=13180): stdout: | (launched: 2022-12-10_07:49:10.396181) 07:49:13.433428 run osmo-hlr_10.42.42.2(pid=13180): stderr: | [0;m[1;31m20221210074910595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074910595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074910595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074910595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074910595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074910596 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074910609 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074910617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074910617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074910617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:49:13.505965 run osmo-msc_10.42.42.6(pid=13186): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13186)] 07:49:13.555866 run osmo-msc_10.42.42.6(pid=13186): stdout: | (launched: 2022-12-10_07:49:12.386425) 07:49:13.607161 run osmo-msc_10.42.42.6(pid=13186): stderr: | [0;m[38;5;43m20221210074912707 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074912709 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7c193cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074912709 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074912709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074912709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074912710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074912711 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074912712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074912712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074912713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:49:13.658698 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13179): Terminating (SIGTERM) 07:49:13.700046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13182): Terminating (SIGTERM) 07:49:13.741605 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13185): Terminating (SIGTERM) 07:49:13.783425 --- ParallelTerminationStrategy: PID 13179 died... 07:49:13.803146 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13179): Terminated: ok {rc=0} 07:49:13.849520 --- ParallelTerminationStrategy: PID 13182 died... 07:49:13.869431 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13182): Terminated: ok {rc=0} 07:49:13.915383 --- ParallelTerminationStrategy: PID 13185 died... 07:49:13.935074 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13185): Terminated: ok {rc=0} 07:49:14.021585 bus /sierra_3: Setting Powered False 07:49:15.119855 bus /sierra_3: Setting Powered False 07:49:16.246880 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:49:17.514988 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:49:17.522283 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:49:17.552469 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 6 x ip_address (candidates: 9) 07:49:17.579729 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 2 x modem (candidates: 12) 07:49:17.630956 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:49:17.659805 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 6 x ip_address (candidates: 9) 07:49:17.685586 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 2 x modem (candidates: 12) 07:49:18.236506 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for voice: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call.py ---------------------------------------------- 07:49:18.284745 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:49:18.295699 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:49:18.359656 tst mo_mt_call.py: using LAC 26919 07:49:18.473440 tst mo_mt_call.py: using RAC 144 07:49:18.597479 tst mo_mt_call.py: using CellId 26919 07:49:18.719010 tst mo_mt_call.py: using BVCI 26920 07:49:18.833323 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:49:18.844583 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:49:18.855735 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:49:18.867397 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:49:18.879234 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:49:18.890876 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:49:19.007300 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:49:19.120484 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:49:19.574350 run create_hlr_db(pid=13191): Launched 07:49:19.687915 bus /sierra_2: Setting Powered False 07:49:20.747813 run create_hlr_db(pid=13191): Terminated: ok {rc=0} 07:49:21.179008 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13193): Launched 07:49:21.495012 run osmo-hlr_10.42.42.2(pid=13194): Launched 07:49:21.616706 run osmo-stp_10.42.42.5: Starting osmo-stp 07:49:22.163948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13196): Launched 07:49:22.477952 run osmo-stp_10.42.42.5(pid=13197): Launched 07:49:22.598928 run osmo-msc_10.42.42.6: Starting osmo-msc 07:49:23.167510 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13199): Launched 07:49:23.482832 run osmo-msc_10.42.42.6(pid=13200): Launched 07:49:23.660276 run osmo-stp_10.42.42.5(pid=13197): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13197)] 07:49:23.793317 run osmo-stp_10.42.42.5(pid=13197): stdout: | (launched: 2022-12-10_07:49:22.421155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:23.926646 run osmo-stp_10.42.42.5(pid=13197): stderr: | [0;m[38;5;43m20221210074922611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074922612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074922612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074922612 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074922613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074922613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074922613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:24.059077 run osmo-stp_10.42.42.5(pid=13197): stdout: | (launched: 2022-12-10_07:49:22.421155) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:24.184757 run osmo-stp_10.42.42.5(pid=13197): stderr: | [0;m[38;5;43m20221210074922611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074922612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074922612 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074922612 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074922613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074922613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074922613 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:24.335565 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13197): Process ended prematurely: osmo-stp_10.42.42.5(pid=13197) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13197)] [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8] 07:49:24.345077 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 07:49:24.372625 run osmo-hlr_10.42.42.2(pid=13194): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13194)] 07:49:24.422635 run osmo-hlr_10.42.42.2(pid=13194): stdout: | (launched: 2022-12-10_07:49:21.438018) 07:49:24.474165 run osmo-hlr_10.42.42.2(pid=13194): stderr: | [0;m[1;31m20221210074921637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074921637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074921637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074921637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074921637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074921637 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074921650 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074921659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074921659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074921659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:49:24.546534 run osmo-msc_10.42.42.6(pid=13200): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13200)] 07:49:24.596652 run osmo-msc_10.42.42.6(pid=13200): stdout: | (launched: 2022-12-10_07:49:23.425645) 07:49:24.648267 run osmo-msc_10.42.42.6(pid=13200): stderr: | [0;m[38;5;43m20221210074923747 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074923748 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9b6fd7ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074923748 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074923748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074923748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074923748 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074923750 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074923750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074923750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074923750 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:49:24.699951 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13193): Terminating (SIGTERM) 07:49:24.741312 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13196): Terminating (SIGTERM) 07:49:24.782999 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13199): Terminating (SIGTERM) 07:49:24.825126 --- ParallelTerminationStrategy: PID 13193 died... 07:49:24.845257 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13193): Terminated: ok {rc=0} 07:49:24.891343 --- ParallelTerminationStrategy: PID 13196 died... 07:49:24.911114 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13196): Terminated: ok {rc=0} 07:49:24.957158 --- ParallelTerminationStrategy: PID 13199 died... 07:49:24.976657 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13199): Terminated: ok {rc=0} 07:49:25.064007 bus /sierra_3: Setting Powered False 07:49:26.162526 bus /sierra_3: Setting Powered False 07:49:27.276776 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo mo_mt_call_osmux.py ---------------------------------------------- 07:49:28.423638 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:49:28.435518 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:49:28.503484 tst mo_mt_call_osmux.py: using LAC 26920 07:49:28.626329 tst mo_mt_call_osmux.py: using RAC 145 07:49:28.753613 tst mo_mt_call_osmux.py: using CellId 26920 07:49:28.875628 tst mo_mt_call_osmux.py: using BVCI 26921 07:49:28.988755 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:49:29.000138 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:49:29.011437 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:49:29.022765 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:49:29.034213 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 6) 07:49:29.045464 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:49:29.162417 tst voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 2) 07:49:29.275477 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:49:29.727943 run create_hlr_db(pid=13202): Launched 07:49:29.840467 bus /sierra_2: Setting Powered False 07:49:30.922717 run create_hlr_db(pid=13202): Terminated: ok {rc=0} 07:49:31.378609 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13204): Launched 07:49:31.722296 run osmo-hlr_10.42.42.2(pid=13205): Launched 07:49:31.845437 run osmo-stp_10.42.42.5: Starting osmo-stp 07:49:32.533807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13207): Launched 07:49:32.848050 run osmo-stp_10.42.42.5(pid=13208): Launched 07:49:32.968543 run osmo-msc_10.42.42.6: Starting osmo-msc 07:49:33.536047 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13210): Launched 07:49:33.850381 run osmo-msc_10.42.42.6(pid=13211): Launched 07:49:34.026042 run osmo-stp_10.42.42.5(pid=13208): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13208)] 07:49:34.158003 run osmo-stp_10.42.42.5(pid=13208): stdout: | (launched: 2022-12-10_07:49:32.791002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:34.290272 run osmo-stp_10.42.42.5(pid=13208): stderr: | [0;m[38;5;43m20221210074932981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074932981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074932981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074932981 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074932982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074932982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074932982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:34.422367 run osmo-stp_10.42.42.5(pid=13208): stdout: | (launched: 2022-12-10_07:49:32.791002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:34.547533 run osmo-stp_10.42.42.5(pid=13208): stderr: | [0;m[38;5;43m20221210074932981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074932981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074932981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074932981 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074932982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074932982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074932982 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:34.696732 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13208): Process ended prematurely: osmo-stp_10.42.42.5(pid=13208) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13208)] [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8] 07:49:34.706108 tst mo_mt_call_osmux.py:8: Test FAILED (6.3 sec) 07:49:34.733543 run osmo-hlr_10.42.42.2(pid=13205): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13205)] 07:49:34.783034 run osmo-hlr_10.42.42.2(pid=13205): stdout: | (launched: 2022-12-10_07:49:31.648640) 07:49:34.834305 run osmo-hlr_10.42.42.2(pid=13205): stderr: | [0;m[1;31m20221210074932030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074932030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074932030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074932030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074932030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074932030 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074932055 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074932068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074932068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074932068 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:49:34.906029 run osmo-msc_10.42.42.6(pid=13211): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13211)] 07:49:34.955294 run osmo-msc_10.42.42.6(pid=13211): stdout: | (launched: 2022-12-10_07:49:33.793299) 07:49:35.006460 run osmo-msc_10.42.42.6(pid=13211): stderr: | [0;m[38;5;43m20221210074934116 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074934116 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6b72118c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074934116 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074934116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074934116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074934116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074934118 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074934119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074934119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074934119 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:49:35.057883 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13204): Terminating (SIGTERM) 07:49:35.099152 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13207): Terminating (SIGTERM) 07:49:35.140578 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13210): Terminating (SIGTERM) 07:49:35.182565 --- ParallelTerminationStrategy: PID 13204 died... 07:49:35.202451 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13204): Terminated: ok {rc=0} 07:49:35.248153 --- ParallelTerminationStrategy: PID 13207 died... 07:49:35.267562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13207): Terminated: ok {rc=0} 07:49:35.313708 --- ParallelTerminationStrategy: PID 13210 died... 07:49:35.333245 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13210): Terminated: ok {rc=0} 07:49:35.420756 bus /sierra_3: Setting Powered False 07:49:36.519149 bus /sierra_3: Setting Powered False 07:49:37.634923 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 emergency:trx-lms-limenet-micro --------------------------------------------------------------------- 07:49:38.875688 tst emergency:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:49:38.880315 tst emergency:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 07:49:38.910160 tst emergency:trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 07:49:38.936252 tst emergency:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 07:49:39.018399 tst emergency:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 07:49:39.046959 tst emergency:trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 07:49:39.072745 tst emergency:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 07:49:39.656042 tst emergency:trx-lms-limenet-micro: RESERVED RESOURCES for emergency: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2371 emergency:trx-lms-limenet-micro emergency_mo_mt_call.py ---------------------------------------------- 07:49:39.662455 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:49:39.674182 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:49:39.723176 tst emergency_mo_mt_call.py: using LAC 26921 07:49:39.843185 tst emergency_mo_mt_call.py: using RAC 146 07:49:39.962726 tst emergency_mo_mt_call.py: using CellId 26921 07:49:40.083244 tst emergency_mo_mt_call.py: using BVCI 26922 07:49:40.194883 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:49:40.206023 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:49:40.217547 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:49:40.228583 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:49:40.239704 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:49:40.250930 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:49:40.367083 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:49:40.480754 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:49:40.927188 run create_hlr_db(pid=13216): Launched 07:49:41.038378 bus /sierra_2: Setting Powered False 07:49:42.097292 run create_hlr_db(pid=13216): Terminated: ok {rc=0} 07:49:42.500571 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13218): Launched 07:49:42.788364 run osmo-hlr_10.42.42.2(pid=13219): Launched 07:49:42.899640 run osmo-stp_10.42.42.5: Starting osmo-stp 07:49:43.406998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13221): Launched 07:49:43.697716 run osmo-stp_10.42.42.5(pid=13222): Launched 07:49:43.826397 tst emergency_mo_mt_call.py: using MSISDN 7619 07:49:43.987102 run osmo-msc_10.42.42.6: Starting osmo-msc 07:49:44.546526 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13224): Launched 07:49:44.855260 run osmo-msc_10.42.42.6(pid=13225): Launched 07:49:45.027304 run osmo-stp_10.42.42.5(pid=13222): ERR: Terminated: ERROR {rc=1} [trial-2371↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13222)] 07:49:45.156841 run osmo-stp_10.42.42.5(pid=13222): stdout: | (launched: 2022-12-10_07:49:43.640915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:45.287756 run osmo-stp_10.42.42.5(pid=13222): stderr: | [0;m[38;5;43m20221210074943833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074943833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074943833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074943834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074943834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074943834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074943834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:45.417996 run osmo-stp_10.42.42.5(pid=13222): stdout: | (launched: 2022-12-10_07:49:43.640915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:45.541743 run osmo-stp_10.42.42.5(pid=13222): stderr: | [0;m[38;5;43m20221210074943833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074943833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074943833 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074943834 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074943834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074943834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074943834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:45.688782 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=13222): Process ended prematurely: osmo-stp_10.42.42.5(pid=13222) [trial-2371↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13222)] [trial-2371↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19] 07:49:45.697863 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 07:49:45.725288 run osmo-hlr_10.42.42.2(pid=13219): ERR: Terminated: ERROR {rc=237} [trial-2371↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13219)] 07:49:45.775060 run osmo-hlr_10.42.42.2(pid=13219): stdout: | (launched: 2022-12-10_07:49:42.735649) 07:49:45.826604 run osmo-hlr_10.42.42.2(pid=13219): stderr: | [0;m[1;31m20221210074942910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074942910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074942910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074942910 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074942911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074942911 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074942922 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/emergency:trx-lms-limenet-micro/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074942930 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074942931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074942931 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:49:45.923196 run osmo-msc_10.42.42.6(pid=13225): ERR: Terminated: ERROR {rc=2} [trial-2371↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13225)] 07:49:45.975025 run osmo-msc_10.42.42.6(pid=13225): stdout: | (launched: 2022-12-10_07:49:44.798964) 07:49:46.027105 run osmo-msc_10.42.42.6(pid=13225): stderr: | [0;m[38;5;43m20221210074945121 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074945121 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f4d3e2f6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074945121 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074945121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074945121 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074945122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074945123 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074945124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074945124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074945124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:49:46.079716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13218): Terminating (SIGTERM) 07:49:46.123066 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13221): Terminating (SIGTERM) 07:49:46.165716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13224): Terminating (SIGTERM) 07:49:46.210435 --- ParallelTerminationStrategy: PID 13218 died... 07:49:46.230526 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13218): Terminated: ok {rc=0} 07:49:46.279541 --- ParallelTerminationStrategy: PID 13221 died... 07:49:46.299604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13221): Terminated: ok {rc=0} 07:49:46.348423 --- ParallelTerminationStrategy: PID 13224 died... 07:49:46.368146 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13224): Terminated: ok {rc=0} 07:49:46.458189 bus /sierra_3: Setting Powered False 07:49:47.554843 bus /sierra_3: Setting Powered False 07:49:48.670303 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 emergency:trx-lms-limenet-micro emergency_preemptive_call.py ---------------------------------------------- 07:49:49.756724 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:49:49.768124 tst emergency:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:49:49.816003 tst emergency_preemptive_call.py: using LAC 26922 07:49:49.930281 tst emergency_preemptive_call.py: using RAC 147 07:49:50.046888 tst emergency_preemptive_call.py: using CellId 26922 07:49:50.160480 tst emergency_preemptive_call.py: using BVCI 26923 07:49:50.264515 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:49:50.275307 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:49:50.285928 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:49:50.297124 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:49:50.308336 tst emergency:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 07:49:50.319284 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:49:50.430138 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:49:50.542183 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:49:50.658333 tst emergency:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:49:50.774102 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:49:51.254611 run create_hlr_db(pid=13227): Launched 07:49:51.381175 bus /sierra_2: Setting Powered False 07:49:52.443083 run create_hlr_db(pid=13227): Terminated: ok {rc=0} 07:49:52.857704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13229): Launched 07:49:53.145532 run osmo-hlr_10.42.42.2(pid=13230): Launched 07:49:53.255342 run osmo-stp_10.42.42.5: Starting osmo-stp 07:49:53.788941 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13232): Launched 07:49:54.099330 run osmo-stp_10.42.42.5(pid=13233): Launched 07:49:54.226202 tst emergency_preemptive_call.py: using MSISDN 7620 07:49:54.384886 run osmo-msc_10.42.42.6: Starting osmo-msc 07:49:54.941652 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13235): Launched 07:49:55.249723 run osmo-msc_10.42.42.6(pid=13236): Launched 07:49:55.421738 run osmo-stp_10.42.42.5(pid=13233): ERR: Terminated: ERROR {rc=1} [trial-2371↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13233)] 07:49:55.552064 run osmo-stp_10.42.42.5(pid=13233): stdout: | (launched: 2022-12-10_07:49:54.042603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:55.683577 run osmo-stp_10.42.42.5(pid=13233): stderr: | [0;m[38;5;43m20221210074954235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074954235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074954235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074954235 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074954236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074954236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074954236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:55.814350 run osmo-stp_10.42.42.5(pid=13233): stdout: | (launched: 2022-12-10_07:49:54.042603) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:49:55.937958 run osmo-stp_10.42.42.5(pid=13233): stderr: | [0;m[38;5;43m20221210074954235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210074954235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210074954235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210074954235 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210074954236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210074954236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210074954236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:49:56.085270 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=13233): Process ended prematurely: osmo-stp_10.42.42.5(pid=13233) [trial-2371↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13233)] [trial-2371↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32] 07:49:56.094259 tst emergency_preemptive_call.py:32: Test FAILED (6.3 sec) 07:49:56.121860 run osmo-hlr_10.42.42.2(pid=13230): ERR: Terminated: ERROR {rc=237} [trial-2371↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13230)] 07:49:56.171847 run osmo-hlr_10.42.42.2(pid=13230): stdout: | (launched: 2022-12-10_07:49:53.092579) 07:49:56.223669 run osmo-hlr_10.42.42.2(pid=13230): stderr: | [0;m[1;31m20221210074953264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210074953264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210074953264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210074953264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210074953264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210074953264 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210074953275 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/emergency:trx-lms-limenet-micro/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210074953285 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210074953286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210074953286 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:49:56.295434 run osmo-msc_10.42.42.6(pid=13236): ERR: Terminated: ERROR {rc=2} [trial-2371↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13236)] 07:49:56.345353 run osmo-msc_10.42.42.6(pid=13236): stdout: | (launched: 2022-12-10_07:49:55.193650) 07:49:56.396643 run osmo-msc_10.42.42.6(pid=13236): stderr: | [0;m[38;5;43m20221210074955515 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210074955516 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa34c384c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210074955516 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210074955516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210074955516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210074955516 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210074955518 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210074955519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210074955519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210074955519 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:49:56.448484 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13229): Terminating (SIGTERM) 07:49:56.489965 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13232): Terminating (SIGTERM) 07:49:56.531832 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13235): Terminating (SIGTERM) 07:49:56.574335 --- ParallelTerminationStrategy: PID 13229 died... 07:49:56.594751 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13229): Terminated: ok {rc=0} 07:49:56.641312 --- ParallelTerminationStrategy: PID 13232 died... 07:49:56.660852 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13232): Terminated: ok {rc=0} 07:49:56.707010 --- ParallelTerminationStrategy: PID 13235 died... 07:49:56.726718 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13235): Terminated: ok {rc=0} 07:49:56.815059 bus /sierra_9: Setting Powered False 07:49:57.914412 bus /sierra_9: Setting Powered False 07:49:59.029163 bus /sierra_8: Setting Powered False 07:50:00.126382 bus /sierra_8: Setting Powered False 07:50:01.245789 bus /sierra_3: Setting Powered False 07:50:02.346388 bus /sierra_3: Setting Powered False 07:50:03.461476 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 emergency:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro --------------------------------------------------------------------- 07:50:04.728097 tst gprs:trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:50:04.732223 tst gprs:trx-lms-limenet-micro: Verifying 1 x bts (candidates: 11) 07:50:04.761116 tst gprs:trx-lms-limenet-micro: Verifying 9 x ip_address (candidates: 9) 07:50:04.799104 tst gprs:trx-lms-limenet-micro: Verifying 4 x modem (candidates: 12) 07:50:04.886728 tst gprs:trx-lms-limenet-micro: Reserving 1 x bts (candidates: 11) 07:50:04.918264 tst gprs:trx-lms-limenet-micro: Reserving 9 x ip_address (candidates: 9) 07:50:04.957703 tst gprs:trx-lms-limenet-micro: Reserving 4 x modem (candidates: 12) 07:50:05.541606 tst gprs:trx-lms-limenet-micro: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro cs_paging_gprs_active.py ---------------------------------------------- 07:50:05.591000 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:05.601803 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:50:05.649776 tst cs_paging_gprs_active.py: using LAC 26923 07:50:05.764085 tst cs_paging_gprs_active.py: using RAC 148 07:50:05.877377 tst cs_paging_gprs_active.py: using CellId 26923 07:50:05.991502 tst cs_paging_gprs_active.py: using BVCI 26924 07:50:06.097733 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:06.108251 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:06.118665 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:06.129331 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:06.139786 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:06.150462 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:06.161218 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:06.171674 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:06.182599 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:50:06.296737 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:50:06.413788 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:50:06.628457 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:50:06.946013 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13245): Launched 07:50:07.220563 run iperf3-srv_10.42.42.10(pid=13246): Launched 07:50:07.339156 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:50:07.552841 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:50:07.869519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13247): Launched 07:50:08.144008 run iperf3-srv_10.42.42.10(pid=13248): Launched 07:50:08.262292 tst cs_paging_gprs_active.py:38: start network... 07:50:08.474188 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:50:08.961784 run create_hlr_db(pid=13249): Launched 07:50:09.090575 bus /sierra_2: Setting Powered False 07:50:10.153908 run create_hlr_db(pid=13249): Terminated: ok {rc=0} 07:50:10.593867 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13251): Launched 07:50:10.909353 run osmo-hlr_10.42.42.2(pid=13252): Launched 07:50:11.030107 run osmo-stp_10.42.42.5: Starting osmo-stp 07:50:11.571714 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13254): Launched 07:50:11.886929 run osmo-stp_10.42.42.5(pid=13255): Launched 07:50:12.007069 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:50:12.549388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13257): Launched 07:50:12.670220 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:50:12.936919 run patchelf(pid=13258): Launched 07:50:13.112841 run osmo-stp_10.42.42.5(pid=13255): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13255)] 07:50:13.246917 run osmo-stp_10.42.42.5(pid=13255): stdout: | (launched: 2022-12-10_07:50:11.829488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:13.382737 run osmo-stp_10.42.42.5(pid=13255): stderr: | [0;m[38;5;43m20221210075012020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075012020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075012020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075012021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075012021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075012021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075012021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:13.518108 run osmo-stp_10.42.42.5(pid=13255): stdout: | (launched: 2022-12-10_07:50:11.829488) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:13.647681 run osmo-stp_10.42.42.5(pid=13255): stderr: | [0;m[38;5;43m20221210075012020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075012020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075012020 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075012021 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075012021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075012021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075012021 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:13.800747 run patchelf(pid=13258): Terminating (SIGINT) 07:50:13.978520 run patchelf(pid=13258): Terminated: ok {rc=0} 07:50:14.107067 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13255): Process ended prematurely: osmo-stp_10.42.42.5(pid=13255) [trial-2371↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13255)] [trial-2371↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38] 07:50:14.116906 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 07:50:14.145134 run osmo-hlr_10.42.42.2(pid=13252): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13252)] 07:50:14.194256 run osmo-hlr_10.42.42.2(pid=13252): stdout: | (launched: 2022-12-10_07:50:10.852001) 07:50:14.245312 run osmo-hlr_10.42.42.2(pid=13252): stderr: | [0;m[1;31m20221210075011048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075011048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075011048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075011048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075011048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075011048 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075011064 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms-limenet-micro/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075011073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075011073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075011073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:50:14.296587 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13245): Terminating (SIGTERM) 07:50:14.338251 run iperf3-srv_10.42.42.10(pid=13246): Terminating (SIGTERM) 07:50:14.379346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13247): Terminating (SIGTERM) 07:50:14.420579 run iperf3-srv_10.42.42.10(pid=13248): Terminating (SIGTERM) 07:50:14.461629 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13251): Terminating (SIGTERM) 07:50:14.502763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13254): Terminating (SIGTERM) 07:50:14.544041 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13257): Terminating (SIGTERM) 07:50:14.585683 --- ParallelTerminationStrategy: PID 13245 died... 07:50:14.605606 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13245): Terminated: ok {rc=0} 07:50:14.651431 --- ParallelTerminationStrategy: PID 13246 died... 07:50:14.670611 run iperf3-srv_10.42.42.10(pid=13246): Terminated {rc=256} 07:50:14.716641 --- ParallelTerminationStrategy: PID 13247 died... 07:50:14.736253 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13247): Terminated: ok {rc=0} 07:50:14.781790 --- ParallelTerminationStrategy: PID 13248 died... 07:50:14.801185 run iperf3-srv_10.42.42.10(pid=13248): Terminated {rc=256} 07:50:14.846726 --- ParallelTerminationStrategy: PID 13251 died... 07:50:14.866174 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13251): Terminated: ok {rc=0} 07:50:14.912058 --- ParallelTerminationStrategy: PID 13254 died... 07:50:14.931516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13254): Terminated: ok {rc=0} 07:50:14.976768 --- ParallelTerminationStrategy: PID 13257 died... 07:50:14.996171 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13257): Terminated: ok {rc=0} 07:50:15.082916 bus /gobi_0: Setting Powered False 07:50:16.188749 bus /gobi_0: Setting Powered False 07:50:17.314484 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro iperf3.py ---------------------------------------------- 07:50:18.458104 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:18.469499 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:50:18.517686 tst iperf3.py: using LAC 26924 07:50:18.641304 tst iperf3.py: using RAC 149 07:50:18.764576 tst iperf3.py: using CellId 26924 07:50:18.887336 tst iperf3.py: using BVCI 26925 07:50:19.000895 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:19.012062 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:19.023013 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:19.033982 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:19.044721 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:19.055671 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:19.066773 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:19.077557 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:19.088460 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:50:19.201939 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:50:19.398785 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:50:19.693254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13259): Launched 07:50:19.948852 run iperf3-srv_10.42.42.10(pid=13260): Launched 07:50:20.059377 tst iperf3.py:8: start network... 07:50:20.255794 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:50:20.708827 run create_hlr_db(pid=13261): Launched 07:50:20.822448 bus /gobi_6: Setting Powered False 07:50:21.881685 run create_hlr_db(pid=13261): Terminated: ok {rc=0} 07:50:22.311966 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13263): Launched 07:50:22.627328 run osmo-hlr_10.42.42.2(pid=13264): Launched 07:50:22.748464 run osmo-stp_10.42.42.5: Starting osmo-stp 07:50:23.292253 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13266): Launched 07:50:23.607017 run osmo-stp_10.42.42.5(pid=13267): Launched 07:50:23.727377 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:50:24.268808 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13269): Launched 07:50:24.389555 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:50:24.655729 run patchelf(pid=13270): Launched 07:50:24.831852 run osmo-stp_10.42.42.5(pid=13267): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13267)] 07:50:24.964777 run osmo-stp_10.42.42.5(pid=13267): stdout: | (launched: 2022-12-10_07:50:23.549743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:25.099657 run osmo-stp_10.42.42.5(pid=13267): stderr: | [0;m[38;5;43m20221210075023742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075023742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075023742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075023742 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075023743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075023743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075023743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:25.234577 run osmo-stp_10.42.42.5(pid=13267): stdout: | (launched: 2022-12-10_07:50:23.549743) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:25.363269 run osmo-stp_10.42.42.5(pid=13267): stderr: | [0;m[38;5;43m20221210075023742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075023742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075023742 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075023742 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075023743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075023743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075023743 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:25.515469 run patchelf(pid=13270): Terminating (SIGINT) 07:50:25.693153 run patchelf(pid=13270): Terminated: ok {rc=0} 07:50:25.820629 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13267): Process ended prematurely: osmo-stp_10.42.42.5(pid=13267) [trial-2371↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13267)] [trial-2371↪gprs:trx-lms-limenet-micro↪iperf3.py:8] 07:50:25.830548 tst iperf3.py:8: Test FAILED (7.4 sec) 07:50:25.858888 run osmo-hlr_10.42.42.2(pid=13264): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms-limenet-micro↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13264)] 07:50:25.908084 run osmo-hlr_10.42.42.2(pid=13264): stdout: | (launched: 2022-12-10_07:50:22.570193) 07:50:25.959275 run osmo-hlr_10.42.42.2(pid=13264): stderr: | [0;m[1;31m20221210075022768 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075022768 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075022768 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075022768 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075022768 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075022769 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075022810 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms-limenet-micro/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075022819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075022819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075022819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:50:26.010812 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13259): Terminating (SIGTERM) 07:50:26.051738 run iperf3-srv_10.42.42.10(pid=13260): Terminating (SIGTERM) 07:50:26.092735 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13263): Terminating (SIGTERM) 07:50:26.133790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13266): Terminating (SIGTERM) 07:50:26.174784 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13269): Terminating (SIGTERM) 07:50:26.216462 --- ParallelTerminationStrategy: PID 13259 died... 07:50:26.236583 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13259): Terminated: ok {rc=0} 07:50:26.282695 --- ParallelTerminationStrategy: PID 13260 died... 07:50:26.302278 run iperf3-srv_10.42.42.10(pid=13260): Terminated {rc=256} 07:50:26.347955 --- ParallelTerminationStrategy: PID 13263 died... 07:50:26.367409 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13263): Terminated: ok {rc=0} 07:50:26.413197 --- ParallelTerminationStrategy: PID 13266 died... 07:50:26.432555 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13266): Terminated: ok {rc=0} 07:50:26.478211 --- ParallelTerminationStrategy: PID 13269 died... 07:50:26.497709 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13269): Terminated: ok {rc=0} 07:50:26.584707 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro iperf3m4.py ---------------------------------------------- 07:50:27.731766 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:27.743437 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:50:27.805748 tst iperf3m4.py: using LAC 26925 07:50:27.934527 tst iperf3m4.py: using RAC 150 07:50:28.061901 tst iperf3m4.py: using CellId 26925 07:50:28.185602 tst iperf3m4.py: using BVCI 26926 07:50:28.299564 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:28.310749 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:28.321813 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:28.332746 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:28.343596 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:28.354438 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:28.365531 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:28.376288 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:28.387357 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:50:28.501961 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:50:28.619322 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:50:28.736679 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:50:28.855650 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:50:29.053841 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:50:29.349464 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13271): Launched 07:50:29.605555 run iperf3-srv_10.42.42.10(pid=13272): Launched 07:50:29.716644 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:50:29.912884 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:50:30.207813 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13273): Launched 07:50:30.463908 run iperf3-srv_10.42.42.10(pid=13274): Launched 07:50:30.574789 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:50:30.770905 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:50:31.090785 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13275): Launched 07:50:31.365721 run iperf3-srv_10.42.42.10(pid=13276): Launched 07:50:31.497754 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:50:31.718881 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:50:32.051346 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13277): Launched 07:50:32.358398 run iperf3-srv_10.42.42.10(pid=13278): Launched 07:50:32.469554 tst iperf3m4.py:8: start network... 07:50:32.666314 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:50:33.121770 run create_hlr_db(pid=13279): Launched 07:50:33.235161 bus /gobi_6: Setting Powered False 07:50:34.294785 run create_hlr_db(pid=13279): Terminated: ok {rc=0} 07:50:34.726746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13281): Launched 07:50:35.043803 run osmo-hlr_10.42.42.2(pid=13282): Launched 07:50:35.164929 run osmo-stp_10.42.42.5: Starting osmo-stp 07:50:35.807788 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13284): Launched 07:50:36.116607 run osmo-stp_10.42.42.5(pid=13285): Launched 07:50:36.234873 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:50:36.772390 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13287): Launched 07:50:36.891265 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:50:37.152042 run patchelf(pid=13288): Launched 07:50:37.324091 run osmo-stp_10.42.42.5(pid=13285): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13285)] 07:50:37.455254 run osmo-stp_10.42.42.5(pid=13285): stdout: | (launched: 2022-12-10_07:50:36.060396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:37.589065 run osmo-stp_10.42.42.5(pid=13285): stderr: | [0;m[38;5;43m20221210075036249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075036249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075036249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075036249 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075036250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075036250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075036250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:37.722089 run osmo-stp_10.42.42.5(pid=13285): stdout: | (launched: 2022-12-10_07:50:36.060396) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:37.848550 run osmo-stp_10.42.42.5(pid=13285): stderr: | [0;m[38;5;43m20221210075036249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075036249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075036249 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075036249 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075036250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075036250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075036250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:37.998744 run patchelf(pid=13288): Terminating (SIGINT) 07:50:38.173150 run patchelf(pid=13288): Terminated: ok {rc=0} 07:50:38.298689 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13285): Process ended prematurely: osmo-stp_10.42.42.5(pid=13285) [trial-2371↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13285)] [trial-2371↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8] 07:50:38.308498 tst iperf3m4.py:8: Test FAILED (10.6 sec) 07:50:38.336865 run osmo-hlr_10.42.42.2(pid=13282): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms-limenet-micro↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13282)] 07:50:38.386467 run osmo-hlr_10.42.42.2(pid=13282): stdout: | (launched: 2022-12-10_07:50:34.986263) 07:50:38.437631 run osmo-hlr_10.42.42.2(pid=13282): stderr: | [0;m[1;31m20221210075035185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075035185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075035185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075035185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075035185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075035185 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075035198 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms-limenet-micro/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075035206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075035206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075035206 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:50:38.489254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13271): Terminating (SIGTERM) 07:50:38.530059 run iperf3-srv_10.42.42.10(pid=13272): Terminating (SIGTERM) 07:50:38.571471 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13273): Terminating (SIGTERM) 07:50:38.612704 run iperf3-srv_10.42.42.10(pid=13274): Terminating (SIGTERM) 07:50:38.653646 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13275): Terminating (SIGTERM) 07:50:38.694801 run iperf3-srv_10.42.42.10(pid=13276): Terminating (SIGTERM) 07:50:38.735545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13277): Terminating (SIGTERM) 07:50:38.776586 run iperf3-srv_10.42.42.10(pid=13278): Terminating (SIGTERM) 07:50:38.817597 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13281): Terminating (SIGTERM) 07:50:38.858784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13284): Terminating (SIGTERM) 07:50:38.900179 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13287): Terminating (SIGTERM) 07:50:38.941919 --- ParallelTerminationStrategy: PID 13271 died... 07:50:38.961729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13271): Terminated: ok {rc=0} 07:50:39.007357 --- ParallelTerminationStrategy: PID 13272 died... 07:50:39.026698 run iperf3-srv_10.42.42.10(pid=13272): Terminated {rc=256} 07:50:39.071943 --- ParallelTerminationStrategy: PID 13273 died... 07:50:39.091331 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13273): Terminated: ok {rc=0} 07:50:39.136756 --- ParallelTerminationStrategy: PID 13274 died... 07:50:39.156138 run iperf3-srv_10.42.42.10(pid=13274): Terminated {rc=256} 07:50:39.201388 --- ParallelTerminationStrategy: PID 13275 died... 07:50:39.220788 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13275): Terminated: ok {rc=0} 07:50:39.266382 --- ParallelTerminationStrategy: PID 13276 died... 07:50:39.285799 run iperf3-srv_10.42.42.10(pid=13276): Terminated {rc=256} 07:50:39.331082 --- ParallelTerminationStrategy: PID 13277 died... 07:50:39.350463 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13277): Terminated: ok {rc=0} 07:50:39.395764 --- ParallelTerminationStrategy: PID 13278 died... 07:50:39.415171 run iperf3-srv_10.42.42.10(pid=13278): Terminated {rc=256} 07:50:39.460486 --- ParallelTerminationStrategy: PID 13281 died... 07:50:39.479947 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13281): Terminated: ok {rc=0} 07:50:39.525187 --- ParallelTerminationStrategy: PID 13284 died... 07:50:39.544635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13284): Terminated: ok {rc=0} 07:50:39.589950 --- ParallelTerminationStrategy: PID 13287 died... 07:50:39.609210 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13287): Terminated: ok {rc=0} 07:50:39.695697 bus /gobi_4: Setting Powered False 07:50:40.793002 bus /gobi_4: Setting Powered False 07:50:41.907245 bus /gobi_1: Setting Powered False 07:50:43.005043 bus /gobi_1: Setting Powered False 07:50:44.119306 bus /gobi_0: Setting Powered False 07:50:45.215738 bus /gobi_0: Setting Powered False 07:50:46.331030 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro ping.py ---------------------------------------------- 07:50:47.435685 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:47.446757 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:50:47.490927 tst ping.py: using LAC 26926 07:50:47.605832 tst ping.py: using RAC 151 07:50:47.717215 tst ping.py: using CellId 26926 07:50:47.837204 tst ping.py: using BVCI 26927 07:50:47.947202 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:47.958467 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:47.969561 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:47.980353 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:47.991293 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:48.002279 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:48.013261 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:48.024054 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:50:48.141112 tst ping.py:19: start network... 07:50:48.345423 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:50:48.817390 run create_hlr_db(pid=13289): Launched 07:50:48.941725 bus /gobi_6: Setting Powered False 07:50:50.002680 run create_hlr_db(pid=13289): Terminated: ok {rc=0} 07:50:50.411159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13291): Launched 07:50:50.695654 run osmo-hlr_10.42.42.2(pid=13292): Launched 07:50:50.804441 run osmo-stp_10.42.42.5: Starting osmo-stp 07:50:51.295521 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13294): Launched 07:50:51.581581 run osmo-stp_10.42.42.5(pid=13295): Launched 07:50:51.691074 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:50:52.181493 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13297): Launched 07:50:52.290501 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:50:52.529345 run patchelf(pid=13298): Launched 07:50:52.687689 run osmo-stp_10.42.42.5(pid=13295): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13295)] 07:50:52.807875 run osmo-stp_10.42.42.5(pid=13295): stdout: | (launched: 2022-12-10_07:50:51.529306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:52.929651 run osmo-stp_10.42.42.5(pid=13295): stderr: | [0;m[38;5;43m20221210075051697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075051697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075051697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075051697 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075051698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075051698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075051698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:53.052325 run osmo-stp_10.42.42.5(pid=13295): stdout: | (launched: 2022-12-10_07:50:51.529306) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:50:53.168540 run osmo-stp_10.42.42.5(pid=13295): stderr: | [0;m[38;5;43m20221210075051697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075051697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075051697 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075051697 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075051698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075051698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075051698 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:50:53.306327 run patchelf(pid=13298): Terminating (SIGINT) 07:50:53.466605 run patchelf(pid=13298): Terminated: ok {rc=0} 07:50:53.582330 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13295): Process ended prematurely: osmo-stp_10.42.42.5(pid=13295) [trial-2371↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13295)] [trial-2371↪gprs:trx-lms-limenet-micro↪ping.py:22] 07:50:53.590837 tst ping.py:22: Test FAILED (6.1 sec) 07:50:53.617396 run osmo-hlr_10.42.42.2(pid=13292): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms-limenet-micro↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13292)] 07:50:53.664613 run osmo-hlr_10.42.42.2(pid=13292): stdout: | (launched: 2022-12-10_07:50:50.643572) 07:50:53.713619 run osmo-hlr_10.42.42.2(pid=13292): stderr: | [0;m[1;31m20221210075050818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075050818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075050818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075050818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075050818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075050818 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075050830 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms-limenet-micro/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075050838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075050838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075050838 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:50:53.762864 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13291): Terminating (SIGTERM) 07:50:53.802093 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13294): Terminating (SIGTERM) 07:50:53.841370 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13297): Terminating (SIGTERM) 07:50:53.881092 --- ParallelTerminationStrategy: PID 13291 died... 07:50:53.899825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13291): Terminated: ok {rc=0} 07:50:53.943528 --- ParallelTerminationStrategy: PID 13294 died... 07:50:53.961763 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13294): Terminated: ok {rc=0} 07:50:54.005347 --- ParallelTerminationStrategy: PID 13297 died... 07:50:54.023413 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13297): Terminated: ok {rc=0} 07:50:54.108783 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro ping_idle_ping.py ---------------------------------------------- 07:50:55.197567 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:55.209310 tst gprs:trx-lms-limenet-micro: Using 1 x bts (candidates: 1) 07:50:55.255911 tst ping_idle_ping.py: using LAC 26927 07:50:55.379137 tst ping_idle_ping.py: using RAC 152 07:50:55.499698 tst ping_idle_ping.py: using CellId 26927 07:50:55.613649 tst ping_idle_ping.py: using BVCI 26928 07:50:55.727710 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:55.738803 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:55.749972 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:55.761750 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:55.773222 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:55.784647 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:55.796360 tst gprs:trx-lms-limenet-micro: Using 1 x ip_address (candidates: 9) 07:50:55.807711 tst gprs:trx-lms-limenet-micro: Using 1 x modem (candidates: 4) 07:50:55.923910 tst ping_idle_ping.py:24: start network... 07:50:56.131067 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:50:56.606092 run create_hlr_db(pid=13299): Launched 07:50:56.731163 bus /gobi_6: Setting Powered False 07:50:57.792325 run create_hlr_db(pid=13299): Terminated: ok {rc=0} 07:50:58.200165 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13301): Launched 07:50:58.484737 run osmo-hlr_10.42.42.2(pid=13302): Launched 07:50:58.595174 run osmo-stp_10.42.42.5: Starting osmo-stp 07:50:59.086094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13304): Launched 07:50:59.372267 run osmo-stp_10.42.42.5(pid=13305): Launched 07:50:59.482223 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:50:59.975192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13307): Launched 07:51:00.085127 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:51:00.326350 run patchelf(pid=13308): Launched 07:51:00.485556 run osmo-stp_10.42.42.5(pid=13305): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13305)] 07:51:00.607305 run osmo-stp_10.42.42.5(pid=13305): stdout: | (launched: 2022-12-10_07:50:59.319819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:00.730629 run osmo-stp_10.42.42.5(pid=13305): stderr: | [0;m[38;5;43m20221210075059489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075059489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075059489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075059489 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075059490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075059490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075059490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:00.860109 run osmo-stp_10.42.42.5(pid=13305): stdout: | (launched: 2022-12-10_07:50:59.319819) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:00.990730 run osmo-stp_10.42.42.5(pid=13305): stderr: | [0;m[38;5;43m20221210075059489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075059489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075059489 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075059489 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075059490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075059490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075059490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:01.178028 run patchelf(pid=13308): Terminating (SIGINT) 07:51:01.344003 run patchelf(pid=13308): Terminated: ok {rc=0} 07:51:01.463788 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13305): Process ended prematurely: osmo-stp_10.42.42.5(pid=13305) [trial-2371↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13305)] [trial-2371↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27] 07:51:01.473847 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 07:51:01.502832 run osmo-hlr_10.42.42.2(pid=13302): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13302)] 07:51:01.552901 run osmo-hlr_10.42.42.2(pid=13302): stdout: | (launched: 2022-12-10_07:50:58.432730) 07:51:01.604296 run osmo-hlr_10.42.42.2(pid=13302): stderr: | [0;m[1;31m20221210075058604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075058604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075058604 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075058605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075058605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075058605 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075058617 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms-limenet-micro/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075058625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075058626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075058626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:51:01.656396 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13301): Terminating (SIGTERM) 07:51:01.698731 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13304): Terminating (SIGTERM) 07:51:01.741874 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13307): Terminating (SIGTERM) 07:51:01.783842 --- ParallelTerminationStrategy: PID 13301 died... 07:51:01.803367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13301): Terminated: ok {rc=0} 07:51:01.849515 --- ParallelTerminationStrategy: PID 13304 died... 07:51:01.868887 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13304): Terminated: ok {rc=0} 07:51:01.914925 --- ParallelTerminationStrategy: PID 13307 died... 07:51:01.934466 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13307): Terminated: ok {rc=0} 07:51:02.024227 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro+mod-bts0-egprs --------------------------------------------------------------------- 07:51:03.320842 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:51:03.326406 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:51:03.356289 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:51:03.393809 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:51:03.478404 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:51:03.506764 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:51:03.544280 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:51:04.138436 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:51:04.185524 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:04.196274 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:51:04.242232 tst cs_paging_gprs_active.py: using LAC 26928 07:51:04.357373 tst cs_paging_gprs_active.py: using RAC 153 07:51:04.473400 tst cs_paging_gprs_active.py: using CellId 26928 07:51:04.589317 tst cs_paging_gprs_active.py: using BVCI 26929 07:51:04.694332 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:04.705197 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:04.715669 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:04.726559 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:04.737386 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:04.748133 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:04.759100 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:04.769807 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:04.780817 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:51:04.899209 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:51:05.014140 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:51:05.210060 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:51:05.500223 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13312): Launched 07:51:05.752844 run iperf3-srv_10.42.42.10(pid=13313): Launched 07:51:05.862636 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:51:06.056843 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:51:06.348661 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13314): Launched 07:51:06.601868 run iperf3-srv_10.42.42.10(pid=13315): Launched 07:51:06.711081 tst cs_paging_gprs_active.py:38: start network... 07:51:06.905557 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:51:07.354766 run create_hlr_db(pid=13316): Launched 07:51:07.466012 bus /gobi_6: Setting Powered False 07:51:08.524167 run create_hlr_db(pid=13316): Terminated: ok {rc=0} 07:51:08.948758 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13318): Launched 07:51:09.259026 run osmo-hlr_10.42.42.2(pid=13319): Launched 07:51:09.378239 run osmo-stp_10.42.42.5: Starting osmo-stp 07:51:09.916287 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13321): Launched 07:51:10.226139 run osmo-stp_10.42.42.5(pid=13322): Launched 07:51:10.345112 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:51:10.880652 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13324): Launched 07:51:10.999872 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:51:11.262791 run patchelf(pid=13325): Launched 07:51:11.435664 run osmo-stp_10.42.42.5(pid=13322): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13322)] 07:51:11.567814 run osmo-stp_10.42.42.5(pid=13322): stdout: | (launched: 2022-12-10_07:51:10.170167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:11.701837 run osmo-stp_10.42.42.5(pid=13322): stderr: | [0;m[38;5;43m20221210075110358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075110359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075110359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075110359 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075110362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075110362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075110362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:11.835437 run osmo-stp_10.42.42.5(pid=13322): stdout: | (launched: 2022-12-10_07:51:10.170167) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:11.962794 run osmo-stp_10.42.42.5(pid=13322): stderr: | [0;m[38;5;43m20221210075110358 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075110359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075110359 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075110359 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075110362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075110362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075110362 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:12.113902 run patchelf(pid=13325): Terminating (SIGINT) 07:51:12.288802 run patchelf(pid=13325): Terminated: ok {rc=0} 07:51:12.415574 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13322): Process ended prematurely: osmo-stp_10.42.42.5(pid=13322) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13322)] [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:51:12.425769 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 07:51:12.453932 run osmo-hlr_10.42.42.2(pid=13319): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13319)] 07:51:12.503547 run osmo-hlr_10.42.42.2(pid=13319): stdout: | (launched: 2022-12-10_07:51:09.202913) 07:51:12.555161 run osmo-hlr_10.42.42.2(pid=13319): stderr: | [0;m[1;31m20221210075109400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075109400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075109400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075109400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075109400 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075109401 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075109413 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms-limenet-micro+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075109423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075109423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075109423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:51:12.607115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13312): Terminating (SIGTERM) 07:51:12.648767 run iperf3-srv_10.42.42.10(pid=13313): Terminating (SIGTERM) 07:51:12.690467 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13314): Terminating (SIGTERM) 07:51:12.732149 run iperf3-srv_10.42.42.10(pid=13315): Terminating (SIGTERM) 07:51:12.773730 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13318): Terminating (SIGTERM) 07:51:12.815257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13321): Terminating (SIGTERM) 07:51:12.856811 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13324): Terminating (SIGTERM) 07:51:12.899106 --- ParallelTerminationStrategy: PID 13312 died... 07:51:12.919034 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13312): Terminated: ok {rc=0} 07:51:12.964902 --- ParallelTerminationStrategy: PID 13313 died... 07:51:12.984573 run iperf3-srv_10.42.42.10(pid=13313): Terminated {rc=256} 07:51:13.030462 --- ParallelTerminationStrategy: PID 13314 died... 07:51:13.049955 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13314): Terminated: ok {rc=0} 07:51:13.095696 --- ParallelTerminationStrategy: PID 13315 died... 07:51:13.115110 run iperf3-srv_10.42.42.10(pid=13315): Terminated {rc=256} 07:51:13.161071 --- ParallelTerminationStrategy: PID 13318 died... 07:51:13.181295 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13318): Terminated: ok {rc=0} 07:51:13.227445 --- ParallelTerminationStrategy: PID 13321 died... 07:51:13.246990 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13321): Terminated: ok {rc=0} 07:51:13.292938 --- ParallelTerminationStrategy: PID 13324 died... 07:51:13.312462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13324): Terminated: ok {rc=0} 07:51:13.400694 bus /gobi_0: Setting Powered False 07:51:14.499430 bus /gobi_0: Setting Powered False 07:51:15.614079 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:51:16.788657 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:16.802393 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:51:16.859802 tst iperf3.py: using LAC 26929 07:51:16.977391 tst iperf3.py: using RAC 154 07:51:17.094869 tst iperf3.py: using CellId 26929 07:51:17.213200 tst iperf3.py: using BVCI 26930 07:51:17.323215 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:17.334324 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:17.345193 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:17.356225 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:17.367106 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:17.378214 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:17.389504 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:17.400329 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:17.411489 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:51:17.529365 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:51:17.738856 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:51:18.049549 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13326): Launched 07:51:18.318801 run iperf3-srv_10.42.42.10(pid=13327): Launched 07:51:18.428572 tst iperf3.py:8: start network... 07:51:18.622603 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:51:19.068340 run create_hlr_db(pid=13328): Launched 07:51:19.181519 bus /gobi_6: Setting Powered False 07:51:20.239497 run create_hlr_db(pid=13328): Terminated: ok {rc=0} 07:51:20.642578 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13330): Launched 07:51:20.932321 run osmo-hlr_10.42.42.2(pid=13331): Launched 07:51:21.043533 run osmo-stp_10.42.42.5: Starting osmo-stp 07:51:21.538791 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13333): Launched 07:51:21.826068 run osmo-stp_10.42.42.5(pid=13334): Launched 07:51:21.990584 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:51:22.486454 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13336): Launched 07:51:22.597531 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:51:22.841217 run patchelf(pid=13337): Launched 07:51:23.002301 run osmo-stp_10.42.42.5(pid=13334): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13334)] 07:51:23.124637 run osmo-stp_10.42.42.5(pid=13334): stdout: | (launched: 2022-12-10_07:51:21.773671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:23.249236 run osmo-stp_10.42.42.5(pid=13334): stderr: | [0;m[38;5;43m20221210075121960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075121960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075121960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075121961 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075121963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075121964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075121964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:23.373550 run osmo-stp_10.42.42.5(pid=13334): stdout: | (launched: 2022-12-10_07:51:21.773671) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:23.491820 run osmo-stp_10.42.42.5(pid=13334): stderr: | [0;m[38;5;43m20221210075121960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075121960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075121960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075121961 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075121963 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075121964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075121964 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:23.632548 run patchelf(pid=13337): Terminating (SIGINT) 07:51:23.795719 run patchelf(pid=13337): Terminated: ok {rc=0} 07:51:23.913740 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13334): Process ended prematurely: osmo-stp_10.42.42.5(pid=13334) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13334)] [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8] 07:51:23.923203 tst iperf3.py:8: Test FAILED (7.2 sec) 07:51:23.949945 run osmo-hlr_10.42.42.2(pid=13331): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13331)] 07:51:23.997483 run osmo-hlr_10.42.42.2(pid=13331): stdout: | (launched: 2022-12-10_07:51:20.879201) 07:51:24.046498 run osmo-hlr_10.42.42.2(pid=13331): stderr: | [0;m[1;31m20221210075121052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075121052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075121052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075121052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075121052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075121053 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075121065 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075121073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075121073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075121073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:51:24.096025 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13326): Terminating (SIGTERM) 07:51:24.135651 run iperf3-srv_10.42.42.10(pid=13327): Terminating (SIGTERM) 07:51:24.175232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13330): Terminating (SIGTERM) 07:51:24.214865 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13333): Terminating (SIGTERM) 07:51:24.254453 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13336): Terminating (SIGTERM) 07:51:24.294161 --- ParallelTerminationStrategy: PID 13326 died... 07:51:24.312791 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13326): Terminated: ok {rc=0} 07:51:24.356936 --- ParallelTerminationStrategy: PID 13327 died... 07:51:24.375405 run iperf3-srv_10.42.42.10(pid=13327): Terminated {rc=256} 07:51:24.419273 --- ParallelTerminationStrategy: PID 13330 died... 07:51:24.437656 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13330): Terminated: ok {rc=0} 07:51:24.481086 --- ParallelTerminationStrategy: PID 13333 died... 07:51:24.499489 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13333): Terminated: ok {rc=0} 07:51:24.543278 --- ParallelTerminationStrategy: PID 13336 died... 07:51:24.561683 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13336): Terminated: ok {rc=0} 07:51:24.647268 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:51:25.791571 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:25.803075 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:51:25.849742 tst iperf3m4.py: using LAC 26930 07:51:25.964792 tst iperf3m4.py: using RAC 155 07:51:26.080153 tst iperf3m4.py: using CellId 26930 07:51:26.193230 tst iperf3m4.py: using BVCI 26931 07:51:26.299107 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:26.310059 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:26.320761 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:26.331747 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:26.342676 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:26.353630 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:26.364561 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:26.375497 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:26.386499 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:51:26.509334 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:51:26.625851 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:51:26.744509 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:51:26.860684 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:51:27.070827 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:51:27.382399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13338): Launched 07:51:27.652668 run iperf3-srv_10.42.42.10(pid=13339): Launched 07:51:27.770232 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:51:27.979611 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:51:28.290507 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13340): Launched 07:51:28.560232 run iperf3-srv_10.42.42.10(pid=13341): Launched 07:51:28.676848 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:51:28.885180 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:51:29.195978 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13342): Launched 07:51:29.466025 run iperf3-srv_10.42.42.10(pid=13343): Launched 07:51:29.582968 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:51:29.791696 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:51:30.103085 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13344): Launched 07:51:30.372369 run iperf3-srv_10.42.42.10(pid=13345): Launched 07:51:30.488768 tst iperf3m4.py:8: start network... 07:51:30.698541 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:51:31.207053 run create_hlr_db(pid=13346): Launched 07:51:31.368691 bus /gobi_6: Setting Powered False 07:51:32.430506 run create_hlr_db(pid=13346): Terminated: ok {rc=0} 07:51:32.863401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13348): Launched 07:51:33.172508 run osmo-hlr_10.42.42.2(pid=13349): Launched 07:51:33.290595 run osmo-stp_10.42.42.5: Starting osmo-stp 07:51:33.825517 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13351): Launched 07:51:34.134434 run osmo-stp_10.42.42.5(pid=13352): Launched 07:51:34.252741 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:51:34.787714 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13354): Launched 07:51:34.907074 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:51:35.169132 run patchelf(pid=13355): Launched 07:51:35.341849 run osmo-stp_10.42.42.5(pid=13352): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13352)] 07:51:35.473536 run osmo-stp_10.42.42.5(pid=13352): stdout: | (launched: 2022-12-10_07:51:34.078219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:35.607054 run osmo-stp_10.42.42.5(pid=13352): stderr: | [0;m[38;5;43m20221210075134266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075134266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075134266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075134267 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075134267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075134267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075134267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:35.740259 run osmo-stp_10.42.42.5(pid=13352): stdout: | (launched: 2022-12-10_07:51:34.078219) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:35.867428 run osmo-stp_10.42.42.5(pid=13352): stderr: | [0;m[38;5;43m20221210075134266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075134266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075134266 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075134267 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075134267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075134267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075134267 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:36.018050 run patchelf(pid=13355): Terminating (SIGINT) 07:51:36.192470 run patchelf(pid=13355): Terminated: ok {rc=0} 07:51:36.318309 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13352): Process ended prematurely: osmo-stp_10.42.42.5(pid=13352) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13352)] [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8] 07:51:36.328208 tst iperf3m4.py:8: Test FAILED (10.6 sec) 07:51:36.356481 run osmo-hlr_10.42.42.2(pid=13349): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13349)] 07:51:36.405767 run osmo-hlr_10.42.42.2(pid=13349): stdout: | (launched: 2022-12-10_07:51:33.116562) 07:51:36.456732 run osmo-hlr_10.42.42.2(pid=13349): stderr: | [0;m[1;31m20221210075133310 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075133310 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075133310 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075133311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075133311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075133311 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075133325 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms-limenet-micro+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075133333 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075133334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075133334 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:51:36.507918 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13338): Terminating (SIGTERM) 07:51:36.549034 run iperf3-srv_10.42.42.10(pid=13339): Terminating (SIGTERM) 07:51:36.590414 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13340): Terminating (SIGTERM) 07:51:36.631890 run iperf3-srv_10.42.42.10(pid=13341): Terminating (SIGTERM) 07:51:36.672820 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13342): Terminating (SIGTERM) 07:51:36.714358 run iperf3-srv_10.42.42.10(pid=13343): Terminating (SIGTERM) 07:51:36.755512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13344): Terminating (SIGTERM) 07:51:36.796866 run iperf3-srv_10.42.42.10(pid=13345): Terminating (SIGTERM) 07:51:36.837945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13348): Terminating (SIGTERM) 07:51:36.879086 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13351): Terminating (SIGTERM) 07:51:36.920233 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13354): Terminating (SIGTERM) 07:51:36.961623 --- ParallelTerminationStrategy: PID 13338 died... 07:51:36.981353 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13338): Terminated: ok {rc=0} 07:51:37.026950 --- ParallelTerminationStrategy: PID 13339 died... 07:51:37.046231 run iperf3-srv_10.42.42.10(pid=13339): Terminated {rc=256} 07:51:37.091671 --- ParallelTerminationStrategy: PID 13340 died... 07:51:37.110811 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13340): Terminated: ok {rc=0} 07:51:37.156086 --- ParallelTerminationStrategy: PID 13341 died... 07:51:37.175385 run iperf3-srv_10.42.42.10(pid=13341): Terminated {rc=256} 07:51:37.220618 --- ParallelTerminationStrategy: PID 13342 died... 07:51:37.239962 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13342): Terminated: ok {rc=0} 07:51:37.285372 --- ParallelTerminationStrategy: PID 13343 died... 07:51:37.304642 run iperf3-srv_10.42.42.10(pid=13343): Terminated {rc=256} 07:51:37.350049 --- ParallelTerminationStrategy: PID 13344 died... 07:51:37.369948 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13344): Terminated: ok {rc=0} 07:51:37.415351 --- ParallelTerminationStrategy: PID 13345 died... 07:51:37.434800 run iperf3-srv_10.42.42.10(pid=13345): Terminated {rc=256} 07:51:37.480129 --- ParallelTerminationStrategy: PID 13348 died... 07:51:37.499681 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13348): Terminated: ok {rc=0} 07:51:37.544815 --- ParallelTerminationStrategy: PID 13351 died... 07:51:37.564529 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13351): Terminated: ok {rc=0} 07:51:37.609788 --- ParallelTerminationStrategy: PID 13354 died... 07:51:37.629349 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13354): Terminated: ok {rc=0} 07:51:37.715889 bus /gobi_4: Setting Powered False 07:51:38.814246 bus /gobi_4: Setting Powered False 07:51:39.929121 bus /gobi_1: Setting Powered False 07:51:41.024779 bus /gobi_1: Setting Powered False 07:51:42.137321 bus /gobi_0: Setting Powered False 07:51:43.234753 bus /gobi_0: Setting Powered False 07:51:44.351417 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping.py ---------------------------------------------- 07:51:45.453824 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:45.465794 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:51:45.513613 tst ping.py: using LAC 26931 07:51:45.634403 tst ping.py: using RAC 156 07:51:45.753856 tst ping.py: using CellId 26931 07:51:45.877489 tst ping.py: using BVCI 26932 07:51:45.992207 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:46.004082 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:46.015740 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:46.029433 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:46.042262 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:46.053891 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:46.066635 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:46.080357 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:51:46.199892 tst ping.py:19: start network... 07:51:46.412795 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:51:46.872664 run create_hlr_db(pid=13357): Launched 07:51:47.019991 bus /gobi_6: Setting Powered False 07:51:48.077469 run create_hlr_db(pid=13357): Terminated: ok {rc=0} 07:51:48.477115 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13359): Launched 07:51:48.761600 run osmo-hlr_10.42.42.2(pid=13360): Launched 07:51:48.871044 run osmo-stp_10.42.42.5: Starting osmo-stp 07:51:49.376278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13362): Launched 07:51:49.660510 run osmo-stp_10.42.42.5(pid=13363): Launched 07:51:49.769441 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:51:50.259922 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13365): Launched 07:51:50.369564 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:51:50.609340 run patchelf(pid=13366): Launched 07:51:50.768515 run osmo-stp_10.42.42.5(pid=13363): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13363)] 07:51:50.889978 run osmo-stp_10.42.42.5(pid=13363): stdout: | (launched: 2022-12-10_07:51:49.608338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:51.012567 run osmo-stp_10.42.42.5(pid=13363): stderr: | [0;m[38;5;43m20221210075149776 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075149777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075149777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075149777 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075149778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075149778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075149778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:51.135665 run osmo-stp_10.42.42.5(pid=13363): stdout: | (launched: 2022-12-10_07:51:49.608338) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:51.252774 run osmo-stp_10.42.42.5(pid=13363): stderr: | [0;m[38;5;43m20221210075149776 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075149777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075149777 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075149777 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075149778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075149778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075149778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:51.391694 run patchelf(pid=13366): Terminating (SIGINT) 07:51:51.553593 run patchelf(pid=13366): Terminated: ok {rc=0} 07:51:51.670278 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13363): Process ended prematurely: osmo-stp_10.42.42.5(pid=13363) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13363)] [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22] 07:51:51.678920 tst ping.py:22: Test FAILED (6.2 sec) 07:51:51.705544 run osmo-hlr_10.42.42.2(pid=13360): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13360)] 07:51:51.753307 run osmo-hlr_10.42.42.2(pid=13360): stdout: | (launched: 2022-12-10_07:51:48.709606) 07:51:51.802676 run osmo-hlr_10.42.42.2(pid=13360): stderr: | [0;m[1;31m20221210075148880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075148880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075148880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075148880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075148880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075148880 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075148892 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075148901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075148901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075148901 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:51:51.852351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13359): Terminating (SIGTERM) 07:51:51.892141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13362): Terminating (SIGTERM) 07:51:51.931824 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13365): Terminating (SIGTERM) 07:51:51.971707 --- ParallelTerminationStrategy: PID 13359 died... 07:51:51.990699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13359): Terminated: ok {rc=0} 07:51:52.035394 --- ParallelTerminationStrategy: PID 13362 died... 07:51:52.054014 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13362): Terminated: ok {rc=0} 07:51:52.098115 --- ParallelTerminationStrategy: PID 13365 died... 07:51:52.116836 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13365): Terminated: ok {rc=0} 07:51:52.200390 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:51:53.287148 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:53.299448 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:51:53.347629 tst ping_idle_ping.py: using LAC 26932 07:51:53.469229 tst ping_idle_ping.py: using RAC 157 07:51:53.590094 tst ping_idle_ping.py: using CellId 26932 07:51:53.711531 tst ping_idle_ping.py: using BVCI 26933 07:51:53.822472 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:53.833811 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:53.844928 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:53.856578 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:53.868206 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:53.879756 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:53.891527 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:51:53.903023 tst gprs:trx-lms-limenet-micro+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:51:54.019798 tst ping_idle_ping.py:24: start network... 07:51:54.226611 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:51:54.703779 run create_hlr_db(pid=13367): Launched 07:51:54.829477 bus /gobi_6: Setting Powered False 07:51:55.890705 run create_hlr_db(pid=13367): Terminated: ok {rc=0} 07:51:56.301949 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13369): Launched 07:51:56.588269 run osmo-hlr_10.42.42.2(pid=13370): Launched 07:51:56.699005 run osmo-stp_10.42.42.5: Starting osmo-stp 07:51:57.218568 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13372): Launched 07:51:57.524418 run osmo-stp_10.42.42.5(pid=13373): Launched 07:51:57.642939 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:51:58.170269 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13375): Launched 07:51:58.287473 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:51:58.545327 run patchelf(pid=13376): Launched 07:51:58.716532 run osmo-stp_10.42.42.5(pid=13373): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13373)] 07:51:58.846402 run osmo-stp_10.42.42.5(pid=13373): stdout: | (launched: 2022-12-10_07:51:57.467997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:58.977702 run osmo-stp_10.42.42.5(pid=13373): stderr: | [0;m[38;5;43m20221210075157655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075157655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075157656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075157656 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075157658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075157659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075157659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:59.109177 run osmo-stp_10.42.42.5(pid=13373): stdout: | (launched: 2022-12-10_07:51:57.467997) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:51:59.234713 run osmo-stp_10.42.42.5(pid=13373): stderr: | [0;m[38;5;43m20221210075157655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075157655 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075157656 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075157656 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075157658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075157659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075157659 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:51:59.383529 run patchelf(pid=13376): Terminating (SIGINT) 07:51:59.555693 run patchelf(pid=13376): Terminated: ok {rc=0} 07:51:59.680849 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13373): Process ended prematurely: osmo-stp_10.42.42.5(pid=13373) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13373)] [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27] 07:51:59.690303 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 07:51:59.718066 run osmo-hlr_10.42.42.2(pid=13370): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13370)] 07:51:59.767490 run osmo-hlr_10.42.42.2(pid=13370): stdout: | (launched: 2022-12-10_07:51:56.535745) 07:51:59.818590 run osmo-hlr_10.42.42.2(pid=13370): stderr: | [0;m[1;31m20221210075156709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075156709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075156709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075156709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075156709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075156709 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075156721 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms-limenet-micro+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075156729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075156729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075156729 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:51:59.870279 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13369): Terminating (SIGTERM) 07:51:59.911790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13372): Terminating (SIGTERM) 07:51:59.953298 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13375): Terminating (SIGTERM) 07:51:59.995158 --- ParallelTerminationStrategy: PID 13369 died... 07:52:00.014968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13369): Terminated: ok {rc=0} 07:52:00.060812 --- ParallelTerminationStrategy: PID 13372 died... 07:52:00.080318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13372): Terminated: ok {rc=0} 07:52:00.125928 --- ParallelTerminationStrategy: PID 13375 died... 07:52:00.145404 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13375): Terminated: ok {rc=0} 07:52:00.232460 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:52:01.586375 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:52:01.597779 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:52:01.641812 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:52:01.693598 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:52:01.804331 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:52:01.856593 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:52:01.916358 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:52:02.467010 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:52:02.518073 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:02.529671 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:52:02.595978 tst cs_paging_gprs_active.py: using LAC 26933 07:52:02.717944 tst cs_paging_gprs_active.py: using RAC 158 07:52:02.839884 tst cs_paging_gprs_active.py: using CellId 26933 07:52:02.961202 tst cs_paging_gprs_active.py: using BVCI 26934 07:52:03.075245 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:03.086849 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:03.098096 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:03.109286 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:03.120397 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:03.131560 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:03.142923 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:03.154066 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:03.165360 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:52:03.283918 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:52:03.405099 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:52:03.616903 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:52:03.929765 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13380): Launched 07:52:04.201154 run iperf3-srv_10.42.42.10(pid=13381): Launched 07:52:04.318872 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:52:04.529349 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:52:04.841817 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13382): Launched 07:52:05.112471 run iperf3-srv_10.42.42.10(pid=13383): Launched 07:52:05.229055 tst cs_paging_gprs_active.py:38: start network... 07:52:05.438544 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:52:05.920405 run create_hlr_db(pid=13384): Launched 07:52:06.035696 bus /gobi_6: Setting Powered False 07:52:07.095112 run create_hlr_db(pid=13384): Terminated: ok {rc=0} 07:52:07.502794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13386): Launched 07:52:07.796663 run osmo-hlr_10.42.42.2(pid=13387): Launched 07:52:07.908341 run osmo-stp_10.42.42.5: Starting osmo-stp 07:52:08.408723 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13389): Launched 07:52:08.700766 run osmo-stp_10.42.42.5(pid=13390): Launched 07:52:08.813231 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:52:09.315948 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13392): Launched 07:52:09.428047 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:52:09.674934 run patchelf(pid=13393): Launched 07:52:09.837715 run osmo-stp_10.42.42.5(pid=13390): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13390)] 07:52:09.962349 run osmo-stp_10.42.42.5(pid=13390): stdout: | (launched: 2022-12-10_07:52:08.647340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:10.088895 run osmo-stp_10.42.42.5(pid=13390): stderr: | [0;m[38;5;43m20221210075208816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075208816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075208817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075208817 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075208817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075208818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075208818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:10.215287 run osmo-stp_10.42.42.5(pid=13390): stdout: | (launched: 2022-12-10_07:52:08.647340) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:10.335317 run osmo-stp_10.42.42.5(pid=13390): stderr: | [0;m[38;5;43m20221210075208816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075208816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075208817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075208817 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075208817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075208818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075208818 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:10.477329 run patchelf(pid=13393): Terminating (SIGINT) 07:52:10.643282 run patchelf(pid=13393): Terminated: ok {rc=0} 07:52:10.763574 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13390): Process ended prematurely: osmo-stp_10.42.42.5(pid=13390) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13390)] [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:52:10.772889 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 07:52:10.800449 run osmo-hlr_10.42.42.2(pid=13387): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13387)] 07:52:10.848324 run osmo-hlr_10.42.42.2(pid=13387): stdout: | (launched: 2022-12-10_07:52:07.743338) 07:52:10.897598 run osmo-hlr_10.42.42.2(pid=13387): stderr: | [0;m[1;31m20221210075207919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075207919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075207919 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075207920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075207920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075207920 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075207947 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075207957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075207957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075207957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:52:10.947293 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13380): Terminating (SIGTERM) 07:52:10.987003 run iperf3-srv_10.42.42.10(pid=13381): Terminating (SIGTERM) 07:52:11.026818 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13382): Terminating (SIGTERM) 07:52:11.066538 run iperf3-srv_10.42.42.10(pid=13383): Terminating (SIGTERM) 07:52:11.106156 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13386): Terminating (SIGTERM) 07:52:11.146032 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13389): Terminating (SIGTERM) 07:52:11.185645 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13392): Terminating (SIGTERM) 07:52:11.225599 --- ParallelTerminationStrategy: PID 13380 died... 07:52:11.244715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13380): Terminated: ok {rc=0} 07:52:11.289166 --- ParallelTerminationStrategy: PID 13381 died... 07:52:11.307597 run iperf3-srv_10.42.42.10(pid=13381): Terminated {rc=256} 07:52:11.351273 --- ParallelTerminationStrategy: PID 13382 died... 07:52:11.369755 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13382): Terminated: ok {rc=0} 07:52:11.413214 --- ParallelTerminationStrategy: PID 13383 died... 07:52:11.431418 run iperf3-srv_10.42.42.10(pid=13383): Terminated {rc=256} 07:52:11.475093 --- ParallelTerminationStrategy: PID 13386 died... 07:52:11.493594 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13386): Terminated: ok {rc=0} 07:52:11.537252 --- ParallelTerminationStrategy: PID 13389 died... 07:52:11.555617 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13389): Terminated: ok {rc=0} 07:52:11.599494 --- ParallelTerminationStrategy: PID 13392 died... 07:52:11.617974 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13392): Terminated: ok {rc=0} 07:52:11.700767 bus /gobi_0: Setting Powered False 07:52:12.795651 bus /gobi_0: Setting Powered False 07:52:13.910013 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:52:15.053539 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:15.065336 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:52:15.133412 tst iperf3.py: using LAC 26934 07:52:15.253923 tst iperf3.py: using RAC 159 07:52:15.376704 tst iperf3.py: using CellId 26934 07:52:15.496671 tst iperf3.py: using BVCI 26935 07:52:15.610346 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:15.621785 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:15.633142 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:15.644495 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:15.655600 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:15.667371 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:15.678723 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:15.689978 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:15.701389 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:52:15.818535 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:52:16.034646 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:52:16.355419 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13394): Launched 07:52:16.653697 run iperf3-srv_10.42.42.10(pid=13395): Launched 07:52:16.775807 tst iperf3.py:8: start network... 07:52:16.978597 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:52:17.437151 run create_hlr_db(pid=13396): Launched 07:52:17.548900 bus /gobi_6: Setting Powered False 07:52:18.607207 run create_hlr_db(pid=13396): Terminated: ok {rc=0} 07:52:19.013456 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13398): Launched 07:52:19.304131 run osmo-hlr_10.42.42.2(pid=13399): Launched 07:52:19.415895 run osmo-stp_10.42.42.5: Starting osmo-stp 07:52:19.960075 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13401): Launched 07:52:20.271669 run osmo-stp_10.42.42.5(pid=13402): Launched 07:52:20.391263 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:52:20.930750 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13404): Launched 07:52:21.049793 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:52:21.311297 run patchelf(pid=13405): Launched 07:52:21.484375 run osmo-stp_10.42.42.5(pid=13402): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13402)] 07:52:21.616738 run osmo-stp_10.42.42.5(pid=13402): stdout: | (launched: 2022-12-10_07:52:20.215468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:21.751499 run osmo-stp_10.42.42.5(pid=13402): stderr: | [0;m[38;5;43m20221210075220405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075220405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075220405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075220405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075220406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075220406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075220406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:21.885342 run osmo-stp_10.42.42.5(pid=13402): stdout: | (launched: 2022-12-10_07:52:20.215468) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:22.013164 run osmo-stp_10.42.42.5(pid=13402): stderr: | [0;m[38;5;43m20221210075220405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075220405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075220405 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075220405 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075220406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075220406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075220406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:22.164929 run patchelf(pid=13405): Terminating (SIGINT) 07:52:22.340541 run patchelf(pid=13405): Terminated: ok {rc=0} 07:52:22.467564 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13402): Process ended prematurely: osmo-stp_10.42.42.5(pid=13402) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13402)] [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8] 07:52:22.477579 tst iperf3.py:8: Test FAILED (7.5 sec) 07:52:22.505708 run osmo-hlr_10.42.42.2(pid=13399): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13399)] 07:52:22.554981 run osmo-hlr_10.42.42.2(pid=13399): stdout: | (launched: 2022-12-10_07:52:19.250790) 07:52:22.606977 run osmo-hlr_10.42.42.2(pid=13399): stderr: | [0;m[1;31m20221210075219428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075219428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075219428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075219428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075219428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075219428 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075219444 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075219453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075219453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075219453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:52:22.658744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13394): Terminating (SIGTERM) 07:52:22.700265 run iperf3-srv_10.42.42.10(pid=13395): Terminating (SIGTERM) 07:52:22.741602 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13398): Terminating (SIGTERM) 07:52:22.782907 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13401): Terminating (SIGTERM) 07:52:22.823960 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13404): Terminating (SIGTERM) 07:52:22.865384 --- ParallelTerminationStrategy: PID 13394 died... 07:52:22.885114 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13394): Terminated: ok {rc=0} 07:52:22.930853 --- ParallelTerminationStrategy: PID 13395 died... 07:52:22.950060 run iperf3-srv_10.42.42.10(pid=13395): Terminated {rc=256} 07:52:22.995365 --- ParallelTerminationStrategy: PID 13398 died... 07:52:23.014616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13398): Terminated: ok {rc=0} 07:52:23.059654 --- ParallelTerminationStrategy: PID 13401 died... 07:52:23.078848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13401): Terminated: ok {rc=0} 07:52:23.123964 --- ParallelTerminationStrategy: PID 13404 died... 07:52:23.143258 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13404): Terminated: ok {rc=0} 07:52:23.230137 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:52:24.374067 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:24.385782 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:52:24.451967 tst iperf3m4.py: using LAC 26935 07:52:24.568051 tst iperf3m4.py: using RAC 160 07:52:24.683633 tst iperf3m4.py: using CellId 26935 07:52:24.799574 tst iperf3m4.py: using BVCI 26936 07:52:24.904716 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:24.915757 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:24.926610 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:24.937705 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:24.948673 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:24.959667 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:24.970678 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:24.981690 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:24.992619 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:52:25.106477 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:52:25.227058 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:52:25.345221 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:52:25.464133 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:52:25.675463 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:52:25.988902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13406): Launched 07:52:26.259160 run iperf3-srv_10.42.42.10(pid=13407): Launched 07:52:26.376290 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:52:26.585480 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:52:26.897148 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13408): Launched 07:52:27.167028 run iperf3-srv_10.42.42.10(pid=13409): Launched 07:52:27.283644 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:52:27.493178 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:52:27.806456 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13410): Launched 07:52:28.076673 run iperf3-srv_10.42.42.10(pid=13411): Launched 07:52:28.193440 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:52:28.402416 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:52:28.715630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13412): Launched 07:52:28.986197 run iperf3-srv_10.42.42.10(pid=13413): Launched 07:52:29.102885 tst iperf3m4.py:8: start network... 07:52:29.312638 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:52:29.793838 run create_hlr_db(pid=13414): Launched 07:52:29.921589 bus /gobi_6: Setting Powered False 07:52:30.979355 run create_hlr_db(pid=13414): Terminated: ok {rc=0} 07:52:31.451814 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13416): Launched 07:52:31.776136 run osmo-hlr_10.42.42.2(pid=13417): Launched 07:52:32.011982 run osmo-stp_10.42.42.5: Starting osmo-stp 07:52:32.652762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13419): Launched 07:52:32.963496 run osmo-stp_10.42.42.5(pid=13420): Launched 07:52:33.083051 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:52:33.620070 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13422): Launched 07:52:33.739697 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:52:34.002910 run patchelf(pid=13423): Launched 07:52:34.176396 run osmo-stp_10.42.42.5(pid=13420): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13420)] 07:52:34.308055 run osmo-stp_10.42.42.5(pid=13420): stdout: | (launched: 2022-12-10_07:52:32.906998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:34.441814 run osmo-stp_10.42.42.5(pid=13420): stderr: | [0;m[38;5;43m20221210075233097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075233097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075233098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075233098 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075233099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075233099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075233099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:34.575256 run osmo-stp_10.42.42.5(pid=13420): stdout: | (launched: 2022-12-10_07:52:32.906998) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:34.703338 run osmo-stp_10.42.42.5(pid=13420): stderr: | [0;m[38;5;43m20221210075233097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075233097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075233098 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075233098 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075233099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075233099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075233099 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:34.854396 run patchelf(pid=13423): Terminating (SIGINT) 07:52:35.029300 run patchelf(pid=13423): Terminated: ok {rc=0} 07:52:35.155311 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13420): Process ended prematurely: osmo-stp_10.42.42.5(pid=13420) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13420)] [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:52:35.165319 tst iperf3m4.py:8: Test FAILED (10.8 sec) 07:52:35.193476 run osmo-hlr_10.42.42.2(pid=13417): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13417)] 07:52:35.242825 run osmo-hlr_10.42.42.2(pid=13417): stdout: | (launched: 2022-12-10_07:52:31.706264) 07:52:35.293833 run osmo-hlr_10.42.42.2(pid=13417): stderr: | [0;m[1;31m20221210075232041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075232041 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075232042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075232042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075232042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075232042 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075232062 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075232071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075232071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075232071 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:52:35.345291 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13406): Terminating (SIGTERM) 07:52:35.386426 run iperf3-srv_10.42.42.10(pid=13407): Terminating (SIGTERM) 07:52:35.427724 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13408): Terminating (SIGTERM) 07:52:35.468880 run iperf3-srv_10.42.42.10(pid=13409): Terminating (SIGTERM) 07:52:35.510081 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13410): Terminating (SIGTERM) 07:52:35.551181 run iperf3-srv_10.42.42.10(pid=13411): Terminating (SIGTERM) 07:52:35.592477 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13412): Terminating (SIGTERM) 07:52:35.633735 run iperf3-srv_10.42.42.10(pid=13413): Terminating (SIGTERM) 07:52:35.674795 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13416): Terminating (SIGTERM) 07:52:35.715784 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13419): Terminating (SIGTERM) 07:52:35.756875 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13422): Terminating (SIGTERM) 07:52:35.798133 --- ParallelTerminationStrategy: PID 13406 died... 07:52:35.817989 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13406): Terminated: ok {rc=0} 07:52:35.863938 --- ParallelTerminationStrategy: PID 13407 died... 07:52:35.883161 run iperf3-srv_10.42.42.10(pid=13407): Terminated {rc=256} 07:52:35.928840 --- ParallelTerminationStrategy: PID 13408 died... 07:52:35.948880 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13408): Terminated: ok {rc=0} 07:52:35.996401 --- ParallelTerminationStrategy: PID 13409 died... 07:52:36.015828 run iperf3-srv_10.42.42.10(pid=13409): Terminated {rc=256} 07:52:36.061344 --- ParallelTerminationStrategy: PID 13410 died... 07:52:36.080834 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13410): Terminated: ok {rc=0} 07:52:36.126430 --- ParallelTerminationStrategy: PID 13411 died... 07:52:36.146044 run iperf3-srv_10.42.42.10(pid=13411): Terminated {rc=256} 07:52:36.191622 --- ParallelTerminationStrategy: PID 13412 died... 07:52:36.211087 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13412): Terminated: ok {rc=0} 07:52:36.256697 --- ParallelTerminationStrategy: PID 13413 died... 07:52:36.276156 run iperf3-srv_10.42.42.10(pid=13413): Terminated {rc=256} 07:52:36.321650 --- ParallelTerminationStrategy: PID 13416 died... 07:52:36.341232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13416): Terminated: ok {rc=0} 07:52:36.386866 --- ParallelTerminationStrategy: PID 13419 died... 07:52:36.406423 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13419): Terminated: ok {rc=0} 07:52:36.452021 --- ParallelTerminationStrategy: PID 13422 died... 07:52:36.471519 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13422): Terminated: ok {rc=0} 07:52:36.558407 bus /gobi_4: Setting Powered False 07:52:37.657563 bus /gobi_4: Setting Powered False 07:52:38.773375 bus /gobi_1: Setting Powered False 07:52:39.871007 bus /gobi_1: Setting Powered False 07:52:40.985990 bus /gobi_0: Setting Powered False 07:52:42.084535 bus /gobi_0: Setting Powered False 07:52:43.200198 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:52:44.302296 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:44.314272 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:52:44.381507 tst ping.py: using LAC 26936 07:52:44.494473 tst ping.py: using RAC 161 07:52:44.606472 tst ping.py: using CellId 26936 07:52:44.719740 tst ping.py: using BVCI 26937 07:52:44.823431 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:44.834434 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:44.845230 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:44.856151 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:44.867034 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:44.878106 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:44.889200 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:44.899952 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:52:45.014575 tst ping.py:19: start network... 07:52:45.219914 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:52:45.692730 run create_hlr_db(pid=13426): Launched 07:52:45.818163 bus /gobi_6: Setting Powered False 07:52:46.877302 run create_hlr_db(pid=13426): Terminated: ok {rc=0} 07:52:47.368554 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13428): Launched 07:52:47.673481 run osmo-hlr_10.42.42.2(pid=13429): Launched 07:52:47.789961 run osmo-stp_10.42.42.5: Starting osmo-stp 07:52:48.316291 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13431): Launched 07:52:48.620280 run osmo-stp_10.42.42.5(pid=13432): Launched 07:52:48.736916 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:52:49.261828 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13434): Launched 07:52:49.378161 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:52:49.634775 run patchelf(pid=13435): Launched 07:52:49.804315 run osmo-stp_10.42.42.5(pid=13432): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13432)] 07:52:49.933502 run osmo-stp_10.42.42.5(pid=13432): stdout: | (launched: 2022-12-10_07:52:48.564661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:50.064137 run osmo-stp_10.42.42.5(pid=13432): stderr: | [0;m[38;5;43m20221210075248753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075248753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075248753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075248754 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075248754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075248754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075248754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:50.195108 run osmo-stp_10.42.42.5(pid=13432): stdout: | (launched: 2022-12-10_07:52:48.564661) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:50.319769 run osmo-stp_10.42.42.5(pid=13432): stderr: | [0;m[38;5;43m20221210075248753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075248753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075248753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075248754 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075248754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075248754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075248754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:50.467282 run patchelf(pid=13435): Terminating (SIGINT) 07:52:50.638513 run patchelf(pid=13435): Terminated: ok {rc=0} 07:52:50.761872 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13432): Process ended prematurely: osmo-stp_10.42.42.5(pid=13432) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13432)] [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22] 07:52:50.771057 tst ping.py:22: Test FAILED (6.5 sec) 07:52:50.798552 run osmo-hlr_10.42.42.2(pid=13429): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13429)] 07:52:50.847671 run osmo-hlr_10.42.42.2(pid=13429): stdout: | (launched: 2022-12-10_07:52:47.618141) 07:52:50.899081 run osmo-hlr_10.42.42.2(pid=13429): stderr: | [0;m[1;31m20221210075247811 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075247811 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075247811 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075247811 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075247811 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075247811 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075247829 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075247840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075247840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075247840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:52:50.950537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13428): Terminating (SIGTERM) 07:52:50.991434 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13431): Terminating (SIGTERM) 07:52:51.032487 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13434): Terminating (SIGTERM) 07:52:51.073750 --- ParallelTerminationStrategy: PID 13428 died... 07:52:51.093272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13428): Terminated: ok {rc=0} 07:52:51.138794 --- ParallelTerminationStrategy: PID 13431 died... 07:52:51.158044 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13431): Terminated: ok {rc=0} 07:52:51.203557 --- ParallelTerminationStrategy: PID 13434 died... 07:52:51.222825 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13434): Terminated: ok {rc=0} 07:52:51.309669 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:52:52.396556 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:52.408158 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:52:52.475047 tst ping_idle_ping.py: using LAC 26937 07:52:52.588036 tst ping_idle_ping.py: using RAC 162 07:52:52.703901 tst ping_idle_ping.py: using CellId 26937 07:52:52.817792 tst ping_idle_ping.py: using BVCI 26938 07:52:52.930724 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:52.942294 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:52.953701 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:52.965241 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:52.976397 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:52.987872 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:52.999330 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:52:53.010745 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:52:53.127287 tst ping_idle_ping.py:24: start network... 07:52:53.333689 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:52:53.811567 run create_hlr_db(pid=13436): Launched 07:52:53.936398 bus /gobi_6: Setting Powered False 07:52:54.998226 run create_hlr_db(pid=13436): Terminated: ok {rc=0} 07:52:55.410729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13438): Launched 07:52:55.698236 run osmo-hlr_10.42.42.2(pid=13439): Launched 07:52:55.808477 run osmo-stp_10.42.42.5: Starting osmo-stp 07:52:56.313766 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13441): Launched 07:52:56.600886 run osmo-stp_10.42.42.5(pid=13442): Launched 07:52:56.712762 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:52:57.207267 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13444): Launched 07:52:57.317302 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:52:57.559602 run patchelf(pid=13445): Launched 07:52:57.719976 run osmo-stp_10.42.42.5(pid=13442): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13442)] 07:52:57.842181 run osmo-stp_10.42.42.5(pid=13442): stdout: | (launched: 2022-12-10_07:52:56.548526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:57.965762 run osmo-stp_10.42.42.5(pid=13442): stderr: | [0;m[38;5;43m20221210075256717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075256717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075256718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075256718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075256719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075256719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075256719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:58.090608 run osmo-stp_10.42.42.5(pid=13442): stdout: | (launched: 2022-12-10_07:52:56.548526) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:52:58.209076 run osmo-stp_10.42.42.5(pid=13442): stderr: | [0;m[38;5;43m20221210075256717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075256717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075256718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075256718 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075256719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075256719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075256719 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:52:58.349417 run patchelf(pid=13445): Terminating (SIGINT) 07:52:58.512386 run patchelf(pid=13445): Terminated: ok {rc=0} 07:52:58.629775 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13442): Process ended prematurely: osmo-stp_10.42.42.5(pid=13442) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13442)] [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 07:52:58.638693 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 07:52:58.665742 run osmo-hlr_10.42.42.2(pid=13439): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13439)] 07:52:58.713434 run osmo-hlr_10.42.42.2(pid=13439): stdout: | (launched: 2022-12-10_07:52:55.645800) 07:52:58.762600 run osmo-hlr_10.42.42.2(pid=13439): stderr: | [0;m[1;31m20221210075255819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075255819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075255819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075255819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075255819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075255819 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075255834 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075255844 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075255845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075255845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:52:58.811929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13438): Terminating (SIGTERM) 07:52:58.851626 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13441): Terminating (SIGTERM) 07:52:58.891340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13444): Terminating (SIGTERM) 07:52:58.931276 --- ParallelTerminationStrategy: PID 13438 died... 07:52:58.950223 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13438): Terminated: ok {rc=0} 07:52:58.995065 --- ParallelTerminationStrategy: PID 13441 died... 07:52:59.013759 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13441): Terminated: ok {rc=0} 07:52:59.057798 --- ParallelTerminationStrategy: PID 13444 died... 07:52:59.076450 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13444): Terminated: ok {rc=0} 07:52:59.162639 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo --------------------------------------------------------------------- 07:53:00.463132 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:53:00.469299 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 1 x bts (candidates: 11) 07:53:00.498756 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 9 x ip_address (candidates: 9) 07:53:00.536509 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Verifying 4 x modem (candidates: 12) 07:53:00.621520 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 1 x bts (candidates: 11) 07:53:00.650214 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 9 x ip_address (candidates: 9) 07:53:00.687972 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Reserving 4 x modem (candidates: 12) 07:53:01.338610 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: RESERVED RESOURCES for gprs: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo cs_paging_gprs_active.py ---------------------------------------------- 07:53:01.401993 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:01.416126 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:53:01.494183 tst cs_paging_gprs_active.py: using LAC 26938 07:53:01.612346 tst cs_paging_gprs_active.py: using RAC 163 07:53:01.767230 tst cs_paging_gprs_active.py: using CellId 26938 07:53:01.896276 tst cs_paging_gprs_active.py: using BVCI 26939 07:53:02.044445 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:02.058707 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:02.073547 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:02.088313 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:02.103607 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:02.118115 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:02.132825 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:02.147527 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:02.162436 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:53:02.286197 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:53:02.401565 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:53:02.598954 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:53:02.892855 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13449): Launched 07:53:03.147807 run iperf3-srv_10.42.42.10(pid=13450): Launched 07:53:03.257774 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:53:03.453394 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:53:03.745964 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13451): Launched 07:53:04.001085 run iperf3-srv_10.42.42.10(pid=13452): Launched 07:53:04.111283 tst cs_paging_gprs_active.py:38: start network... 07:53:04.306722 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:53:04.758747 run create_hlr_db(pid=13453): Launched 07:53:04.870194 bus /gobi_6: Setting Powered False 07:53:05.928905 run create_hlr_db(pid=13453): Terminated: ok {rc=0} 07:53:06.358231 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13455): Launched 07:53:06.671716 run osmo-hlr_10.42.42.2(pid=13456): Launched 07:53:06.791462 run osmo-stp_10.42.42.5: Starting osmo-stp 07:53:07.329648 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13458): Launched 07:53:07.642419 run osmo-stp_10.42.42.5(pid=13459): Launched 07:53:07.762996 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:53:08.302906 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13461): Launched 07:53:08.422807 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:53:08.693120 run patchelf(pid=13462): Launched 07:53:08.867842 run osmo-stp_10.42.42.5(pid=13459): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13459)] 07:53:09.000841 run osmo-stp_10.42.42.5(pid=13459): stdout: | (launched: 2022-12-10_07:53:07.585261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:09.135695 run osmo-stp_10.42.42.5(pid=13459): stderr: | [0;m[38;5;43m20221210075307774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075307774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075307775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075307775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075307777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075307777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075307777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:09.270638 run osmo-stp_10.42.42.5(pid=13459): stdout: | (launched: 2022-12-10_07:53:07.585261) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:09.399349 run osmo-stp_10.42.42.5(pid=13459): stderr: | [0;m[38;5;43m20221210075307774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075307774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075307775 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075307775 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075307777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075307777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075307777 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:09.551716 run patchelf(pid=13462): Terminating (SIGINT) 07:53:09.729309 run patchelf(pid=13462): Terminated: ok {rc=0} 07:53:09.857198 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=13459): Process ended prematurely: osmo-stp_10.42.42.5(pid=13459) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13459)] [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38] 07:53:09.867107 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 07:53:09.895517 run osmo-hlr_10.42.42.2(pid=13456): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13456)] 07:53:09.945324 run osmo-hlr_10.42.42.2(pid=13456): stdout: | (launched: 2022-12-10_07:53:06.614930) 07:53:09.997086 run osmo-hlr_10.42.42.2(pid=13456): stderr: | [0;m[1;31m20221210075306810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075306810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075306810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075306810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075306810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075306810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075306826 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075306835 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075306836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075306836 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:53:10.049231 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13449): Terminating (SIGTERM) 07:53:10.090867 run iperf3-srv_10.42.42.10(pid=13450): Terminating (SIGTERM) 07:53:10.132921 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13451): Terminating (SIGTERM) 07:53:10.174707 run iperf3-srv_10.42.42.10(pid=13452): Terminating (SIGTERM) 07:53:10.216083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13455): Terminating (SIGTERM) 07:53:10.257761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13458): Terminating (SIGTERM) 07:53:10.299339 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13461): Terminating (SIGTERM) 07:53:10.341188 --- ParallelTerminationStrategy: PID 13449 died... 07:53:10.361193 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13449): Terminated: ok {rc=0} 07:53:10.407280 --- ParallelTerminationStrategy: PID 13450 died... 07:53:10.426681 run iperf3-srv_10.42.42.10(pid=13450): Terminated {rc=256} 07:53:10.472322 --- ParallelTerminationStrategy: PID 13451 died... 07:53:10.491802 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13451): Terminated: ok {rc=0} 07:53:10.537502 --- ParallelTerminationStrategy: PID 13452 died... 07:53:10.557077 run iperf3-srv_10.42.42.10(pid=13452): Terminated {rc=256} 07:53:10.602686 --- ParallelTerminationStrategy: PID 13455 died... 07:53:10.622580 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13455): Terminated: ok {rc=0} 07:53:10.668220 --- ParallelTerminationStrategy: PID 13458 died... 07:53:10.687787 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13458): Terminated: ok {rc=0} 07:53:10.733565 --- ParallelTerminationStrategy: PID 13461 died... 07:53:10.753062 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13461): Terminated: ok {rc=0} 07:53:10.839507 bus /gobi_0: Setting Powered False 07:53:11.937651 bus /gobi_0: Setting Powered False 07:53:13.052251 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3.py ---------------------------------------------- 07:53:14.196588 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:14.208258 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:53:14.274798 tst iperf3.py: using LAC 26939 07:53:14.391005 tst iperf3.py: using RAC 164 07:53:14.507133 tst iperf3.py: using CellId 26939 07:53:14.624007 tst iperf3.py: using BVCI 26940 07:53:14.731849 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:14.742851 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:14.753805 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:14.764638 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:14.775617 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:14.786624 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:14.797718 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:14.808745 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:14.820096 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:53:14.933367 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:53:15.144157 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:53:15.457275 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13463): Launched 07:53:15.729260 run iperf3-srv_10.42.42.10(pid=13464): Launched 07:53:15.858524 tst iperf3.py:8: start network... 07:53:16.103755 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:53:16.669506 run create_hlr_db(pid=13493): Launched 07:53:16.844347 bus /gobi_6: Setting Powered False 07:53:17.932187 run create_hlr_db(pid=13493): Terminated: ok {rc=0} 07:53:18.506589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13680): Launched 07:53:18.911901 run osmo-hlr_10.42.42.2(pid=13732): Launched 07:53:19.135843 run osmo-stp_10.42.42.5: Starting osmo-stp 07:53:19.822352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13740): Launched 07:53:20.149772 run osmo-stp_10.42.42.5(pid=13741): Launched 07:53:20.375195 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:53:21.077815 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13743): Launched 07:53:21.203484 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:53:21.457122 run patchelf(pid=13746): Launched 07:53:21.641352 run osmo-stp_10.42.42.5(pid=13741): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13741)] 07:53:21.775166 run osmo-stp_10.42.42.5(pid=13741): stdout: | (launched: 2022-12-10_07:53:20.079268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:21.915824 run osmo-stp_10.42.42.5(pid=13741): stderr: | [0;m[38;5;43m20221210075320416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075320416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075320416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075320417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075320417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075320417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075320417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:22.054309 run osmo-stp_10.42.42.5(pid=13741): stdout: | (launched: 2022-12-10_07:53:20.079268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:22.184407 run osmo-stp_10.42.42.5(pid=13741): stderr: | [0;m[38;5;43m20221210075320416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075320416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075320416 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075320417 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075320417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075320417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075320417 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:22.340630 run patchelf(pid=13746): Terminating (SIGINT) 07:53:22.519057 run patchelf(pid=13746): Terminated: ok {rc=0} 07:53:22.648415 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13741): Process ended prematurely: osmo-stp_10.42.42.5(pid=13741) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13741)] [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8] 07:53:22.659504 tst iperf3.py:8: Test FAILED (8.5 sec) 07:53:22.689517 run osmo-hlr_10.42.42.2(pid=13732): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13732)] 07:53:22.740753 run osmo-hlr_10.42.42.2(pid=13732): stdout: | (launched: 2022-12-10_07:53:18.828486) 07:53:22.794464 run osmo-hlr_10.42.42.2(pid=13732): stderr: | [0;m[1;31m20221210075319161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075319161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075319161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075319161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075319161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075319161 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075319175 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075319200 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075319201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075319201 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:53:22.847115 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13463): Terminating (SIGTERM) 07:53:22.889821 run iperf3-srv_10.42.42.10(pid=13464): Terminating (SIGTERM) 07:53:22.935109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13680): Terminating (SIGTERM) 07:53:22.978171 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13740): Terminating (SIGTERM) 07:53:23.022584 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13743): Terminating (SIGTERM) 07:53:23.067272 --- ParallelTerminationStrategy: PID 13463 died... 07:53:23.087654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13463): Terminated: ok {rc=0} 07:53:23.135865 --- ParallelTerminationStrategy: PID 13464 died... 07:53:23.155924 run iperf3-srv_10.42.42.10(pid=13464): Terminated {rc=256} 07:53:23.202722 --- ParallelTerminationStrategy: PID 13680 died... 07:53:23.222787 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13680): Terminated: ok {rc=0} 07:53:23.269795 --- ParallelTerminationStrategy: PID 13740 died... 07:53:23.290004 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13740): Terminated: ok {rc=0} 07:53:23.337183 --- ParallelTerminationStrategy: PID 13743 died... 07:53:23.357337 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13743): Terminated: ok {rc=0} 07:53:23.447317 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo iperf3m4.py ---------------------------------------------- 07:53:24.602766 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:24.616041 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:53:24.685777 tst iperf3m4.py: using LAC 26940 07:53:24.814853 tst iperf3m4.py: using RAC 165 07:53:24.943960 tst iperf3m4.py: using CellId 26940 07:53:25.070475 tst iperf3m4.py: using BVCI 26941 07:53:25.188185 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:25.200643 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:25.213543 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:25.225874 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:25.238427 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:25.250947 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:25.263230 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:25.276396 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:25.288909 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:53:25.412813 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:53:25.539041 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:53:25.663343 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:53:25.786303 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:53:26.005737 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:53:26.338048 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13747): Launched 07:53:26.637035 run iperf3-srv_10.42.42.10(pid=13748): Launched 07:53:26.772740 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:53:26.990562 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:53:27.320045 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13749): Launched 07:53:27.623245 run iperf3-srv_10.42.42.10(pid=13750): Launched 07:53:27.757643 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:53:27.975434 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:53:28.313901 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13751): Launched 07:53:28.604241 run iperf3-srv_10.42.42.10(pid=13752): Launched 07:53:28.738283 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:53:28.954530 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:53:29.285706 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13753): Launched 07:53:29.580301 run iperf3-srv_10.42.42.10(pid=13754): Launched 07:53:29.713871 tst iperf3m4.py:8: start network... 07:53:29.930963 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:53:30.442307 run create_hlr_db(pid=13755): Launched 07:53:30.605694 bus /gobi_6: Setting Powered False 07:53:31.715563 run create_hlr_db(pid=13755): Terminated: ok {rc=0} 07:53:32.278026 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13757): Launched 07:53:32.666660 run osmo-hlr_10.42.42.2(pid=13758): Launched 07:53:32.858090 run osmo-stp_10.42.42.5: Starting osmo-stp 07:53:33.558526 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13760): Launched 07:53:33.901723 run osmo-stp_10.42.42.5(pid=13761): Launched 07:53:34.144198 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:53:34.785047 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13763): Launched 07:53:34.917173 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:53:35.205792 run patchelf(pid=13764): Launched 07:53:35.389462 run osmo-stp_10.42.42.5(pid=13761): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13761)] 07:53:35.525702 run osmo-stp_10.42.42.5(pid=13761): stdout: | (launched: 2022-12-10_07:53:33.829218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:35.665219 run osmo-stp_10.42.42.5(pid=13761): stderr: | [0;m[38;5;43m20221210075334128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075334128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075334128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075334128 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075334129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075334129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075334129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:35.804213 run osmo-stp_10.42.42.5(pid=13761): stdout: | (launched: 2022-12-10_07:53:33.829218) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:35.936174 run osmo-stp_10.42.42.5(pid=13761): stderr: | [0;m[38;5;43m20221210075334128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075334128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075334128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075334128 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075334129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075334129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075334129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:36.092667 run patchelf(pid=13764): Terminating (SIGINT) 07:53:36.274124 run patchelf(pid=13764): Terminated: ok {rc=0} 07:53:36.406503 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13761): Process ended prematurely: osmo-stp_10.42.42.5(pid=13761) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13761)] [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8] 07:53:36.417748 tst iperf3m4.py:8: Test FAILED (11.9 sec) 07:53:36.448056 run osmo-hlr_10.42.42.2(pid=13758): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13758)] 07:53:36.500140 run osmo-hlr_10.42.42.2(pid=13758): stdout: | (launched: 2022-12-10_07:53:32.595223) 07:53:36.554640 run osmo-hlr_10.42.42.2(pid=13758): stderr: | [0;m[1;31m20221210075332927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075332927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075332927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075332927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075332927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075332927 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075332948 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075332968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075332981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075332981 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:53:36.608592 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13747): Terminating (SIGTERM) 07:53:36.653092 run iperf3-srv_10.42.42.10(pid=13748): Terminating (SIGTERM) 07:53:36.699526 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13749): Terminating (SIGTERM) 07:53:36.745124 run iperf3-srv_10.42.42.10(pid=13750): Terminating (SIGTERM) 07:53:36.791233 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13751): Terminating (SIGTERM) 07:53:36.835160 run iperf3-srv_10.42.42.10(pid=13752): Terminating (SIGTERM) 07:53:36.881568 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13753): Terminating (SIGTERM) 07:53:36.925290 run iperf3-srv_10.42.42.10(pid=13754): Terminating (SIGTERM) 07:53:36.973201 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13757): Terminating (SIGTERM) 07:53:37.017223 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13760): Terminating (SIGTERM) 07:53:37.062456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13763): Terminating (SIGTERM) 07:53:37.107985 --- ParallelTerminationStrategy: PID 13747 died... 07:53:37.128902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13747): Terminated: ok {rc=0} 07:53:37.178907 --- ParallelTerminationStrategy: PID 13748 died... 07:53:37.199509 run iperf3-srv_10.42.42.10(pid=13748): Terminated {rc=256} 07:53:37.247409 --- ParallelTerminationStrategy: PID 13749 died... 07:53:37.268203 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13749): Terminated: ok {rc=0} 07:53:37.315931 --- ParallelTerminationStrategy: PID 13750 died... 07:53:37.337817 run iperf3-srv_10.42.42.10(pid=13750): Terminated {rc=256} 07:53:37.385687 --- ParallelTerminationStrategy: PID 13751 died... 07:53:37.406418 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13751): Terminated: ok {rc=0} 07:53:37.454498 --- ParallelTerminationStrategy: PID 13752 died... 07:53:37.475559 run iperf3-srv_10.42.42.10(pid=13752): Terminated {rc=256} 07:53:37.523748 --- ParallelTerminationStrategy: PID 13753 died... 07:53:37.545719 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=13753): Terminated: ok {rc=0} 07:53:37.595449 --- ParallelTerminationStrategy: PID 13754 died... 07:53:37.616092 run iperf3-srv_10.42.42.10(pid=13754): Terminated {rc=256} 07:53:37.664026 --- ParallelTerminationStrategy: PID 13757 died... 07:53:37.684924 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13757): Terminated: ok {rc=0} 07:53:37.732924 --- ParallelTerminationStrategy: PID 13760 died... 07:53:37.754661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13760): Terminated: ok {rc=0} 07:53:37.802675 --- ParallelTerminationStrategy: PID 13763 died... 07:53:37.823421 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13763): Terminated: ok {rc=0} 07:53:37.914537 bus /gobi_4: Setting Powered False 07:53:39.022339 bus /gobi_4: Setting Powered False 07:53:40.141462 bus /gobi_1: Setting Powered False 07:53:41.240163 bus /gobi_1: Setting Powered False 07:53:42.360076 bus /gobi_0: Setting Powered False 07:53:43.458493 bus /gobi_0: Setting Powered False 07:53:44.573432 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping.py ---------------------------------------------- 07:53:45.676801 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:45.689056 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:53:45.760738 tst ping.py: using LAC 26941 07:53:45.901952 tst ping.py: using RAC 166 07:53:46.027383 tst ping.py: using CellId 26941 07:53:46.165688 tst ping.py: using BVCI 26942 07:53:46.295235 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:46.307231 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:46.319053 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:46.331201 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:46.342898 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:46.354995 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:46.367255 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:46.379494 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:53:46.513258 tst ping.py:19: start network... 07:53:46.722147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:53:47.208485 run create_hlr_db(pid=13766): Launched 07:53:47.357177 bus /gobi_6: Setting Powered False 07:53:48.413927 run create_hlr_db(pid=13766): Terminated: ok {rc=0} 07:53:48.835387 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13768): Launched 07:53:49.142533 run osmo-hlr_10.42.42.2(pid=13769): Launched 07:53:49.259140 run osmo-stp_10.42.42.5: Starting osmo-stp 07:53:49.794060 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13771): Launched 07:53:50.100212 run osmo-stp_10.42.42.5(pid=13772): Launched 07:53:50.217097 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:53:50.746389 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13774): Launched 07:53:50.863004 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:53:51.120861 run patchelf(pid=13775): Launched 07:53:51.291764 run osmo-stp_10.42.42.5(pid=13772): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13772)] 07:53:51.422086 run osmo-stp_10.42.42.5(pid=13772): stdout: | (launched: 2022-12-10_07:53:50.044432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:51.553467 run osmo-stp_10.42.42.5(pid=13772): stderr: | [0;m[38;5;43m20221210075350234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075350235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075350235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075350235 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075350236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075350236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075350236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:51.686000 run osmo-stp_10.42.42.5(pid=13772): stdout: | (launched: 2022-12-10_07:53:50.044432) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:51.811828 run osmo-stp_10.42.42.5(pid=13772): stderr: | [0;m[38;5;43m20221210075350234 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075350235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075350235 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075350235 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075350236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075350236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075350236 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:51.960910 run patchelf(pid=13775): Terminating (SIGINT) 07:53:52.133587 run patchelf(pid=13775): Terminated: ok {rc=0} 07:53:52.257416 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=13772): Process ended prematurely: osmo-stp_10.42.42.5(pid=13772) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13772)] [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22] 07:53:52.266637 tst ping.py:22: Test FAILED (6.6 sec) 07:53:52.294207 run osmo-hlr_10.42.42.2(pid=13769): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13769)] 07:53:52.343292 run osmo-hlr_10.42.42.2(pid=13769): stdout: | (launched: 2022-12-10_07:53:49.085764) 07:53:52.394259 run osmo-hlr_10.42.42.2(pid=13769): stderr: | [0;m[1;31m20221210075349282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075349282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075349282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075349282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075349282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075349282 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075349294 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075349303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075349303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075349303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:53:52.446036 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13768): Terminating (SIGTERM) 07:53:52.487442 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13771): Terminating (SIGTERM) 07:53:52.528820 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13774): Terminating (SIGTERM) 07:53:52.570486 --- ParallelTerminationStrategy: PID 13768 died... 07:53:52.590406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13768): Terminated: ok {rc=0} 07:53:52.636596 --- ParallelTerminationStrategy: PID 13771 died... 07:53:52.655909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13771): Terminated: ok {rc=0} 07:53:52.701767 --- ParallelTerminationStrategy: PID 13774 died... 07:53:52.721331 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13774): Terminated: ok {rc=0} 07:53:52.808275 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo ping_idle_ping.py ---------------------------------------------- 07:53:53.896124 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:53.908281 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x bts (candidates: 1) 07:53:53.976682 tst ping_idle_ping.py: using LAC 26942 07:53:54.091466 tst ping_idle_ping.py: using RAC 167 07:53:54.214480 tst ping_idle_ping.py: using CellId 26942 07:53:54.336831 tst ping_idle_ping.py: using BVCI 26943 07:53:54.448767 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:54.460657 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:54.472059 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:54.483680 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:54.495262 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:54.506642 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:54.518145 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x ip_address (candidates: 9) 07:53:54.529487 tst gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo: Using 1 x modem (candidates: 4) 07:53:54.643025 tst ping_idle_ping.py:24: start network... 07:53:54.836704 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:53:55.283212 run create_hlr_db(pid=13776): Launched 07:53:55.394150 bus /gobi_6: Setting Powered False 07:53:56.452610 run create_hlr_db(pid=13776): Terminated: ok {rc=0} 07:53:56.876618 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13778): Launched 07:53:57.184459 run osmo-hlr_10.42.42.2(pid=13779): Launched 07:53:57.302394 run osmo-stp_10.42.42.5: Starting osmo-stp 07:53:57.836109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13781): Launched 07:53:58.143684 run osmo-stp_10.42.42.5(pid=13782): Launched 07:53:58.261701 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:53:58.793335 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13784): Launched 07:53:58.911057 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:53:59.170632 run patchelf(pid=13785): Launched 07:53:59.341822 run osmo-stp_10.42.42.5(pid=13782): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13782)] 07:53:59.472260 run osmo-stp_10.42.42.5(pid=13782): stdout: | (launched: 2022-12-10_07:53:58.087784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:59.604277 run osmo-stp_10.42.42.5(pid=13782): stderr: | [0;m[38;5;43m20221210075358275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075358276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075358276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075358276 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075358279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075358279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075358279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:53:59.736941 run osmo-stp_10.42.42.5(pid=13782): stdout: | (launched: 2022-12-10_07:53:58.087784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:53:59.863256 run osmo-stp_10.42.42.5(pid=13782): stderr: | [0;m[38;5;43m20221210075358275 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075358276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075358276 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075358276 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075358279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075358279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075358279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:00.012669 run patchelf(pid=13785): Terminating (SIGINT) 07:54:00.185636 run patchelf(pid=13785): Terminated: ok {rc=0} 07:54:00.310259 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=13782): Process ended prematurely: osmo-stp_10.42.42.5(pid=13782) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13782)] [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27] 07:54:00.319851 tst ping_idle_ping.py:27: Test FAILED (6.4 sec) 07:54:00.347983 run osmo-hlr_10.42.42.2(pid=13779): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13779)] 07:54:00.397594 run osmo-hlr_10.42.42.2(pid=13779): stdout: | (launched: 2022-12-10_07:53:57.128566) 07:54:00.448888 run osmo-hlr_10.42.42.2(pid=13779): stderr: | [0;m[1;31m20221210075357325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075357325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075357325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075357325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075357325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075357325 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075357338 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075357346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075357346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075357346 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:54:00.500888 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13778): Terminating (SIGTERM) 07:54:00.542747 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13781): Terminating (SIGTERM) 07:54:00.584462 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13784): Terminating (SIGTERM) 07:54:00.626372 --- ParallelTerminationStrategy: PID 13778 died... 07:54:00.646616 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13778): Terminated: ok {rc=0} 07:54:00.692927 --- ParallelTerminationStrategy: PID 13781 died... 07:54:00.712593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13781): Terminated: ok {rc=0} 07:54:00.758598 --- ParallelTerminationStrategy: PID 13784 died... 07:54:00.778163 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13784): Terminated: ok {rc=0} 07:54:00.865513 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:54:02.181396 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:54:02.193534 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:54:02.224446 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 07:54:02.260013 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:54:02.313521 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:54:02.343699 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 07:54:02.378920 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:54:02.938325 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2371 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 07:54:02.945587 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:54:02.957327 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:54:03.023720 tst switch_tch_pdch.py: using LAC 26943 07:54:03.137846 tst switch_tch_pdch.py: using RAC 168 07:54:03.250690 tst switch_tch_pdch.py: using CellId 26943 07:54:03.363488 tst switch_tch_pdch.py: using BVCI 26944 07:54:03.467520 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:54:03.478779 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:54:03.489944 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:54:03.501839 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:54:03.513640 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:54:03.525437 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:54:03.537185 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 07:54:03.548602 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:54:03.668293 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:54:03.787199 tst switch_tch_pdch.py:51: start network... 07:54:03.993931 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:54:04.467726 run create_hlr_db(pid=13789): Launched 07:54:04.593440 bus /gobi_6: Setting Powered False 07:54:05.655988 run create_hlr_db(pid=13789): Terminated: ok {rc=0} 07:54:06.065237 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13791): Launched 07:54:06.351772 run osmo-hlr_10.42.42.2(pid=13792): Launched 07:54:06.462196 run osmo-stp_10.42.42.5: Starting osmo-stp 07:54:06.954117 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13794): Launched 07:54:07.240356 run osmo-stp_10.42.42.5(pid=13795): Launched 07:54:07.350470 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:54:07.843540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13797): Launched 07:54:07.952888 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:54:08.194516 run patchelf(pid=13798): Launched 07:54:08.354519 run osmo-stp_10.42.42.5(pid=13795): ERR: Terminated: ERROR {rc=1} [trial-2371↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13795)] 07:54:08.476219 run osmo-stp_10.42.42.5(pid=13795): stdout: | (launched: 2022-12-10_07:54:07.187600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:08.599810 run osmo-stp_10.42.42.5(pid=13795): stderr: | [0;m[38;5;43m20221210075407356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075407356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075407356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075407357 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075407357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075407357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075407357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:08.723309 run osmo-stp_10.42.42.5(pid=13795): stdout: | (launched: 2022-12-10_07:54:07.187600) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:08.841220 run osmo-stp_10.42.42.5(pid=13795): stderr: | [0;m[38;5;43m20221210075407356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075407356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075407356 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075407357 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075407357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075407357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075407357 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:08.980555 run patchelf(pid=13798): Terminating (SIGINT) 07:54:09.142559 run patchelf(pid=13798): Terminated: ok {rc=0} 07:54:09.258923 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13795): Process ended prematurely: osmo-stp_10.42.42.5(pid=13795) [trial-2371↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13795)] [trial-2371↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54] 07:54:09.267566 tst switch_tch_pdch.py:54: Test FAILED (6.3 sec) 07:54:09.294274 run osmo-hlr_10.42.42.2(pid=13792): ERR: Terminated: ERROR {rc=237} [trial-2371↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13792)] 07:54:09.341712 run osmo-hlr_10.42.42.2(pid=13792): stdout: | (launched: 2022-12-10_07:54:06.299411) 07:54:09.390806 run osmo-hlr_10.42.42.2(pid=13792): stderr: | [0;m[1;31m20221210075406472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075406472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075406472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075406472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075406472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075406472 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075406484 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075406492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075406492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075406492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:54:09.440503 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13791): Terminating (SIGTERM) 07:54:09.480382 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13794): Terminating (SIGTERM) 07:54:09.520111 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13797): Terminating (SIGTERM) 07:54:09.560019 --- ParallelTerminationStrategy: PID 13791 died... 07:54:09.579038 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13791): Terminated: ok {rc=0} 07:54:09.623349 --- ParallelTerminationStrategy: PID 13794 died... 07:54:09.642149 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13794): Terminated: ok {rc=0} 07:54:09.686273 --- ParallelTerminationStrategy: PID 13797 died... 07:54:09.704821 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13797): Terminated: ok {rc=0} 07:54:09.788711 bus /gobi_0: Setting Powered False 07:54:10.886394 bus /gobi_0: Setting Powered False 07:54:12.002389 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo --------------------------------------------------------------------- 07:54:13.258415 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:54:13.265302 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 1 x bts (candidates: 11) 07:54:13.295128 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 8 x ip_address (candidates: 9) 07:54:13.328767 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Verifying 2 x modem (candidates: 12) 07:54:13.381350 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 1 x bts (candidates: 11) 07:54:13.410485 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 8 x ip_address (candidates: 9) 07:54:13.443992 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Reserving 2 x modem (candidates: 12) 07:54:13.999207 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: RESERVED RESOURCES for dynts: bts LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2371 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo switch_tch_pdch.py ---------------------------------------------- 07:54:14.004097 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:54:14.014986 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x bts (candidates: 1) 07:54:14.082685 tst switch_tch_pdch.py: using LAC 26944 07:54:14.194246 tst switch_tch_pdch.py: using RAC 169 07:54:14.305064 tst switch_tch_pdch.py: using CellId 26944 07:54:14.415129 tst switch_tch_pdch.py: using BVCI 26945 07:54:14.518526 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:54:14.529504 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:54:14.540231 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:54:14.551273 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:54:14.562234 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:54:14.573244 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:54:14.584267 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x ip_address (candidates: 8) 07:54:14.595222 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:54:14.709530 tst dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo: Using 1 x modem (candidates: 2) 07:54:14.827702 tst switch_tch_pdch.py:51: start network... 07:54:15.034112 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:54:15.481458 run create_hlr_db(pid=13804): Launched 07:54:15.606870 bus /gobi_6: Setting Powered False 07:54:16.681298 run create_hlr_db(pid=13804): Terminated: ok {rc=0} 07:54:17.140351 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13806): Launched 07:54:17.451566 run osmo-hlr_10.42.42.2(pid=13807): Launched 07:54:17.569429 run osmo-stp_10.42.42.5: Starting osmo-stp 07:54:18.070643 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13809): Launched 07:54:18.374826 run osmo-stp_10.42.42.5(pid=13810): Launched 07:54:18.492318 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:54:18.994771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13812): Launched 07:54:19.111042 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:54:19.367921 run patchelf(pid=13813): Launched 07:54:19.538121 run osmo-stp_10.42.42.5(pid=13810): ERR: Terminated: ERROR {rc=1} [trial-2371↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13810)] 07:54:19.668176 run osmo-stp_10.42.42.5(pid=13810): stdout: | (launched: 2022-12-10_07:54:18.319265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:19.799542 run osmo-stp_10.42.42.5(pid=13810): stderr: | [0;m[38;5;43m20221210075418507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075418507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075418508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075418508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075418509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075418509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075418509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:19.930978 run osmo-stp_10.42.42.5(pid=13810): stdout: | (launched: 2022-12-10_07:54:18.319265) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:20.056426 run osmo-stp_10.42.42.5(pid=13810): stderr: | [0;m[38;5;43m20221210075418507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075418507 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075418508 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075418508 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075418509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075418509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075418509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:20.205636 run patchelf(pid=13813): Terminating (SIGINT) 07:54:20.377783 run patchelf(pid=13813): Terminated: ok {rc=0} 07:54:20.501939 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=13810): Process ended prematurely: osmo-stp_10.42.42.5(pid=13810) [trial-2371↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13810)] [trial-2371↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54] 07:54:20.511118 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 07:54:20.538736 run osmo-hlr_10.42.42.2(pid=13807): ERR: Terminated: ERROR {rc=237} [trial-2371↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13807)] 07:54:20.588170 run osmo-hlr_10.42.42.2(pid=13807): stdout: | (launched: 2022-12-10_07:54:17.396071) 07:54:20.639321 run osmo-hlr_10.42.42.2(pid=13807): stderr: | [0;m[1;31m20221210075417595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075417595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075417595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075417595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075417595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075417595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075417607 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075417618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075417618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075417618 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:54:20.692069 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13806): Terminating (SIGTERM) 07:54:20.733347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13809): Terminating (SIGTERM) 07:54:20.774641 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13812): Terminating (SIGTERM) 07:54:20.815997 --- ParallelTerminationStrategy: PID 13806 died... 07:54:20.835682 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13806): Terminated: ok {rc=0} 07:54:20.881319 --- ParallelTerminationStrategy: PID 13809 died... 07:54:20.900595 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13809): Terminated: ok {rc=0} 07:54:20.946121 --- ParallelTerminationStrategy: PID 13812 died... 07:54:20.965525 run pcap-recorder_any(filters='host 10.42.42.6')(pid=13812): Terminated: ok {rc=0} 07:54:21.052154 bus /gobi_0: Setting Powered False 07:54:22.151664 bus /gobi_0: Setting Powered False 07:54:23.266388 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 nitb_sms:nanobts --------------------------------------------------------------------- 07:54:24.513483 tst nitb_sms:nanobts: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:54:24.517338 tst nitb_sms:nanobts: Verifying 1 x bts (candidates: 11) 07:54:24.541396 tst nitb_sms:nanobts: Verifying 1 x ip_address (candidates: 9) 07:54:24.550470 tst nitb_sms:nanobts: Verifying 2 x modem (candidates: 12) 07:54:24.603301 tst nitb_sms:nanobts: Reserving 1 x bts (candidates: 11) 07:54:24.627309 tst nitb_sms:nanobts: Reserving 1 x ip_address (candidates: 9) 07:54:24.634412 tst nitb_sms:nanobts: Reserving 2 x modem (candidates: 12) 07:54:25.169494 tst nitb_sms:nanobts: RESERVED RESOURCES for nitb_sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 nitb_sms:nanobts mo_mt_sms.py ---------------------------------------------- 07:54:25.174736 tst nitb_sms:nanobts: Using 1 x ip_address (candidates: 1) 07:54:25.185499 tst nitb_sms:nanobts: Using 1 x bts (candidates: 1) 07:54:25.224579 tst mo_mt_sms.py: using LAC 26945 07:54:25.339307 tst mo_mt_sms.py: using RAC 170 07:54:25.452025 tst mo_mt_sms.py: using CellId 26945 07:54:25.565627 tst mo_mt_sms.py: using BVCI 26946 07:54:25.677900 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 07:54:25.789928 tst nitb_sms:nanobts: Using 1 x modem (candidates: 2) 07:54:25.904604 tst mo_mt_sms.py:9: start nitb and bts... 07:54:26.110483 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:54:26.736256 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13819): Launched 07:54:27.042211 run osmo-nitb_10.42.42.2(pid=13820): Launched 07:54:27.212293 run osmo-nitb_10.42.42.2(pid=13820): ERR: Terminated: ERROR {rc=2} [trial-2371↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13820)] 07:54:27.350362 run osmo-nitb_10.42.42.2(pid=13820): stdout: | (launched: 2022-12-10_07:54:26.986769) 07:54:27.489829 run osmo-nitb_10.42.42.2(pid=13820): stderr: | (launched: 2022-12-10_07:54:27.032314) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:54:27.628921 run osmo-nitb_10.42.42.2(pid=13820): stdout: | (launched: 2022-12-10_07:54:26.986769) 07:54:27.763283 run osmo-nitb_10.42.42.2(pid=13820): stderr: | (launched: 2022-12-10_07:54:27.032314) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f5483dba268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13820): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13820) [trial-2371↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13820)] 07:54:28.158345 tst osmo-nitb_10.42.42.2(pid=13820): stdout: | (launched: 2022-12-10_07:54:26.986769) 07:54:28.283260 tst osmo-nitb_10.42.42.2(pid=13820): stderr: | (launched: 2022-12-10_07:54:27.032314) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:54:28.428911 tst mo_mt_sms.py:11: ERR: Error: osmo-nitb_10.42.42.2(pid=13820): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13820) [trial-2371↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13820)] [trial-2371↪nitb_sms:nanobts↪mo_mt_sms.py:11] 07:54:28.437944 tst mo_mt_sms.py:11: Test FAILED (3.3 sec) 07:54:28.445086 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13819): Terminating (SIGTERM) 07:54:28.655000 --- ParallelTerminationStrategy: PID 13819 died... 07:54:28.676370 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13819): Terminated: ok {rc=0} 07:54:28.763074 bus /sierra_3: Setting Powered False 07:54:29.861362 bus /sierra_3: Setting Powered False 07:54:30.978952 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 nitb_sms:nanobts FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 sms:nanobts+band-1900 --------------------------------------------------------------------- 07:54:32.172216 tst sms:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:54:32.181789 tst sms:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 07:54:32.219403 tst sms:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 07:54:32.248767 tst sms:nanobts+band-1900: Verifying 2 x modem (candidates: 12) 07:54:32.300457 tst sms:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 07:54:32.324809 tst sms:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 07:54:32.353049 tst sms:nanobts+band-1900: Reserving 2 x modem (candidates: 12) 07:54:32.901909 tst sms:nanobts+band-1900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 sms:nanobts+band-1900 mo_mt_sms.py ---------------------------------------------- 07:54:32.908221 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:54:32.919047 tst sms:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:54:32.957357 tst mo_mt_sms.py: using LAC 26946 07:54:33.070145 tst mo_mt_sms.py: using RAC 171 07:54:33.181717 tst mo_mt_sms.py: using CellId 26946 07:54:33.293629 tst mo_mt_sms.py: using BVCI 26947 07:54:33.405573 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:54:33.416656 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:54:33.427807 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:54:33.439494 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:54:33.451140 tst sms:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:54:33.462776 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 07:54:33.576331 tst sms:nanobts+band-1900: Using 1 x modem (candidates: 2) 07:54:33.693050 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:54:34.142138 run create_hlr_db(pid=13824): Launched 07:54:34.270011 bus /sierra_2: Setting Powered False 07:54:35.330794 run create_hlr_db(pid=13824): Terminated: ok {rc=0} 07:54:35.742121 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13826): Launched 07:54:36.028757 run osmo-hlr_10.42.42.2(pid=13827): Launched 07:54:36.138990 run osmo-stp_10.42.42.5: Starting osmo-stp 07:54:36.631463 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13829): Launched 07:54:36.917426 run osmo-stp_10.42.42.5(pid=13830): Launched 07:54:37.026887 run osmo-msc_10.42.42.6: Starting osmo-msc 07:54:37.545495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13832): Launched 07:54:37.832565 run osmo-msc_10.42.42.6(pid=13833): Launched 07:54:37.995176 run osmo-stp_10.42.42.5(pid=13830): ERR: Terminated: ERROR {rc=1} [trial-2371↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13830)] 07:54:38.118152 run osmo-stp_10.42.42.5(pid=13830): stdout: | (launched: 2022-12-10_07:54:36.865160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:38.241170 run osmo-stp_10.42.42.5(pid=13830): stderr: | [0;m[38;5;43m20221210075437034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075437034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075437035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075437035 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075437035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075437036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075437036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:38.361138 run osmo-stp_10.42.42.5(pid=13830): stdout: | (launched: 2022-12-10_07:54:36.865160) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:38.475426 run osmo-stp_10.42.42.5(pid=13830): stderr: | [0;m[38;5;43m20221210075437034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075437034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075437035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075437035 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075437035 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075437036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075437036 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:38.612129 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=13830): Process ended prematurely: osmo-stp_10.42.42.5(pid=13830) [trial-2371↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13830)] [trial-2371↪sms:nanobts+band-1900↪mo_mt_sms.py:16] 07:54:38.620151 tst mo_mt_sms.py:16: Test FAILED (5.7 sec) 07:54:38.646112 run osmo-hlr_10.42.42.2(pid=13827): ERR: Terminated: ERROR {rc=237} [trial-2371↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13827)] 07:54:38.693897 run osmo-hlr_10.42.42.2(pid=13827): stdout: | (launched: 2022-12-10_07:54:35.976497) 07:54:38.743251 run osmo-hlr_10.42.42.2(pid=13827): stderr: | [0;m[1;31m20221210075436151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075436151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075436151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075436151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075436151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075436151 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075436163 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/sms:nanobts+band-1900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075436172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075436172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075436172 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:54:38.811725 run osmo-msc_10.42.42.6(pid=13833): ERR: Terminated: ERROR {rc=2} [trial-2371↪sms:nanobts+band-1900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13833)] 07:54:38.859511 run osmo-msc_10.42.42.6(pid=13833): stdout: | (launched: 2022-12-10_07:54:37.779939) 07:54:38.908416 run osmo-msc_10.42.42.6(pid=13833): stderr: | [0;m[38;5;43m20221210075438049 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210075438049 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ffb22ac6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210075438049 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210075438050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210075438050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210075438050 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210075438051 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210075438052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210075438052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210075438052 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:54:38.957763 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13826): Terminating (SIGTERM) 07:54:38.997449 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13829): Terminating (SIGTERM) 07:54:39.037084 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13832): Terminating (SIGTERM) 07:54:39.076855 --- ParallelTerminationStrategy: PID 13826 died... 07:54:39.095851 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13826): Terminated: ok {rc=0} 07:54:39.139929 --- ParallelTerminationStrategy: PID 13829 died... 07:54:39.158402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13829): Terminated: ok {rc=0} 07:54:39.203036 --- ParallelTerminationStrategy: PID 13832 died... 07:54:39.221551 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13832): Terminated: ok {rc=0} 07:54:39.307684 bus /sierra_3: Setting Powered False 07:54:40.406870 bus /sierra_3: Setting Powered False 07:54:41.522311 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 sms:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 nitb_ussd:nanobts+band-1900 --------------------------------------------------------------------- 07:54:42.745199 tst nitb_ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:54:42.750033 tst nitb_ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 07:54:42.773878 tst nitb_ussd:nanobts+band-1900: Verifying 1 x ip_address (candidates: 9) 07:54:42.781242 tst nitb_ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 07:54:42.817356 tst nitb_ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 07:54:42.840713 tst nitb_ussd:nanobts+band-1900: Reserving 1 x ip_address (candidates: 9) 07:54:42.847782 tst nitb_ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 07:54:43.366512 tst nitb_ussd:nanobts+band-1900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2371 nitb_ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 07:54:43.372858 tst nitb_ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 1) 07:54:43.384029 tst nitb_ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:54:43.422655 tst assert_extension.py: using LAC 26947 07:54:43.544514 tst assert_extension.py: using RAC 172 07:54:43.664646 tst assert_extension.py: using CellId 26947 07:54:43.788308 tst assert_extension.py: using BVCI 26948 07:54:43.900933 tst nitb_ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 07:54:44.014353 tst assert_extension.py:10: start nitb and bts... 07:54:44.205262 run osmo-nitb_10.42.42.2: Starting osmo-nitb 07:54:44.789738 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13838): Launched 07:54:45.076286 run osmo-nitb_10.42.42.2(pid=13839): Launched 07:54:45.235633 run osmo-nitb_10.42.42.2(pid=13839): ERR: Terminated: ERROR {rc=2} [trial-2371↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13839)] 07:54:45.364514 run osmo-nitb_10.42.42.2(pid=13839): stdout: | (launched: 2022-12-10_07:54:45.023858) 07:54:45.494762 run osmo-nitb_10.42.42.2(pid=13839): stderr: | (launched: 2022-12-10_07:54:45.066619) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:54:45.625548 run osmo-nitb_10.42.42.2(pid=13839): stdout: | (launched: 2022-12-10_07:54:45.023858) 07:54:45.750536 run osmo-nitb_10.42.42.2(pid=13839): stderr: | (launched: 2022-12-10_07:54:45.066619) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f5483dba268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=13839): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13839) [trial-2371↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13839)] 07:54:46.184365 tst osmo-nitb_10.42.42.2(pid=13839): stdout: | (launched: 2022-12-10_07:54:45.023858) 07:54:46.310198 tst osmo-nitb_10.42.42.2(pid=13839): stderr: | (launched: 2022-12-10_07:54:45.066619) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 07:54:46.451274 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=13839): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13839) [trial-2371↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13839)] [trial-2371↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12] 07:54:46.460379 tst assert_extension.py:12: Test FAILED (3.1 sec) 07:54:46.467782 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13838): Terminating (SIGTERM) 07:54:46.679783 --- ParallelTerminationStrategy: PID 13838 died... 07:54:46.700272 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=13838): Terminated: ok {rc=0} 07:54:46.803132 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 nitb_ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 ussd:nanobts+band-1900 --------------------------------------------------------------------- 07:54:47.981733 tst ussd:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:54:47.986961 tst ussd:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 07:54:48.011027 tst ussd:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 07:54:48.038209 tst ussd:nanobts+band-1900: Verifying 1 x modem (candidates: 12) 07:54:48.075392 tst ussd:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 07:54:48.100156 tst ussd:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 07:54:48.127590 tst ussd:nanobts+band-1900: Reserving 1 x modem (candidates: 12) 07:54:48.653904 tst ussd:nanobts+band-1900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2371 ussd:nanobts+band-1900 assert_extension.py ---------------------------------------------- 07:54:48.659038 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:54:48.669794 tst ussd:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:54:48.709096 tst assert_extension.py: using LAC 26948 07:54:48.827180 tst assert_extension.py: using RAC 173 07:54:48.940812 tst assert_extension.py: using CellId 26948 07:54:49.052655 tst assert_extension.py: using BVCI 26949 07:54:49.156304 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:54:49.166995 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:54:49.177585 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:54:49.188833 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:54:49.200194 tst ussd:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:54:49.211467 tst ussd:nanobts+band-1900: Using 1 x modem (candidates: 1) 07:54:49.328655 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:54:49.802645 run create_hlr_db(pid=13844): Launched 07:54:49.927510 bus /sierra_2: Setting Powered False 07:54:50.988829 run create_hlr_db(pid=13844): Terminated: ok {rc=0} 07:54:51.398343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13846): Launched 07:54:51.684791 run osmo-hlr_10.42.42.2(pid=13847): Launched 07:54:51.795155 run osmo-stp_10.42.42.5: Starting osmo-stp 07:54:52.292129 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13849): Launched 07:54:52.578024 run osmo-stp_10.42.42.5(pid=13850): Launched 07:54:52.688047 run osmo-msc_10.42.42.6: Starting osmo-msc 07:54:53.205045 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13852): Launched 07:54:53.491149 run osmo-msc_10.42.42.6(pid=13853): Launched 07:54:53.651567 run osmo-stp_10.42.42.5(pid=13850): ERR: Terminated: ERROR {rc=1} [trial-2371↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13850)] 07:54:53.773363 run osmo-stp_10.42.42.5(pid=13850): stdout: | (launched: 2022-12-10_07:54:52.525347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:53.894940 run osmo-stp_10.42.42.5(pid=13850): stderr: | [0;m[38;5;43m20221210075452692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075452693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075452693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075452693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075452694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075452694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075452694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:54.014630 run osmo-stp_10.42.42.5(pid=13850): stdout: | (launched: 2022-12-10_07:54:52.525347) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:54:54.129635 run osmo-stp_10.42.42.5(pid=13850): stderr: | [0;m[38;5;43m20221210075452692 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075452693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075452693 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075452693 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075452694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075452694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075452694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:54:54.266116 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=13850): Process ended prematurely: osmo-stp_10.42.42.5(pid=13850) [trial-2371↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13850)] [trial-2371↪ussd:nanobts+band-1900↪assert_extension.py:17] 07:54:54.274161 tst assert_extension.py:17: Test FAILED (5.6 sec) 07:54:54.300627 run osmo-hlr_10.42.42.2(pid=13847): ERR: Terminated: ERROR {rc=237} [trial-2371↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13847)] 07:54:54.348110 run osmo-hlr_10.42.42.2(pid=13847): stdout: | (launched: 2022-12-10_07:54:51.632488) 07:54:54.397518 run osmo-hlr_10.42.42.2(pid=13847): stderr: | [0;m[1;31m20221210075451808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075451808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075451808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075451808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075451808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075451808 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075451820 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/ussd:nanobts+band-1900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075451828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075451829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075451829 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:54:54.465886 run osmo-msc_10.42.42.6(pid=13853): ERR: Terminated: ERROR {rc=2} [trial-2371↪ussd:nanobts+band-1900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13853)] 07:54:54.513158 run osmo-msc_10.42.42.6(pid=13853): stdout: | (launched: 2022-12-10_07:54:53.438672) 07:54:54.562101 run osmo-msc_10.42.42.6(pid=13853): stderr: | [0;m[38;5;43m20221210075453710 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210075453710 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa55376bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210075453710 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210075453711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210075453711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210075453711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210075453713 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210075453713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210075453713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210075453713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:54:54.611314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13846): Terminating (SIGTERM) 07:54:54.650919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13849): Terminating (SIGTERM) 07:54:54.690824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13852): Terminating (SIGTERM) 07:54:54.730990 --- ParallelTerminationStrategy: PID 13846 died... 07:54:54.750138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13846): Terminated: ok {rc=0} 07:54:54.794600 --- ParallelTerminationStrategy: PID 13849 died... 07:54:54.813474 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13849): Terminated: ok {rc=0} 07:54:54.857597 --- ParallelTerminationStrategy: PID 13852 died... 07:54:54.876133 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13852): Terminated: ok {rc=0} 07:54:54.962634 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 ussd:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 07:54:56.159506 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:54:56.168447 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 07:54:56.193146 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 07:54:56.220285 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 07:54:56.274149 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 07:54:56.298662 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 07:54:56.325529 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 07:54:56.876927 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 07:54:56.927745 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:54:56.939409 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:54:57.000162 tst mo_mt_call.py: using LAC 26949 07:54:57.120697 tst mo_mt_call.py: using RAC 174 07:54:57.234652 tst mo_mt_call.py: using CellId 26949 07:54:57.346776 tst mo_mt_call.py: using BVCI 26950 07:54:57.451502 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:54:57.462618 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:54:57.473453 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:54:57.484376 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:54:57.495607 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:54:57.506683 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:54:57.619960 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:54:57.733483 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:54:58.183530 run create_hlr_db(pid=13858): Launched 07:54:58.294315 bus /sierra_2: Setting Powered False 07:54:59.353077 run create_hlr_db(pid=13858): Terminated: ok {rc=0} 07:54:59.759041 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13860): Launched 07:55:00.050218 run osmo-hlr_10.42.42.2(pid=13861): Launched 07:55:00.161670 run osmo-stp_10.42.42.5: Starting osmo-stp 07:55:00.661534 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13863): Launched 07:55:00.980115 run osmo-stp_10.42.42.5(pid=13864): Launched 07:55:01.276035 run osmo-msc_10.42.42.6: Starting osmo-msc 07:55:01.862634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13869): Launched 07:55:02.206053 run osmo-msc_10.42.42.6(pid=13870): Launched 07:55:02.389664 run osmo-stp_10.42.42.5(pid=13864): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13864)] 07:55:02.522143 run osmo-stp_10.42.42.5(pid=13864): stdout: | (launched: 2022-12-10_07:55:00.916384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:02.655462 run osmo-stp_10.42.42.5(pid=13864): stderr: | [0;m[38;5;43m20221210075501122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075501122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075501123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075501123 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075501124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075501124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075501124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:02.788492 run osmo-stp_10.42.42.5(pid=13864): stdout: | (launched: 2022-12-10_07:55:00.916384) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:02.913211 run osmo-stp_10.42.42.5(pid=13864): stderr: | [0;m[38;5;43m20221210075501122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075501122 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075501123 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075501123 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075501124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075501124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075501124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:03.063394 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13864): Process ended prematurely: osmo-stp_10.42.42.5(pid=13864) [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13864)] [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 07:55:03.072816 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:55:03.100810 run osmo-hlr_10.42.42.2(pid=13861): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13861)] 07:55:03.150960 run osmo-hlr_10.42.42.2(pid=13861): stdout: | (launched: 2022-12-10_07:54:59.997285) 07:55:03.202696 run osmo-hlr_10.42.42.2(pid=13861): stderr: | [0;m[1;31m20221210075500172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075500172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075500172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075500172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075500172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075500172 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075500185 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075500193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075500194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075500194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:55:03.274606 run osmo-msc_10.42.42.6(pid=13870): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13870)] 07:55:03.324194 run osmo-msc_10.42.42.6(pid=13870): stdout: | (launched: 2022-12-10_07:55:02.133272) 07:55:03.375348 run osmo-msc_10.42.42.6(pid=13870): stderr: | [0;m[38;5;43m20221210075502470 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210075502470 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f61e3046c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210075502470 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210075502470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210075502470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210075502470 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210075502472 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210075502472 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210075502473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210075502473 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:55:03.426669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13860): Terminating (SIGTERM) 07:55:03.468173 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13863): Terminating (SIGTERM) 07:55:03.509757 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13869): Terminating (SIGTERM) 07:55:03.551937 --- ParallelTerminationStrategy: PID 13860 died... 07:55:03.571962 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13860): Terminated: ok {rc=0} 07:55:03.618432 --- ParallelTerminationStrategy: PID 13863 died... 07:55:03.637996 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13863): Terminated: ok {rc=0} 07:55:03.684642 --- ParallelTerminationStrategy: PID 13869 died... 07:55:03.704197 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13869): Terminated: ok {rc=0} 07:55:03.791945 bus /sierra_3: Setting Powered False 07:55:04.889897 bus /sierra_3: Setting Powered False 07:55:06.005082 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 07:55:07.152246 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:55:07.164477 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 07:55:07.225821 tst mo_mt_call_osmux.py: using LAC 26950 07:55:07.349386 tst mo_mt_call_osmux.py: using RAC 175 07:55:07.473121 tst mo_mt_call_osmux.py: using CellId 26950 07:55:07.596907 tst mo_mt_call_osmux.py: using BVCI 26951 07:55:07.711733 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:55:07.723390 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:55:07.734766 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:55:07.746605 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:55:07.758236 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 07:55:07.769673 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:55:07.887021 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 07:55:08.001315 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:55:08.453234 run create_hlr_db(pid=13872): Launched 07:55:08.565571 bus /sierra_2: Setting Powered False 07:55:09.624042 run create_hlr_db(pid=13872): Terminated: ok {rc=0} 07:55:10.031891 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13874): Launched 07:55:10.324188 run osmo-hlr_10.42.42.2(pid=13875): Launched 07:55:10.435792 run osmo-stp_10.42.42.5: Starting osmo-stp 07:55:10.937924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13877): Launched 07:55:11.231570 run osmo-stp_10.42.42.5(pid=13878): Launched 07:55:11.344317 run osmo-msc_10.42.42.6: Starting osmo-msc 07:55:11.871878 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13880): Launched 07:55:12.164153 run osmo-msc_10.42.42.6(pid=13881): Launched 07:55:12.328475 run osmo-stp_10.42.42.5(pid=13878): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13878)] 07:55:12.452842 run osmo-stp_10.42.42.5(pid=13878): stdout: | (launched: 2022-12-10_07:55:11.178235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:12.577230 run osmo-stp_10.42.42.5(pid=13878): stderr: | [0;m[38;5;43m20221210075511347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075511347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075511347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075511347 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075511348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075511348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075511348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:12.698888 run osmo-stp_10.42.42.5(pid=13878): stdout: | (launched: 2022-12-10_07:55:11.178235) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:12.814928 run osmo-stp_10.42.42.5(pid=13878): stderr: | [0;m[38;5;43m20221210075511347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075511347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075511347 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075511347 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075511348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075511348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075511348 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:12.954017 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13878): Process ended prematurely: osmo-stp_10.42.42.5(pid=13878) [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13878)] [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 07:55:12.962639 tst mo_mt_call_osmux.py:8: Test FAILED (5.8 sec) 07:55:12.989562 run osmo-hlr_10.42.42.2(pid=13875): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13875)] 07:55:13.037233 run osmo-hlr_10.42.42.2(pid=13875): stdout: | (launched: 2022-12-10_07:55:10.270555) 07:55:13.086755 run osmo-hlr_10.42.42.2(pid=13875): stderr: | [0;m[1;31m20221210075510445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075510445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075510445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075510445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075510445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075510445 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075510458 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075510466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075510466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075510466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:55:13.155858 run osmo-msc_10.42.42.6(pid=13881): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13881)] 07:55:13.203254 run osmo-msc_10.42.42.6(pid=13881): stdout: | (launched: 2022-12-10_07:55:12.110926) 07:55:13.252235 run osmo-msc_10.42.42.6(pid=13881): stderr: | [0;m[38;5;43m20221210075512380 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210075512380 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe7524f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210075512380 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210075512380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210075512380 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210075512381 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210075512383 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210075512383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210075512383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210075512383 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:55:13.301669 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13874): Terminating (SIGTERM) 07:55:13.341187 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13877): Terminating (SIGTERM) 07:55:13.380342 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13880): Terminating (SIGTERM) 07:55:13.420744 --- ParallelTerminationStrategy: PID 13874 died... 07:55:13.440148 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13874): Terminated: ok {rc=0} 07:55:13.486465 --- ParallelTerminationStrategy: PID 13877 died... 07:55:13.505478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13877): Terminated: ok {rc=0} 07:55:13.550999 --- ParallelTerminationStrategy: PID 13880 died... 07:55:13.569980 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13880): Terminated: ok {rc=0} 07:55:13.658445 bus /sierra_3: Setting Powered False 07:55:14.755951 bus /sierra_3: Setting Powered False 07:55:15.875750 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 07:55:17.131658 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:55:17.139999 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 07:55:17.165589 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 07:55:17.198124 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 07:55:17.249570 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 07:55:17.273899 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 07:55:17.300605 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 07:55:17.859114 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 07:55:17.909090 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:55:17.920542 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:55:17.979279 tst mo_mt_call.py: using LAC 26951 07:55:18.099700 tst mo_mt_call.py: using RAC 176 07:55:18.220436 tst mo_mt_call.py: using CellId 26951 07:55:18.341121 tst mo_mt_call.py: using BVCI 26952 07:55:18.453856 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:55:18.465359 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:55:18.476625 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:55:18.487996 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:55:18.499537 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:55:18.510883 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:55:18.631985 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:55:18.750959 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:55:19.232595 run create_hlr_db(pid=13887): Launched 07:55:19.350963 bus /sierra_2: Setting Powered False 07:55:20.409399 run create_hlr_db(pid=13887): Terminated: ok {rc=0} 07:55:20.815625 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13889): Launched 07:55:21.105909 run osmo-hlr_10.42.42.2(pid=13890): Launched 07:55:21.216571 run osmo-stp_10.42.42.5: Starting osmo-stp 07:55:21.731570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13892): Launched 07:55:22.022471 run osmo-stp_10.42.42.5(pid=13893): Launched 07:55:22.134007 run osmo-msc_10.42.42.6: Starting osmo-msc 07:55:22.660784 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13895): Launched 07:55:22.953708 run osmo-msc_10.42.42.6(pid=13896): Launched 07:55:23.117107 run osmo-stp_10.42.42.5(pid=13893): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13893)] 07:55:23.240423 run osmo-stp_10.42.42.5(pid=13893): stdout: | (launched: 2022-12-10_07:55:21.969688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:23.364061 run osmo-stp_10.42.42.5(pid=13893): stderr: | [0;m[38;5;43m20221210075522139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075522140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075522140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075522140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075522141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075522141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075522141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:23.486023 run osmo-stp_10.42.42.5(pid=13893): stdout: | (launched: 2022-12-10_07:55:21.969688) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:23.602571 run osmo-stp_10.42.42.5(pid=13893): stderr: | [0;m[38;5;43m20221210075522139 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075522140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075522140 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075522140 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075522141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075522141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075522141 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:23.742482 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13893): Process ended prematurely: osmo-stp_10.42.42.5(pid=13893) [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13893)] [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 07:55:23.751353 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 07:55:23.778827 run osmo-hlr_10.42.42.2(pid=13890): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13890)] 07:55:23.826677 run osmo-hlr_10.42.42.2(pid=13890): stdout: | (launched: 2022-12-10_07:55:21.052694) 07:55:23.875652 run osmo-hlr_10.42.42.2(pid=13890): stderr: | [0;m[1;31m20221210075521229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075521229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075521229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075521229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075521229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075521229 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075521242 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075521250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075521250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075521250 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:55:23.944231 run osmo-msc_10.42.42.6(pid=13896): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13896)] 07:55:23.991794 run osmo-msc_10.42.42.6(pid=13896): stdout: | (launched: 2022-12-10_07:55:22.900105) 07:55:24.040767 run osmo-msc_10.42.42.6(pid=13896): stderr: | [0;m[38;5;43m20221210075523171 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210075523171 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f322923ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210075523171 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210075523171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210075523171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210075523171 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210075523173 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210075523174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210075523174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210075523174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:55:24.090109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13889): Terminating (SIGTERM) 07:55:24.129547 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13892): Terminating (SIGTERM) 07:55:24.169114 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13895): Terminating (SIGTERM) 07:55:24.209087 --- ParallelTerminationStrategy: PID 13889 died... 07:55:24.227930 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13889): Terminated: ok {rc=0} 07:55:24.272062 --- ParallelTerminationStrategy: PID 13892 died... 07:55:24.290613 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13892): Terminated: ok {rc=0} 07:55:24.334947 --- ParallelTerminationStrategy: PID 13895 died... 07:55:24.353369 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13895): Terminated: ok {rc=0} 07:55:24.437273 bus /sierra_3: Setting Powered False 07:55:25.535025 bus /sierra_3: Setting Powered False 07:55:26.650736 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 07:55:27.798176 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:55:27.810621 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 07:55:27.871796 tst mo_mt_call_osmux.py: using LAC 26952 07:55:27.988530 tst mo_mt_call_osmux.py: using RAC 177 07:55:28.112069 tst mo_mt_call_osmux.py: using CellId 26952 07:55:28.228533 tst mo_mt_call_osmux.py: using BVCI 26953 07:55:28.336353 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:55:28.347383 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:55:28.358453 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:55:28.369893 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:55:28.381071 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 07:55:28.392437 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:55:28.509623 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 07:55:28.627575 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:55:29.111389 run create_hlr_db(pid=13898): Launched 07:55:29.239477 bus /sierra_2: Setting Powered False 07:55:30.301239 run create_hlr_db(pid=13898): Terminated: ok {rc=0} 07:55:30.718544 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13900): Launched 07:55:31.049703 run osmo-hlr_10.42.42.2(pid=13901): Launched 07:55:31.333281 run osmo-stp_10.42.42.5: Starting osmo-stp 07:55:32.045556 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13903): Launched 07:55:32.432481 run osmo-stp_10.42.42.5(pid=13904): Launched 07:55:32.590894 run osmo-msc_10.42.42.6: Starting osmo-msc 07:55:33.160115 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13906): Launched 07:55:33.473267 run osmo-msc_10.42.42.6(pid=13907): Launched 07:55:33.649237 run osmo-stp_10.42.42.5(pid=13904): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13904)] 07:55:33.781097 run osmo-stp_10.42.42.5(pid=13904): stdout: | (launched: 2022-12-10_07:55:32.361524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:33.912868 run osmo-stp_10.42.42.5(pid=13904): stderr: | [0;m[38;5;43m20221210075532596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075532596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075532597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075532597 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075532597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075532598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075532598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:34.043931 run osmo-stp_10.42.42.5(pid=13904): stdout: | (launched: 2022-12-10_07:55:32.361524) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:34.169169 run osmo-stp_10.42.42.5(pid=13904): stderr: | [0;m[38;5;43m20221210075532596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075532596 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075532597 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075532597 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075532597 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075532598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075532598 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:34.318258 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13904): Process ended prematurely: osmo-stp_10.42.42.5(pid=13904) [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13904)] [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 07:55:34.327716 tst mo_mt_call_osmux.py:8: Test FAILED (6.6 sec) 07:55:34.355430 run osmo-hlr_10.42.42.2(pid=13901): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13901)] 07:55:34.405121 run osmo-hlr_10.42.42.2(pid=13901): stdout: | (launched: 2022-12-10_07:55:30.983401) 07:55:34.456305 run osmo-hlr_10.42.42.2(pid=13901): stderr: | [0;m[1;31m20221210075531443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075531443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075531443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075531443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075531443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075531443 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075531470 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075531491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075531491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075531491 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:55:34.527747 run osmo-msc_10.42.42.6(pid=13907): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13907)] 07:55:34.577287 run osmo-msc_10.42.42.6(pid=13907): stdout: | (launched: 2022-12-10_07:55:33.416686) 07:55:34.628317 run osmo-msc_10.42.42.6(pid=13907): stderr: | [0;m[38;5;43m20221210075533736 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210075533736 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7faf123d3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210075533736 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210075533736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210075533736 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210075533737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210075533738 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210075533739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210075533739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210075533739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:55:34.679662 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13900): Terminating (SIGTERM) 07:55:34.721458 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13903): Terminating (SIGTERM) 07:55:34.763000 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13906): Terminating (SIGTERM) 07:55:34.804583 --- ParallelTerminationStrategy: PID 13900 died... 07:55:34.824355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13900): Terminated: ok {rc=0} 07:55:34.870608 --- ParallelTerminationStrategy: PID 13903 died... 07:55:34.890249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13903): Terminated: ok {rc=0} 07:55:34.936150 --- ParallelTerminationStrategy: PID 13906 died... 07:55:34.955792 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13906): Terminated: ok {rc=0} 07:55:35.043288 bus /sierra_3: Setting Powered False 07:55:36.142930 bus /sierra_3: Setting Powered False 07:55:37.257954 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 07:55:38.500901 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:55:38.508692 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 07:55:38.532728 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 07:55:38.560109 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 07:55:38.619181 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 07:55:38.643221 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 07:55:38.670010 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 07:55:39.216848 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 07:55:39.266076 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:55:39.277550 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:55:39.334789 tst mo_mt_call.py: using LAC 26953 07:55:39.448236 tst mo_mt_call.py: using RAC 178 07:55:39.561092 tst mo_mt_call.py: using CellId 26953 07:55:39.674229 tst mo_mt_call.py: using BVCI 26954 07:55:39.780197 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:55:39.791239 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:55:39.802170 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:55:39.813555 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:55:39.824995 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:55:39.836103 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:55:39.952538 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:55:40.067748 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:55:40.518083 run create_hlr_db(pid=13912): Launched 07:55:40.629639 bus /sierra_2: Setting Powered False 07:55:41.688049 run create_hlr_db(pid=13912): Terminated: ok {rc=0} 07:55:42.115060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13914): Launched 07:55:42.425655 run osmo-hlr_10.42.42.2(pid=13915): Launched 07:55:42.545376 run osmo-stp_10.42.42.5: Starting osmo-stp 07:55:43.081228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13917): Launched 07:55:43.391165 run osmo-stp_10.42.42.5(pid=13918): Launched 07:55:43.510104 run osmo-msc_10.42.42.6: Starting osmo-msc 07:55:44.073316 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13920): Launched 07:55:44.385503 run osmo-msc_10.42.42.6(pid=13921): Launched 07:55:44.560674 run osmo-stp_10.42.42.5(pid=13918): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13918)] 07:55:44.692435 run osmo-stp_10.42.42.5(pid=13918): stdout: | (launched: 2022-12-10_07:55:43.335050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:44.824397 run osmo-stp_10.42.42.5(pid=13918): stderr: | [0;m[38;5;43m20221210075543522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075543522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075543522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075543523 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075543525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075543525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075543525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:44.955897 run osmo-stp_10.42.42.5(pid=13918): stdout: | (launched: 2022-12-10_07:55:43.335050) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:45.080005 run osmo-stp_10.42.42.5(pid=13918): stderr: | [0;m[38;5;43m20221210075543522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075543522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075543522 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075543523 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075543525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075543525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075543525 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:45.228638 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13918): Process ended prematurely: osmo-stp_10.42.42.5(pid=13918) [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13918)] [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 07:55:45.237833 tst mo_mt_call.py:8: Test FAILED (6.0 sec) 07:55:45.265278 run osmo-hlr_10.42.42.2(pid=13915): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13915)] 07:55:45.314412 run osmo-hlr_10.42.42.2(pid=13915): stdout: | (launched: 2022-12-10_07:55:42.369528) 07:55:45.365890 run osmo-hlr_10.42.42.2(pid=13915): stderr: | [0;m[1;31m20221210075542563 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075542564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075542564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075542564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075542564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075542564 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075542579 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075542589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075542589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075542589 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:55:45.436827 run osmo-msc_10.42.42.6(pid=13921): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13921)] 07:55:45.485983 run osmo-msc_10.42.42.6(pid=13921): stdout: | (launched: 2022-12-10_07:55:44.328136) 07:55:45.536864 run osmo-msc_10.42.42.6(pid=13921): stderr: | [0;m[38;5;43m20221210075544649 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210075544649 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f52665b6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210075544650 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210075544650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210075544650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210075544650 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210075544652 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210075544652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210075544652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210075544652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:55:45.588489 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13914): Terminating (SIGTERM) 07:55:45.629667 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13917): Terminating (SIGTERM) 07:55:45.670708 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13920): Terminating (SIGTERM) 07:55:45.712342 --- ParallelTerminationStrategy: PID 13914 died... 07:55:45.732076 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13914): Terminated: ok {rc=0} 07:55:45.777612 --- ParallelTerminationStrategy: PID 13917 died... 07:55:45.796727 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13917): Terminated: ok {rc=0} 07:55:45.856400 --- ParallelTerminationStrategy: PID 13920 died... 07:55:45.882244 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13920): Terminated: ok {rc=0} 07:55:45.988471 bus /sierra_3: Setting Powered False 07:55:47.084196 bus /sierra_3: Setting Powered False 07:55:48.196703 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 07:55:49.343989 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:55:49.356466 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 07:55:49.417393 tst mo_mt_call_osmux.py: using LAC 26954 07:55:49.542487 tst mo_mt_call_osmux.py: using RAC 179 07:55:49.664856 tst mo_mt_call_osmux.py: using CellId 26954 07:55:49.786153 tst mo_mt_call_osmux.py: using BVCI 26955 07:55:49.898709 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:55:49.910242 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:55:49.921741 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:55:49.933126 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:55:49.944535 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 07:55:49.955893 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:55:50.073190 tst voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 07:55:50.188649 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:55:50.640456 run create_hlr_db(pid=13923): Launched 07:55:50.754532 bus /sierra_2: Setting Powered False 07:55:51.813318 run create_hlr_db(pid=13923): Terminated: ok {rc=0} 07:55:52.241430 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13925): Launched 07:55:52.553590 run osmo-hlr_10.42.42.2(pid=13926): Launched 07:55:52.674094 run osmo-stp_10.42.42.5: Starting osmo-stp 07:55:53.217663 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13928): Launched 07:55:53.529638 run osmo-stp_10.42.42.5(pid=13929): Launched 07:55:53.649598 run osmo-msc_10.42.42.6: Starting osmo-msc 07:55:54.219870 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13931): Launched 07:55:54.533352 run osmo-msc_10.42.42.6(pid=13932): Launched 07:55:54.710259 run osmo-stp_10.42.42.5(pid=13929): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13929)] 07:55:54.842874 run osmo-stp_10.42.42.5(pid=13929): stdout: | (launched: 2022-12-10_07:55:53.473145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:54.975143 run osmo-stp_10.42.42.5(pid=13929): stderr: | [0;m[38;5;43m20221210075553663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075553663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075553663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075553663 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075553664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075553664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075553664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:55.108815 run osmo-stp_10.42.42.5(pid=13929): stdout: | (launched: 2022-12-10_07:55:53.473145) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:55:55.233787 run osmo-stp_10.42.42.5(pid=13929): stderr: | [0;m[38;5;43m20221210075553663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075553663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075553663 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075553663 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075553664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075553664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075553664 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:55:55.383475 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13929): Process ended prematurely: osmo-stp_10.42.42.5(pid=13929) [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13929)] [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 07:55:55.393071 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 07:55:55.421080 run osmo-hlr_10.42.42.2(pid=13926): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13926)] 07:55:55.470986 run osmo-hlr_10.42.42.2(pid=13926): stdout: | (launched: 2022-12-10_07:55:52.497034) 07:55:55.522526 run osmo-hlr_10.42.42.2(pid=13926): stderr: | [0;m[1;31m20221210075552695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075552695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075552695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075552695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075552695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075552695 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075552708 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075552716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075552716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075552716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:55:55.594248 run osmo-msc_10.42.42.6(pid=13932): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13932)] 07:55:55.644048 run osmo-msc_10.42.42.6(pid=13932): stdout: | (launched: 2022-12-10_07:55:54.476613) 07:55:55.695702 run osmo-msc_10.42.42.6(pid=13932): stderr: | [0;m[38;5;43m20221210075554797 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210075554797 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1e2c54ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210075554797 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210075554797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210075554797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210075554797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210075554799 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210075554800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210075554800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210075554800 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:55:55.747305 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13925): Terminating (SIGTERM) 07:55:55.788591 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13928): Terminating (SIGTERM) 07:55:55.831119 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13931): Terminating (SIGTERM) 07:55:55.872935 --- ParallelTerminationStrategy: PID 13925 died... 07:55:55.892997 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13925): Terminated: ok {rc=0} 07:55:55.939216 --- ParallelTerminationStrategy: PID 13928 died... 07:55:55.958938 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13928): Terminated: ok {rc=0} 07:55:56.004761 --- ParallelTerminationStrategy: PID 13931 died... 07:55:56.024374 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13931): Terminated: ok {rc=0} 07:55:56.111550 bus /sierra_3: Setting Powered False 07:55:57.209597 bus /sierra_3: Setting Powered False 07:55:58.324747 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 07:55:59.560847 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:55:59.568057 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 07:55:59.591646 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 07:55:59.618260 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 07:55:59.669164 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 07:55:59.692896 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 07:55:59.719799 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 07:56:00.269242 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 07:56:00.316402 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:56:00.327469 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:56:00.386284 tst mo_mt_call.py: using LAC 26955 07:56:00.509191 tst mo_mt_call.py: using RAC 180 07:56:00.631564 tst mo_mt_call.py: using CellId 26955 07:56:00.753456 tst mo_mt_call.py: using BVCI 26956 07:56:00.882021 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:56:00.894130 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:56:00.921940 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:56:00.934544 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:56:00.947739 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:56:00.961626 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:56:01.081850 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:56:01.205310 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:56:01.717392 run create_hlr_db(pid=13937): Launched 07:56:01.876781 bus /sierra_2: Setting Powered False 07:56:02.937923 run create_hlr_db(pid=13937): Terminated: ok {rc=0} 07:56:03.371794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13939): Launched 07:56:03.683532 run osmo-hlr_10.42.42.2(pid=13940): Launched 07:56:03.803170 run osmo-stp_10.42.42.5: Starting osmo-stp 07:56:04.337532 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13942): Launched 07:56:04.648329 run osmo-stp_10.42.42.5(pid=13943): Launched 07:56:04.767178 run osmo-msc_10.42.42.6: Starting osmo-msc 07:56:05.329774 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13945): Launched 07:56:05.642201 run osmo-msc_10.42.42.6(pid=13946): Launched 07:56:05.817324 run osmo-stp_10.42.42.5(pid=13943): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13943)] 07:56:05.948684 run osmo-stp_10.42.42.5(pid=13943): stdout: | (launched: 2022-12-10_07:56:04.591938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:06.080844 run osmo-stp_10.42.42.5(pid=13943): stderr: | [0;m[38;5;43m20221210075604785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075604785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075604785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075604786 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075604786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075604786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075604786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:06.212362 run osmo-stp_10.42.42.5(pid=13943): stdout: | (launched: 2022-12-10_07:56:04.591938) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:06.336833 run osmo-stp_10.42.42.5(pid=13943): stderr: | [0;m[38;5;43m20221210075604785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075604785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075604785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075604786 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075604786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075604786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075604786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:06.486038 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13943): Process ended prematurely: osmo-stp_10.42.42.5(pid=13943) [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13943)] [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 07:56:06.495502 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 07:56:06.523327 run osmo-hlr_10.42.42.2(pid=13940): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13940)] 07:56:06.573440 run osmo-hlr_10.42.42.2(pid=13940): stdout: | (launched: 2022-12-10_07:56:03.627170) 07:56:06.625081 run osmo-hlr_10.42.42.2(pid=13940): stderr: | [0;m[1;31m20221210075603824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075603824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075603824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075603824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075603824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075603824 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075603837 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075603845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075603845 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075603846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:56:06.697030 run osmo-msc_10.42.42.6(pid=13946): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13946)] 07:56:06.746759 run osmo-msc_10.42.42.6(pid=13946): stdout: | (launched: 2022-12-10_07:56:05.585552) 07:56:06.797967 run osmo-msc_10.42.42.6(pid=13946): stderr: | [0;m[38;5;43m20221210075605905 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210075605905 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb1b1420c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210075605905 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210075605905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210075605905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210075605905 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210075605907 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210075605907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210075605907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210075605908 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:56:06.849599 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13939): Terminating (SIGTERM) 07:56:06.891035 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13942): Terminating (SIGTERM) 07:56:06.932555 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13945): Terminating (SIGTERM) 07:56:06.974549 --- ParallelTerminationStrategy: PID 13939 died... 07:56:06.994566 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13939): Terminated: ok {rc=0} 07:56:07.040824 --- ParallelTerminationStrategy: PID 13942 died... 07:56:07.060761 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13942): Terminated: ok {rc=0} 07:56:07.107043 --- ParallelTerminationStrategy: PID 13945 died... 07:56:07.126787 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13945): Terminated: ok {rc=0} 07:56:07.213669 bus /sierra_3: Setting Powered False 07:56:08.312294 bus /sierra_3: Setting Powered False 07:56:09.428070 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 07:56:10.571612 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:56:10.583334 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 07:56:10.642640 tst mo_mt_call_osmux.py: using LAC 26956 07:56:10.756172 tst mo_mt_call_osmux.py: using RAC 181 07:56:10.870516 tst mo_mt_call_osmux.py: using CellId 26956 07:56:10.986856 tst mo_mt_call_osmux.py: using BVCI 26957 07:56:11.091715 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:56:11.102824 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:56:11.113742 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:56:11.124669 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:56:11.135796 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 07:56:11.146907 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:56:11.264607 tst voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 07:56:11.385141 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:56:11.868886 run create_hlr_db(pid=13949): Launched 07:56:11.996906 bus /sierra_2: Setting Powered False 07:56:13.059094 run create_hlr_db(pid=13949): Terminated: ok {rc=0} 07:56:13.476589 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13951): Launched 07:56:13.770156 run osmo-hlr_10.42.42.2(pid=13952): Launched 07:56:13.881251 run osmo-stp_10.42.42.5: Starting osmo-stp 07:56:14.394278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13954): Launched 07:56:14.684882 run osmo-stp_10.42.42.5(pid=13955): Launched 07:56:14.795995 run osmo-msc_10.42.42.6: Starting osmo-msc 07:56:15.322249 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13957): Launched 07:56:15.614769 run osmo-msc_10.42.42.6(pid=13958): Launched 07:56:15.779279 run osmo-stp_10.42.42.5(pid=13955): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13955)] 07:56:16.035684 run osmo-stp_10.42.42.5(pid=13955): stdout: | (launched: 2022-12-10_07:56:14.631737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:16.213318 run osmo-stp_10.42.42.5(pid=13955): stderr: | [0;m[38;5;43m20221210075614799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075614799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075614800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075614800 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075614802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075614802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075614802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:16.383106 run osmo-stp_10.42.42.5(pid=13955): stdout: | (launched: 2022-12-10_07:56:14.631737) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:16.544726 run osmo-stp_10.42.42.5(pid=13955): stderr: | [0;m[38;5;43m20221210075614799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075614799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075614800 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075614800 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075614802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075614802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075614802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:16.737236 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13955): Process ended prematurely: osmo-stp_10.42.42.5(pid=13955) [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13955)] [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 07:56:16.750012 tst mo_mt_call_osmux.py:8: Test FAILED (6.2 sec) 07:56:16.781938 run osmo-hlr_10.42.42.2(pid=13952): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13952)] 07:56:16.833169 run osmo-hlr_10.42.42.2(pid=13952): stdout: | (launched: 2022-12-10_07:56:13.716834) 07:56:16.885089 run osmo-hlr_10.42.42.2(pid=13952): stderr: | [0;m[1;31m20221210075613889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075613889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075613889 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075613890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075613890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075613890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075613902 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075613911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075613911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075613911 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:56:16.959061 run osmo-msc_10.42.42.6(pid=13958): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13958)] 07:56:17.011006 run osmo-msc_10.42.42.6(pid=13958): stdout: | (launched: 2022-12-10_07:56:15.561159) 07:56:17.064744 run osmo-msc_10.42.42.6(pid=13958): stderr: | [0;m[38;5;43m20221210075615836 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210075615836 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f092a140c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210075615837 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210075615837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210075615837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210075615838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210075615839 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210075615840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210075615840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210075615840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:56:17.117805 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13951): Terminating (SIGTERM) 07:56:17.160596 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13954): Terminating (SIGTERM) 07:56:17.206206 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13957): Terminating (SIGTERM) 07:56:17.251286 --- ParallelTerminationStrategy: PID 13951 died... 07:56:17.271699 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13951): Terminated: ok {rc=0} 07:56:17.319851 --- ParallelTerminationStrategy: PID 13954 died... 07:56:17.339920 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13954): Terminated: ok {rc=0} 07:56:17.387219 --- ParallelTerminationStrategy: PID 13957 died... 07:56:17.406839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13957): Terminated: ok {rc=0} 07:56:17.494577 bus /sierra_3: Setting Powered False 07:56:18.592809 bus /sierra_3: Setting Powered False 07:56:19.708022 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 07:56:20.949050 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:56:20.956767 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 07:56:20.981444 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 07:56:21.008597 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 07:56:21.062599 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 07:56:21.088197 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 07:56:21.115333 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 07:56:21.666101 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 07:56:21.717397 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:56:21.729270 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:56:21.793540 tst mo_mt_call.py: using LAC 26957 07:56:21.908640 tst mo_mt_call.py: using RAC 182 07:56:22.021382 tst mo_mt_call.py: using CellId 26957 07:56:22.137100 tst mo_mt_call.py: using BVCI 26958 07:56:22.242093 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:56:22.253331 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:56:22.264223 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:56:22.275333 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:56:22.286793 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:56:22.297968 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:56:22.414841 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:56:22.533452 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:56:23.017192 run create_hlr_db(pid=13963): Launched 07:56:23.145532 bus /sierra_2: Setting Powered False 07:56:24.207737 run create_hlr_db(pid=13963): Terminated: ok {rc=0} 07:56:24.624385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13965): Launched 07:56:24.916482 run osmo-hlr_10.42.42.2(pid=13966): Launched 07:56:25.029104 run osmo-stp_10.42.42.5: Starting osmo-stp 07:56:25.530960 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13968): Launched 07:56:25.821553 run osmo-stp_10.42.42.5(pid=13969): Launched 07:56:25.932828 run osmo-msc_10.42.42.6: Starting osmo-msc 07:56:26.462680 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13971): Launched 07:56:26.754614 run osmo-msc_10.42.42.6(pid=13972): Launched 07:56:26.918873 run osmo-stp_10.42.42.5(pid=13969): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13969)] 07:56:27.042861 run osmo-stp_10.42.42.5(pid=13969): stdout: | (launched: 2022-12-10_07:56:25.768530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:27.167589 run osmo-stp_10.42.42.5(pid=13969): stderr: | [0;m[38;5;43m20221210075625935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075625935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075625935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075625936 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075625936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075625936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075625936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:27.288749 run osmo-stp_10.42.42.5(pid=13969): stdout: | (launched: 2022-12-10_07:56:25.768530) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:27.404924 run osmo-stp_10.42.42.5(pid=13969): stderr: | [0;m[38;5;43m20221210075625935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075625935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075625935 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075625936 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075625936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075625936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075625936 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:27.544367 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13969): Process ended prematurely: osmo-stp_10.42.42.5(pid=13969) [trial-2371↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13969)] [trial-2371↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 07:56:27.553182 tst mo_mt_call.py:8: Test FAILED (5.9 sec) 07:56:27.579675 run osmo-hlr_10.42.42.2(pid=13966): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13966)] 07:56:27.627462 run osmo-hlr_10.42.42.2(pid=13966): stdout: | (launched: 2022-12-10_07:56:24.863338) 07:56:27.676912 run osmo-hlr_10.42.42.2(pid=13966): stderr: | [0;m[1;31m20221210075625038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075625038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075625038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075625038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075625038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075625038 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075625050 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075625059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075625059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075625059 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:56:27.746053 run osmo-msc_10.42.42.6(pid=13972): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13972)] 07:56:27.793531 run osmo-msc_10.42.42.6(pid=13972): stdout: | (launched: 2022-12-10_07:56:26.701177) 07:56:27.842645 run osmo-msc_10.42.42.6(pid=13972): stderr: | [0;m[38;5;43m20221210075626970 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210075626970 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2a38273c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210075626971 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210075626971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210075626971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210075626971 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210075626975 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210075626975 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210075626976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210075626976 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:56:27.892126 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13965): Terminating (SIGTERM) 07:56:27.931509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13968): Terminating (SIGTERM) 07:56:27.971483 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13971): Terminating (SIGTERM) 07:56:28.011485 --- ParallelTerminationStrategy: PID 13965 died... 07:56:28.030532 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13965): Terminated: ok {rc=0} 07:56:28.074812 --- ParallelTerminationStrategy: PID 13968 died... 07:56:28.093400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13968): Terminated: ok {rc=0} 07:56:28.137214 --- ParallelTerminationStrategy: PID 13971 died... 07:56:28.156142 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13971): Terminated: ok {rc=0} 07:56:28.242284 bus /sierra_3: Setting Powered False 07:56:29.341348 bus /sierra_3: Setting Powered False 07:56:30.455198 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 07:56:31.597552 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:56:31.610169 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 07:56:31.671015 tst mo_mt_call_osmux.py: using LAC 26958 07:56:31.825530 tst mo_mt_call_osmux.py: using RAC 183 07:56:31.981709 tst mo_mt_call_osmux.py: using CellId 26958 07:56:32.143485 tst mo_mt_call_osmux.py: using BVCI 26959 07:56:32.252920 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:56:32.265159 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:56:32.277296 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:56:32.290367 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:56:32.303988 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 07:56:32.315369 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:56:32.434203 tst voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 07:56:32.553587 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:56:33.038779 run create_hlr_db(pid=13974): Launched 07:56:33.166390 bus /sierra_2: Setting Powered False 07:56:34.229057 run create_hlr_db(pid=13974): Terminated: ok {rc=0} 07:56:34.646227 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13976): Launched 07:56:34.938793 run osmo-hlr_10.42.42.2(pid=13977): Launched 07:56:35.050559 run osmo-stp_10.42.42.5: Starting osmo-stp 07:56:35.552048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13979): Launched 07:56:35.844431 run osmo-stp_10.42.42.5(pid=13980): Launched 07:56:35.956404 run osmo-msc_10.42.42.6: Starting osmo-msc 07:56:36.485252 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13982): Launched 07:56:36.777371 run osmo-msc_10.42.42.6(pid=13983): Launched 07:56:36.942435 run osmo-stp_10.42.42.5(pid=13980): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13980)] 07:56:37.067056 run osmo-stp_10.42.42.5(pid=13980): stdout: | (launched: 2022-12-10_07:56:35.790892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:37.191539 run osmo-stp_10.42.42.5(pid=13980): stderr: | [0;m[38;5;43m20221210075635959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075635959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075635959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075635959 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075635960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075635960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075635960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:37.313449 run osmo-stp_10.42.42.5(pid=13980): stdout: | (launched: 2022-12-10_07:56:35.790892) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:37.430041 run osmo-stp_10.42.42.5(pid=13980): stderr: | [0;m[38;5;43m20221210075635959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075635959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075635959 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075635959 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075635960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075635960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075635960 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:37.569717 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=13980): Process ended prematurely: osmo-stp_10.42.42.5(pid=13980) [trial-2371↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13980)] [trial-2371↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 07:56:37.578598 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 07:56:37.605615 run osmo-hlr_10.42.42.2(pid=13977): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13977)] 07:56:37.653500 run osmo-hlr_10.42.42.2(pid=13977): stdout: | (launched: 2022-12-10_07:56:34.885675) 07:56:37.702866 run osmo-hlr_10.42.42.2(pid=13977): stderr: | [0;m[1;31m20221210075635063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075635063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075635063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075635063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075635063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075635063 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075635076 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075635085 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075635086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075635086 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:56:37.771993 run osmo-msc_10.42.42.6(pid=13983): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13983)] 07:56:37.819810 run osmo-msc_10.42.42.6(pid=13983): stdout: | (launched: 2022-12-10_07:56:36.723808) 07:56:37.868790 run osmo-msc_10.42.42.6(pid=13983): stderr: | [0;m[38;5;43m20221210075636994 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210075636994 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd406405c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210075636994 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210075636994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210075636994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210075636994 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210075636996 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210075636996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210075636996 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210075636997 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:56:37.918473 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13976): Terminating (SIGTERM) 07:56:37.958181 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13979): Terminating (SIGTERM) 07:56:37.997851 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13982): Terminating (SIGTERM) 07:56:38.037699 --- ParallelTerminationStrategy: PID 13976 died... 07:56:38.056755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13976): Terminated: ok {rc=0} 07:56:38.101339 --- ParallelTerminationStrategy: PID 13979 died... 07:56:38.119882 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13979): Terminated: ok {rc=0} 07:56:38.163947 --- ParallelTerminationStrategy: PID 13982 died... 07:56:38.182484 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13982): Terminated: ok {rc=0} 07:56:38.268643 bus /sierra_3: Setting Powered False 07:56:39.368023 bus /sierra_3: Setting Powered False 07:56:40.483533 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 emergency:nanobts+band-1900 --------------------------------------------------------------------- 07:56:41.726925 tst emergency:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:56:41.732327 tst emergency:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 07:56:41.756794 tst emergency:nanobts+band-1900: Verifying 6 x ip_address (candidates: 9) 07:56:41.784062 tst emergency:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 07:56:41.873938 tst emergency:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 07:56:41.897563 tst emergency:nanobts+band-1900: Reserving 6 x ip_address (candidates: 9) 07:56:41.924403 tst emergency:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 07:56:42.501870 tst emergency:nanobts+band-1900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2371 emergency:nanobts+band-1900 emergency_mo_mt_call.py ---------------------------------------------- 07:56:42.507081 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:42.517879 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:56:42.557529 tst emergency_mo_mt_call.py: using LAC 26959 07:56:42.671761 tst emergency_mo_mt_call.py: using RAC 184 07:56:42.783324 tst emergency_mo_mt_call.py: using CellId 26959 07:56:42.894710 tst emergency_mo_mt_call.py: using BVCI 26960 07:56:42.998406 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:43.009268 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:43.019874 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:43.031009 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:43.042124 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:43.052785 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:56:43.165298 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:56:43.277501 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:56:43.718939 run create_hlr_db(pid=13988): Launched 07:56:43.828570 bus /sierra_2: Setting Powered False 07:56:44.886702 run create_hlr_db(pid=13988): Terminated: ok {rc=0} 07:56:45.287352 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13990): Launched 07:56:45.573230 run osmo-hlr_10.42.42.2(pid=13991): Launched 07:56:45.683112 run osmo-stp_10.42.42.5: Starting osmo-stp 07:56:46.236481 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13993): Launched 07:56:46.537988 run osmo-stp_10.42.42.5(pid=13994): Launched 07:56:46.800521 tst emergency_mo_mt_call.py: using MSISDN 7621 07:56:47.012169 run osmo-msc_10.42.42.6: Starting osmo-msc 07:56:47.533891 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13996): Launched 07:56:47.819882 run osmo-msc_10.42.42.6(pid=13997): Launched 07:56:47.980308 run osmo-stp_10.42.42.5(pid=13994): ERR: Terminated: ERROR {rc=1} [trial-2371↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13994)] 07:56:48.101241 run osmo-stp_10.42.42.5(pid=13994): stdout: | (launched: 2022-12-10_07:56:46.476684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:48.223592 run osmo-stp_10.42.42.5(pid=13994): stderr: | [0;m[38;5;43m20221210075646681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075646681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075646681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075646682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075646682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075646682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075646682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:48.342973 run osmo-stp_10.42.42.5(pid=13994): stdout: | (launched: 2022-12-10_07:56:46.476684) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:48.456780 run osmo-stp_10.42.42.5(pid=13994): stderr: | [0;m[38;5;43m20221210075646681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075646681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075646681 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075646682 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075646682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075646682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075646682 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:48.593002 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=13994): Process ended prematurely: osmo-stp_10.42.42.5(pid=13994) [trial-2371↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13994)] [trial-2371↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19] 07:56:48.601224 tst emergency_mo_mt_call.py:19: Test FAILED (6.1 sec) 07:56:48.627310 run osmo-hlr_10.42.42.2(pid=13991): ERR: Terminated: ERROR {rc=237} [trial-2371↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=13991)] 07:56:48.675038 run osmo-hlr_10.42.42.2(pid=13991): stdout: | (launched: 2022-12-10_07:56:45.520654) 07:56:48.723978 run osmo-hlr_10.42.42.2(pid=13991): stderr: | [0;m[1;31m20221210075645696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075645696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075645696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075645696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075645696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075645696 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075645708 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/emergency:nanobts+band-1900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075645716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075645716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075645716 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:56:48.792017 run osmo-msc_10.42.42.6(pid=13997): ERR: Terminated: ERROR {rc=2} [trial-2371↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=13997)] 07:56:48.839170 run osmo-msc_10.42.42.6(pid=13997): stdout: | (launched: 2022-12-10_07:56:47.767430) 07:56:48.888078 run osmo-msc_10.42.42.6(pid=13997): stderr: | [0;m[38;5;43m20221210075648036 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210075648036 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f58d3b32c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210075648036 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210075648036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210075648036 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210075648037 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210075648038 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210075648039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210075648039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210075648039 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:56:48.937416 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13990): Terminating (SIGTERM) 07:56:48.976982 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13993): Terminating (SIGTERM) 07:56:49.016562 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13996): Terminating (SIGTERM) 07:56:49.056386 --- ParallelTerminationStrategy: PID 13990 died... 07:56:49.075441 run pcap-recorder_any(filters='host 10.42.42.2')(pid=13990): Terminated: ok {rc=0} 07:56:49.119647 --- ParallelTerminationStrategy: PID 13993 died... 07:56:49.138111 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=13993): Terminated: ok {rc=0} 07:56:49.182063 --- ParallelTerminationStrategy: PID 13996 died... 07:56:49.200588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=13996): Terminated: ok {rc=0} 07:56:49.285671 bus /sierra_3: Setting Powered False 07:56:50.384370 bus /sierra_3: Setting Powered False 07:56:51.496090 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 emergency:nanobts+band-1900 emergency_preemptive_call.py ---------------------------------------------- 07:56:52.582002 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:52.593879 tst emergency:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:56:52.635784 tst emergency_preemptive_call.py: using LAC 26960 07:56:52.758919 tst emergency_preemptive_call.py: using RAC 185 07:56:52.881330 tst emergency_preemptive_call.py: using CellId 26960 07:56:53.002345 tst emergency_preemptive_call.py: using BVCI 26961 07:56:53.114892 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:53.126114 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:53.137069 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:53.147941 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:53.159002 tst emergency:nanobts+band-1900: Using 1 x ip_address (candidates: 6) 07:56:53.169845 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:56:53.283340 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:56:53.400741 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:56:53.514201 tst emergency:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:56:53.631419 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:56:54.109624 run create_hlr_db(pid=13999): Launched 07:56:54.234725 bus /sierra_2: Setting Powered False 07:56:55.296723 run create_hlr_db(pid=13999): Terminated: ok {rc=0} 07:56:55.707159 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14001): Launched 07:56:55.994049 run osmo-hlr_10.42.42.2(pid=14002): Launched 07:56:56.103768 run osmo-stp_10.42.42.5: Starting osmo-stp 07:56:56.596084 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14004): Launched 07:56:56.881825 run osmo-stp_10.42.42.5(pid=14005): Launched 07:56:57.001519 tst emergency_preemptive_call.py: using MSISDN 7622 07:56:57.165296 run osmo-msc_10.42.42.6: Starting osmo-msc 07:56:57.677401 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14007): Launched 07:56:57.964170 run osmo-msc_10.42.42.6(pid=14008): Launched 07:56:58.125609 run osmo-stp_10.42.42.5(pid=14005): ERR: Terminated: ERROR {rc=1} [trial-2371↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14005)] 07:56:58.246680 run osmo-stp_10.42.42.5(pid=14005): stdout: | (launched: 2022-12-10_07:56:56.829300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:58.368300 run osmo-stp_10.42.42.5(pid=14005): stderr: | [0;m[38;5;43m20221210075656997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075656998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075656998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075656999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075657001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075657002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075657002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:58.487766 run osmo-stp_10.42.42.5(pid=14005): stdout: | (launched: 2022-12-10_07:56:56.829300) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:56:58.601999 run osmo-stp_10.42.42.5(pid=14005): stderr: | [0;m[38;5;43m20221210075656997 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075656998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075656998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075656999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075657001 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075657002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075657002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:56:58.738606 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=14005): Process ended prematurely: osmo-stp_10.42.42.5(pid=14005) [trial-2371↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14005)] [trial-2371↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32] 07:56:58.746668 tst emergency_preemptive_call.py:32: Test FAILED (6.2 sec) 07:56:58.772738 run osmo-hlr_10.42.42.2(pid=14002): ERR: Terminated: ERROR {rc=237} [trial-2371↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14002)] 07:56:58.820518 run osmo-hlr_10.42.42.2(pid=14002): stdout: | (launched: 2022-12-10_07:56:55.941456) 07:56:58.869710 run osmo-hlr_10.42.42.2(pid=14002): stderr: | [0;m[1;31m20221210075656118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075656118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075656118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075656118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075656118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075656118 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075656130 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/emergency:nanobts+band-1900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075656138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075656138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075656138 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:56:58.938317 run osmo-msc_10.42.42.6(pid=14008): ERR: Terminated: ERROR {rc=2} [trial-2371↪emergency:nanobts+band-1900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14008)] 07:56:58.985681 run osmo-msc_10.42.42.6(pid=14008): stdout: | (launched: 2022-12-10_07:56:57.911528) 07:56:59.034583 run osmo-msc_10.42.42.6(pid=14008): stderr: | [0;m[38;5;43m20221210075658184 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210075658184 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5cda548c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210075658184 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210075658184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210075658184 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210075658185 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210075658188 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210075658188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210075658188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210075658188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 07:56:59.084093 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14001): Terminating (SIGTERM) 07:56:59.123665 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14004): Terminating (SIGTERM) 07:56:59.163263 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14007): Terminating (SIGTERM) 07:56:59.203523 --- ParallelTerminationStrategy: PID 14001 died... 07:56:59.222577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14001): Terminated: ok {rc=0} 07:56:59.267526 --- ParallelTerminationStrategy: PID 14004 died... 07:56:59.286222 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14004): Terminated: ok {rc=0} 07:56:59.330582 --- ParallelTerminationStrategy: PID 14007 died... 07:56:59.349317 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14007): Terminated: ok {rc=0} 07:56:59.435312 bus /sierra_9: Setting Powered False 07:57:00.534265 bus /sierra_9: Setting Powered False 07:57:01.645329 bus /sierra_8: Setting Powered False 07:57:02.744224 bus /sierra_8: Setting Powered False 07:57:03.859761 bus /sierra_3: Setting Powered False 07:57:04.956526 bus /sierra_3: Setting Powered False 07:57:06.071600 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 emergency:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:nanobts+band-1900 --------------------------------------------------------------------- 07:57:07.345661 tst gprs:nanobts+band-1900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:57:07.351201 tst gprs:nanobts+band-1900: Verifying 1 x bts (candidates: 11) 07:57:07.376318 tst gprs:nanobts+band-1900: Verifying 9 x ip_address (candidates: 9) 07:57:07.416283 tst gprs:nanobts+band-1900: Verifying 4 x modem (candidates: 12) 07:57:07.501842 tst gprs:nanobts+band-1900: Reserving 1 x bts (candidates: 11) 07:57:07.525024 tst gprs:nanobts+band-1900: Reserving 9 x ip_address (candidates: 9) 07:57:07.562661 tst gprs:nanobts+band-1900: Reserving 4 x modem (candidates: 12) 07:57:08.152609 tst gprs:nanobts+band-1900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:nanobts+band-1900 cs_paging_gprs_active.py ---------------------------------------------- 07:57:08.201088 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:08.211674 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:57:08.250980 tst cs_paging_gprs_active.py: using LAC 26961 07:57:08.366177 tst cs_paging_gprs_active.py: using RAC 186 07:57:08.481188 tst cs_paging_gprs_active.py: using CellId 26961 07:57:08.602718 tst cs_paging_gprs_active.py: using BVCI 26962 07:57:08.710940 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:08.721643 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:08.732065 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:08.742857 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:08.753621 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:08.764142 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:08.774972 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:08.785555 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:08.796369 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:57:08.914878 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:57:09.029502 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:57:09.225854 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:57:09.519062 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14015): Launched 07:57:09.777717 run iperf3-srv_10.42.42.10(pid=14016): Launched 07:57:09.897098 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:57:10.109779 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:57:10.424663 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14017): Launched 07:57:10.698165 run iperf3-srv_10.42.42.10(pid=14018): Launched 07:57:10.816286 tst cs_paging_gprs_active.py:38: start network... 07:57:11.027540 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:57:11.512305 run create_hlr_db(pid=14019): Launched 07:57:11.640312 bus /sierra_2: Setting Powered False 07:57:12.703529 run create_hlr_db(pid=14019): Terminated: ok {rc=0} 07:57:13.124163 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14021): Launched 07:57:13.418842 run osmo-hlr_10.42.42.2(pid=14022): Launched 07:57:13.532020 run osmo-stp_10.42.42.5: Starting osmo-stp 07:57:14.049696 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14024): Launched 07:57:14.342175 run osmo-stp_10.42.42.5(pid=14025): Launched 07:57:14.454297 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:57:14.957870 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14027): Launched 07:57:15.070381 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:57:15.317688 run patchelf(pid=14028): Launched 07:57:15.481087 run osmo-stp_10.42.42.5(pid=14025): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14025)] 07:57:15.605283 run osmo-stp_10.42.42.5(pid=14025): stdout: | (launched: 2022-12-10_07:57:14.288800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:15.731305 run osmo-stp_10.42.42.5(pid=14025): stderr: | [0;m[38;5;43m20221210075714457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075714458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075714458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075714458 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075714459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075714459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075714459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:15.882678 run osmo-stp_10.42.42.5(pid=14025): stdout: | (launched: 2022-12-10_07:57:14.288800) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:16.021854 run osmo-stp_10.42.42.5(pid=14025): stderr: | [0;m[38;5;43m20221210075714457 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075714458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075714458 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075714458 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075714459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075714459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075714459 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:16.182395 run patchelf(pid=14028): Terminating (SIGINT) 07:57:16.365109 run patchelf(pid=14028): Terminated: ok {rc=0} 07:57:16.497173 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14025): Process ended prematurely: osmo-stp_10.42.42.5(pid=14025) [trial-2371↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14025)] [trial-2371↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38] 07:57:16.508232 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 07:57:16.538383 run osmo-hlr_10.42.42.2(pid=14022): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14022)] 07:57:16.591989 run osmo-hlr_10.42.42.2(pid=14022): stdout: | (launched: 2022-12-10_07:57:13.365327) 07:57:16.645281 run osmo-hlr_10.42.42.2(pid=14022): stderr: | [0;m[1;31m20221210075713539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075713539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075713539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075713539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075713539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075713539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075713551 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-1900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075713559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075713560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075713560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:57:16.699437 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14015): Terminating (SIGTERM) 07:57:16.742809 run iperf3-srv_10.42.42.10(pid=14016): Terminating (SIGTERM) 07:57:16.788744 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14017): Terminating (SIGTERM) 07:57:16.832118 run iperf3-srv_10.42.42.10(pid=14018): Terminating (SIGTERM) 07:57:16.875412 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14021): Terminating (SIGTERM) 07:57:16.919329 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14024): Terminating (SIGTERM) 07:57:16.964735 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14027): Terminating (SIGTERM) 07:57:17.011274 --- ParallelTerminationStrategy: PID 14015 died... 07:57:17.032682 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14015): Terminated: ok {rc=0} 07:57:17.083972 --- ParallelTerminationStrategy: PID 14016 died... 07:57:17.104456 run iperf3-srv_10.42.42.10(pid=14016): Terminated {rc=256} 07:57:17.152426 --- ParallelTerminationStrategy: PID 14017 died... 07:57:17.173024 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14017): Terminated: ok {rc=0} 07:57:17.222090 --- ParallelTerminationStrategy: PID 14018 died... 07:57:17.242740 run iperf3-srv_10.42.42.10(pid=14018): Terminated {rc=256} 07:57:17.288768 --- ParallelTerminationStrategy: PID 14021 died... 07:57:17.308749 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14021): Terminated: ok {rc=0} 07:57:17.354765 --- ParallelTerminationStrategy: PID 14024 died... 07:57:17.374309 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14024): Terminated: ok {rc=0} 07:57:17.420165 --- ParallelTerminationStrategy: PID 14027 died... 07:57:17.439942 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14027): Terminated: ok {rc=0} 07:57:17.528421 bus /gobi_0: Setting Powered False 07:57:18.626330 bus /gobi_0: Setting Powered False 07:57:19.743131 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-1900 iperf3.py ---------------------------------------------- 07:57:20.886973 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:20.898226 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:57:20.937797 tst iperf3.py: using LAC 26962 07:57:21.068252 tst iperf3.py: using RAC 187 07:57:21.190901 tst iperf3.py: using CellId 26962 07:57:21.312783 tst iperf3.py: using BVCI 26963 07:57:21.426814 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:21.437980 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:21.449010 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:21.460288 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:21.471514 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:21.482864 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:21.494294 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:21.505590 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:21.517036 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:57:21.634905 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:57:21.830228 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:57:22.122107 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14029): Launched 07:57:22.375075 run iperf3-srv_10.42.42.10(pid=14030): Launched 07:57:22.484312 tst iperf3.py:8: start network... 07:57:22.678110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:57:23.128022 run create_hlr_db(pid=14031): Launched 07:57:23.240738 bus /gobi_6: Setting Powered False 07:57:24.300000 run create_hlr_db(pid=14031): Terminated: ok {rc=0} 07:57:24.729155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14033): Launched 07:57:25.042779 run osmo-hlr_10.42.42.2(pid=14034): Launched 07:57:25.162687 run osmo-stp_10.42.42.5: Starting osmo-stp 07:57:25.703393 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14036): Launched 07:57:26.015382 run osmo-stp_10.42.42.5(pid=14037): Launched 07:57:26.135066 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:57:26.673793 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14039): Launched 07:57:26.794004 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:57:27.057453 run patchelf(pid=14040): Launched 07:57:27.232134 run osmo-stp_10.42.42.5(pid=14037): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14037)] 07:57:27.364404 run osmo-stp_10.42.42.5(pid=14037): stdout: | (launched: 2022-12-10_07:57:25.958845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:27.498636 run osmo-stp_10.42.42.5(pid=14037): stderr: | [0;m[38;5;43m20221210075726152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075726152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075726153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075726153 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075726154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075726154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075726154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:27.632657 run osmo-stp_10.42.42.5(pid=14037): stdout: | (launched: 2022-12-10_07:57:25.958845) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:27.761207 run osmo-stp_10.42.42.5(pid=14037): stderr: | [0;m[38;5;43m20221210075726152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075726152 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075726153 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075726153 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075726154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075726154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075726154 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:27.912915 run patchelf(pid=14040): Terminating (SIGINT) 07:57:28.089848 run patchelf(pid=14040): Terminated: ok {rc=0} 07:57:28.217807 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14037): Process ended prematurely: osmo-stp_10.42.42.5(pid=14037) [trial-2371↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14037)] [trial-2371↪gprs:nanobts+band-1900↪iperf3.py:8] 07:57:28.227669 tst iperf3.py:8: Test FAILED (7.4 sec) 07:57:28.255867 run osmo-hlr_10.42.42.2(pid=14034): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-1900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14034)] 07:57:28.305279 run osmo-hlr_10.42.42.2(pid=14034): stdout: | (launched: 2022-12-10_07:57:24.986218) 07:57:28.356308 run osmo-hlr_10.42.42.2(pid=14034): stderr: | [0;m[1;31m20221210075725183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075725183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075725183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075725183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075725183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075725183 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075725200 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-1900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075725209 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075725210 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075725211 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:57:28.407695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14029): Terminating (SIGTERM) 07:57:28.449234 run iperf3-srv_10.42.42.10(pid=14030): Terminating (SIGTERM) 07:57:28.490624 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14033): Terminating (SIGTERM) 07:57:28.532110 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14036): Terminating (SIGTERM) 07:57:28.573340 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14039): Terminating (SIGTERM) 07:57:28.615001 --- ParallelTerminationStrategy: PID 14029 died... 07:57:28.634853 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14029): Terminated: ok {rc=0} 07:57:28.680790 --- ParallelTerminationStrategy: PID 14030 died... 07:57:28.700127 run iperf3-srv_10.42.42.10(pid=14030): Terminated {rc=256} 07:57:28.746193 --- ParallelTerminationStrategy: PID 14033 died... 07:57:28.765720 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14033): Terminated: ok {rc=0} 07:57:28.811567 --- ParallelTerminationStrategy: PID 14036 died... 07:57:28.831062 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14036): Terminated: ok {rc=0} 07:57:28.876925 --- ParallelTerminationStrategy: PID 14039 died... 07:57:28.896798 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14039): Terminated: ok {rc=0} 07:57:28.983882 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-1900 iperf3m4.py ---------------------------------------------- 07:57:30.131796 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:30.143475 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:57:30.183768 tst iperf3m4.py: using LAC 26963 07:57:30.307892 tst iperf3m4.py: using RAC 188 07:57:30.435124 tst iperf3m4.py: using CellId 26963 07:57:30.556381 tst iperf3m4.py: using BVCI 26964 07:57:30.669498 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:30.680490 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:30.691463 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:30.702559 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:30.713520 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:30.724336 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:30.735443 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:30.746578 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:30.757826 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:57:30.876405 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:57:31.009705 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:57:31.156881 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:57:31.304440 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:57:31.578271 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:57:31.927712 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14041): Launched 07:57:32.216354 run iperf3-srv_10.42.42.10(pid=14042): Launched 07:57:32.351540 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:57:32.561802 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:57:32.876600 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14043): Launched 07:57:33.148711 run iperf3-srv_10.42.42.10(pid=14044): Launched 07:57:33.265883 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:57:33.475865 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:57:33.790577 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14045): Launched 07:57:34.062529 run iperf3-srv_10.42.42.10(pid=14046): Launched 07:57:34.179620 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:57:34.390843 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:57:34.704445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14047): Launched 07:57:34.976532 run iperf3-srv_10.42.42.10(pid=14048): Launched 07:57:35.093891 tst iperf3m4.py:8: start network... 07:57:35.303951 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:57:35.788350 run create_hlr_db(pid=14049): Launched 07:57:35.915914 bus /gobi_6: Setting Powered False 07:57:36.979217 run create_hlr_db(pid=14049): Terminated: ok {rc=0} 07:57:37.397549 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14051): Launched 07:57:37.689496 run osmo-hlr_10.42.42.2(pid=14052): Launched 07:57:37.801391 run osmo-stp_10.42.42.5: Starting osmo-stp 07:57:38.320042 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14054): Launched 07:57:38.612104 run osmo-stp_10.42.42.5(pid=14055): Launched 07:57:38.724305 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:57:39.228000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14057): Launched 07:57:39.340734 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:57:39.587478 run patchelf(pid=14058): Launched 07:57:39.765775 run osmo-stp_10.42.42.5(pid=14055): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14055)] 07:57:39.899754 run osmo-stp_10.42.42.5(pid=14055): stdout: | (launched: 2022-12-10_07:57:38.558915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:40.035605 run osmo-stp_10.42.42.5(pid=14055): stderr: | [0;m[38;5;43m20221210075738725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075738725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075738725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075738726 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075738726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075738726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075738726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:40.171413 run osmo-stp_10.42.42.5(pid=14055): stdout: | (launched: 2022-12-10_07:57:38.558915) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:40.301511 run osmo-stp_10.42.42.5(pid=14055): stderr: | [0;m[38;5;43m20221210075738725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075738725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075738725 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075738726 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075738726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075738726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075738726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:40.455178 run patchelf(pid=14058): Terminating (SIGINT) 07:57:40.633570 run patchelf(pid=14058): Terminated: ok {rc=0} 07:57:40.762486 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14055): Process ended prematurely: osmo-stp_10.42.42.5(pid=14055) [trial-2371↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14055)] [trial-2371↪gprs:nanobts+band-1900↪iperf3m4.py:8] 07:57:40.772609 tst iperf3m4.py:8: Test FAILED (10.7 sec) 07:57:40.802420 run osmo-hlr_10.42.42.2(pid=14052): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-1900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14052)] 07:57:40.852741 run osmo-hlr_10.42.42.2(pid=14052): stdout: | (launched: 2022-12-10_07:57:37.636020) 07:57:40.905014 run osmo-hlr_10.42.42.2(pid=14052): stderr: | [0;m[1;31m20221210075737810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075737810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075737810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075737810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075737810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075737810 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075737824 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-1900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075737834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075737834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075737834 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:57:40.957399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14041): Terminating (SIGTERM) 07:57:40.999281 run iperf3-srv_10.42.42.10(pid=14042): Terminating (SIGTERM) 07:57:41.041439 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14043): Terminating (SIGTERM) 07:57:41.083578 run iperf3-srv_10.42.42.10(pid=14044): Terminating (SIGTERM) 07:57:41.125768 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14045): Terminating (SIGTERM) 07:57:41.168006 run iperf3-srv_10.42.42.10(pid=14046): Terminating (SIGTERM) 07:57:41.210014 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14047): Terminating (SIGTERM) 07:57:41.252065 run iperf3-srv_10.42.42.10(pid=14048): Terminating (SIGTERM) 07:57:41.294160 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14051): Terminating (SIGTERM) 07:57:41.336138 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14054): Terminating (SIGTERM) 07:57:41.378280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14057): Terminating (SIGTERM) 07:57:41.420593 --- ParallelTerminationStrategy: PID 14041 died... 07:57:41.440636 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14041): Terminated: ok {rc=0} 07:57:41.487660 --- ParallelTerminationStrategy: PID 14042 died... 07:57:41.507110 run iperf3-srv_10.42.42.10(pid=14042): Terminated {rc=256} 07:57:41.553985 --- ParallelTerminationStrategy: PID 14043 died... 07:57:41.573572 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14043): Terminated: ok {rc=0} 07:57:41.620044 --- ParallelTerminationStrategy: PID 14044 died... 07:57:41.639592 run iperf3-srv_10.42.42.10(pid=14044): Terminated {rc=256} 07:57:41.686400 --- ParallelTerminationStrategy: PID 14045 died... 07:57:41.705947 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14045): Terminated: ok {rc=0} 07:57:41.752892 --- ParallelTerminationStrategy: PID 14046 died... 07:57:41.772367 run iperf3-srv_10.42.42.10(pid=14046): Terminated {rc=256} 07:57:41.819146 --- ParallelTerminationStrategy: PID 14047 died... 07:57:41.838822 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14047): Terminated: ok {rc=0} 07:57:41.885880 --- ParallelTerminationStrategy: PID 14048 died... 07:57:41.905561 run iperf3-srv_10.42.42.10(pid=14048): Terminated {rc=256} 07:57:41.952403 --- ParallelTerminationStrategy: PID 14051 died... 07:57:41.972100 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14051): Terminated: ok {rc=0} 07:57:42.019135 --- ParallelTerminationStrategy: PID 14054 died... 07:57:42.038704 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14054): Terminated: ok {rc=0} 07:57:42.085581 --- ParallelTerminationStrategy: PID 14057 died... 07:57:42.105205 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14057): Terminated: ok {rc=0} 07:57:42.194560 bus /gobi_4: Setting Powered False 07:57:43.292778 bus /gobi_4: Setting Powered False 07:57:44.411070 bus /gobi_1: Setting Powered False 07:57:45.509091 bus /gobi_1: Setting Powered False 07:57:46.621993 bus /gobi_0: Setting Powered False 07:57:47.722667 bus /gobi_0: Setting Powered False 07:57:48.839521 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-1900 ping.py ---------------------------------------------- 07:57:49.941944 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:49.953188 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:57:49.992152 tst ping.py: using LAC 26964 07:57:50.106069 tst ping.py: using RAC 189 07:57:50.219087 tst ping.py: using CellId 26964 07:57:50.342840 tst ping.py: using BVCI 26965 07:57:50.456070 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:50.467000 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:50.478066 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:50.488827 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:50.499631 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:50.510389 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:50.521318 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:50.532323 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:57:50.647467 tst ping.py:19: start network... 07:57:50.854539 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:57:51.328835 run create_hlr_db(pid=14059): Launched 07:57:51.453647 bus /gobi_6: Setting Powered False 07:57:52.515341 run create_hlr_db(pid=14059): Terminated: ok {rc=0} 07:57:52.925221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14061): Launched 07:57:53.212600 run osmo-hlr_10.42.42.2(pid=14062): Launched 07:57:53.322978 run osmo-stp_10.42.42.5: Starting osmo-stp 07:57:53.817866 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14064): Launched 07:57:54.103720 run osmo-stp_10.42.42.5(pid=14065): Launched 07:57:54.213124 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:57:54.705907 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14067): Launched 07:57:54.815835 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:57:55.057020 run patchelf(pid=14068): Launched 07:57:55.216510 run osmo-stp_10.42.42.5(pid=14065): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14065)] 07:57:55.337762 run osmo-stp_10.42.42.5(pid=14065): stdout: | (launched: 2022-12-10_07:57:54.050890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:55.460772 run osmo-stp_10.42.42.5(pid=14065): stderr: | [0;m[38;5;43m20221210075754219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075754219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075754219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075754219 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075754222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075754222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075754222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:55.583945 run osmo-stp_10.42.42.5(pid=14065): stdout: | (launched: 2022-12-10_07:57:54.050890) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:57:55.701570 run osmo-stp_10.42.42.5(pid=14065): stderr: | [0;m[38;5;43m20221210075754219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075754219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075754219 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075754219 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075754222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075754222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075754222 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:57:55.840737 run patchelf(pid=14068): Terminating (SIGINT) 07:57:56.003429 run patchelf(pid=14068): Terminated: ok {rc=0} 07:57:56.120784 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14065): Process ended prematurely: osmo-stp_10.42.42.5(pid=14065) [trial-2371↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14065)] [trial-2371↪gprs:nanobts+band-1900↪ping.py:22] 07:57:56.129494 tst ping.py:22: Test FAILED (6.2 sec) 07:57:56.156242 run osmo-hlr_10.42.42.2(pid=14062): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-1900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14062)] 07:57:56.203558 run osmo-hlr_10.42.42.2(pid=14062): stdout: | (launched: 2022-12-10_07:57:53.159976) 07:57:56.252583 run osmo-hlr_10.42.42.2(pid=14062): stderr: | [0;m[1;31m20221210075753332 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075753333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075753333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075753333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075753333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075753333 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075753346 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-1900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075753354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075753354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075753354 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:57:56.302043 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14061): Terminating (SIGTERM) 07:57:56.341863 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14064): Terminating (SIGTERM) 07:57:56.381871 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14067): Terminating (SIGTERM) 07:57:56.421950 --- ParallelTerminationStrategy: PID 14061 died... 07:57:56.441005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14061): Terminated: ok {rc=0} 07:57:56.485063 --- ParallelTerminationStrategy: PID 14064 died... 07:57:56.503666 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14064): Terminated: ok {rc=0} 07:57:56.547597 --- ParallelTerminationStrategy: PID 14067 died... 07:57:56.566259 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14067): Terminated: ok {rc=0} 07:57:56.651982 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-1900 ping_idle_ping.py ---------------------------------------------- 07:57:57.740329 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:57.751906 tst gprs:nanobts+band-1900: Using 1 x bts (candidates: 1) 07:57:57.792265 tst ping_idle_ping.py: using LAC 26965 07:57:57.906207 tst ping_idle_ping.py: using RAC 190 07:57:58.017904 tst ping_idle_ping.py: using CellId 26965 07:57:58.130658 tst ping_idle_ping.py: using BVCI 26966 07:57:58.244467 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:58.255636 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:58.266742 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:58.277770 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:58.288803 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:58.299910 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:58.311210 tst gprs:nanobts+band-1900: Using 1 x ip_address (candidates: 9) 07:57:58.322482 tst gprs:nanobts+band-1900: Using 1 x modem (candidates: 4) 07:57:58.435523 tst ping_idle_ping.py:24: start network... 07:57:58.627337 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:57:59.074574 run create_hlr_db(pid=14069): Launched 07:57:59.185722 bus /gobi_6: Setting Powered False 07:58:00.244709 run create_hlr_db(pid=14069): Terminated: ok {rc=0} 07:58:00.668217 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14071): Launched 07:58:01.010744 run osmo-hlr_10.42.42.2(pid=14072): Launched 07:58:01.193584 run osmo-stp_10.42.42.5: Starting osmo-stp 07:58:01.845808 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14074): Launched 07:58:02.183126 run osmo-stp_10.42.42.5(pid=14075): Launched 07:58:02.316089 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:58:02.815909 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14077): Launched 07:58:02.926808 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:58:03.169663 run patchelf(pid=14078): Launched 07:58:03.330657 run osmo-stp_10.42.42.5(pid=14075): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14075)] 07:58:03.453471 run osmo-stp_10.42.42.5(pid=14075): stdout: | (launched: 2022-12-10_07:58:02.116498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:03.578095 run osmo-stp_10.42.42.5(pid=14075): stderr: | [0;m[38;5;43m20221210075802314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075802314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075802314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075802315 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075802315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075802315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075802315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:03.703107 run osmo-stp_10.42.42.5(pid=14075): stdout: | (launched: 2022-12-10_07:58:02.116498) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:03.821894 run osmo-stp_10.42.42.5(pid=14075): stderr: | [0;m[38;5;43m20221210075802314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075802314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075802314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075802315 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075802315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075802315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075802315 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:03.962530 run patchelf(pid=14078): Terminating (SIGINT) 07:58:04.125883 run patchelf(pid=14078): Terminated: ok {rc=0} 07:58:04.243736 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14075): Process ended prematurely: osmo-stp_10.42.42.5(pid=14075) [trial-2371↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14075)] [trial-2371↪gprs:nanobts+band-1900↪ping_idle_ping.py:27] 07:58:04.252499 tst ping_idle_ping.py:27: Test FAILED (6.5 sec) 07:58:04.279326 run osmo-hlr_10.42.42.2(pid=14072): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-1900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14072)] 07:58:04.327593 run osmo-hlr_10.42.42.2(pid=14072): stdout: | (launched: 2022-12-10_07:58:00.948525) 07:58:04.376619 run osmo-hlr_10.42.42.2(pid=14072): stderr: | [0;m[1;31m20221210075801299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075801299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075801299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075801299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075801299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075801299 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075801318 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-1900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075801326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075801326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075801326 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:58:04.426367 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14071): Terminating (SIGTERM) 07:58:04.466609 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14074): Terminating (SIGTERM) 07:58:04.506314 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14077): Terminating (SIGTERM) 07:58:04.546313 --- ParallelTerminationStrategy: PID 14071 died... 07:58:04.565149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14071): Terminated: ok {rc=0} 07:58:04.609273 --- ParallelTerminationStrategy: PID 14074 died... 07:58:04.627933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14074): Terminated: ok {rc=0} 07:58:04.671881 --- ParallelTerminationStrategy: PID 14077 died... 07:58:04.690522 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14077): Terminated: ok {rc=0} 07:58:04.776024 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:nanobts+band-1900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:nanobts+band-1900+mod-bts0-egprs --------------------------------------------------------------------- 07:58:06.067080 tst gprs:nanobts+band-1900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:58:06.073075 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 07:58:06.097280 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 07:58:06.135399 tst gprs:nanobts+band-1900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 07:58:06.220793 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 07:58:06.245637 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 07:58:06.283329 tst gprs:nanobts+band-1900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 07:58:06.874715 tst gprs:nanobts+band-1900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:nanobts+band-1900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 07:58:06.922895 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:06.933816 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:58:06.973891 tst cs_paging_gprs_active.py: using LAC 26966 07:58:07.090231 tst cs_paging_gprs_active.py: using RAC 191 07:58:07.206461 tst cs_paging_gprs_active.py: using CellId 26966 07:58:07.321814 tst cs_paging_gprs_active.py: using BVCI 26967 07:58:07.427166 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:07.438021 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:07.448517 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:07.459350 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:07.470138 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:07.480829 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:07.491967 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:07.502933 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:07.514033 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:58:07.632779 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:58:07.747520 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:58:07.944481 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:58:08.238376 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14082): Launched 07:58:08.493476 run iperf3-srv_10.42.42.10(pid=14083): Launched 07:58:08.603868 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:58:08.800716 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:58:09.095091 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14084): Launched 07:58:09.349645 run iperf3-srv_10.42.42.10(pid=14085): Launched 07:58:09.459247 tst cs_paging_gprs_active.py:38: start network... 07:58:09.654608 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:58:10.104884 run create_hlr_db(pid=14086): Launched 07:58:10.216712 bus /gobi_6: Setting Powered False 07:58:11.276181 run create_hlr_db(pid=14086): Terminated: ok {rc=0} 07:58:11.704593 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14088): Launched 07:58:12.017690 run osmo-hlr_10.42.42.2(pid=14089): Launched 07:58:12.137552 run osmo-stp_10.42.42.5: Starting osmo-stp 07:58:12.680048 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14091): Launched 07:58:12.993880 run osmo-stp_10.42.42.5(pid=14092): Launched 07:58:13.113750 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:58:13.654543 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14094): Launched 07:58:13.774514 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:58:14.038817 run patchelf(pid=14095): Launched 07:58:14.214247 run osmo-stp_10.42.42.5(pid=14092): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14092)] 07:58:14.347043 run osmo-stp_10.42.42.5(pid=14092): stdout: | (launched: 2022-12-10_07:58:12.936821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:14.481468 run osmo-stp_10.42.42.5(pid=14092): stderr: | [0;m[38;5;43m20221210075813127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075813127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075813128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075813128 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075813128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075813129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075813129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:14.616538 run osmo-stp_10.42.42.5(pid=14092): stdout: | (launched: 2022-12-10_07:58:12.936821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:14.744770 run osmo-stp_10.42.42.5(pid=14092): stderr: | [0;m[38;5;43m20221210075813127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075813127 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075813128 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075813128 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075813128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075813129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075813129 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:14.897656 run patchelf(pid=14095): Terminating (SIGINT) 07:58:15.074130 run patchelf(pid=14095): Terminated: ok {rc=0} 07:58:15.201407 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14092): Process ended prematurely: osmo-stp_10.42.42.5(pid=14092) [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14092)] [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 07:58:15.211396 tst cs_paging_gprs_active.py:38: Test FAILED (8.3 sec) 07:58:15.239772 run osmo-hlr_10.42.42.2(pid=14089): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14089)] 07:58:15.289409 run osmo-hlr_10.42.42.2(pid=14089): stdout: | (launched: 2022-12-10_07:58:11.961005) 07:58:15.340636 run osmo-hlr_10.42.42.2(pid=14089): stderr: | [0;m[1;31m20221210075812160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075812160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075812160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075812160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075812160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075812160 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075812172 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-1900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075812182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075812182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075812182 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:58:15.392422 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14082): Terminating (SIGTERM) 07:58:15.434062 run iperf3-srv_10.42.42.10(pid=14083): Terminating (SIGTERM) 07:58:15.475350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14084): Terminating (SIGTERM) 07:58:15.516721 run iperf3-srv_10.42.42.10(pid=14085): Terminating (SIGTERM) 07:58:15.558300 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14088): Terminating (SIGTERM) 07:58:15.599661 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14091): Terminating (SIGTERM) 07:58:15.640889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14094): Terminating (SIGTERM) 07:58:15.682414 --- ParallelTerminationStrategy: PID 14082 died... 07:58:15.702239 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14082): Terminated: ok {rc=0} 07:58:15.747939 --- ParallelTerminationStrategy: PID 14083 died... 07:58:15.767579 run iperf3-srv_10.42.42.10(pid=14083): Terminated {rc=256} 07:58:15.812795 --- ParallelTerminationStrategy: PID 14084 died... 07:58:15.835088 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14084): Terminated: ok {rc=0} 07:58:15.895356 --- ParallelTerminationStrategy: PID 14085 died... 07:58:15.915681 run iperf3-srv_10.42.42.10(pid=14085): Terminated {rc=256} 07:58:15.962530 --- ParallelTerminationStrategy: PID 14088 died... 07:58:15.983196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14088): Terminated: ok {rc=0} 07:58:16.029976 --- ParallelTerminationStrategy: PID 14091 died... 07:58:16.050204 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14091): Terminated: ok {rc=0} 07:58:16.097252 --- ParallelTerminationStrategy: PID 14094 died... 07:58:16.117633 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14094): Terminated: ok {rc=0} 07:58:16.206289 bus /gobi_0: Setting Powered False 07:58:17.303447 bus /gobi_0: Setting Powered False 07:58:18.418401 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-1900+mod-bts0-egprs iperf3.py ---------------------------------------------- 07:58:19.566055 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:19.577832 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:58:19.624093 tst iperf3.py: using LAC 26967 07:58:19.740751 tst iperf3.py: using RAC 192 07:58:19.856753 tst iperf3.py: using CellId 26967 07:58:19.980864 tst iperf3.py: using BVCI 26968 07:58:20.090048 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:20.101050 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:20.112225 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:20.123961 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:20.135510 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:20.147172 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:20.159008 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:20.170503 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:20.182106 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:58:20.301905 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:58:20.514155 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:58:20.829445 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14096): Launched 07:58:21.103107 run iperf3-srv_10.42.42.10(pid=14097): Launched 07:58:21.220850 tst iperf3.py:8: start network... 07:58:21.431517 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:58:21.917329 run create_hlr_db(pid=14098): Launched 07:58:22.046283 bus /gobi_6: Setting Powered False 07:58:23.108738 run create_hlr_db(pid=14098): Terminated: ok {rc=0} 07:58:23.528406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14100): Launched 07:58:23.822555 run osmo-hlr_10.42.42.2(pid=14101): Launched 07:58:23.934856 run osmo-stp_10.42.42.5: Starting osmo-stp 07:58:24.454392 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14103): Launched 07:58:24.748413 run osmo-stp_10.42.42.5(pid=14104): Launched 07:58:24.860601 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:58:25.365167 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14106): Launched 07:58:25.477445 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:58:25.724207 run patchelf(pid=14107): Launched 07:58:25.887825 run osmo-stp_10.42.42.5(pid=14104): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14104)] 07:58:26.012132 run osmo-stp_10.42.42.5(pid=14104): stdout: | (launched: 2022-12-10_07:58:24.694770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:26.138505 run osmo-stp_10.42.42.5(pid=14104): stderr: | [0;m[38;5;43m20221210075824863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075824864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075824864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075824864 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075824865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075824865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075824865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:26.264311 run osmo-stp_10.42.42.5(pid=14104): stdout: | (launched: 2022-12-10_07:58:24.694770) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:26.384710 run osmo-stp_10.42.42.5(pid=14104): stderr: | [0;m[38;5;43m20221210075824863 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075824864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075824864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075824864 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075824865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075824865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075824865 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:26.526969 run patchelf(pid=14107): Terminating (SIGINT) 07:58:26.701727 run patchelf(pid=14107): Terminated: ok {rc=0} 07:58:26.830137 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14104): Process ended prematurely: osmo-stp_10.42.42.5(pid=14104) [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14104)] [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8] 07:58:26.840055 tst iperf3.py:8: Test FAILED (7.3 sec) 07:58:26.868585 run osmo-hlr_10.42.42.2(pid=14101): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14101)] 07:58:26.918831 run osmo-hlr_10.42.42.2(pid=14101): stdout: | (launched: 2022-12-10_07:58:23.768718) 07:58:26.970775 run osmo-hlr_10.42.42.2(pid=14101): stderr: | [0;m[1;31m20221210075823941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075823941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075823941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075823941 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075823942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075823942 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075823954 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075823962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075823962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075823962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:58:27.023152 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14096): Terminating (SIGTERM) 07:58:27.065142 run iperf3-srv_10.42.42.10(pid=14097): Terminating (SIGTERM) 07:58:27.106874 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14100): Terminating (SIGTERM) 07:58:27.148167 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14103): Terminating (SIGTERM) 07:58:27.189602 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14106): Terminating (SIGTERM) 07:58:27.231622 --- ParallelTerminationStrategy: PID 14096 died... 07:58:27.251738 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14096): Terminated: ok {rc=0} 07:58:27.298270 --- ParallelTerminationStrategy: PID 14097 died... 07:58:27.317844 run iperf3-srv_10.42.42.10(pid=14097): Terminated {rc=256} 07:58:27.363556 --- ParallelTerminationStrategy: PID 14100 died... 07:58:27.383060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14100): Terminated: ok {rc=0} 07:58:27.429032 --- ParallelTerminationStrategy: PID 14103 died... 07:58:27.448352 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14103): Terminated: ok {rc=0} 07:58:27.493807 --- ParallelTerminationStrategy: PID 14106 died... 07:58:27.513192 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14106): Terminated: ok {rc=0} 07:58:27.600525 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-1900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 07:58:28.748516 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:28.760405 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:58:28.802981 tst iperf3m4.py: using LAC 26968 07:58:28.926921 tst iperf3m4.py: using RAC 193 07:58:29.048791 tst iperf3m4.py: using CellId 26968 07:58:29.171330 tst iperf3m4.py: using BVCI 26969 07:58:29.284594 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:29.295886 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:29.306953 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:29.318078 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:29.329111 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:29.340076 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:29.351301 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:29.362206 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:29.373369 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:58:29.487761 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:58:29.609178 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:58:29.726636 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:58:29.846137 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:58:30.057860 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:58:30.372806 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14108): Launched 07:58:30.646195 run iperf3-srv_10.42.42.10(pid=14109): Launched 07:58:30.764151 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:58:31.013117 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:58:31.338387 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14110): Launched 07:58:31.629738 run iperf3-srv_10.42.42.10(pid=14111): Launched 07:58:31.754783 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:58:31.957509 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:58:32.261323 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14112): Launched 07:58:32.517200 run iperf3-srv_10.42.42.10(pid=14113): Launched 07:58:32.628119 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:58:32.824477 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:58:33.118380 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14114): Launched 07:58:33.373160 run iperf3-srv_10.42.42.10(pid=14115): Launched 07:58:33.483193 tst iperf3m4.py:8: start network... 07:58:33.679014 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:58:34.131156 run create_hlr_db(pid=14116): Launched 07:58:34.244227 bus /gobi_6: Setting Powered False 07:58:35.302613 run create_hlr_db(pid=14116): Terminated: ok {rc=0} 07:58:35.711394 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14118): Launched 07:58:36.003758 run osmo-hlr_10.42.42.2(pid=14119): Launched 07:58:36.115491 run osmo-stp_10.42.42.5: Starting osmo-stp 07:58:36.630398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14121): Launched 07:58:36.925569 run osmo-stp_10.42.42.5(pid=14122): Launched 07:58:37.038283 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:58:37.544643 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14124): Launched 07:58:37.658398 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:58:37.906028 run patchelf(pid=14125): Launched 07:58:38.070249 run osmo-stp_10.42.42.5(pid=14122): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14122)] 07:58:38.194895 run osmo-stp_10.42.42.5(pid=14122): stdout: | (launched: 2022-12-10_07:58:36.871293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:38.320879 run osmo-stp_10.42.42.5(pid=14122): stderr: | [0;m[38;5;43m20221210075837041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075837041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075837042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075837042 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075837043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075837043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075837043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:38.447383 run osmo-stp_10.42.42.5(pid=14122): stdout: | (launched: 2022-12-10_07:58:36.871293) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:38.567629 run osmo-stp_10.42.42.5(pid=14122): stderr: | [0;m[38;5;43m20221210075837041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075837041 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075837042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075837042 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075837043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075837043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075837043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:38.710587 run patchelf(pid=14125): Terminating (SIGINT) 07:58:38.877943 run patchelf(pid=14125): Terminated: ok {rc=0} 07:58:38.998279 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14122): Process ended prematurely: osmo-stp_10.42.42.5(pid=14122) [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14122)] [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8] 07:58:39.007616 tst iperf3m4.py:8: Test FAILED (10.3 sec) 07:58:39.035631 run osmo-hlr_10.42.42.2(pid=14119): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14119)] 07:58:39.083214 run osmo-hlr_10.42.42.2(pid=14119): stdout: | (launched: 2022-12-10_07:58:35.950029) 07:58:39.132791 run osmo-hlr_10.42.42.2(pid=14119): stderr: | [0;m[1;31m20221210075836123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075836123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075836123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075836123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075836123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075836123 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075836135 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-1900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075836144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075836144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075836144 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:58:39.182729 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14108): Terminating (SIGTERM) 07:58:39.222673 run iperf3-srv_10.42.42.10(pid=14109): Terminating (SIGTERM) 07:58:39.262630 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14110): Terminating (SIGTERM) 07:58:39.302651 run iperf3-srv_10.42.42.10(pid=14111): Terminating (SIGTERM) 07:58:39.342395 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14112): Terminating (SIGTERM) 07:58:39.382194 run iperf3-srv_10.42.42.10(pid=14113): Terminating (SIGTERM) 07:58:39.421906 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14114): Terminating (SIGTERM) 07:58:39.461630 run iperf3-srv_10.42.42.10(pid=14115): Terminating (SIGTERM) 07:58:39.501369 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14118): Terminating (SIGTERM) 07:58:39.541293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14121): Terminating (SIGTERM) 07:58:39.581223 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14124): Terminating (SIGTERM) 07:58:39.621383 --- ParallelTerminationStrategy: PID 14108 died... 07:58:39.640480 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14108): Terminated: ok {rc=0} 07:58:39.685236 --- ParallelTerminationStrategy: PID 14109 died... 07:58:39.703740 run iperf3-srv_10.42.42.10(pid=14109): Terminated {rc=256} 07:58:39.747582 --- ParallelTerminationStrategy: PID 14110 died... 07:58:39.766177 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14110): Terminated: ok {rc=0} 07:58:39.810217 --- ParallelTerminationStrategy: PID 14111 died... 07:58:39.828795 run iperf3-srv_10.42.42.10(pid=14111): Terminated {rc=256} 07:58:39.872513 --- ParallelTerminationStrategy: PID 14112 died... 07:58:39.890988 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14112): Terminated: ok {rc=0} 07:58:39.934861 --- ParallelTerminationStrategy: PID 14113 died... 07:58:39.953553 run iperf3-srv_10.42.42.10(pid=14113): Terminated {rc=256} 07:58:39.997399 --- ParallelTerminationStrategy: PID 14114 died... 07:58:40.015887 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14114): Terminated: ok {rc=0} 07:58:40.059828 --- ParallelTerminationStrategy: PID 14115 died... 07:58:40.078454 run iperf3-srv_10.42.42.10(pid=14115): Terminated {rc=256} 07:58:40.122370 --- ParallelTerminationStrategy: PID 14118 died... 07:58:40.140736 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14118): Terminated: ok {rc=0} 07:58:40.184490 --- ParallelTerminationStrategy: PID 14121 died... 07:58:40.202935 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14121): Terminated: ok {rc=0} 07:58:40.246829 --- ParallelTerminationStrategy: PID 14124 died... 07:58:40.265514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14124): Terminated: ok {rc=0} 07:58:40.351732 bus /gobi_4: Setting Powered False 07:58:41.451669 bus /gobi_4: Setting Powered False 07:58:42.564822 bus /gobi_1: Setting Powered False 07:58:43.661860 bus /gobi_1: Setting Powered False 07:58:44.778249 bus /gobi_0: Setting Powered False 07:58:45.896693 bus /gobi_0: Setting Powered False 07:58:47.025634 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-1900+mod-bts0-egprs ping.py ---------------------------------------------- 07:58:48.129979 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:48.141392 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:58:48.184894 tst ping.py: using LAC 26969 07:58:48.297594 tst ping.py: using RAC 194 07:58:48.409373 tst ping.py: using CellId 26969 07:58:48.520911 tst ping.py: using BVCI 26970 07:58:48.625588 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:48.636347 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:48.646976 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:48.657804 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:48.668490 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:48.679241 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:48.690055 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:48.701078 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:58:48.812479 tst ping.py:19: start network... 07:58:49.004440 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:58:49.449973 run create_hlr_db(pid=14127): Launched 07:58:49.576451 bus /gobi_6: Setting Powered False 07:58:50.638304 run create_hlr_db(pid=14127): Terminated: ok {rc=0} 07:58:51.052177 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14129): Launched 07:58:51.339824 run osmo-hlr_10.42.42.2(pid=14130): Launched 07:58:51.450307 run osmo-stp_10.42.42.5: Starting osmo-stp 07:58:51.948848 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14132): Launched 07:58:52.237183 run osmo-stp_10.42.42.5(pid=14133): Launched 07:58:52.347138 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:58:52.843200 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14135): Launched 07:58:52.953632 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:58:53.196509 run patchelf(pid=14136): Launched 07:58:53.356747 run osmo-stp_10.42.42.5(pid=14133): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14133)] 07:58:53.479241 run osmo-stp_10.42.42.5(pid=14133): stdout: | (launched: 2022-12-10_07:58:52.184076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:53.602650 run osmo-stp_10.42.42.5(pid=14133): stderr: | [0;m[38;5;43m20221210075852352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075852352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075852352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075852353 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075852353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075852353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075852353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:53.726120 run osmo-stp_10.42.42.5(pid=14133): stdout: | (launched: 2022-12-10_07:58:52.184076) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:58:53.843687 run osmo-stp_10.42.42.5(pid=14133): stderr: | [0;m[38;5;43m20221210075852352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075852352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075852352 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075852353 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075852353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075852353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075852353 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:58:53.982739 run patchelf(pid=14136): Terminating (SIGINT) 07:58:54.144935 run patchelf(pid=14136): Terminated: ok {rc=0} 07:58:54.261869 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14133): Process ended prematurely: osmo-stp_10.42.42.5(pid=14133) [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14133)] [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22] 07:58:54.270522 tst ping.py:22: Test FAILED (6.1 sec) 07:58:54.297696 run osmo-hlr_10.42.42.2(pid=14130): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14130)] 07:58:54.345422 run osmo-hlr_10.42.42.2(pid=14130): stdout: | (launched: 2022-12-10_07:58:51.286971) 07:58:54.394799 run osmo-hlr_10.42.42.2(pid=14130): stderr: | [0;m[1;31m20221210075851462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075851462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075851462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075851462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075851462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075851462 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075851474 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-1900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075851482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075851482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075851482 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:58:54.444528 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14129): Terminating (SIGTERM) 07:58:54.484137 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14132): Terminating (SIGTERM) 07:58:54.523771 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14135): Terminating (SIGTERM) 07:58:54.563804 --- ParallelTerminationStrategy: PID 14129 died... 07:58:54.582799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14129): Terminated: ok {rc=0} 07:58:54.627001 --- ParallelTerminationStrategy: PID 14132 died... 07:58:54.645513 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14132): Terminated: ok {rc=0} 07:58:54.689533 --- ParallelTerminationStrategy: PID 14135 died... 07:58:54.708050 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14135): Terminated: ok {rc=0} 07:58:54.795215 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-1900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 07:58:55.884149 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:55.895927 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 07:58:55.938206 tst ping_idle_ping.py: using LAC 26970 07:58:56.053395 tst ping_idle_ping.py: using RAC 195 07:58:56.176416 tst ping_idle_ping.py: using CellId 26970 07:58:56.299510 tst ping_idle_ping.py: using BVCI 26971 07:58:56.412402 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:56.423913 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:56.435287 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:56.447534 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:56.459179 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:56.471090 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:56.483070 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 07:58:56.494900 tst gprs:nanobts+band-1900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 07:58:56.611065 tst ping_idle_ping.py:24: start network... 07:58:56.804825 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:58:57.258698 run create_hlr_db(pid=14137): Launched 07:58:57.369417 bus /gobi_6: Setting Powered False 07:58:58.428341 run create_hlr_db(pid=14137): Terminated: ok {rc=0} 07:58:58.831644 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14139): Launched 07:58:59.120248 run osmo-hlr_10.42.42.2(pid=14140): Launched 07:58:59.231029 run osmo-stp_10.42.42.5: Starting osmo-stp 07:58:59.738554 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14142): Launched 07:59:00.026271 run osmo-stp_10.42.42.5(pid=14143): Launched 07:59:00.136720 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:59:00.631742 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14145): Launched 07:59:00.742264 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:59:01.010558 run patchelf(pid=14146): Launched 07:59:01.200380 run osmo-stp_10.42.42.5(pid=14143): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14143)] 07:59:01.335357 run osmo-stp_10.42.42.5(pid=14143): stdout: | (launched: 2022-12-10_07:58:59.973442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:01.472803 run osmo-stp_10.42.42.5(pid=14143): stderr: | [0;m[38;5;43m20221210075900145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075900145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075900145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075900146 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075900146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075900146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075900146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:01.611896 run osmo-stp_10.42.42.5(pid=14143): stdout: | (launched: 2022-12-10_07:58:59.973442) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:01.742195 run osmo-stp_10.42.42.5(pid=14143): stderr: | [0;m[38;5;43m20221210075900145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075900145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075900145 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075900146 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075900146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075900146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075900146 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:01.898827 run patchelf(pid=14146): Terminating (SIGINT) 07:59:02.078205 run patchelf(pid=14146): Terminated: ok {rc=0} 07:59:02.208083 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14143): Process ended prematurely: osmo-stp_10.42.42.5(pid=14143) [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14143)] [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27] 07:59:02.218335 tst ping_idle_ping.py:27: Test FAILED (6.3 sec) 07:59:02.247365 run osmo-hlr_10.42.42.2(pid=14140): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14140)] 07:59:02.298654 run osmo-hlr_10.42.42.2(pid=14140): stdout: | (launched: 2022-12-10_07:58:59.067329) 07:59:02.350658 run osmo-hlr_10.42.42.2(pid=14140): stderr: | [0;m[1;31m20221210075859240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075859241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075859241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075859241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075859241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075859241 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075859253 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-1900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075859261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075859261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075859261 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:59:02.402911 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14139): Terminating (SIGTERM) 07:59:02.445211 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14142): Terminating (SIGTERM) 07:59:02.487629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14145): Terminating (SIGTERM) 07:59:02.530490 --- ParallelTerminationStrategy: PID 14139 died... 07:59:02.550718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14139): Terminated: ok {rc=0} 07:59:02.598332 --- ParallelTerminationStrategy: PID 14142 died... 07:59:02.618047 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14142): Terminated: ok {rc=0} 07:59:02.664853 --- ParallelTerminationStrategy: PID 14145 died... 07:59:02.684468 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14145): Terminated: ok {rc=0} 07:59:02.773375 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:nanobts+band-1900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:nanobts+band-1900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 07:59:04.072203 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 07:59:04.080521 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 07:59:04.104578 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 07:59:04.142414 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 07:59:04.227594 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 07:59:04.250655 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 07:59:04.288246 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 07:59:04.882823 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:nanobts+band-1900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 07:59:04.930613 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:04.941479 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:59:05.000101 tst cs_paging_gprs_active.py: using LAC 26971 07:59:05.125700 tst cs_paging_gprs_active.py: using RAC 196 07:59:05.242095 tst cs_paging_gprs_active.py: using CellId 26971 07:59:05.356620 tst cs_paging_gprs_active.py: using BVCI 26972 07:59:05.462737 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:05.473543 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:05.484114 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:05.495075 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:05.505947 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:05.516729 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:05.527674 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:05.538372 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:05.549412 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:59:05.668730 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:59:05.784039 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 07:59:05.982692 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:59:06.277409 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14150): Launched 07:59:06.532310 run iperf3-srv_10.42.42.10(pid=14151): Launched 07:59:06.642718 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 07:59:06.839267 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:59:07.134715 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14152): Launched 07:59:07.389594 run iperf3-srv_10.42.42.10(pid=14153): Launched 07:59:07.499897 tst cs_paging_gprs_active.py:38: start network... 07:59:07.695694 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:59:08.149244 run create_hlr_db(pid=14154): Launched 07:59:08.261440 bus /gobi_6: Setting Powered False 07:59:09.320391 run create_hlr_db(pid=14154): Terminated: ok {rc=0} 07:59:09.749670 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14156): Launched 07:59:10.063075 run osmo-hlr_10.42.42.2(pid=14157): Launched 07:59:10.183107 run osmo-stp_10.42.42.5: Starting osmo-stp 07:59:10.728091 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14159): Launched 07:59:11.041355 run osmo-stp_10.42.42.5(pid=14160): Launched 07:59:11.161547 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:59:11.701660 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14162): Launched 07:59:11.821812 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:59:12.085497 run patchelf(pid=14163): Launched 07:59:12.260198 run osmo-stp_10.42.42.5(pid=14160): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14160)] 07:59:12.393246 run osmo-stp_10.42.42.5(pid=14160): stdout: | (launched: 2022-12-10_07:59:10.984693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:12.527912 run osmo-stp_10.42.42.5(pid=14160): stderr: | [0;m[38;5;43m20221210075911174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075911174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075911175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075911175 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075911177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075911178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075911178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:12.662421 run osmo-stp_10.42.42.5(pid=14160): stdout: | (launched: 2022-12-10_07:59:10.984693) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:12.790867 run osmo-stp_10.42.42.5(pid=14160): stderr: | [0;m[38;5;43m20221210075911174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075911174 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075911175 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075911175 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075911177 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075911178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075911178 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:12.943476 run patchelf(pid=14163): Terminating (SIGINT) 07:59:13.121108 run patchelf(pid=14163): Terminated: ok {rc=0} 07:59:13.249069 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14160): Process ended prematurely: osmo-stp_10.42.42.5(pid=14160) [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14160)] [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 07:59:13.258950 tst cs_paging_gprs_active.py:38: Test FAILED (8.4 sec) 07:59:13.287261 run osmo-hlr_10.42.42.2(pid=14157): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14157)] 07:59:13.336401 run osmo-hlr_10.42.42.2(pid=14157): stdout: | (launched: 2022-12-10_07:59:10.006350) 07:59:13.387327 run osmo-hlr_10.42.42.2(pid=14157): stderr: | [0;m[1;31m20221210075910202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075910202 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075910203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075910203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075910203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075910203 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075910215 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075910223 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075910224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075910224 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:59:13.438942 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14150): Terminating (SIGTERM) 07:59:13.480109 run iperf3-srv_10.42.42.10(pid=14151): Terminating (SIGTERM) 07:59:13.521300 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14152): Terminating (SIGTERM) 07:59:13.562725 run iperf3-srv_10.42.42.10(pid=14153): Terminating (SIGTERM) 07:59:13.603746 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14156): Terminating (SIGTERM) 07:59:13.645347 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14159): Terminating (SIGTERM) 07:59:13.686817 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14162): Terminating (SIGTERM) 07:59:13.728241 --- ParallelTerminationStrategy: PID 14150 died... 07:59:13.748043 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14150): Terminated: ok {rc=0} 07:59:13.793732 --- ParallelTerminationStrategy: PID 14151 died... 07:59:13.813734 run iperf3-srv_10.42.42.10(pid=14151): Terminated {rc=256} 07:59:13.859221 --- ParallelTerminationStrategy: PID 14152 died... 07:59:13.878561 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14152): Terminated: ok {rc=0} 07:59:13.923684 --- ParallelTerminationStrategy: PID 14153 died... 07:59:13.943040 run iperf3-srv_10.42.42.10(pid=14153): Terminated {rc=256} 07:59:13.988238 --- ParallelTerminationStrategy: PID 14156 died... 07:59:14.007605 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14156): Terminated: ok {rc=0} 07:59:14.052930 --- ParallelTerminationStrategy: PID 14159 died... 07:59:14.072247 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14159): Terminated: ok {rc=0} 07:59:14.117650 --- ParallelTerminationStrategy: PID 14162 died... 07:59:14.137052 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14162): Terminated: ok {rc=0} 07:59:14.224186 bus /gobi_0: Setting Powered False 07:59:15.321624 bus /gobi_0: Setting Powered False 07:59:16.447652 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 07:59:17.589523 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:17.601060 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:59:17.663511 tst iperf3.py: using LAC 26972 07:59:17.782175 tst iperf3.py: using RAC 197 07:59:17.898787 tst iperf3.py: using CellId 26972 07:59:18.015339 tst iperf3.py: using BVCI 26973 07:59:18.123646 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:18.134736 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:18.145632 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:18.157356 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:18.168935 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:18.180679 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:18.192353 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:18.203689 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:18.215398 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:59:18.332788 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 07:59:18.545625 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:59:18.861844 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14164): Launched 07:59:19.135805 run iperf3-srv_10.42.42.10(pid=14165): Launched 07:59:19.253195 tst iperf3.py:8: start network... 07:59:19.465011 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:59:19.951534 run create_hlr_db(pid=14166): Launched 07:59:20.080399 bus /gobi_6: Setting Powered False 07:59:21.143011 run create_hlr_db(pid=14166): Terminated: ok {rc=0} 07:59:21.580138 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14168): Launched 07:59:21.893703 run osmo-hlr_10.42.42.2(pid=14169): Launched 07:59:22.012808 run osmo-stp_10.42.42.5: Starting osmo-stp 07:59:22.552272 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14171): Launched 07:59:22.866225 run osmo-stp_10.42.42.5(pid=14172): Launched 07:59:22.986140 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:59:23.525797 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14174): Launched 07:59:23.645521 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:59:23.909194 run patchelf(pid=14175): Launched 07:59:24.083259 run osmo-stp_10.42.42.5(pid=14172): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14172)] 07:59:24.215596 run osmo-stp_10.42.42.5(pid=14172): stdout: | (launched: 2022-12-10_07:59:22.809294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:24.349761 run osmo-stp_10.42.42.5(pid=14172): stderr: | [0;m[38;5;43m20221210075923000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075923000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075923001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075923001 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075923002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075923002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075923002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:24.483946 run osmo-stp_10.42.42.5(pid=14172): stdout: | (launched: 2022-12-10_07:59:22.809294) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:24.611872 run osmo-stp_10.42.42.5(pid=14172): stderr: | [0;m[38;5;43m20221210075923000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075923000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075923001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075923001 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075923002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075923002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075923002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:24.763452 run patchelf(pid=14175): Terminating (SIGINT) 07:59:24.939540 run patchelf(pid=14175): Terminated: ok {rc=0} 07:59:25.066555 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14172): Process ended prematurely: osmo-stp_10.42.42.5(pid=14172) [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14172)] [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8] 07:59:25.076440 tst iperf3.py:8: Test FAILED (7.5 sec) 07:59:25.104776 run osmo-hlr_10.42.42.2(pid=14169): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14169)] 07:59:25.154141 run osmo-hlr_10.42.42.2(pid=14169): stdout: | (launched: 2022-12-10_07:59:21.836728) 07:59:25.205146 run osmo-hlr_10.42.42.2(pid=14169): stderr: | [0;m[1;31m20221210075922036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075922036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075922036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075922036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075922036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075922036 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075922049 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075922058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075922058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075922058 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:59:25.256372 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14164): Terminating (SIGTERM) 07:59:25.297497 run iperf3-srv_10.42.42.10(pid=14165): Terminating (SIGTERM) 07:59:25.338577 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14168): Terminating (SIGTERM) 07:59:25.379658 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14171): Terminating (SIGTERM) 07:59:25.420777 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14174): Terminating (SIGTERM) 07:59:25.462219 --- ParallelTerminationStrategy: PID 14164 died... 07:59:25.482020 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14164): Terminated: ok {rc=0} 07:59:25.527829 --- ParallelTerminationStrategy: PID 14165 died... 07:59:25.547334 run iperf3-srv_10.42.42.10(pid=14165): Terminated {rc=256} 07:59:25.592511 --- ParallelTerminationStrategy: PID 14168 died... 07:59:25.611804 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14168): Terminated: ok {rc=0} 07:59:25.657191 --- ParallelTerminationStrategy: PID 14171 died... 07:59:25.676473 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14171): Terminated: ok {rc=0} 07:59:25.721874 --- ParallelTerminationStrategy: PID 14174 died... 07:59:25.742186 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14174): Terminated: ok {rc=0} 07:59:25.829512 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-1900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 07:59:26.978532 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:26.990348 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:59:27.050269 tst iperf3m4.py: using LAC 26973 07:59:27.173169 tst iperf3m4.py: using RAC 198 07:59:27.294948 tst iperf3m4.py: using CellId 26973 07:59:27.417493 tst iperf3m4.py: using BVCI 26974 07:59:27.530688 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:27.542007 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:27.553184 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:27.564298 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:27.575357 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:27.586547 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:27.597770 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:27.608733 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:27.620010 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:59:27.733810 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:59:27.853659 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:59:27.970179 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:59:28.085156 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 07:59:28.280766 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:59:28.574399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14176): Launched 07:59:28.829248 run iperf3-srv_10.42.42.10(pid=14177): Launched 07:59:28.939355 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 07:59:29.134889 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:59:29.428343 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14178): Launched 07:59:29.682504 run iperf3-srv_10.42.42.10(pid=14179): Launched 07:59:29.792485 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 07:59:29.987548 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:59:30.280391 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14180): Launched 07:59:30.534980 run iperf3-srv_10.42.42.10(pid=14181): Launched 07:59:30.645220 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 07:59:30.851526 run iperf3-srv_10.42.42.10: Starting iperf3-srv 07:59:31.229289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14182): Launched 07:59:31.543449 run iperf3-srv_10.42.42.10(pid=14183): Launched 07:59:31.674178 tst iperf3m4.py:8: start network... 07:59:31.892179 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:59:32.387866 run create_hlr_db(pid=14184): Launched 07:59:32.516168 bus /gobi_6: Setting Powered False 07:59:33.578325 run create_hlr_db(pid=14184): Terminated: ok {rc=0} 07:59:34.015096 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14186): Launched 07:59:34.328470 run osmo-hlr_10.42.42.2(pid=14187): Launched 07:59:34.447743 run osmo-stp_10.42.42.5: Starting osmo-stp 07:59:34.990482 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14189): Launched 07:59:35.304033 run osmo-stp_10.42.42.5(pid=14190): Launched 07:59:35.423484 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:59:35.962710 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14192): Launched 07:59:36.082808 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:59:36.346739 run patchelf(pid=14193): Launched 07:59:36.521503 run osmo-stp_10.42.42.5(pid=14190): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14190)] 07:59:36.653957 run osmo-stp_10.42.42.5(pid=14190): stdout: | (launched: 2022-12-10_07:59:35.246993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:36.788503 run osmo-stp_10.42.42.5(pid=14190): stderr: | [0;m[38;5;43m20221210075935439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075935439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075935439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075935440 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075935440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075935440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075935440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:36.923874 run osmo-stp_10.42.42.5(pid=14190): stdout: | (launched: 2022-12-10_07:59:35.246993) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:37.052247 run osmo-stp_10.42.42.5(pid=14190): stderr: | [0;m[38;5;43m20221210075935439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075935439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075935439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075935440 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075935440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075935440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075935440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:37.205142 run patchelf(pid=14193): Terminating (SIGINT) 07:59:37.381587 run patchelf(pid=14193): Terminated: ok {rc=0} 07:59:37.509228 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14190): Process ended prematurely: osmo-stp_10.42.42.5(pid=14190) [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14190)] [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 07:59:37.519162 tst iperf3m4.py:8: Test FAILED (10.6 sec) 07:59:37.547604 run osmo-hlr_10.42.42.2(pid=14187): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14187)] 07:59:37.596692 run osmo-hlr_10.42.42.2(pid=14187): stdout: | (launched: 2022-12-10_07:59:34.271549) 07:59:37.647837 run osmo-hlr_10.42.42.2(pid=14187): stderr: | [0;m[1;31m20221210075934468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075934468 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075934469 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075934469 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075934469 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075934469 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075934482 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075934490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075934490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075934490 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:59:37.699019 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14176): Terminating (SIGTERM) 07:59:37.740205 run iperf3-srv_10.42.42.10(pid=14177): Terminating (SIGTERM) 07:59:37.781461 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14178): Terminating (SIGTERM) 07:59:37.822932 run iperf3-srv_10.42.42.10(pid=14179): Terminating (SIGTERM) 07:59:37.864049 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14180): Terminating (SIGTERM) 07:59:37.905315 run iperf3-srv_10.42.42.10(pid=14181): Terminating (SIGTERM) 07:59:37.946599 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14182): Terminating (SIGTERM) 07:59:37.987965 run iperf3-srv_10.42.42.10(pid=14183): Terminating (SIGTERM) 07:59:38.030458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14186): Terminating (SIGTERM) 07:59:38.071948 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14189): Terminating (SIGTERM) 07:59:38.113085 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14192): Terminating (SIGTERM) 07:59:38.154481 --- ParallelTerminationStrategy: PID 14176 died... 07:59:38.174287 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14176): Terminated: ok {rc=0} 07:59:38.219992 --- ParallelTerminationStrategy: PID 14177 died... 07:59:38.239411 run iperf3-srv_10.42.42.10(pid=14177): Terminated {rc=256} 07:59:38.285514 --- ParallelTerminationStrategy: PID 14178 died... 07:59:38.304716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14178): Terminated: ok {rc=0} 07:59:38.350208 --- ParallelTerminationStrategy: PID 14179 died... 07:59:38.369670 run iperf3-srv_10.42.42.10(pid=14179): Terminated {rc=256} 07:59:38.415165 --- ParallelTerminationStrategy: PID 14180 died... 07:59:38.434431 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14180): Terminated: ok {rc=0} 07:59:38.479805 --- ParallelTerminationStrategy: PID 14181 died... 07:59:38.499030 run iperf3-srv_10.42.42.10(pid=14181): Terminated {rc=256} 07:59:38.544296 --- ParallelTerminationStrategy: PID 14182 died... 07:59:38.563735 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14182): Terminated: ok {rc=0} 07:59:38.609039 --- ParallelTerminationStrategy: PID 14183 died... 07:59:38.628342 run iperf3-srv_10.42.42.10(pid=14183): Terminated {rc=256} 07:59:38.673770 --- ParallelTerminationStrategy: PID 14186 died... 07:59:38.693183 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14186): Terminated: ok {rc=0} 07:59:38.738553 --- ParallelTerminationStrategy: PID 14189 died... 07:59:38.758043 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14189): Terminated: ok {rc=0} 07:59:38.803570 --- ParallelTerminationStrategy: PID 14192 died... 07:59:38.823303 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14192): Terminated: ok {rc=0} 07:59:38.910316 bus /gobi_4: Setting Powered False 07:59:40.009047 bus /gobi_4: Setting Powered False 07:59:41.126723 bus /gobi_1: Setting Powered False 07:59:42.225737 bus /gobi_1: Setting Powered False 07:59:43.341567 bus /gobi_0: Setting Powered False 07:59:44.437786 bus /gobi_0: Setting Powered False 07:59:45.554665 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 07:59:46.674464 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:46.690810 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:59:46.763740 tst ping.py: using LAC 26974 07:59:46.887627 tst ping.py: using RAC 199 07:59:47.004488 tst ping.py: using CellId 26974 07:59:47.121260 tst ping.py: using BVCI 26975 07:59:47.228909 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:47.240741 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:47.253867 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:47.265589 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:47.277861 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:47.291893 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:47.303610 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:47.316633 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:59:47.433560 tst ping.py:19: start network... 07:59:47.640877 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:59:48.118444 run create_hlr_db(pid=14194): Launched 07:59:48.245006 bus /gobi_6: Setting Powered False 07:59:49.307599 run create_hlr_db(pid=14194): Terminated: ok {rc=0} 07:59:49.721524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14196): Launched 07:59:50.010565 run osmo-hlr_10.42.42.2(pid=14197): Launched 07:59:50.121378 run osmo-stp_10.42.42.5: Starting osmo-stp 07:59:50.639186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14199): Launched 07:59:50.926427 run osmo-stp_10.42.42.5(pid=14200): Launched 07:59:51.036679 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:59:51.532613 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14202): Launched 07:59:51.642675 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:59:51.884429 run patchelf(pid=14203): Launched 07:59:52.044630 run osmo-stp_10.42.42.5(pid=14200): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14200)] 07:59:52.166208 run osmo-stp_10.42.42.5(pid=14200): stdout: | (launched: 2022-12-10_07:59:50.874002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:52.289247 run osmo-stp_10.42.42.5(pid=14200): stderr: | [0;m[38;5;43m20221210075951042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075951042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075951042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075951043 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075951043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075951043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075951043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:52.412595 run osmo-stp_10.42.42.5(pid=14200): stdout: | (launched: 2022-12-10_07:59:50.874002) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 07:59:52.530434 run osmo-stp_10.42.42.5(pid=14200): stderr: | [0;m[38;5;43m20221210075951042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075951042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075951042 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075951043 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075951043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075951043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075951043 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 07:59:52.669841 run patchelf(pid=14203): Terminating (SIGINT) 07:59:52.831655 run patchelf(pid=14203): Terminated: ok {rc=0} 07:59:52.948376 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14200): Process ended prematurely: osmo-stp_10.42.42.5(pid=14200) [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14200)] [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22] 07:59:52.957133 tst ping.py:22: Test FAILED (6.3 sec) 07:59:52.984034 run osmo-hlr_10.42.42.2(pid=14197): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14197)] 07:59:53.031341 run osmo-hlr_10.42.42.2(pid=14197): stdout: | (launched: 2022-12-10_07:59:49.957712) 07:59:53.080501 run osmo-hlr_10.42.42.2(pid=14197): stderr: | [0;m[1;31m20221210075950132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075950132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075950132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075950132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075950132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075950132 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075950144 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075950152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075950152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075950152 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 07:59:53.129887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14196): Terminating (SIGTERM) 07:59:53.169582 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14199): Terminating (SIGTERM) 07:59:53.209330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14202): Terminating (SIGTERM) 07:59:53.249910 --- ParallelTerminationStrategy: PID 14196 died... 07:59:53.268871 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14196): Terminated: ok {rc=0} 07:59:53.313419 --- ParallelTerminationStrategy: PID 14199 died... 07:59:53.331682 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14199): Terminated: ok {rc=0} 07:59:53.375790 --- ParallelTerminationStrategy: PID 14202 died... 07:59:53.394329 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14202): Terminated: ok {rc=0} 07:59:53.479898 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-1900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 07:59:54.568484 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:54.580580 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 07:59:54.646322 tst ping_idle_ping.py: using LAC 26975 07:59:54.766628 tst ping_idle_ping.py: using RAC 200 07:59:54.891701 tst ping_idle_ping.py: using CellId 26975 07:59:55.012308 tst ping_idle_ping.py: using BVCI 26976 07:59:55.123690 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:55.135051 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:55.146153 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:55.157271 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:55.168260 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:55.179353 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:55.190610 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 07:59:55.201685 tst gprs:nanobts+band-1900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 07:59:55.313888 tst ping_idle_ping.py:24: start network... 07:59:55.507232 run osmo-hlr_10.42.42.2: Starting osmo-hlr 07:59:55.955488 run create_hlr_db(pid=14204): Launched 07:59:56.066542 bus /gobi_6: Setting Powered False 07:59:57.124808 run create_hlr_db(pid=14204): Terminated: ok {rc=0} 07:59:57.528268 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14206): Launched 07:59:57.816467 run osmo-hlr_10.42.42.2(pid=14207): Launched 07:59:57.926367 run osmo-stp_10.42.42.5: Starting osmo-stp 07:59:58.434188 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14209): Launched 07:59:58.721685 run osmo-stp_10.42.42.5(pid=14210): Launched 07:59:58.832231 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 07:59:59.327484 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14212): Launched 07:59:59.438123 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 07:59:59.680135 run patchelf(pid=14213): Launched 07:59:59.840790 run osmo-stp_10.42.42.5(pid=14210): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14210)] 07:59:59.962659 run osmo-stp_10.42.42.5(pid=14210): stdout: | (launched: 2022-12-10_07:59:58.669321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:00.086224 run osmo-stp_10.42.42.5(pid=14210): stderr: | [0;m[38;5;43m20221210075958838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075958838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075958838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075958839 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075958839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075958839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075958839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:00.210251 run osmo-stp_10.42.42.5(pid=14210): stdout: | (launched: 2022-12-10_07:59:58.669321) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:00.328668 run osmo-stp_10.42.42.5(pid=14210): stderr: | [0;m[38;5;43m20221210075958838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210075958838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210075958838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210075958839 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210075958839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210075958839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210075958839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:00.468848 run patchelf(pid=14213): Terminating (SIGINT) 08:00:00.631220 run patchelf(pid=14213): Terminated: ok {rc=0} 08:00:00.748372 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14210): Process ended prematurely: osmo-stp_10.42.42.5(pid=14210) [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14210)] [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 08:00:00.757131 tst ping_idle_ping.py:27: Test FAILED (6.2 sec) 08:00:00.783850 run osmo-hlr_10.42.42.2(pid=14207): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14207)] 08:00:00.831985 run osmo-hlr_10.42.42.2(pid=14207): stdout: | (launched: 2022-12-10_07:59:57.763428) 08:00:00.894666 run osmo-hlr_10.42.42.2(pid=14207): stderr: | [0;m[1;31m20221210075957939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210075957939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210075957939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210075957939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210075957939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210075957939 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210075957951 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-1900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210075957959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210075957959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210075957959 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:00:00.955817 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14206): Terminating (SIGTERM) 08:00:01.009688 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14209): Terminating (SIGTERM) 08:00:01.060629 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14212): Terminating (SIGTERM) 08:00:01.107244 --- ParallelTerminationStrategy: PID 14206 died... 08:00:01.128149 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14206): Terminated: ok {rc=0} 08:00:01.180132 --- ParallelTerminationStrategy: PID 14209 died... 08:00:01.210260 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14209): Terminated: ok {rc=0} 08:00:01.262713 --- ParallelTerminationStrategy: PID 14212 died... 08:00:01.283330 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14212): Terminated: ok {rc=0} 08:00:01.379477 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:nanobts+band-1900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 08:00:02.670950 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:00:02.678208 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:00:02.702133 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 08:00:02.735987 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:00:02.789017 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:00:02.812809 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 08:00:02.846718 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:00:03.406081 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-1900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2371 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 08:00:03.411108 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:00:03.422476 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:00:03.485491 tst switch_tch_pdch.py: using LAC 26976 08:00:03.598801 tst switch_tch_pdch.py: using RAC 201 08:00:03.720405 tst switch_tch_pdch.py: using CellId 26976 08:00:03.840529 tst switch_tch_pdch.py: using BVCI 26977 08:00:03.952574 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:00:03.964601 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:00:03.976608 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:00:03.989231 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:00:04.002153 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:00:04.014450 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:00:04.026253 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:00:04.038584 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:00:04.154288 tst dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:00:04.269861 tst switch_tch_pdch.py:51: start network... 08:00:04.461662 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:00:04.904074 run create_hlr_db(pid=14220): Launched 08:00:05.014094 bus /gobi_6: Setting Powered False 08:00:06.072463 run create_hlr_db(pid=14220): Terminated: ok {rc=0} 08:00:06.493296 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14222): Launched 08:00:06.802110 run osmo-hlr_10.42.42.2(pid=14223): Launched 08:00:06.920306 run osmo-stp_10.42.42.5: Starting osmo-stp 08:00:07.450357 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14225): Launched 08:00:07.757239 run osmo-stp_10.42.42.5(pid=14226): Launched 08:00:07.875771 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:00:08.408088 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14228): Launched 08:00:08.526667 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:00:08.786140 run patchelf(pid=14229): Launched 08:00:08.957936 run osmo-stp_10.42.42.5(pid=14226): ERR: Terminated: ERROR {rc=1} [trial-2371↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14226)] 08:00:09.088501 run osmo-stp_10.42.42.5(pid=14226): stdout: | (launched: 2022-12-10_08:00:07.701438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:09.220761 run osmo-stp_10.42.42.5(pid=14226): stderr: | [0;m[38;5;43m20221210080007890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080007890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080007891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080007891 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080007893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080007893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080007894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:09.352888 run osmo-stp_10.42.42.5(pid=14226): stdout: | (launched: 2022-12-10_08:00:07.701438) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:09.479738 run osmo-stp_10.42.42.5(pid=14226): stderr: | [0;m[38;5;43m20221210080007890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080007890 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080007891 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080007891 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080007893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080007893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080007894 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:09.629183 run patchelf(pid=14229): Terminating (SIGINT) 08:00:09.802578 run patchelf(pid=14229): Terminated: ok {rc=0} 08:00:09.927658 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14226): Process ended prematurely: osmo-stp_10.42.42.5(pid=14226) [trial-2371↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14226)] [trial-2371↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 08:00:09.936915 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 08:00:09.964509 run osmo-hlr_10.42.42.2(pid=14223): ERR: Terminated: ERROR {rc=237} [trial-2371↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14223)] 08:00:10.013974 run osmo-hlr_10.42.42.2(pid=14223): stdout: | (launched: 2022-12-10_08:00:06.745661) 08:00:10.065199 run osmo-hlr_10.42.42.2(pid=14223): stderr: | [0;m[1;31m20221210080006940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080006940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080006940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080006940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080006940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080006940 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080006953 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080006961 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080006962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080006962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:00:10.116650 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14222): Terminating (SIGTERM) 08:00:10.158100 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14225): Terminating (SIGTERM) 08:00:10.199598 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14228): Terminating (SIGTERM) 08:00:10.241595 --- ParallelTerminationStrategy: PID 14222 died... 08:00:10.261406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14222): Terminated: ok {rc=0} 08:00:10.307535 --- ParallelTerminationStrategy: PID 14225 died... 08:00:10.327141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14225): Terminated: ok {rc=0} 08:00:10.373088 --- ParallelTerminationStrategy: PID 14228 died... 08:00:10.392517 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14228): Terminated: ok {rc=0} 08:00:10.478798 bus /gobi_0: Setting Powered False 08:00:11.574501 bus /gobi_0: Setting Powered False 08:00:12.689273 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 sms:nanobts+band-900 --------------------------------------------------------------------- 08:00:13.930105 tst sms:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:00:13.936225 tst sms:nanobts+band-900: Verifying 1 x bts (candidates: 11) 08:00:13.969920 tst sms:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 08:00:13.996791 tst sms:nanobts+band-900: Verifying 2 x modem (candidates: 12) 08:00:14.049608 tst sms:nanobts+band-900: Reserving 1 x bts (candidates: 11) 08:00:14.082787 tst sms:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 08:00:14.109698 tst sms:nanobts+band-900: Reserving 2 x modem (candidates: 12) 08:00:14.657294 tst sms:nanobts+band-900: RESERVED RESOURCES for sms: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 sms:nanobts+band-900 mo_mt_sms.py ---------------------------------------------- 08:00:14.662287 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:00:14.673368 tst sms:nanobts+band-900: Using 1 x bts (candidates: 1) 08:00:14.719264 tst mo_mt_sms.py: using LAC 26977 08:00:14.841310 tst mo_mt_sms.py: using RAC 202 08:00:14.960556 tst mo_mt_sms.py: using CellId 26977 08:00:15.081249 tst mo_mt_sms.py: using BVCI 26978 08:00:15.191840 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:00:15.202697 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:00:15.213530 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:00:15.224323 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:00:15.235123 tst sms:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:00:15.245835 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 08:00:15.357887 tst sms:nanobts+band-900: Using 1 x modem (candidates: 2) 08:00:15.469467 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:00:15.923540 run create_hlr_db(pid=14233): Launched 08:00:16.074544 bus /gobi_6: Setting Powered False 08:00:17.130869 run create_hlr_db(pid=14233): Terminated: ok {rc=0} 08:00:17.538889 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14235): Launched 08:00:17.825580 run osmo-hlr_10.42.42.2(pid=14236): Launched 08:00:17.935842 run osmo-stp_10.42.42.5: Starting osmo-stp 08:00:18.444199 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14238): Launched 08:00:18.729900 run osmo-stp_10.42.42.5(pid=14239): Launched 08:00:18.840304 run osmo-msc_10.42.42.6: Starting osmo-msc 08:00:19.358582 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14241): Launched 08:00:19.646811 run osmo-msc_10.42.42.6(pid=14242): Launched 08:00:19.809549 run osmo-stp_10.42.42.5(pid=14239): ERR: Terminated: ERROR {rc=1} [trial-2371↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14239)] 08:00:19.932438 run osmo-stp_10.42.42.5(pid=14239): stdout: | (launched: 2022-12-10_08:00:18.677921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:20.055429 run osmo-stp_10.42.42.5(pid=14239): stderr: | [0;m[38;5;43m20221210080018845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080018845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080018846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080018846 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080018846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080018847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080018847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:20.175744 run osmo-stp_10.42.42.5(pid=14239): stdout: | (launched: 2022-12-10_08:00:18.677921) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:20.290918 run osmo-stp_10.42.42.5(pid=14239): stderr: | [0;m[38;5;43m20221210080018845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080018845 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080018846 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080018846 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080018846 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080018847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080018847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:20.428255 tst mo_mt_sms.py:16: ERR: Error: osmo-stp_10.42.42.5(pid=14239): Process ended prematurely: osmo-stp_10.42.42.5(pid=14239) [trial-2371↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14239)] [trial-2371↪sms:nanobts+band-900↪mo_mt_sms.py:16] 08:00:20.436422 tst mo_mt_sms.py:16: Test FAILED (5.8 sec) 08:00:20.462808 run osmo-hlr_10.42.42.2(pid=14236): ERR: Terminated: ERROR {rc=237} [trial-2371↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14236)] 08:00:20.510938 run osmo-hlr_10.42.42.2(pid=14236): stdout: | (launched: 2022-12-10_08:00:17.773363) 08:00:20.560332 run osmo-hlr_10.42.42.2(pid=14236): stderr: | [0;m[1;31m20221210080017946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080017946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080017946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080017946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080017946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080017946 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080017957 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/sms:nanobts+band-900/mo_mt_sms.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080017966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080017966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080017966 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:00:20.629219 run osmo-msc_10.42.42.6(pid=14242): ERR: Terminated: ERROR {rc=2} [trial-2371↪sms:nanobts+band-900↪mo_mt_sms.py↪mo_mt_sms.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14242)] 08:00:20.676710 run osmo-msc_10.42.42.6(pid=14242): stdout: | (launched: 2022-12-10_08:00:19.593846) 08:00:20.725886 run osmo-msc_10.42.42.6(pid=14242): stderr: | [0;m[38;5;43m20221210080019864 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080019864 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3b8d866c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080019864 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080019864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080019864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080019865 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080019866 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080019867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080019867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080019867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:00:20.775575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14235): Terminating (SIGTERM) 08:00:20.815713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14238): Terminating (SIGTERM) 08:00:20.855625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14241): Terminating (SIGTERM) 08:00:20.895936 --- ParallelTerminationStrategy: PID 14235 died... 08:00:20.915086 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14235): Terminated: ok {rc=0} 08:00:20.959635 --- ParallelTerminationStrategy: PID 14238 died... 08:00:20.978318 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14238): Terminated: ok {rc=0} 08:00:21.023160 --- ParallelTerminationStrategy: PID 14241 died... 08:00:21.041673 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14241): Terminated: ok {rc=0} 08:00:21.126710 bus /sierra_3: Setting Powered False 08:00:22.226845 bus /sierra_3: Setting Powered False 08:00:23.343654 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 sms:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 nitb_ussd:nanobts+band-900 --------------------------------------------------------------------- 08:00:24.573951 tst nitb_ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:00:24.578626 tst nitb_ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 08:00:24.610770 tst nitb_ussd:nanobts+band-900: Verifying 1 x ip_address (candidates: 9) 08:00:24.617358 tst nitb_ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 08:00:24.653168 tst nitb_ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 08:00:24.686375 tst nitb_ussd:nanobts+band-900: Reserving 1 x ip_address (candidates: 9) 08:00:24.693429 tst nitb_ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 08:00:25.212084 tst nitb_ussd:nanobts+band-900: RESERVED RESOURCES for nitb_ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2371 nitb_ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 08:00:25.217520 tst nitb_ussd:nanobts+band-900: Using 1 x ip_address (candidates: 1) 08:00:25.228672 tst nitb_ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 08:00:25.280507 tst assert_extension.py: using LAC 26978 08:00:25.401211 tst assert_extension.py: using RAC 203 08:00:25.519908 tst assert_extension.py: using CellId 26978 08:00:25.633223 tst assert_extension.py: using BVCI 26979 08:00:25.737347 tst nitb_ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 08:00:25.853177 tst assert_extension.py:10: start nitb and bts... 08:00:26.060075 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:00:26.686745 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14248): Launched 08:00:26.994037 run osmo-nitb_10.42.42.2(pid=14249): Launched 08:00:27.164375 run osmo-nitb_10.42.42.2(pid=14249): ERR: Terminated: ERROR {rc=2} [trial-2371↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14249)] 08:00:27.303130 run osmo-nitb_10.42.42.2(pid=14249): stdout: | (launched: 2022-12-10_08:00:26.938150) 08:00:27.443179 run osmo-nitb_10.42.42.2(pid=14249): stderr: | (launched: 2022-12-10_08:00:26.984027) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:00:27.583723 run osmo-nitb_10.42.42.2(pid=14249): stdout: | (launched: 2022-12-10_08:00:26.938150) 08:00:27.718170 run osmo-nitb_10.42.42.2(pid=14249): stderr: | (launched: 2022-12-10_08:00:26.984027) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f5483dba268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14249): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14249) [trial-2371↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14249)] 08:00:28.109663 tst osmo-nitb_10.42.42.2(pid=14249): stdout: | (launched: 2022-12-10_08:00:26.938150) 08:00:28.233711 tst osmo-nitb_10.42.42.2(pid=14249): stderr: | (launched: 2022-12-10_08:00:26.984027) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:00:28.380232 tst assert_extension.py:12: ERR: Error: osmo-nitb_10.42.42.2(pid=14249): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14249) [trial-2371↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14249)] [trial-2371↪nitb_ussd:nanobts+band-900↪assert_extension.py:12] 08:00:28.389401 tst assert_extension.py:12: Test FAILED (3.2 sec) 08:00:28.396498 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14248): Terminating (SIGTERM) 08:00:28.606972 --- ParallelTerminationStrategy: PID 14248 died... 08:00:28.628611 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14248): Terminated: ok {rc=0} 08:00:28.716924 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 nitb_ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 ussd:nanobts+band-900 --------------------------------------------------------------------- 08:00:29.895420 tst ussd:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:00:29.900557 tst ussd:nanobts+band-900: Verifying 1 x bts (candidates: 11) 08:00:29.933810 tst ussd:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 08:00:29.960902 tst ussd:nanobts+band-900: Verifying 1 x modem (candidates: 12) 08:00:29.995834 tst ussd:nanobts+band-900: Reserving 1 x bts (candidates: 11) 08:00:30.028918 tst ussd:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 08:00:30.055790 tst ussd:nanobts+band-900: Reserving 1 x modem (candidates: 12) 08:00:30.585898 tst ussd:nanobts+band-900: RESERVED RESOURCES for ussd: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2371 ussd:nanobts+band-900 assert_extension.py ---------------------------------------------- 08:00:30.592090 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:00:30.604386 tst ussd:nanobts+band-900: Using 1 x bts (candidates: 1) 08:00:30.650188 tst assert_extension.py: using LAC 26979 08:00:30.768826 tst assert_extension.py: using RAC 204 08:00:30.910939 tst assert_extension.py: using CellId 26979 08:00:31.030205 tst assert_extension.py: using BVCI 26980 08:00:31.143990 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:00:31.155538 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:00:31.166978 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:00:31.178724 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:00:31.191063 tst ussd:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:00:31.202618 tst ussd:nanobts+band-900: Using 1 x modem (candidates: 1) 08:00:31.317511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:00:31.811147 run create_hlr_db(pid=14253): Launched 08:00:31.973790 bus /sierra_2: Setting Powered False 08:00:33.035936 run create_hlr_db(pid=14253): Terminated: ok {rc=0} 08:00:33.466139 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14255): Launched 08:00:33.774773 run osmo-hlr_10.42.42.2(pid=14256): Launched 08:00:33.892914 run osmo-stp_10.42.42.5: Starting osmo-stp 08:00:34.424833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14258): Launched 08:00:34.733067 run osmo-stp_10.42.42.5(pid=14259): Launched 08:00:34.852171 run osmo-msc_10.42.42.6: Starting osmo-msc 08:00:35.412357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14261): Launched 08:00:35.721201 run osmo-msc_10.42.42.6(pid=14262): Launched 08:00:35.894320 run osmo-stp_10.42.42.5(pid=14259): ERR: Terminated: ERROR {rc=1} [trial-2371↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14259)] 08:00:36.024455 run osmo-stp_10.42.42.5(pid=14259): stdout: | (launched: 2022-12-10_08:00:34.676752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:36.154980 run osmo-stp_10.42.42.5(pid=14259): stderr: | [0;m[38;5;43m20221210080034867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080034868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080034868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080034868 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080034869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080034869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080034869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:36.284727 run osmo-stp_10.42.42.5(pid=14259): stdout: | (launched: 2022-12-10_08:00:34.676752) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:36.407359 run osmo-stp_10.42.42.5(pid=14259): stderr: | [0;m[38;5;43m20221210080034867 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080034868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080034868 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080034868 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080034869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080034869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080034869 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:36.553669 tst assert_extension.py:17: ERR: Error: osmo-stp_10.42.42.5(pid=14259): Process ended prematurely: osmo-stp_10.42.42.5(pid=14259) [trial-2371↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14259)] [trial-2371↪ussd:nanobts+band-900↪assert_extension.py:17] 08:00:36.562400 tst assert_extension.py:17: Test FAILED (6.0 sec) 08:00:36.589413 run osmo-hlr_10.42.42.2(pid=14256): ERR: Terminated: ERROR {rc=237} [trial-2371↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14256)] 08:00:36.639125 run osmo-hlr_10.42.42.2(pid=14256): stdout: | (launched: 2022-12-10_08:00:33.718841) 08:00:36.690348 run osmo-hlr_10.42.42.2(pid=14256): stderr: | [0;m[1;31m20221210080033914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080033914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080033914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080033914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080033914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080033914 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080033927 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/ussd:nanobts+band-900/assert_extension.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080033935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080033935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080033935 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:00:36.761857 run osmo-msc_10.42.42.6(pid=14262): ERR: Terminated: ERROR {rc=2} [trial-2371↪ussd:nanobts+band-900↪assert_extension.py↪assert_extension.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14262)] 08:00:36.811185 run osmo-msc_10.42.42.6(pid=14262): stdout: | (launched: 2022-12-10_08:00:35.665277) 08:00:36.862593 run osmo-msc_10.42.42.6(pid=14262): stderr: | [0;m[38;5;43m20221210080035985 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080035985 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fadb574ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080035985 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080035985 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080035986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080035986 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080035987 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080035988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080035988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080035988 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:00:36.914124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14255): Terminating (SIGTERM) 08:00:36.955331 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14258): Terminating (SIGTERM) 08:00:36.996817 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14261): Terminating (SIGTERM) 08:00:37.038897 --- ParallelTerminationStrategy: PID 14255 died... 08:00:37.058647 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14255): Terminated: ok {rc=0} 08:00:37.104655 --- ParallelTerminationStrategy: PID 14258 died... 08:00:37.124074 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14258): Terminated: ok {rc=0} 08:00:37.170233 --- ParallelTerminationStrategy: PID 14261 died... 08:00:37.189810 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14261): Terminated: ok {rc=0} 08:00:37.276734 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 ussd:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 --------------------------------------------------------------------- 08:00:38.489480 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:00:38.497443 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 1 x bts (candidates: 11) 08:00:38.530265 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 6 x ip_address (candidates: 9) 08:00:38.557345 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Verifying 2 x modem (candidates: 12) 08:00:38.611516 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 1 x bts (candidates: 11) 08:00:38.645454 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 6 x ip_address (candidates: 9) 08:00:38.671444 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Reserving 2 x modem (candidates: 12) 08:00:39.217743 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call.py ---------------------------------------------- 08:00:39.266744 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:00:39.278030 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:00:39.346462 tst mo_mt_call.py: using LAC 26980 08:00:39.472174 tst mo_mt_call.py: using RAC 205 08:00:39.588730 tst mo_mt_call.py: using CellId 26980 08:00:39.705438 tst mo_mt_call.py: using BVCI 26981 08:00:39.812385 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:00:39.823553 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:00:39.834615 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:00:39.846151 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:00:39.858086 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:00:39.869667 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:00:39.983864 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:00:40.097526 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:00:40.548932 run create_hlr_db(pid=14268): Launched 08:00:40.659713 bus /sierra_2: Setting Powered False 08:00:41.719002 run create_hlr_db(pid=14268): Terminated: ok {rc=0} 08:00:42.126673 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14270): Launched 08:00:42.417497 run osmo-hlr_10.42.42.2(pid=14271): Launched 08:00:42.529299 run osmo-stp_10.42.42.5: Starting osmo-stp 08:00:43.045257 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14273): Launched 08:00:43.338309 run osmo-stp_10.42.42.5(pid=14274): Launched 08:00:43.450726 run osmo-msc_10.42.42.6: Starting osmo-msc 08:00:43.980737 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14276): Launched 08:00:44.273356 run osmo-msc_10.42.42.6(pid=14277): Launched 08:00:44.438321 run osmo-stp_10.42.42.5(pid=14274): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14274)] 08:00:44.562877 run osmo-stp_10.42.42.5(pid=14274): stdout: | (launched: 2022-12-10_08:00:43.284555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:44.687539 run osmo-stp_10.42.42.5(pid=14274): stderr: | [0;m[38;5;43m20221210080043453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080043453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080043453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080043454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080043454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080043454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080043454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:44.809586 run osmo-stp_10.42.42.5(pid=14274): stdout: | (launched: 2022-12-10_08:00:43.284555) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:44.926054 run osmo-stp_10.42.42.5(pid=14274): stderr: | [0;m[38;5;43m20221210080043453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080043453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080043453 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080043454 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080043454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080043454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080043454 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:45.065395 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14274): Process ended prematurely: osmo-stp_10.42.42.5(pid=14274) [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14274)] [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8] 08:00:45.074253 tst mo_mt_call.py:8: Test FAILED (5.8 sec) 08:00:45.101393 run osmo-hlr_10.42.42.2(pid=14271): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14271)] 08:00:45.149240 run osmo-hlr_10.42.42.2(pid=14271): stdout: | (launched: 2022-12-10_08:00:42.364257) 08:00:45.198295 run osmo-hlr_10.42.42.2(pid=14271): stderr: | [0;m[1;31m20221210080042538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080042538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080042538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080042538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080042538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080042538 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080042549 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080042558 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080042559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080042559 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:00:45.267157 run osmo-msc_10.42.42.6(pid=14277): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14277)] 08:00:45.314738 run osmo-msc_10.42.42.6(pid=14277): stdout: | (launched: 2022-12-10_08:00:44.219925) 08:00:45.364010 run osmo-msc_10.42.42.6(pid=14277): stderr: | [0;m[38;5;43m20221210080044489 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080044489 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f35d0ea8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080044490 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080044490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080044490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080044490 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080044492 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080044492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080044492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080044492 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:00:45.413626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14270): Terminating (SIGTERM) 08:00:45.453542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14273): Terminating (SIGTERM) 08:00:45.493669 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14276): Terminating (SIGTERM) 08:00:45.533904 --- ParallelTerminationStrategy: PID 14270 died... 08:00:45.553200 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14270): Terminated: ok {rc=0} 08:00:45.597998 --- ParallelTerminationStrategy: PID 14273 died... 08:00:45.616603 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14273): Terminated: ok {rc=0} 08:00:45.661666 --- ParallelTerminationStrategy: PID 14276 died... 08:00:45.680446 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14276): Terminated: ok {rc=0} 08:00:45.767419 bus /sierra_3: Setting Powered False 08:00:46.873440 bus /sierra_3: Setting Powered False 08:00:48.000224 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 mo_mt_call_osmux.py ---------------------------------------------- 08:00:49.147450 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:00:49.159655 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x bts (candidates: 1) 08:00:49.227769 tst mo_mt_call_osmux.py: using LAC 26981 08:00:49.351975 tst mo_mt_call_osmux.py: using RAC 206 08:00:49.475635 tst mo_mt_call_osmux.py: using CellId 26981 08:00:49.598650 tst mo_mt_call_osmux.py: using BVCI 26982 08:00:49.712010 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:00:49.723609 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:00:49.735093 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:00:49.746907 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:00:49.758606 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x ip_address (candidates: 6) 08:00:49.770148 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:00:49.884563 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1: Using 1 x modem (candidates: 2) 08:00:50.001110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:00:50.454399 run create_hlr_db(pid=14279): Launched 08:00:50.583663 bus /sierra_2: Setting Powered False 08:00:51.647027 run create_hlr_db(pid=14279): Terminated: ok {rc=0} 08:00:52.084786 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14281): Launched 08:00:52.399076 run osmo-hlr_10.42.42.2(pid=14282): Launched 08:00:52.519019 run osmo-stp_10.42.42.5: Starting osmo-stp 08:00:53.062396 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14284): Launched 08:00:53.376355 run osmo-stp_10.42.42.5(pid=14285): Launched 08:00:53.496201 run osmo-msc_10.42.42.6: Starting osmo-msc 08:00:54.065357 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14287): Launched 08:00:54.378835 run osmo-msc_10.42.42.6(pid=14288): Launched 08:00:54.554227 run osmo-stp_10.42.42.5(pid=14285): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14285)] 08:00:54.686896 run osmo-stp_10.42.42.5(pid=14285): stdout: | (launched: 2022-12-10_08:00:53.319223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:54.819682 run osmo-stp_10.42.42.5(pid=14285): stderr: | [0;m[38;5;43m20221210080053513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080053513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080053513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080053514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080053514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080053514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080053514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:54.952514 run osmo-stp_10.42.42.5(pid=14285): stdout: | (launched: 2022-12-10_08:00:53.319223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:00:55.077201 run osmo-stp_10.42.42.5(pid=14285): stderr: | [0;m[38;5;43m20221210080053513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080053513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080053513 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080053514 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080053514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080053514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080053514 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:00:55.226684 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14285): Process ended prematurely: osmo-stp_10.42.42.5(pid=14285) [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14285)] [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8] 08:00:55.235966 tst mo_mt_call_osmux.py:8: Test FAILED (6.1 sec) 08:00:55.263362 run osmo-hlr_10.42.42.2(pid=14282): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14282)] 08:00:55.312795 run osmo-hlr_10.42.42.2(pid=14282): stdout: | (launched: 2022-12-10_08:00:52.341811) 08:00:55.363824 run osmo-hlr_10.42.42.2(pid=14282): stderr: | [0;m[1;31m20221210080052539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080052539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080052539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080052539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080052539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080052539 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080052552 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080052561 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080052562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080052562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:00:55.435272 run osmo-msc_10.42.42.6(pid=14288): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14288)] 08:00:55.486116 run osmo-msc_10.42.42.6(pid=14288): stdout: | (launched: 2022-12-10_08:00:54.321754) 08:00:55.535333 run osmo-msc_10.42.42.6(pid=14288): stderr: | [0;m[38;5;43m20221210080054645 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080054645 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9fb375cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080054645 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080054645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080054645 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080054646 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080054647 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080054648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080054648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080054648 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:00:55.584833 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14281): Terminating (SIGTERM) 08:00:55.625097 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14284): Terminating (SIGTERM) 08:00:55.665064 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14287): Terminating (SIGTERM) 08:00:55.705160 --- ParallelTerminationStrategy: PID 14281 died... 08:00:55.724240 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14281): Terminated: ok {rc=0} 08:00:55.769090 --- ParallelTerminationStrategy: PID 14284 died... 08:00:55.787974 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14284): Terminated: ok {rc=0} 08:00:55.832682 --- ParallelTerminationStrategy: PID 14287 died... 08:00:55.851515 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14287): Terminated: ok {rc=0} 08:00:55.938725 bus /sierra_3: Setting Powered False 08:00:57.037350 bus /sierra_3: Setting Powered False 08:00:58.154483 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 --------------------------------------------------------------------- 08:00:59.407632 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:00:59.415502 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 1 x bts (candidates: 11) 08:00:59.451114 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 6 x ip_address (candidates: 9) 08:00:59.476926 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Verifying 2 x modem (candidates: 12) 08:00:59.527324 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 1 x bts (candidates: 11) 08:00:59.558901 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 6 x ip_address (candidates: 9) 08:00:59.584812 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Reserving 2 x modem (candidates: 12) 08:01:00.136537 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call.py ---------------------------------------------- 08:01:00.184334 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:01:00.195472 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:01:00.261629 tst mo_mt_call.py: using LAC 26982 08:01:00.387093 tst mo_mt_call.py: using RAC 207 08:01:00.515013 tst mo_mt_call.py: using CellId 26982 08:01:00.630575 tst mo_mt_call.py: using BVCI 26983 08:01:00.736399 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:01:00.747382 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:01:00.758426 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:01:00.769781 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:01:00.781102 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:01:00.792162 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:01:00.935336 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:01:01.080511 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:01:01.623808 run create_hlr_db(pid=14293): Launched 08:01:01.788417 bus /sierra_2: Setting Powered False 08:01:02.851614 run create_hlr_db(pid=14293): Terminated: ok {rc=0} 08:01:03.287537 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14295): Launched 08:01:03.600294 run osmo-hlr_10.42.42.2(pid=14296): Launched 08:01:03.719748 run osmo-stp_10.42.42.5: Starting osmo-stp 08:01:04.261894 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14298): Launched 08:01:04.575721 run osmo-stp_10.42.42.5(pid=14299): Launched 08:01:04.695575 run osmo-msc_10.42.42.6: Starting osmo-msc 08:01:05.261960 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14301): Launched 08:01:05.574863 run osmo-msc_10.42.42.6(pid=14302): Launched 08:01:05.749984 run osmo-stp_10.42.42.5(pid=14299): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14299)] 08:01:05.882414 run osmo-stp_10.42.42.5(pid=14299): stdout: | (launched: 2022-12-10_08:01:04.518872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:06.015354 run osmo-stp_10.42.42.5(pid=14299): stderr: | [0;m[38;5;43m20221210080104709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080104710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080104710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080104710 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080104711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080104711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080104711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:06.147131 run osmo-stp_10.42.42.5(pid=14299): stdout: | (launched: 2022-12-10_08:01:04.518872) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:06.271739 run osmo-stp_10.42.42.5(pid=14299): stderr: | [0;m[38;5;43m20221210080104709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080104710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080104710 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080104710 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080104711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080104711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080104711 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:06.420769 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14299): Process ended prematurely: osmo-stp_10.42.42.5(pid=14299) [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14299)] [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8] 08:01:06.430295 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:01:06.457769 run osmo-hlr_10.42.42.2(pid=14296): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14296)] 08:01:06.506895 run osmo-hlr_10.42.42.2(pid=14296): stdout: | (launched: 2022-12-10_08:01:03.543661) 08:01:06.558581 run osmo-hlr_10.42.42.2(pid=14296): stderr: | [0;m[1;31m20221210080103740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080103740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080103740 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080103741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080103741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080103741 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080103752 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080103761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080103761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080103761 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:01:06.629615 run osmo-msc_10.42.42.6(pid=14302): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14302)] 08:01:06.678845 run osmo-msc_10.42.42.6(pid=14302): stdout: | (launched: 2022-12-10_08:01:05.518087) 08:01:06.729673 run osmo-msc_10.42.42.6(pid=14302): stderr: | [0;m[38;5;43m20221210080105838 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080105838 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f54d0727c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080105838 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080105838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080105838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080105839 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080105840 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080105841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080105841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080105841 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:01:06.781088 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14295): Terminating (SIGTERM) 08:01:06.822228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14298): Terminating (SIGTERM) 08:01:06.863828 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14301): Terminating (SIGTERM) 08:01:06.905579 --- ParallelTerminationStrategy: PID 14295 died... 08:01:06.925538 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14295): Terminated: ok {rc=0} 08:01:06.971289 --- ParallelTerminationStrategy: PID 14298 died... 08:01:06.990619 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14298): Terminated: ok {rc=0} 08:01:07.036561 --- ParallelTerminationStrategy: PID 14301 died... 08:01:07.056038 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14301): Terminated: ok {rc=0} 08:01:07.142438 bus /sierra_3: Setting Powered False 08:01:08.240940 bus /sierra_3: Setting Powered False 08:01:09.354091 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 mo_mt_call_osmux.py ---------------------------------------------- 08:01:10.495123 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:01:10.506775 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x bts (candidates: 1) 08:01:10.572738 tst mo_mt_call_osmux.py: using LAC 26983 08:01:10.686860 tst mo_mt_call_osmux.py: using RAC 208 08:01:10.803515 tst mo_mt_call_osmux.py: using CellId 26983 08:01:10.919856 tst mo_mt_call_osmux.py: using BVCI 26984 08:01:11.027118 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:01:11.038140 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:01:11.048913 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:01:11.059737 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:01:11.071113 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x ip_address (candidates: 6) 08:01:11.082247 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:01:11.200094 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2: Using 1 x modem (candidates: 2) 08:01:11.315068 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:01:11.768433 run create_hlr_db(pid=14304): Launched 08:01:11.880247 bus /sierra_2: Setting Powered False 08:01:12.943222 run create_hlr_db(pid=14304): Terminated: ok {rc=0} 08:01:13.359254 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14306): Launched 08:01:13.652485 run osmo-hlr_10.42.42.2(pid=14307): Launched 08:01:13.764195 run osmo-stp_10.42.42.5: Starting osmo-stp 08:01:14.275319 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14309): Launched 08:01:14.568573 run osmo-stp_10.42.42.5(pid=14310): Launched 08:01:14.681148 run osmo-msc_10.42.42.6: Starting osmo-msc 08:01:15.209665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14312): Launched 08:01:15.502303 run osmo-msc_10.42.42.6(pid=14313): Launched 08:01:15.667274 run osmo-stp_10.42.42.5(pid=14310): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14310)] 08:01:15.792387 run osmo-stp_10.42.42.5(pid=14310): stdout: | (launched: 2022-12-10_08:01:14.515003) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:15.936641 run osmo-stp_10.42.42.5(pid=14310): stderr: | [0;m[38;5;43m20221210080114684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080114684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080114685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080114685 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080114685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080114686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080114686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:16.066735 run osmo-stp_10.42.42.5(pid=14310): stdout: | (launched: 2022-12-10_08:01:14.515003) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:16.186768 run osmo-stp_10.42.42.5(pid=14310): stderr: | [0;m[38;5;43m20221210080114684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080114684 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080114685 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080114685 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080114685 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080114686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080114686 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:16.330486 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14310): Process ended prematurely: osmo-stp_10.42.42.5(pid=14310) [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14310)] [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8] 08:01:16.340236 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 08:01:16.370067 run osmo-hlr_10.42.42.2(pid=14307): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14307)] 08:01:16.419649 run osmo-hlr_10.42.42.2(pid=14307): stdout: | (launched: 2022-12-10_08:01:13.598914) 08:01:16.471023 run osmo-hlr_10.42.42.2(pid=14307): stderr: | [0;m[1;31m20221210080113773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080113773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080113773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080113773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080113773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080113773 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080113786 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080113794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080113794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080113794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:01:16.541893 run osmo-msc_10.42.42.6(pid=14313): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14313)] 08:01:16.591512 run osmo-msc_10.42.42.6(pid=14313): stdout: | (launched: 2022-12-10_08:01:15.449176) 08:01:16.642730 run osmo-msc_10.42.42.6(pid=14313): stderr: | [0;m[38;5;43m20221210080115718 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080115718 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1bc1c4ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080115719 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080115719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080115719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080115719 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080115721 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080115721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080115721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080115721 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:01:16.694242 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14306): Terminating (SIGTERM) 08:01:16.735906 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14309): Terminating (SIGTERM) 08:01:16.778157 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14312): Terminating (SIGTERM) 08:01:16.821846 --- ParallelTerminationStrategy: PID 14306 died... 08:01:16.841373 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14306): Terminated: ok {rc=0} 08:01:16.888447 --- ParallelTerminationStrategy: PID 14309 died... 08:01:16.907889 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14309): Terminated: ok {rc=0} 08:01:16.955228 --- ParallelTerminationStrategy: PID 14312 died... 08:01:16.974738 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14312): Terminated: ok {rc=0} 08:01:17.064023 bus /sierra_3: Setting Powered False 08:01:18.162401 bus /sierra_3: Setting Powered False 08:01:19.278950 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 --------------------------------------------------------------------- 08:01:20.524078 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:01:20.532798 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 1 x bts (candidates: 11) 08:01:20.566267 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 6 x ip_address (candidates: 9) 08:01:20.593246 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Verifying 2 x modem (candidates: 12) 08:01:20.646714 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 1 x bts (candidates: 11) 08:01:20.679662 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 6 x ip_address (candidates: 9) 08:01:20.706742 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Reserving 2 x modem (candidates: 12) 08:01:21.257687 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call.py ---------------------------------------------- 08:01:21.307915 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:01:21.319523 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:01:21.386956 tst mo_mt_call.py: using LAC 26984 08:01:21.510461 tst mo_mt_call.py: using RAC 209 08:01:21.635249 tst mo_mt_call.py: using CellId 26984 08:01:21.760267 tst mo_mt_call.py: using BVCI 26985 08:01:21.875797 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:01:21.887306 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:01:21.898673 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:01:21.910127 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:01:21.921561 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:01:21.932798 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:01:22.052765 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:01:22.171875 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:01:22.657859 run create_hlr_db(pid=14318): Launched 08:01:22.785779 bus /sierra_2: Setting Powered False 08:01:23.849055 run create_hlr_db(pid=14318): Terminated: ok {rc=0} 08:01:24.288349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14320): Launched 08:01:24.603627 run osmo-hlr_10.42.42.2(pid=14321): Launched 08:01:24.723127 run osmo-stp_10.42.42.5: Starting osmo-stp 08:01:25.261583 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14323): Launched 08:01:25.574012 run osmo-stp_10.42.42.5(pid=14324): Launched 08:01:25.693518 run osmo-msc_10.42.42.6: Starting osmo-msc 08:01:26.259839 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14326): Launched 08:01:26.573341 run osmo-msc_10.42.42.6(pid=14327): Launched 08:01:26.748473 run osmo-stp_10.42.42.5(pid=14324): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14324)] 08:01:26.881051 run osmo-stp_10.42.42.5(pid=14324): stdout: | (launched: 2022-12-10_08:01:25.517256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:27.013457 run osmo-stp_10.42.42.5(pid=14324): stderr: | [0;m[38;5;43m20221210080125707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080125707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080125707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080125708 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080125708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080125708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080125708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:27.145548 run osmo-stp_10.42.42.5(pid=14324): stdout: | (launched: 2022-12-10_08:01:25.517256) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:27.270735 run osmo-stp_10.42.42.5(pid=14324): stderr: | [0;m[38;5;43m20221210080125707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080125707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080125707 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080125708 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080125708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080125708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080125708 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:27.420396 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14324): Process ended prematurely: osmo-stp_10.42.42.5(pid=14324) [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14324)] [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8] 08:01:27.429976 tst mo_mt_call.py:8: Test FAILED (6.2 sec) 08:01:27.457521 run osmo-hlr_10.42.42.2(pid=14321): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14321)] 08:01:27.507199 run osmo-hlr_10.42.42.2(pid=14321): stdout: | (launched: 2022-12-10_08:01:24.545987) 08:01:27.558488 run osmo-hlr_10.42.42.2(pid=14321): stderr: | [0;m[1;31m20221210080124743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080124743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080124743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080124743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080124743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080124743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080124756 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080124764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080124764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080124764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:01:27.629700 run osmo-msc_10.42.42.6(pid=14327): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14327)] 08:01:27.678867 run osmo-msc_10.42.42.6(pid=14327): stdout: | (launched: 2022-12-10_08:01:26.516450) 08:01:27.729798 run osmo-msc_10.42.42.6(pid=14327): stderr: | [0;m[38;5;43m20221210080126837 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080126837 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f15b0621c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080126837 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080126837 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080126838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080126838 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080126839 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080126840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080126840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080126840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:01:27.781082 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14320): Terminating (SIGTERM) 08:01:27.821868 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14323): Terminating (SIGTERM) 08:01:27.863175 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14326): Terminating (SIGTERM) 08:01:27.904788 --- ParallelTerminationStrategy: PID 14320 died... 08:01:27.924844 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14320): Terminated: ok {rc=0} 08:01:27.970803 --- ParallelTerminationStrategy: PID 14323 died... 08:01:27.990415 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14323): Terminated: ok {rc=0} 08:01:28.036003 --- ParallelTerminationStrategy: PID 14326 died... 08:01:28.055897 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14326): Terminated: ok {rc=0} 08:01:28.142542 bus /sierra_3: Setting Powered False 08:01:29.240687 bus /sierra_3: Setting Powered False 08:01:30.357579 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 mo_mt_call_osmux.py ---------------------------------------------- 08:01:31.503799 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:01:31.518471 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x bts (candidates: 1) 08:01:31.587625 tst mo_mt_call_osmux.py: using LAC 26985 08:01:31.709690 tst mo_mt_call_osmux.py: using RAC 210 08:01:31.863674 tst mo_mt_call_osmux.py: using CellId 26985 08:01:32.015498 tst mo_mt_call_osmux.py: using BVCI 26986 08:01:32.126125 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:01:32.138371 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:01:32.150496 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:01:32.164424 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:01:32.177524 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x ip_address (candidates: 6) 08:01:32.189685 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:01:32.308564 tst voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3: Using 1 x modem (candidates: 2) 08:01:32.431095 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:01:32.886954 run create_hlr_db(pid=14329): Launched 08:01:32.998515 bus /sierra_2: Setting Powered False 08:01:34.057768 run create_hlr_db(pid=14329): Terminated: ok {rc=0} 08:01:34.468401 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14331): Launched 08:01:34.762021 run osmo-hlr_10.42.42.2(pid=14332): Launched 08:01:34.874774 run osmo-stp_10.42.42.5: Starting osmo-stp 08:01:35.392221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14334): Launched 08:01:35.684784 run osmo-stp_10.42.42.5(pid=14335): Launched 08:01:35.796700 run osmo-msc_10.42.42.6: Starting osmo-msc 08:01:36.326014 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14337): Launched 08:01:36.620460 run osmo-msc_10.42.42.6(pid=14338): Launched 08:01:36.786576 run osmo-stp_10.42.42.5(pid=14335): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14335)] 08:01:36.911872 run osmo-stp_10.42.42.5(pid=14335): stdout: | (launched: 2022-12-10_08:01:35.631065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:37.037233 run osmo-stp_10.42.42.5(pid=14335): stderr: | [0;m[38;5;43m20221210080135797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080135798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080135799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080135799 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080135801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080135801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080135802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:37.159988 run osmo-stp_10.42.42.5(pid=14335): stdout: | (launched: 2022-12-10_08:01:35.631065) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:37.276851 run osmo-stp_10.42.42.5(pid=14335): stderr: | [0;m[38;5;43m20221210080135797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080135798 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080135799 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080135799 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080135801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080135801 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080135802 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:37.416735 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14335): Process ended prematurely: osmo-stp_10.42.42.5(pid=14335) [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14335)] [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8] 08:01:37.425725 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 08:01:37.452019 run osmo-hlr_10.42.42.2(pid=14332): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14332)] 08:01:37.499708 run osmo-hlr_10.42.42.2(pid=14332): stdout: | (launched: 2022-12-10_08:01:34.708663) 08:01:37.548520 run osmo-hlr_10.42.42.2(pid=14332): stderr: | [0;m[1;31m20221210080134885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080134885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080134885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080134885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080134885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080134885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080134898 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080134906 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080134907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080134907 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:01:37.616734 run osmo-msc_10.42.42.6(pid=14338): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14338)] 08:01:37.663693 run osmo-msc_10.42.42.6(pid=14338): stdout: | (launched: 2022-12-10_08:01:36.566766) 08:01:37.712604 run osmo-msc_10.42.42.6(pid=14338): stderr: | [0;m[38;5;43m20221210080136835 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080136835 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f265e244c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080136836 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080136836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080136836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080136836 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080136839 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080136839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080136839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080136839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:01:37.761676 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14331): Terminating (SIGTERM) 08:01:37.801094 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14334): Terminating (SIGTERM) 08:01:37.840485 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14337): Terminating (SIGTERM) 08:01:37.880315 --- ParallelTerminationStrategy: PID 14331 died... 08:01:37.899317 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14331): Terminated: ok {rc=0} 08:01:37.943492 --- ParallelTerminationStrategy: PID 14334 died... 08:01:37.962063 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14334): Terminated: ok {rc=0} 08:01:38.006276 --- ParallelTerminationStrategy: PID 14337 died... 08:01:38.024665 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14337): Terminated: ok {rc=0} 08:01:38.107694 bus /sierra_3: Setting Powered False 08:01:39.202302 bus /sierra_3: Setting Powered False 08:01:40.316000 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 --------------------------------------------------------------------- 08:01:41.562475 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:01:41.569840 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 1 x bts (candidates: 11) 08:01:41.602371 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 6 x ip_address (candidates: 9) 08:01:41.628555 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Verifying 2 x modem (candidates: 12) 08:01:41.679228 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 1 x bts (candidates: 11) 08:01:41.710630 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 6 x ip_address (candidates: 9) 08:01:41.736232 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Reserving 2 x modem (candidates: 12) 08:01:42.292779 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call.py ---------------------------------------------- 08:01:42.343202 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:01:42.354884 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:01:42.422774 tst mo_mt_call.py: using LAC 26986 08:01:42.545563 tst mo_mt_call.py: using RAC 211 08:01:42.665200 tst mo_mt_call.py: using CellId 26986 08:01:42.779882 tst mo_mt_call.py: using BVCI 26987 08:01:42.886275 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:01:42.897339 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:01:42.908108 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:01:42.919129 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:01:42.930222 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:01:42.941451 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:01:43.054877 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:01:43.168421 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:01:43.619200 run create_hlr_db(pid=14344): Launched 08:01:43.731643 bus /sierra_2: Setting Powered False 08:01:44.790216 run create_hlr_db(pid=14344): Terminated: ok {rc=0} 08:01:45.218309 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14346): Launched 08:01:45.533528 run osmo-hlr_10.42.42.2(pid=14347): Launched 08:01:45.655389 run osmo-stp_10.42.42.5: Starting osmo-stp 08:01:46.242833 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14349): Launched 08:01:46.583759 run osmo-stp_10.42.42.5(pid=14350): Launched 08:01:46.743393 run osmo-msc_10.42.42.6: Starting osmo-msc 08:01:47.424037 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14352): Launched 08:01:47.737650 run osmo-msc_10.42.42.6(pid=14353): Launched 08:01:47.912697 run osmo-stp_10.42.42.5(pid=14350): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14350)] 08:01:48.044909 run osmo-stp_10.42.42.5(pid=14350): stdout: | (launched: 2022-12-10_08:01:46.512858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:48.177226 run osmo-stp_10.42.42.5(pid=14350): stderr: | [0;m[38;5;43m20221210080146852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080146852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080146852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080146853 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080146853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080146853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080146853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:48.309403 run osmo-stp_10.42.42.5(pid=14350): stdout: | (launched: 2022-12-10_08:01:46.512858) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:48.434273 run osmo-stp_10.42.42.5(pid=14350): stderr: | [0;m[38;5;43m20221210080146852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080146852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080146852 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080146853 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080146853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080146853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080146853 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:48.583285 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14350): Process ended prematurely: osmo-stp_10.42.42.5(pid=14350) [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14350)] [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8] 08:01:48.592666 tst mo_mt_call.py:8: Test FAILED (6.3 sec) 08:01:48.620178 run osmo-hlr_10.42.42.2(pid=14347): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14347)] 08:01:48.669522 run osmo-hlr_10.42.42.2(pid=14347): stdout: | (launched: 2022-12-10_08:01:45.476300) 08:01:48.720412 run osmo-hlr_10.42.42.2(pid=14347): stderr: | [0;m[1;31m20221210080145674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080145674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080145674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080145674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080145674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080145674 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080145686 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080145694 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080145695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080145695 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:01:48.791565 run osmo-msc_10.42.42.6(pid=14353): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14353)] 08:01:48.840705 run osmo-msc_10.42.42.6(pid=14353): stdout: | (launched: 2022-12-10_08:01:47.680860) 08:01:48.892059 run osmo-msc_10.42.42.6(pid=14353): stderr: | [0;m[38;5;43m20221210080148003 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080148003 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2c550f1c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080148003 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080148003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080148003 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080148004 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080148005 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080148006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080148006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080148006 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:01:48.943232 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14346): Terminating (SIGTERM) 08:01:48.984239 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14349): Terminating (SIGTERM) 08:01:49.025492 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14352): Terminating (SIGTERM) 08:01:49.067055 --- ParallelTerminationStrategy: PID 14346 died... 08:01:49.086980 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14346): Terminated: ok {rc=0} 08:01:49.132899 --- ParallelTerminationStrategy: PID 14349 died... 08:01:49.152450 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14349): Terminated: ok {rc=0} 08:01:49.197976 --- ParallelTerminationStrategy: PID 14352 died... 08:01:49.217672 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14352): Terminated: ok {rc=0} 08:01:49.304555 bus /sierra_3: Setting Powered False 08:01:50.402280 bus /sierra_3: Setting Powered False 08:01:51.513981 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 mo_mt_call_osmux.py ---------------------------------------------- 08:01:52.654332 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:01:52.665964 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x bts (candidates: 1) 08:01:52.732158 tst mo_mt_call_osmux.py: using LAC 26987 08:01:52.846770 tst mo_mt_call_osmux.py: using RAC 212 08:01:52.962922 tst mo_mt_call_osmux.py: using CellId 26987 08:01:53.079765 tst mo_mt_call_osmux.py: using BVCI 26988 08:01:53.187586 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:01:53.198682 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:01:53.209734 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:01:53.220804 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:01:53.232023 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x ip_address (candidates: 6) 08:01:53.242936 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:01:53.356643 tst voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3: Using 1 x modem (candidates: 2) 08:01:53.477510 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:01:53.964887 run create_hlr_db(pid=14355): Launched 08:01:54.093064 bus /sierra_2: Setting Powered False 08:01:55.156012 run create_hlr_db(pid=14355): Terminated: ok {rc=0} 08:01:55.575455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14357): Launched 08:01:55.868680 run osmo-hlr_10.42.42.2(pid=14358): Launched 08:01:55.981134 run osmo-stp_10.42.42.5: Starting osmo-stp 08:01:56.498998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14360): Launched 08:01:56.791446 run osmo-stp_10.42.42.5(pid=14361): Launched 08:01:56.903716 run osmo-msc_10.42.42.6: Starting osmo-msc 08:01:57.433161 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14363): Launched 08:01:57.748887 run osmo-msc_10.42.42.6(pid=14364): Launched 08:01:57.924910 run osmo-stp_10.42.42.5(pid=14361): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14361)] 08:01:58.057716 run osmo-stp_10.42.42.5(pid=14361): stdout: | (launched: 2022-12-10_08:01:56.738009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:58.190402 run osmo-stp_10.42.42.5(pid=14361): stderr: | [0;m[38;5;43m20221210080156907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080156908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080156908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080156908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080156909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080156909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080156909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:58.323303 run osmo-stp_10.42.42.5(pid=14361): stdout: | (launched: 2022-12-10_08:01:56.738009) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:01:58.448232 run osmo-stp_10.42.42.5(pid=14361): stderr: | [0;m[38;5;43m20221210080156907 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080156908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080156908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080156908 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080156909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080156909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080156909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:01:58.598088 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14361): Process ended prematurely: osmo-stp_10.42.42.5(pid=14361) [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14361)] [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8] 08:01:58.607486 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 08:01:58.634951 run osmo-hlr_10.42.42.2(pid=14358): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14358)] 08:01:58.684397 run osmo-hlr_10.42.42.2(pid=14358): stdout: | (launched: 2022-12-10_08:01:55.815214) 08:01:58.735407 run osmo-hlr_10.42.42.2(pid=14358): stderr: | [0;m[1;31m20221210080155989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080155989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080155989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080155989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080155989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080155989 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080156002 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080156011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080156011 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080156012 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:01:58.807051 run osmo-msc_10.42.42.6(pid=14364): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14364)] 08:01:58.856245 run osmo-msc_10.42.42.6(pid=14364): stdout: | (launched: 2022-12-10_08:01:57.691460) 08:01:58.907590 run osmo-msc_10.42.42.6(pid=14364): stderr: | [0;m[38;5;43m20221210080158012 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080158012 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7b05b6ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080158012 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080158013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080158013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080158013 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080158015 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080158015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080158015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080158015 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:01:58.958948 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14357): Terminating (SIGTERM) 08:01:58.999964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14360): Terminating (SIGTERM) 08:01:59.041393 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14363): Terminating (SIGTERM) 08:01:59.082896 --- ParallelTerminationStrategy: PID 14357 died... 08:01:59.102782 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14357): Terminated: ok {rc=0} 08:01:59.148375 --- ParallelTerminationStrategy: PID 14360 died... 08:01:59.167807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14360): Terminated: ok {rc=0} 08:01:59.213341 --- ParallelTerminationStrategy: PID 14363 died... 08:01:59.232474 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14363): Terminated: ok {rc=0} 08:01:59.319656 bus /sierra_3: Setting Powered False 08:02:00.417761 bus /sierra_3: Setting Powered False 08:02:01.543353 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any --------------------------------------------------------------------- 08:02:02.791746 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:02:02.799555 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:02:02.832683 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 6 x ip_address (candidates: 9) 08:02:02.859609 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:02:02.913313 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:02:02.946635 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 6 x ip_address (candidates: 9) 08:02:02.973594 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:02:03.525893 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call.py ---------------------------------------------- 08:02:03.576251 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:02:03.587838 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:02:03.655202 tst mo_mt_call.py: using LAC 26988 08:02:03.778242 tst mo_mt_call.py: using RAC 213 08:02:03.902197 tst mo_mt_call.py: using CellId 26988 08:02:04.025561 tst mo_mt_call.py: using BVCI 26989 08:02:04.138866 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:02:04.150435 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:02:04.161821 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:02:04.173150 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:02:04.184595 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:02:04.195880 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:02:04.309393 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:02:04.427298 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:02:04.881551 run create_hlr_db(pid=14369): Launched 08:02:04.993940 bus /sierra_2: Setting Powered False 08:02:06.053166 run create_hlr_db(pid=14369): Terminated: ok {rc=0} 08:02:06.482039 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14372): Launched 08:02:06.795491 run osmo-hlr_10.42.42.2(pid=14373): Launched 08:02:06.916490 run osmo-stp_10.42.42.5: Starting osmo-stp 08:02:07.461153 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14375): Launched 08:02:07.773514 run osmo-stp_10.42.42.5(pid=14376): Launched 08:02:07.893561 run osmo-msc_10.42.42.6: Starting osmo-msc 08:02:08.460017 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14378): Launched 08:02:08.771516 run osmo-msc_10.42.42.6(pid=14379): Launched 08:02:08.946630 run osmo-stp_10.42.42.5(pid=14376): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14376)] 08:02:09.077804 run osmo-stp_10.42.42.5(pid=14376): stdout: | (launched: 2022-12-10_08:02:07.716717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:09.209214 run osmo-stp_10.42.42.5(pid=14376): stderr: | [0;m[38;5;43m20221210080207908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080207908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080207908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080207909 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080207909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080207909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080207909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:09.340375 run osmo-stp_10.42.42.5(pid=14376): stdout: | (launched: 2022-12-10_08:02:07.716717) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:09.464561 run osmo-stp_10.42.42.5(pid=14376): stderr: | [0;m[38;5;43m20221210080207908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080207908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080207908 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080207909 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080207909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080207909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080207909 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:09.613144 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14376): Process ended prematurely: osmo-stp_10.42.42.5(pid=14376) [trial-2371↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14376)] [trial-2371↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8] 08:02:09.622409 tst mo_mt_call.py:8: Test FAILED (6.1 sec) 08:02:09.649558 run osmo-hlr_10.42.42.2(pid=14373): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14373)] 08:02:09.698711 run osmo-hlr_10.42.42.2(pid=14373): stdout: | (launched: 2022-12-10_08:02:06.738668) 08:02:09.749579 run osmo-hlr_10.42.42.2(pid=14373): stderr: | [0;m[1;31m20221210080206936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080206936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080206936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080206936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080206936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080206936 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080206948 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080206957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080206957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080206957 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:02:09.820660 run osmo-msc_10.42.42.6(pid=14379): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14379)] 08:02:09.869689 run osmo-msc_10.42.42.6(pid=14379): stdout: | (launched: 2022-12-10_08:02:08.714928) 08:02:09.920563 run osmo-msc_10.42.42.6(pid=14379): stderr: | [0;m[38;5;43m20221210080209034 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080209034 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f809c939c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080209034 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080209034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080209034 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080209035 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080209036 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080209037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080209037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080209037 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:02:09.971705 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14372): Terminating (SIGTERM) 08:02:10.012686 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14375): Terminating (SIGTERM) 08:02:10.053740 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14378): Terminating (SIGTERM) 08:02:10.095078 --- ParallelTerminationStrategy: PID 14372 died... 08:02:10.114882 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14372): Terminated: ok {rc=0} 08:02:10.160295 --- ParallelTerminationStrategy: PID 14375 died... 08:02:10.179577 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14375): Terminated: ok {rc=0} 08:02:10.224663 --- ParallelTerminationStrategy: PID 14378 died... 08:02:10.243913 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14378): Terminated: ok {rc=0} 08:02:10.330661 bus /sierra_3: Setting Powered False 08:02:11.429114 bus /sierra_3: Setting Powered False 08:02:12.545069 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any mo_mt_call_osmux.py ---------------------------------------------- 08:02:13.688125 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:02:13.699767 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:02:13.766435 tst mo_mt_call_osmux.py: using LAC 26989 08:02:13.881249 tst mo_mt_call_osmux.py: using RAC 214 08:02:13.995438 tst mo_mt_call_osmux.py: using CellId 26989 08:02:14.109523 tst mo_mt_call_osmux.py: using BVCI 26990 08:02:14.217352 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:02:14.228651 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:02:14.239682 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:02:14.250828 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:02:14.262093 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x ip_address (candidates: 6) 08:02:14.273137 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:02:14.386426 tst voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:02:14.500096 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:02:14.954725 run create_hlr_db(pid=14381): Launched 08:02:15.066218 bus /sierra_2: Setting Powered False 08:02:16.130520 run create_hlr_db(pid=14381): Terminated: ok {rc=0} 08:02:16.593349 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14383): Launched 08:02:16.931147 run osmo-hlr_10.42.42.2(pid=14384): Launched 08:02:17.150853 run osmo-stp_10.42.42.5: Starting osmo-stp 08:02:17.655692 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14386): Launched 08:02:17.949501 run osmo-stp_10.42.42.5(pid=14387): Launched 08:02:18.062190 run osmo-msc_10.42.42.6: Starting osmo-msc 08:02:18.592846 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14389): Launched 08:02:18.885617 run osmo-msc_10.42.42.6(pid=14390): Launched 08:02:19.050045 run osmo-stp_10.42.42.5(pid=14387): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14387)] 08:02:19.174410 run osmo-stp_10.42.42.5(pid=14387): stdout: | (launched: 2022-12-10_08:02:17.896146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:19.299172 run osmo-stp_10.42.42.5(pid=14387): stderr: | [0;m[38;5;43m20221210080218066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080218066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080218066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080218067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080218067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080218067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080218067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:19.421497 run osmo-stp_10.42.42.5(pid=14387): stdout: | (launched: 2022-12-10_08:02:17.896146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:19.538154 run osmo-stp_10.42.42.5(pid=14387): stderr: | [0;m[38;5;43m20221210080218066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080218066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080218066 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080218067 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080218067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080218067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080218067 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:19.678502 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14387): Process ended prematurely: osmo-stp_10.42.42.5(pid=14387) [trial-2371↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14387)] [trial-2371↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8] 08:02:19.687089 tst mo_mt_call_osmux.py:8: Test FAILED (6.0 sec) 08:02:19.713457 run osmo-hlr_10.42.42.2(pid=14384): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14384)] 08:02:19.760851 run osmo-hlr_10.42.42.2(pid=14384): stdout: | (launched: 2022-12-10_08:02:16.866284) 08:02:19.809762 run osmo-hlr_10.42.42.2(pid=14384): stderr: | [0;m[1;31m20221210080217153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080217153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080217153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080217153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080217153 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080217154 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080217166 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080217174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080217174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080217174 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:02:19.878217 run osmo-msc_10.42.42.6(pid=14390): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14390)] 08:02:19.925446 run osmo-msc_10.42.42.6(pid=14390): stdout: | (launched: 2022-12-10_08:02:18.832196) 08:02:19.974185 run osmo-msc_10.42.42.6(pid=14390): stderr: | [0;m[38;5;43m20221210080219102 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080219102 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0ffe646c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080219102 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080219102 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080219103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080219103 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080219104 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080219105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080219105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080219105 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:02:20.023278 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14383): Terminating (SIGTERM) 08:02:20.062542 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14386): Terminating (SIGTERM) 08:02:20.101836 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14389): Terminating (SIGTERM) 08:02:20.141588 --- ParallelTerminationStrategy: PID 14383 died... 08:02:20.160653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14383): Terminated: ok {rc=0} 08:02:20.204729 --- ParallelTerminationStrategy: PID 14386 died... 08:02:20.223218 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14386): Terminated: ok {rc=0} 08:02:20.267047 --- ParallelTerminationStrategy: PID 14389 died... 08:02:20.285481 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14389): Terminated: ok {rc=0} 08:02:20.369510 bus /sierra_3: Setting Powered False 08:02:21.466460 bus /sierra_3: Setting Powered False 08:02:22.583384 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 08:02:23.828541 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:02:23.835241 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 08:02:23.867920 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 6 x ip_address (candidates: 9) 08:02:23.894034 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 2 x modem (candidates: 12) 08:02:23.951246 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 08:02:23.983266 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 6 x ip_address (candidates: 9) 08:02:24.009279 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 2 x modem (candidates: 12) 08:02:24.555955 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for voice: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call.py ---------------------------------------------- 08:02:24.603475 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:02:24.614756 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:02:24.662132 tst mo_mt_call.py: using LAC 26990 08:02:24.783627 tst mo_mt_call.py: using RAC 215 08:02:24.909406 tst mo_mt_call.py: using CellId 26990 08:02:25.025625 tst mo_mt_call.py: using BVCI 26991 08:02:25.134277 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:02:25.145573 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:02:25.156480 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:02:25.167779 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:02:25.179127 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:02:25.190368 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:02:25.308372 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:02:25.424320 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:02:25.877662 run create_hlr_db(pid=14395): Launched 08:02:25.990508 bus /sierra_2: Setting Powered False 08:02:27.049706 run create_hlr_db(pid=14395): Terminated: ok {rc=0} 08:02:27.459054 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14397): Launched 08:02:27.752150 run osmo-hlr_10.42.42.2(pid=14398): Launched 08:02:27.865096 run osmo-stp_10.42.42.5: Starting osmo-stp 08:02:28.365857 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14400): Launched 08:02:28.658504 run osmo-stp_10.42.42.5(pid=14401): Launched 08:02:28.771286 run osmo-msc_10.42.42.6: Starting osmo-msc 08:02:29.299719 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14403): Launched 08:02:29.592416 run osmo-msc_10.42.42.6(pid=14404): Launched 08:02:29.756840 run osmo-stp_10.42.42.5(pid=14401): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14401)] 08:02:29.881441 run osmo-stp_10.42.42.5(pid=14401): stdout: | (launched: 2022-12-10_08:02:28.604878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:30.006013 run osmo-stp_10.42.42.5(pid=14401): stderr: | [0;m[38;5;43m20221210080228773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080228774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080228774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080228774 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080228775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080228775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080228775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:30.128371 run osmo-stp_10.42.42.5(pid=14401): stdout: | (launched: 2022-12-10_08:02:28.604878) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:30.245448 run osmo-stp_10.42.42.5(pid=14401): stderr: | [0;m[38;5;43m20221210080228773 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080228774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080228774 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080228774 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080228775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080228775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080228775 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:30.385588 tst mo_mt_call.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14401): Process ended prematurely: osmo-stp_10.42.42.5(pid=14401) [trial-2371↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14401)] [trial-2371↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8] 08:02:30.394317 tst mo_mt_call.py:8: Test FAILED (5.8 sec) 08:02:30.421117 run osmo-hlr_10.42.42.2(pid=14398): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14398)] 08:02:30.468652 run osmo-hlr_10.42.42.2(pid=14398): stdout: | (launched: 2022-12-10_08:02:27.698824) 08:02:30.517894 run osmo-hlr_10.42.42.2(pid=14398): stderr: | [0;m[1;31m20221210080227874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080227874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080227874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080227874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080227874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080227874 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080227887 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080227895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080227895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080227895 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:02:30.586808 run osmo-msc_10.42.42.6(pid=14404): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py↪mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14404)] 08:02:30.634186 run osmo-msc_10.42.42.6(pid=14404): stdout: | (launched: 2022-12-10_08:02:29.539054) 08:02:30.683318 run osmo-msc_10.42.42.6(pid=14404): stderr: | [0;m[38;5;43m20221210080229809 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080229809 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2036dc7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080229809 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080229809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080229809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080229809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080229811 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080229811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080229812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080229812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:02:30.732714 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14397): Terminating (SIGTERM) 08:02:30.772465 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14400): Terminating (SIGTERM) 08:02:30.812167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14403): Terminating (SIGTERM) 08:02:30.865671 --- ParallelTerminationStrategy: PID 14397 died... 08:02:30.896355 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14397): Terminated: ok {rc=0} 08:02:30.948310 --- ParallelTerminationStrategy: PID 14400 died... 08:02:30.969046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14400): Terminated: ok {rc=0} 08:02:31.017752 --- ParallelTerminationStrategy: PID 14403 died... 08:02:31.043760 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14403): Terminated: ok {rc=0} 08:02:31.147210 bus /sierra_3: Setting Powered False 08:02:32.244762 bus /sierra_3: Setting Powered False 08:02:33.359704 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend mo_mt_call_osmux.py ---------------------------------------------- 08:02:34.507512 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:02:34.520315 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:02:34.572670 tst mo_mt_call_osmux.py: using LAC 26991 08:02:34.697859 tst mo_mt_call_osmux.py: using RAC 216 08:02:34.823171 tst mo_mt_call_osmux.py: using CellId 26991 08:02:34.947146 tst mo_mt_call_osmux.py: using BVCI 26992 08:02:35.063265 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:02:35.075217 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:02:35.087071 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:02:35.099065 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:02:35.111071 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 6) 08:02:35.123020 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:02:35.238227 tst voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 2) 08:02:35.357042 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:02:35.844680 run create_hlr_db(pid=14406): Launched 08:02:35.976632 bus /sierra_2: Setting Powered False 08:02:37.035876 run create_hlr_db(pid=14406): Terminated: ok {rc=0} 08:02:37.445459 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14408): Launched 08:02:37.739156 run osmo-hlr_10.42.42.2(pid=14409): Launched 08:02:37.851404 run osmo-stp_10.42.42.5: Starting osmo-stp 08:02:38.354798 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14411): Launched 08:02:38.649188 run osmo-stp_10.42.42.5(pid=14412): Launched 08:02:38.762238 run osmo-msc_10.42.42.6: Starting osmo-msc 08:02:39.293596 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14414): Launched 08:02:39.587512 run osmo-msc_10.42.42.6(pid=14415): Launched 08:02:39.751912 run osmo-stp_10.42.42.5(pid=14412): ERR: Terminated: ERROR {rc=1} [trial-2371↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14412)] 08:02:39.876444 run osmo-stp_10.42.42.5(pid=14412): stdout: | (launched: 2022-12-10_08:02:38.594562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:40.001384 run osmo-stp_10.42.42.5(pid=14412): stderr: | [0;m[38;5;43m20221210080238761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080238761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080238761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080238762 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080238764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080238764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080238764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:40.123664 run osmo-stp_10.42.42.5(pid=14412): stdout: | (launched: 2022-12-10_08:02:38.594562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:40.240153 run osmo-stp_10.42.42.5(pid=14412): stderr: | [0;m[38;5;43m20221210080238761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080238761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080238761 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080238762 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080238764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080238764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080238764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:40.379761 tst mo_mt_call_osmux.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14412): Process ended prematurely: osmo-stp_10.42.42.5(pid=14412) [trial-2371↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14412)] [trial-2371↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8] 08:02:40.388485 tst mo_mt_call_osmux.py:8: Test FAILED (5.9 sec) 08:02:40.415162 run osmo-hlr_10.42.42.2(pid=14409): ERR: Terminated: ERROR {rc=237} [trial-2371↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14409)] 08:02:40.462385 run osmo-hlr_10.42.42.2(pid=14409): stdout: | (launched: 2022-12-10_08:02:37.685671) 08:02:40.511499 run osmo-hlr_10.42.42.2(pid=14409): stderr: | [0;m[1;31m20221210080237861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080237861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080237861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080237861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080237861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080237861 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080237874 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/mo_mt_call_osmux.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080237882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080237882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080237882 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:02:40.580133 run osmo-msc_10.42.42.6(pid=14415): ERR: Terminated: ERROR {rc=2} [trial-2371↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py↪mo_mt_call_osmux.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14415)] 08:02:40.627522 run osmo-msc_10.42.42.6(pid=14415): stdout: | (launched: 2022-12-10_08:02:39.533997) 08:02:40.676498 run osmo-msc_10.42.42.6(pid=14415): stderr: | [0;m[38;5;43m20221210080239802 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080239802 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdcc352dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080239802 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080239802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080239803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080239803 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080239804 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080239805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080239805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080239805 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:02:40.725769 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14408): Terminating (SIGTERM) 08:02:40.765267 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14411): Terminating (SIGTERM) 08:02:40.804824 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14414): Terminating (SIGTERM) 08:02:40.844676 --- ParallelTerminationStrategy: PID 14408 died... 08:02:40.863729 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14408): Terminated: ok {rc=0} 08:02:40.907798 --- ParallelTerminationStrategy: PID 14411 died... 08:02:40.926506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14411): Terminated: ok {rc=0} 08:02:40.970690 --- ParallelTerminationStrategy: PID 14414 died... 08:02:40.989336 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14414): Terminated: ok {rc=0} 08:02:41.073759 bus /sierra_3: Setting Powered False 08:02:42.169081 bus /sierra_3: Setting Powered False 08:02:43.280231 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 emergency:nanobts+band-900 --------------------------------------------------------------------- 08:02:44.531936 tst emergency:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:02:44.538049 tst emergency:nanobts+band-900: Verifying 1 x bts (candidates: 11) 08:02:44.570622 tst emergency:nanobts+band-900: Verifying 6 x ip_address (candidates: 9) 08:02:44.596476 tst emergency:nanobts+band-900: Verifying 4 x modem (candidates: 12) 08:02:44.680314 tst emergency:nanobts+band-900: Reserving 1 x bts (candidates: 11) 08:02:44.713086 tst emergency:nanobts+band-900: Reserving 6 x ip_address (candidates: 9) 08:02:44.739729 tst emergency:nanobts+band-900: Reserving 4 x modem (candidates: 12) 08:02:45.319746 tst emergency:nanobts+band-900: RESERVED RESOURCES for emergency: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd sierra_3rd sierra_4th ---------------------------------------------- trial-2371 emergency:nanobts+band-900 emergency_mo_mt_call.py ---------------------------------------------- 08:02:45.325170 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:02:45.335796 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 08:02:45.384711 tst emergency_mo_mt_call.py: using LAC 26992 08:02:45.505290 tst emergency_mo_mt_call.py: using RAC 217 08:02:45.624472 tst emergency_mo_mt_call.py: using CellId 26992 08:02:45.743919 tst emergency_mo_mt_call.py: using BVCI 26993 08:02:45.870189 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:02:45.882570 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:02:45.893908 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:02:45.910038 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:02:45.927288 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:02:45.941101 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 08:02:46.065389 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 08:02:46.181656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:02:46.657890 run create_hlr_db(pid=14420): Launched 08:02:46.830871 bus /sierra_2: Setting Powered False 08:02:47.892131 run create_hlr_db(pid=14420): Terminated: ok {rc=0} 08:02:48.314799 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14422): Launched 08:02:48.603387 run osmo-hlr_10.42.42.2(pid=14423): Launched 08:02:48.714124 run osmo-stp_10.42.42.5: Starting osmo-stp 08:02:49.206800 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14425): Launched 08:02:49.493479 run osmo-stp_10.42.42.5(pid=14426): Launched 08:02:49.612869 tst emergency_mo_mt_call.py: using MSISDN 7623 08:02:49.760469 run osmo-msc_10.42.42.6: Starting osmo-msc 08:02:50.277267 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14428): Launched 08:02:50.564549 run osmo-msc_10.42.42.6(pid=14429): Launched 08:02:50.726551 run osmo-stp_10.42.42.5(pid=14426): ERR: Terminated: ERROR {rc=1} [trial-2371↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14426)] 08:02:50.849278 run osmo-stp_10.42.42.5(pid=14426): stdout: | (launched: 2022-12-10_08:02:49.440757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:50.972826 run osmo-stp_10.42.42.5(pid=14426): stderr: | [0;m[38;5;43m20221210080249611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080249611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080249611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080249612 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080249612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080249612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080249612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:51.092663 run osmo-stp_10.42.42.5(pid=14426): stdout: | (launched: 2022-12-10_08:02:49.440757) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:02:51.207417 run osmo-stp_10.42.42.5(pid=14426): stderr: | [0;m[38;5;43m20221210080249611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080249611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080249611 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080249612 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080249612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080249612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080249612 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:02:51.344402 tst emergency_mo_mt_call.py:19: ERR: Error: osmo-stp_10.42.42.5(pid=14426): Process ended prematurely: osmo-stp_10.42.42.5(pid=14426) [trial-2371↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14426)] [trial-2371↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19] 08:02:51.352728 tst emergency_mo_mt_call.py:19: Test FAILED (6.0 sec) 08:02:51.378890 run osmo-hlr_10.42.42.2(pid=14423): ERR: Terminated: ERROR {rc=237} [trial-2371↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14423)] 08:02:51.427185 run osmo-hlr_10.42.42.2(pid=14423): stdout: | (launched: 2022-12-10_08:02:48.549987) 08:02:51.476831 run osmo-hlr_10.42.42.2(pid=14423): stderr: | [0;m[1;31m20221210080248725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080248725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080248725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080248725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080248725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080248725 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080248738 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/emergency:nanobts+band-900/emergency_mo_mt_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080248746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080248746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080248746 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:02:51.545861 run osmo-msc_10.42.42.6(pid=14429): ERR: Terminated: ERROR {rc=2} [trial-2371↪emergency:nanobts+band-900↪emergency_mo_mt_call.py↪emergency_mo_mt_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14429)] 08:02:51.593417 run osmo-msc_10.42.42.6(pid=14429): stdout: | (launched: 2022-12-10_08:02:50.511640) 08:02:51.642627 run osmo-msc_10.42.42.6(pid=14429): stderr: | [0;m[38;5;43m20221210080250782 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080250783 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7d480a0c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080250783 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080250783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080250783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080250783 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080250785 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080250785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080250785 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080250786 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:02:51.692109 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14422): Terminating (SIGTERM) 08:02:51.731883 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14425): Terminating (SIGTERM) 08:02:51.771458 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14428): Terminating (SIGTERM) 08:02:51.811412 --- ParallelTerminationStrategy: PID 14422 died... 08:02:51.830385 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14422): Terminated: ok {rc=0} 08:02:51.874573 --- ParallelTerminationStrategy: PID 14425 died... 08:02:51.892933 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14425): Terminated: ok {rc=0} 08:02:51.937139 --- ParallelTerminationStrategy: PID 14428 died... 08:02:51.955663 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14428): Terminated: ok {rc=0} 08:02:52.041769 bus /sierra_3: Setting Powered False 08:02:53.140417 bus /sierra_3: Setting Powered False 08:02:54.254717 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 emergency:nanobts+band-900 emergency_preemptive_call.py ---------------------------------------------- 08:02:55.341861 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:02:55.353095 tst emergency:nanobts+band-900: Using 1 x bts (candidates: 1) 08:02:55.401529 tst emergency_preemptive_call.py: using LAC 26993 08:02:55.516804 tst emergency_preemptive_call.py: using RAC 218 08:02:55.630067 tst emergency_preemptive_call.py: using CellId 26993 08:02:55.742913 tst emergency_preemptive_call.py: using BVCI 26994 08:02:55.846778 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:02:55.857429 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:02:55.867659 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:02:55.878375 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:02:55.888914 tst emergency:nanobts+band-900: Using 1 x ip_address (candidates: 6) 08:02:55.900020 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 08:02:56.013314 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 08:02:56.126500 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 08:02:56.242575 tst emergency:nanobts+band-900: Using 1 x modem (candidates: 4) 08:02:56.358870 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:02:56.839345 run create_hlr_db(pid=14431): Launched 08:02:56.966822 bus /sierra_2: Setting Powered False 08:02:58.028508 run create_hlr_db(pid=14431): Terminated: ok {rc=0} 08:02:58.441887 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14433): Launched 08:02:58.729317 run osmo-hlr_10.42.42.2(pid=14434): Launched 08:02:58.839626 run osmo-stp_10.42.42.5: Starting osmo-stp 08:02:59.349721 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14436): Launched 08:02:59.637659 run osmo-stp_10.42.42.5(pid=14437): Launched 08:02:59.759789 tst emergency_preemptive_call.py: using MSISDN 7624 08:02:59.923124 run osmo-msc_10.42.42.6: Starting osmo-msc 08:03:00.440445 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14439): Launched 08:03:00.729330 run osmo-msc_10.42.42.6(pid=14440): Launched 08:03:00.914074 run osmo-stp_10.42.42.5(pid=14437): ERR: Terminated: ERROR {rc=1} [trial-2371↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14437)] 08:03:01.184542 run osmo-stp_10.42.42.5(pid=14437): stdout: | (launched: 2022-12-10_08:02:59.585017) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:01.403899 run osmo-stp_10.42.42.5(pid=14437): stderr: | [0;m[38;5;43m20221210080259753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080259753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080259753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080259753 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080259754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080259754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080259754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:01.562063 run osmo-stp_10.42.42.5(pid=14437): stdout: | (launched: 2022-12-10_08:02:59.585017) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:01.682308 run osmo-stp_10.42.42.5(pid=14437): stderr: | [0;m[38;5;43m20221210080259753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080259753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080259753 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080259753 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080259754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080259754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080259754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:01.825422 tst emergency_preemptive_call.py:32: ERR: Error: osmo-stp_10.42.42.5(pid=14437): Process ended prematurely: osmo-stp_10.42.42.5(pid=14437) [trial-2371↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14437)] [trial-2371↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32] 08:03:01.834705 tst emergency_preemptive_call.py:32: Test FAILED (6.5 sec) 08:03:01.864443 run osmo-hlr_10.42.42.2(pid=14434): ERR: Terminated: ERROR {rc=237} [trial-2371↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14434)] 08:03:01.916691 run osmo-hlr_10.42.42.2(pid=14434): stdout: | (launched: 2022-12-10_08:02:58.676465) 08:03:01.970680 run osmo-hlr_10.42.42.2(pid=14434): stderr: | [0;m[1;31m20221210080258853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080258853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080258853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080258853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080258853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080258853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080258866 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/emergency:nanobts+band-900/emergency_preemptive_call.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080258874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080258874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080258874 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:03:02.043236 run osmo-msc_10.42.42.6(pid=14440): ERR: Terminated: ERROR {rc=2} [trial-2371↪emergency:nanobts+band-900↪emergency_preemptive_call.py↪emergency_preemptive_call.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14440)] 08:03:02.093944 run osmo-msc_10.42.42.6(pid=14440): stdout: | (launched: 2022-12-10_08:03:00.676070) 08:03:02.145680 run osmo-msc_10.42.42.6(pid=14440): stderr: | [0;m[38;5;43m20221210080301115 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080301115 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3d73c5cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080301116 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080301116 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080301117 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080301118 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080301122 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080301124 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080301125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080301125 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:03:02.197800 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14433): Terminating (SIGTERM) 08:03:02.239587 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14436): Terminating (SIGTERM) 08:03:02.281991 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14439): Terminating (SIGTERM) 08:03:02.325757 --- ParallelTerminationStrategy: PID 14433 died... 08:03:02.345155 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14433): Terminated: ok {rc=0} 08:03:02.391473 --- ParallelTerminationStrategy: PID 14436 died... 08:03:02.410989 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14436): Terminated: ok {rc=0} 08:03:02.457572 --- ParallelTerminationStrategy: PID 14439 died... 08:03:02.476239 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14439): Terminated: ok {rc=0} 08:03:02.563301 bus /sierra_9: Setting Powered False 08:03:03.662392 bus /sierra_9: Setting Powered False 08:03:04.778769 bus /sierra_8: Setting Powered False 08:03:05.877540 bus /sierra_8: Setting Powered False 08:03:06.990663 bus /sierra_3: Setting Powered False 08:03:08.087564 bus /sierra_3: Setting Powered False 08:03:09.205328 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 emergency:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:nanobts+band-900 --------------------------------------------------------------------- 08:03:10.482235 tst gprs:nanobts+band-900: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:03:10.488185 tst gprs:nanobts+band-900: Verifying 1 x bts (candidates: 11) 08:03:10.520755 tst gprs:nanobts+band-900: Verifying 9 x ip_address (candidates: 9) 08:03:10.558848 tst gprs:nanobts+band-900: Verifying 4 x modem (candidates: 12) 08:03:10.643681 tst gprs:nanobts+band-900: Reserving 1 x bts (candidates: 11) 08:03:10.675385 tst gprs:nanobts+band-900: Reserving 9 x ip_address (candidates: 9) 08:03:10.713238 tst gprs:nanobts+band-900: Reserving 4 x modem (candidates: 12) 08:03:11.303025 tst gprs:nanobts+band-900: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:nanobts+band-900 cs_paging_gprs_active.py ---------------------------------------------- 08:03:11.351474 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:11.362069 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 08:03:11.409185 tst cs_paging_gprs_active.py: using LAC 26994 08:03:11.526003 tst cs_paging_gprs_active.py: using RAC 219 08:03:11.644105 tst cs_paging_gprs_active.py: using CellId 26994 08:03:11.760909 tst cs_paging_gprs_active.py: using BVCI 26995 08:03:11.867303 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:11.877994 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:11.888309 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:11.898904 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:11.909409 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:11.919949 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:11.930744 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:11.941352 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:11.951951 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:03:12.067634 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:03:12.184808 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:03:12.381819 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:03:12.675997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14446): Launched 08:03:12.933442 run iperf3-srv_10.42.42.10(pid=14447): Launched 08:03:13.044579 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:03:13.241465 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:03:13.536516 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14448): Launched 08:03:13.792687 run iperf3-srv_10.42.42.10(pid=14449): Launched 08:03:13.903403 tst cs_paging_gprs_active.py:38: start network... 08:03:14.100389 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:03:14.552891 run create_hlr_db(pid=14450): Launched 08:03:14.674187 bus /sierra_2: Setting Powered False 08:03:15.736435 run create_hlr_db(pid=14450): Terminated: ok {rc=0} 08:03:16.219084 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14452): Launched 08:03:16.558502 run osmo-hlr_10.42.42.2(pid=14453): Launched 08:03:16.788538 run osmo-stp_10.42.42.5: Starting osmo-stp 08:03:17.410402 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14455): Launched 08:03:17.725498 run osmo-stp_10.42.42.5(pid=14456): Launched 08:03:17.845543 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:03:18.389116 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14458): Launched 08:03:18.509953 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:03:18.775672 run patchelf(pid=14459): Launched 08:03:18.951766 run osmo-stp_10.42.42.5(pid=14456): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14456)] 08:03:19.085532 run osmo-stp_10.42.42.5(pid=14456): stdout: | (launched: 2022-12-10_08:03:17.668369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:19.220938 run osmo-stp_10.42.42.5(pid=14456): stderr: | [0;m[38;5;43m20221210080317858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080317858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080317859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080317859 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080317859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080317859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080317860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:19.356447 run osmo-stp_10.42.42.5(pid=14456): stdout: | (launched: 2022-12-10_08:03:17.668369) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:19.485333 run osmo-stp_10.42.42.5(pid=14456): stderr: | [0;m[38;5;43m20221210080317858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080317858 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080317859 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080317859 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080317859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080317859 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080317860 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:19.638120 run patchelf(pid=14459): Terminating (SIGINT) 08:03:19.815357 run patchelf(pid=14459): Terminated: ok {rc=0} 08:03:19.943993 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14456): Process ended prematurely: osmo-stp_10.42.42.5(pid=14456) [trial-2371↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14456)] [trial-2371↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38] 08:03:19.954034 tst cs_paging_gprs_active.py:38: Test FAILED (8.6 sec) 08:03:19.982445 run osmo-hlr_10.42.42.2(pid=14453): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-900↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14453)] 08:03:20.032142 run osmo-hlr_10.42.42.2(pid=14453): stdout: | (launched: 2022-12-10_08:03:16.488694) 08:03:20.083559 run osmo-hlr_10.42.42.2(pid=14453): stderr: | [0;m[1;31m20221210080316790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080316790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080316790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080316790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080316790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080316790 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080316817 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-900/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080316839 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080316840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080316840 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:03:20.135364 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14446): Terminating (SIGTERM) 08:03:20.177068 run iperf3-srv_10.42.42.10(pid=14447): Terminating (SIGTERM) 08:03:20.218665 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14448): Terminating (SIGTERM) 08:03:20.260384 run iperf3-srv_10.42.42.10(pid=14449): Terminating (SIGTERM) 08:03:20.302022 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14452): Terminating (SIGTERM) 08:03:20.343807 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14455): Terminating (SIGTERM) 08:03:20.385364 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14458): Terminating (SIGTERM) 08:03:20.427307 --- ParallelTerminationStrategy: PID 14446 died... 08:03:20.447205 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14446): Terminated: ok {rc=0} 08:03:20.493388 --- ParallelTerminationStrategy: PID 14447 died... 08:03:20.512930 run iperf3-srv_10.42.42.10(pid=14447): Terminated {rc=256} 08:03:20.558757 --- ParallelTerminationStrategy: PID 14448 died... 08:03:20.578247 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14448): Terminated: ok {rc=0} 08:03:20.624109 --- ParallelTerminationStrategy: PID 14449 died... 08:03:20.643646 run iperf3-srv_10.42.42.10(pid=14449): Terminated {rc=256} 08:03:20.689424 --- ParallelTerminationStrategy: PID 14452 died... 08:03:20.708846 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14452): Terminated: ok {rc=0} 08:03:20.754689 --- ParallelTerminationStrategy: PID 14455 died... 08:03:20.774328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14455): Terminated: ok {rc=0} 08:03:20.820444 --- ParallelTerminationStrategy: PID 14458 died... 08:03:20.840187 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14458): Terminated: ok {rc=0} 08:03:20.927728 bus /gobi_0: Setting Powered False 08:03:22.026859 bus /gobi_0: Setting Powered False 08:03:23.143025 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-900 iperf3.py ---------------------------------------------- 08:03:24.290034 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:24.301895 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 08:03:24.353954 tst iperf3.py: using LAC 26995 08:03:24.479140 tst iperf3.py: using RAC 220 08:03:24.604229 tst iperf3.py: using CellId 26995 08:03:24.728180 tst iperf3.py: using BVCI 26996 08:03:24.836419 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:24.847053 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:24.857536 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:24.868056 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:24.878584 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:24.889222 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:24.899805 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:24.910344 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:24.921056 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:03:25.039767 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:03:25.253822 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:03:25.569643 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14460): Launched 08:03:25.843790 run iperf3-srv_10.42.42.10(pid=14461): Launched 08:03:25.962438 tst iperf3.py:8: start network... 08:03:26.175102 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:03:26.664439 run create_hlr_db(pid=14462): Launched 08:03:26.793657 bus /gobi_6: Setting Powered False 08:03:27.856403 run create_hlr_db(pid=14462): Terminated: ok {rc=0} 08:03:28.279229 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14464): Launched 08:03:28.573254 run osmo-hlr_10.42.42.2(pid=14465): Launched 08:03:28.686204 run osmo-stp_10.42.42.5: Starting osmo-stp 08:03:29.192929 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14467): Launched 08:03:29.486865 run osmo-stp_10.42.42.5(pid=14468): Launched 08:03:29.599398 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:03:30.104749 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14470): Launched 08:03:30.218232 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:03:30.466054 run patchelf(pid=14471): Launched 08:03:30.630036 run osmo-stp_10.42.42.5(pid=14468): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14468)] 08:03:30.754467 run osmo-stp_10.42.42.5(pid=14468): stdout: | (launched: 2022-12-10_08:03:29.433290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:30.890553 run osmo-stp_10.42.42.5(pid=14468): stderr: | [0;m[38;5;43m20221210080329603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080329603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080329603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080329603 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080329604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080329604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080329604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:31.033177 run osmo-stp_10.42.42.5(pid=14468): stdout: | (launched: 2022-12-10_08:03:29.433290) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:31.167290 run osmo-stp_10.42.42.5(pid=14468): stderr: | [0;m[38;5;43m20221210080329603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080329603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080329603 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080329603 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080329604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080329604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080329604 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:31.326582 run patchelf(pid=14471): Terminating (SIGINT) 08:03:31.549105 run patchelf(pid=14471): Terminated: ok {rc=0} 08:03:31.685824 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14468): Process ended prematurely: osmo-stp_10.42.42.5(pid=14468) [trial-2371↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14468)] [trial-2371↪gprs:nanobts+band-900↪iperf3.py:8] 08:03:31.696700 tst iperf3.py:8: Test FAILED (7.4 sec) 08:03:31.727450 run osmo-hlr_10.42.42.2(pid=14465): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-900↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14465)] 08:03:31.779464 run osmo-hlr_10.42.42.2(pid=14465): stdout: | (launched: 2022-12-10_08:03:28.519402) 08:03:31.833633 run osmo-hlr_10.42.42.2(pid=14465): stderr: | [0;m[1;31m20221210080328693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080328693 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080328694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080328694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080328694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080328694 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080328706 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-900/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080328715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080328715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080328715 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:03:31.887684 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14460): Terminating (SIGTERM) 08:03:31.930958 run iperf3-srv_10.42.42.10(pid=14461): Terminating (SIGTERM) 08:03:31.974005 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14464): Terminating (SIGTERM) 08:03:32.018694 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14467): Terminating (SIGTERM) 08:03:32.063418 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14470): Terminating (SIGTERM) 08:03:32.110044 --- ParallelTerminationStrategy: PID 14460 died... 08:03:32.130254 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14460): Terminated: ok {rc=0} 08:03:32.178828 --- ParallelTerminationStrategy: PID 14461 died... 08:03:32.199121 run iperf3-srv_10.42.42.10(pid=14461): Terminated {rc=256} 08:03:32.247057 --- ParallelTerminationStrategy: PID 14464 died... 08:03:32.266837 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14464): Terminated: ok {rc=0} 08:03:32.312839 --- ParallelTerminationStrategy: PID 14467 died... 08:03:32.333323 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14467): Terminated: ok {rc=0} 08:03:32.379970 --- ParallelTerminationStrategy: PID 14470 died... 08:03:32.399671 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14470): Terminated: ok {rc=0} 08:03:32.489736 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-900 iperf3m4.py ---------------------------------------------- 08:03:33.635202 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:33.646297 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 08:03:33.694445 tst iperf3m4.py: using LAC 26996 08:03:33.814397 tst iperf3m4.py: using RAC 221 08:03:33.929375 tst iperf3m4.py: using CellId 26996 08:03:34.055865 tst iperf3m4.py: using BVCI 26997 08:03:34.172113 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:34.183405 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:34.194524 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:34.205812 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:34.216932 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:34.228139 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:34.239423 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:34.250529 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:34.261645 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:03:34.380133 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:03:34.496829 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:03:34.615699 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:03:34.734284 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:03:34.947996 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:03:35.265605 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14472): Launched 08:03:35.540189 run iperf3-srv_10.42.42.10(pid=14473): Launched 08:03:35.658698 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:03:35.870978 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:03:36.187907 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14474): Launched 08:03:36.462064 run iperf3-srv_10.42.42.10(pid=14475): Launched 08:03:36.580490 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:03:36.793223 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:03:37.110527 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14476): Launched 08:03:37.385228 run iperf3-srv_10.42.42.10(pid=14477): Launched 08:03:37.503963 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:03:37.716302 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:03:38.033424 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14478): Launched 08:03:38.307356 run iperf3-srv_10.42.42.10(pid=14479): Launched 08:03:38.426224 tst iperf3m4.py:8: start network... 08:03:38.638527 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:03:39.128285 run create_hlr_db(pid=14480): Launched 08:03:39.256858 bus /gobi_6: Setting Powered False 08:03:40.320367 run create_hlr_db(pid=14480): Terminated: ok {rc=0} 08:03:40.742283 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14482): Launched 08:03:41.037517 run osmo-hlr_10.42.42.2(pid=14483): Launched 08:03:41.150606 run osmo-stp_10.42.42.5: Starting osmo-stp 08:03:41.661669 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14485): Launched 08:03:41.956573 run osmo-stp_10.42.42.5(pid=14486): Launched 08:03:42.069297 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:03:42.576049 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14488): Launched 08:03:42.690070 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:03:42.938476 run patchelf(pid=14489): Launched 08:03:43.102899 run osmo-stp_10.42.42.5(pid=14486): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14486)] 08:03:43.228451 run osmo-stp_10.42.42.5(pid=14486): stdout: | (launched: 2022-12-10_08:03:41.902362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:43.355510 run osmo-stp_10.42.42.5(pid=14486): stderr: | [0;m[38;5;43m20221210080342071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080342071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080342071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080342072 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080342072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080342072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080342073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:43.482719 run osmo-stp_10.42.42.5(pid=14486): stdout: | (launched: 2022-12-10_08:03:41.902362) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:43.603595 run osmo-stp_10.42.42.5(pid=14486): stderr: | [0;m[38;5;43m20221210080342071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080342071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080342071 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080342072 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080342072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080342072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080342073 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:43.746977 run patchelf(pid=14489): Terminating (SIGINT) 08:03:43.913665 run patchelf(pid=14489): Terminated: ok {rc=0} 08:03:44.034047 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14486): Process ended prematurely: osmo-stp_10.42.42.5(pid=14486) [trial-2371↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14486)] [trial-2371↪gprs:nanobts+band-900↪iperf3m4.py:8] 08:03:44.043326 tst iperf3m4.py:8: Test FAILED (10.4 sec) 08:03:44.070818 run osmo-hlr_10.42.42.2(pid=14483): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-900↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14483)] 08:03:44.118665 run osmo-hlr_10.42.42.2(pid=14483): stdout: | (launched: 2022-12-10_08:03:40.983550) 08:03:44.167912 run osmo-hlr_10.42.42.2(pid=14483): stderr: | [0;m[1;31m20221210080341157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080341157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080341157 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080341158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080341158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080341158 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080341170 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-900/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080341181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080341181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080341181 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:03:44.217512 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14472): Terminating (SIGTERM) 08:03:44.257149 run iperf3-srv_10.42.42.10(pid=14473): Terminating (SIGTERM) 08:03:44.296595 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14474): Terminating (SIGTERM) 08:03:44.336131 run iperf3-srv_10.42.42.10(pid=14475): Terminating (SIGTERM) 08:03:44.375695 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14476): Terminating (SIGTERM) 08:03:44.415256 run iperf3-srv_10.42.42.10(pid=14477): Terminating (SIGTERM) 08:03:44.454777 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14478): Terminating (SIGTERM) 08:03:44.494313 run iperf3-srv_10.42.42.10(pid=14479): Terminating (SIGTERM) 08:03:44.533968 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14482): Terminating (SIGTERM) 08:03:44.573452 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14485): Terminating (SIGTERM) 08:03:44.612753 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14488): Terminating (SIGTERM) 08:03:44.652420 --- ParallelTerminationStrategy: PID 14472 died... 08:03:44.671559 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14472): Terminated: ok {rc=0} 08:03:44.716555 --- ParallelTerminationStrategy: PID 14473 died... 08:03:44.735371 run iperf3-srv_10.42.42.10(pid=14473): Terminated {rc=256} 08:03:44.780499 --- ParallelTerminationStrategy: PID 14474 died... 08:03:44.799289 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14474): Terminated: ok {rc=0} 08:03:44.843337 --- ParallelTerminationStrategy: PID 14475 died... 08:03:44.861833 run iperf3-srv_10.42.42.10(pid=14475): Terminated {rc=256} 08:03:44.906096 --- ParallelTerminationStrategy: PID 14476 died... 08:03:44.924835 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14476): Terminated: ok {rc=0} 08:03:44.968866 --- ParallelTerminationStrategy: PID 14477 died... 08:03:44.987982 run iperf3-srv_10.42.42.10(pid=14477): Terminated {rc=256} 08:03:45.032365 --- ParallelTerminationStrategy: PID 14478 died... 08:03:45.051137 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14478): Terminated: ok {rc=0} 08:03:45.095085 --- ParallelTerminationStrategy: PID 14479 died... 08:03:45.113680 run iperf3-srv_10.42.42.10(pid=14479): Terminated {rc=256} 08:03:45.158119 --- ParallelTerminationStrategy: PID 14482 died... 08:03:45.176928 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14482): Terminated: ok {rc=0} 08:03:45.221552 --- ParallelTerminationStrategy: PID 14485 died... 08:03:45.240353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14485): Terminated: ok {rc=0} 08:03:45.285046 --- ParallelTerminationStrategy: PID 14488 died... 08:03:45.303889 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14488): Terminated: ok {rc=0} 08:03:45.388384 bus /gobi_4: Setting Powered False 08:03:46.493423 bus /gobi_4: Setting Powered False 08:03:47.615236 bus /gobi_1: Setting Powered False 08:03:48.714429 bus /gobi_1: Setting Powered False 08:03:49.831609 bus /gobi_0: Setting Powered False 08:03:50.930360 bus /gobi_0: Setting Powered False 08:03:52.048499 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-900 ping.py ---------------------------------------------- 08:03:53.152709 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:53.164481 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 08:03:53.215016 tst ping.py: using LAC 26997 08:03:53.336698 tst ping.py: using RAC 222 08:03:53.455343 tst ping.py: using CellId 26997 08:03:53.568903 tst ping.py: using BVCI 26998 08:03:53.673749 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:53.684387 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:53.695022 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:53.705902 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:53.716422 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:53.727057 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:53.737863 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:03:53.748439 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:03:53.866258 tst ping.py:19: start network... 08:03:54.076178 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:03:54.557249 run create_hlr_db(pid=14490): Launched 08:03:54.684443 bus /gobi_6: Setting Powered False 08:03:55.747209 run create_hlr_db(pid=14490): Terminated: ok {rc=0} 08:03:56.162716 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14492): Launched 08:03:56.452681 run osmo-hlr_10.42.42.2(pid=14493): Launched 08:03:56.563701 run osmo-stp_10.42.42.5: Starting osmo-stp 08:03:57.075273 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14495): Launched 08:03:57.363606 run osmo-stp_10.42.42.5(pid=14496): Launched 08:03:57.473930 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:03:57.973176 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14498): Launched 08:03:58.084147 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:03:58.328163 run patchelf(pid=14499): Launched 08:03:58.490310 run osmo-stp_10.42.42.5(pid=14496): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14496)] 08:03:58.612760 run osmo-stp_10.42.42.5(pid=14496): stdout: | (launched: 2022-12-10_08:03:57.310560) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:58.736885 run osmo-stp_10.42.42.5(pid=14496): stderr: | [0;m[38;5;43m20221210080357479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080357480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080357480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080357480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080357481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080357481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080357481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:58.861636 run osmo-stp_10.42.42.5(pid=14496): stdout: | (launched: 2022-12-10_08:03:57.310560) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:03:58.979891 run osmo-stp_10.42.42.5(pid=14496): stderr: | [0;m[38;5;43m20221210080357479 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080357480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080357480 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080357480 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080357481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080357481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080357481 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:03:59.120494 run patchelf(pid=14499): Terminating (SIGINT) 08:03:59.284897 run patchelf(pid=14499): Terminated: ok {rc=0} 08:03:59.402797 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14496): Process ended prematurely: osmo-stp_10.42.42.5(pid=14496) [trial-2371↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14496)] [trial-2371↪gprs:nanobts+band-900↪ping.py:22] 08:03:59.411357 tst ping.py:22: Test FAILED (6.3 sec) 08:03:59.438456 run osmo-hlr_10.42.42.2(pid=14493): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-900↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14493)] 08:03:59.486026 run osmo-hlr_10.42.42.2(pid=14493): stdout: | (launched: 2022-12-10_08:03:56.399128) 08:03:59.535135 run osmo-hlr_10.42.42.2(pid=14493): stderr: | [0;m[1;31m20221210080356575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080356575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080356575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080356575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080356575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080356575 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080356588 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-900/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080356596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080356596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080356596 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:03:59.584643 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14492): Terminating (SIGTERM) 08:03:59.624373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14495): Terminating (SIGTERM) 08:03:59.664540 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14498): Terminating (SIGTERM) 08:03:59.705062 --- ParallelTerminationStrategy: PID 14492 died... 08:03:59.723855 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14492): Terminated: ok {rc=0} 08:03:59.768565 --- ParallelTerminationStrategy: PID 14495 died... 08:03:59.787441 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14495): Terminated: ok {rc=0} 08:03:59.831671 --- ParallelTerminationStrategy: PID 14498 died... 08:03:59.850388 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14498): Terminated: ok {rc=0} 08:03:59.933683 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-900 ping_idle_ping.py ---------------------------------------------- 08:04:01.022878 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:04:01.041195 tst gprs:nanobts+band-900: Using 1 x bts (candidates: 1) 08:04:01.105202 tst ping_idle_ping.py: using LAC 26998 08:04:01.233280 tst ping_idle_ping.py: using RAC 223 08:04:01.399244 tst ping_idle_ping.py: using CellId 26998 08:04:01.554602 tst ping_idle_ping.py: using BVCI 26999 08:04:01.673111 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:04:01.684680 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:04:01.696247 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:04:01.708293 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:04:01.720871 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:04:01.732358 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:04:01.744540 tst gprs:nanobts+band-900: Using 1 x ip_address (candidates: 9) 08:04:01.756656 tst gprs:nanobts+band-900: Using 1 x modem (candidates: 4) 08:04:01.878683 tst ping_idle_ping.py:24: start network... 08:04:02.094495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:04:02.585599 run create_hlr_db(pid=14500): Launched 08:04:02.713025 bus /gobi_6: Setting Powered False 08:04:03.775562 run create_hlr_db(pid=14500): Terminated: ok {rc=0} 08:04:04.209547 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14502): Launched 08:04:04.519875 run osmo-hlr_10.42.42.2(pid=14503): Launched 08:04:04.639276 run osmo-stp_10.42.42.5: Starting osmo-stp 08:04:05.177354 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14505): Launched 08:04:05.489216 run osmo-stp_10.42.42.5(pid=14506): Launched 08:04:05.608680 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:04:06.145971 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14508): Launched 08:04:06.264520 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:04:06.526953 run patchelf(pid=14509): Launched 08:04:06.699684 run osmo-stp_10.42.42.5(pid=14506): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14506)] 08:04:06.830902 run osmo-stp_10.42.42.5(pid=14506): stdout: | (launched: 2022-12-10_08:04:05.432363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:06.963881 run osmo-stp_10.42.42.5(pid=14506): stderr: | [0;m[38;5;43m20221210080405624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080405624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080405624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080405625 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080405625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080405625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080405625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:07.097303 run osmo-stp_10.42.42.5(pid=14506): stdout: | (launched: 2022-12-10_08:04:05.432363) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:07.224205 run osmo-stp_10.42.42.5(pid=14506): stderr: | [0;m[38;5;43m20221210080405624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080405624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080405624 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080405625 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080405625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080405625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080405625 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:07.375890 run patchelf(pid=14509): Terminating (SIGINT) 08:04:07.550851 run patchelf(pid=14509): Terminated: ok {rc=0} 08:04:07.676577 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14506): Process ended prematurely: osmo-stp_10.42.42.5(pid=14506) [trial-2371↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14506)] [trial-2371↪gprs:nanobts+band-900↪ping_idle_ping.py:27] 08:04:07.685890 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 08:04:07.713684 run osmo-hlr_10.42.42.2(pid=14503): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-900↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14503)] 08:04:07.763281 run osmo-hlr_10.42.42.2(pid=14503): stdout: | (launched: 2022-12-10_08:04:04.463363) 08:04:07.814649 run osmo-hlr_10.42.42.2(pid=14503): stderr: | [0;m[1;31m20221210080404659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080404659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080404659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080404659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080404659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080404659 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080404672 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-900/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080404680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080404680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080404680 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:04:07.866234 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14502): Terminating (SIGTERM) 08:04:07.907691 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14505): Terminating (SIGTERM) 08:04:07.949527 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14508): Terminating (SIGTERM) 08:04:07.991476 --- ParallelTerminationStrategy: PID 14502 died... 08:04:08.011555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14502): Terminated: ok {rc=0} 08:04:08.057613 --- ParallelTerminationStrategy: PID 14505 died... 08:04:08.077316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14505): Terminated: ok {rc=0} 08:04:08.123360 --- ParallelTerminationStrategy: PID 14508 died... 08:04:08.143034 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14508): Terminated: ok {rc=0} 08:04:08.229780 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:nanobts+band-900 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:nanobts+band-900+mod-bts0-egprs --------------------------------------------------------------------- 08:04:09.528663 tst gprs:nanobts+band-900+mod-bts0-egprs: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:04:09.535056 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 1 x bts (candidates: 11) 08:04:09.567037 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 9 x ip_address (candidates: 9) 08:04:09.604716 tst gprs:nanobts+band-900+mod-bts0-egprs: Verifying 4 x modem (candidates: 12) 08:04:09.690520 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 1 x bts (candidates: 11) 08:04:09.722132 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 9 x ip_address (candidates: 9) 08:04:09.759616 tst gprs:nanobts+band-900+mod-bts0-egprs: Reserving 4 x modem (candidates: 12) 08:04:10.357537 tst gprs:nanobts+band-900+mod-bts0-egprs: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:nanobts+band-900+mod-bts0-egprs cs_paging_gprs_active.py ---------------------------------------------- 08:04:10.405690 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:10.416381 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:04:10.465320 tst cs_paging_gprs_active.py: using LAC 26999 08:04:10.589470 tst cs_paging_gprs_active.py: using RAC 224 08:04:10.720648 tst cs_paging_gprs_active.py: using CellId 26999 08:04:10.844780 tst cs_paging_gprs_active.py: using BVCI 27000 08:04:10.959986 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:10.971525 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:10.982795 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:10.994225 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:11.005547 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:11.016686 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:11.028118 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:11.039271 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:11.050625 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:04:11.172106 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:04:11.288097 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:04:11.486715 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:04:11.782548 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14513): Launched 08:04:12.040838 run iperf3-srv_10.42.42.10(pid=14514): Launched 08:04:12.152745 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:04:12.349934 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:04:12.646189 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14515): Launched 08:04:12.903295 run iperf3-srv_10.42.42.10(pid=14516): Launched 08:04:13.014774 tst cs_paging_gprs_active.py:38: start network... 08:04:13.212021 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:04:13.666992 run create_hlr_db(pid=14517): Launched 08:04:13.780924 bus /gobi_6: Setting Powered False 08:04:14.840068 run create_hlr_db(pid=14517): Terminated: ok {rc=0} 08:04:15.273130 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14519): Launched 08:04:15.589983 run osmo-hlr_10.42.42.2(pid=14520): Launched 08:04:15.710832 run osmo-stp_10.42.42.5: Starting osmo-stp 08:04:16.305657 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14522): Launched 08:04:16.649701 run osmo-stp_10.42.42.5(pid=14523): Launched 08:04:16.897912 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:04:17.512279 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14525): Launched 08:04:17.633965 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:04:17.900788 run patchelf(pid=14526): Launched 08:04:18.077728 run osmo-stp_10.42.42.5(pid=14523): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14523)] 08:04:18.211840 run osmo-stp_10.42.42.5(pid=14523): stdout: | (launched: 2022-12-10_08:04:16.577112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:18.348007 run osmo-stp_10.42.42.5(pid=14523): stderr: | [0;m[38;5;43m20221210080416871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080416872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080416872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080416872 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080416873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080416873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080416873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:18.484072 run osmo-stp_10.42.42.5(pid=14523): stdout: | (launched: 2022-12-10_08:04:16.577112) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:18.613979 run osmo-stp_10.42.42.5(pid=14523): stderr: | [0;m[38;5;43m20221210080416871 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080416872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080416872 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080416872 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080416873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080416873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080416873 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:18.767836 run patchelf(pid=14526): Terminating (SIGINT) 08:04:18.946136 run patchelf(pid=14526): Terminated: ok {rc=0} 08:04:19.075564 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14523): Process ended prematurely: osmo-stp_10.42.42.5(pid=14523) [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14523)] [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38] 08:04:19.085513 tst cs_paging_gprs_active.py:38: Test FAILED (8.7 sec) 08:04:19.113878 run osmo-hlr_10.42.42.2(pid=14520): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14520)] 08:04:19.163600 run osmo-hlr_10.42.42.2(pid=14520): stdout: | (launched: 2022-12-10_08:04:15.532822) 08:04:19.215071 run osmo-hlr_10.42.42.2(pid=14520): stderr: | [0;m[1;31m20221210080415730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080415730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080415730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080415730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080415730 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080415731 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080415746 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-900+mod-bts0-egprs/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080415754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080415754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080415754 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:04:19.267261 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14513): Terminating (SIGTERM) 08:04:19.309734 run iperf3-srv_10.42.42.10(pid=14514): Terminating (SIGTERM) 08:04:19.351421 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14515): Terminating (SIGTERM) 08:04:19.393697 run iperf3-srv_10.42.42.10(pid=14516): Terminating (SIGTERM) 08:04:19.435859 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14519): Terminating (SIGTERM) 08:04:19.477610 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14522): Terminating (SIGTERM) 08:04:19.519456 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14525): Terminating (SIGTERM) 08:04:19.561333 --- ParallelTerminationStrategy: PID 14513 died... 08:04:19.581269 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14513): Terminated: ok {rc=0} 08:04:19.627380 --- ParallelTerminationStrategy: PID 14514 died... 08:04:19.646901 run iperf3-srv_10.42.42.10(pid=14514): Terminated {rc=256} 08:04:19.692760 --- ParallelTerminationStrategy: PID 14515 died... 08:04:19.712519 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14515): Terminated: ok {rc=0} 08:04:19.758906 --- ParallelTerminationStrategy: PID 14516 died... 08:04:19.778512 run iperf3-srv_10.42.42.10(pid=14516): Terminated {rc=256} 08:04:19.824449 --- ParallelTerminationStrategy: PID 14519 died... 08:04:19.843970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14519): Terminated: ok {rc=0} 08:04:19.889929 --- ParallelTerminationStrategy: PID 14522 died... 08:04:19.909544 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14522): Terminated: ok {rc=0} 08:04:19.955884 --- ParallelTerminationStrategy: PID 14525 died... 08:04:19.975568 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14525): Terminated: ok {rc=0} 08:04:20.063611 bus /gobi_0: Setting Powered False 08:04:21.162045 bus /gobi_0: Setting Powered False 08:04:22.277124 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-900+mod-bts0-egprs iperf3.py ---------------------------------------------- 08:04:23.424379 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:23.436477 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:04:23.489344 tst iperf3.py: using LAC 27000 08:04:23.607524 tst iperf3.py: using RAC 225 08:04:23.733487 tst iperf3.py: using CellId 27000 08:04:23.859120 tst iperf3.py: using BVCI 27001 08:04:23.974549 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:23.985979 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:23.997259 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:24.008857 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:24.020221 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:24.031445 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:24.043008 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:24.054041 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:24.065877 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:04:24.183409 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:04:24.398154 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:04:24.715523 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14527): Launched 08:04:24.991218 run iperf3-srv_10.42.42.10(pid=14528): Launched 08:04:25.110608 tst iperf3.py:8: start network... 08:04:25.323780 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:04:25.813840 run create_hlr_db(pid=14529): Launched 08:04:25.931840 bus /gobi_6: Setting Powered False 08:04:26.991552 run create_hlr_db(pid=14529): Terminated: ok {rc=0} 08:04:27.401778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14531): Launched 08:04:27.695967 run osmo-hlr_10.42.42.2(pid=14532): Launched 08:04:27.808681 run osmo-stp_10.42.42.5: Starting osmo-stp 08:04:28.330353 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14534): Launched 08:04:28.625178 run osmo-stp_10.42.42.5(pid=14535): Launched 08:04:28.738196 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:04:29.246158 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14537): Launched 08:04:29.359520 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:04:29.607943 run patchelf(pid=14538): Launched 08:04:29.772249 run osmo-stp_10.42.42.5(pid=14535): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14535)] 08:04:29.897443 run osmo-stp_10.42.42.5(pid=14535): stdout: | (launched: 2022-12-10_08:04:28.570904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:30.024005 run osmo-stp_10.42.42.5(pid=14535): stderr: | [0;m[38;5;43m20221210080428739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080428739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080428739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080428739 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080428742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080428742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080428742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:30.151513 run osmo-stp_10.42.42.5(pid=14535): stdout: | (launched: 2022-12-10_08:04:28.570904) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:30.272188 run osmo-stp_10.42.42.5(pid=14535): stderr: | [0;m[38;5;43m20221210080428739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080428739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080428739 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080428739 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080428742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080428742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080428742 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:30.415171 run patchelf(pid=14538): Terminating (SIGINT) 08:04:30.582391 run patchelf(pid=14538): Terminated: ok {rc=0} 08:04:30.703057 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14535): Process ended prematurely: osmo-stp_10.42.42.5(pid=14535) [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14535)] [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8] 08:04:30.712266 tst iperf3.py:8: Test FAILED (7.3 sec) 08:04:30.739547 run osmo-hlr_10.42.42.2(pid=14532): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14532)] 08:04:30.787250 run osmo-hlr_10.42.42.2(pid=14532): stdout: | (launched: 2022-12-10_08:04:27.642352) 08:04:30.845942 run osmo-hlr_10.42.42.2(pid=14532): stderr: | [0;m[1;31m20221210080427821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080427821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080427821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080427821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080427821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080427821 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080427838 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-900+mod-bts0-egprs/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080427847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080427847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080427847 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:04:30.913354 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14527): Terminating (SIGTERM) 08:04:30.959687 run iperf3-srv_10.42.42.10(pid=14528): Terminating (SIGTERM) 08:04:31.002838 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14531): Terminating (SIGTERM) 08:04:31.067391 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14534): Terminating (SIGTERM) 08:04:31.113939 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14537): Terminating (SIGTERM) 08:04:31.159529 --- ParallelTerminationStrategy: PID 14527 died... 08:04:31.180624 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14527): Terminated: ok {rc=0} 08:04:31.230381 --- ParallelTerminationStrategy: PID 14528 died... 08:04:31.250754 run iperf3-srv_10.42.42.10(pid=14528): Terminated {rc=256} 08:04:31.298262 --- ParallelTerminationStrategy: PID 14531 died... 08:04:31.318455 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14531): Terminated: ok {rc=0} 08:04:31.366626 --- ParallelTerminationStrategy: PID 14534 died... 08:04:31.388155 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14534): Terminated: ok {rc=0} 08:04:31.438271 --- ParallelTerminationStrategy: PID 14537 died... 08:04:31.459110 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14537): Terminated: ok {rc=0} 08:04:31.551222 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-900+mod-bts0-egprs iperf3m4.py ---------------------------------------------- 08:04:32.700856 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:32.712857 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:04:32.769097 tst iperf3m4.py: using LAC 27001 08:04:32.892198 tst iperf3m4.py: using RAC 226 08:04:33.016853 tst iperf3m4.py: using CellId 27001 08:04:33.139172 tst iperf3m4.py: using BVCI 27002 08:04:33.253743 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:33.265141 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:33.276424 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:33.287833 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:33.298974 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:33.310173 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:33.321599 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:33.332685 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:33.344152 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:04:33.466524 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:04:33.583378 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:04:33.701929 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:04:33.820813 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:04:34.019329 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:04:34.315266 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14539): Launched 08:04:34.572054 run iperf3-srv_10.42.42.10(pid=14540): Launched 08:04:34.683091 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:04:34.880022 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:04:35.175028 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14541): Launched 08:04:35.431305 run iperf3-srv_10.42.42.10(pid=14542): Launched 08:04:35.542418 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:04:35.739466 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:04:36.034227 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14543): Launched 08:04:36.290664 run iperf3-srv_10.42.42.10(pid=14544): Launched 08:04:36.401261 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:04:36.598083 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:04:36.893657 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14545): Launched 08:04:37.150338 run iperf3-srv_10.42.42.10(pid=14546): Launched 08:04:37.260731 tst iperf3m4.py:8: start network... 08:04:37.457397 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:04:37.912287 run create_hlr_db(pid=14547): Launched 08:04:38.025633 bus /gobi_6: Setting Powered False 08:04:39.084862 run create_hlr_db(pid=14547): Terminated: ok {rc=0} 08:04:39.517103 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14549): Launched 08:04:39.834211 run osmo-hlr_10.42.42.2(pid=14550): Launched 08:04:39.956027 run osmo-stp_10.42.42.5: Starting osmo-stp 08:04:40.501017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14552): Launched 08:04:40.816333 run osmo-stp_10.42.42.5(pid=14553): Launched 08:04:40.936660 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:04:41.482040 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14555): Launched 08:04:41.603784 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:04:41.870464 run patchelf(pid=14556): Launched 08:04:42.047236 run osmo-stp_10.42.42.5(pid=14553): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14553)] 08:04:42.180803 run osmo-stp_10.42.42.5(pid=14553): stdout: | (launched: 2022-12-10_08:04:40.758774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:42.316313 run osmo-stp_10.42.42.5(pid=14553): stderr: | [0;m[38;5;43m20221210080440950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080440950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080440950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080440951 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080440951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080440951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080440951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:42.451828 run osmo-stp_10.42.42.5(pid=14553): stdout: | (launched: 2022-12-10_08:04:40.758774) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:42.581182 run osmo-stp_10.42.42.5(pid=14553): stderr: | [0;m[38;5;43m20221210080440950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080440950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080440950 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080440951 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080440951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080440951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080440951 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:42.734296 run patchelf(pid=14556): Terminating (SIGINT) 08:04:42.911850 run patchelf(pid=14556): Terminated: ok {rc=0} 08:04:43.040264 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14553): Process ended prematurely: osmo-stp_10.42.42.5(pid=14553) [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14553)] [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8] 08:04:43.050279 tst iperf3m4.py:8: Test FAILED (10.4 sec) 08:04:43.079152 run osmo-hlr_10.42.42.2(pid=14550): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14550)] 08:04:43.128642 run osmo-hlr_10.42.42.2(pid=14550): stdout: | (launched: 2022-12-10_08:04:39.776780) 08:04:43.179975 run osmo-hlr_10.42.42.2(pid=14550): stderr: | [0;m[1;31m20221210080439973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080439973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080439973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080439973 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080439974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080439974 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080439986 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-900+mod-bts0-egprs/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080439994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080439994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080439994 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:04:43.231910 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14539): Terminating (SIGTERM) 08:04:43.273685 run iperf3-srv_10.42.42.10(pid=14540): Terminating (SIGTERM) 08:04:43.315594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14541): Terminating (SIGTERM) 08:04:43.357563 run iperf3-srv_10.42.42.10(pid=14542): Terminating (SIGTERM) 08:04:43.399101 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14543): Terminating (SIGTERM) 08:04:43.440800 run iperf3-srv_10.42.42.10(pid=14544): Terminating (SIGTERM) 08:04:43.482272 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14545): Terminating (SIGTERM) 08:04:43.523858 run iperf3-srv_10.42.42.10(pid=14546): Terminating (SIGTERM) 08:04:43.565363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14549): Terminating (SIGTERM) 08:04:43.607122 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14552): Terminating (SIGTERM) 08:04:43.648849 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14555): Terminating (SIGTERM) 08:04:43.691090 --- ParallelTerminationStrategy: PID 14539 died... 08:04:43.711197 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14539): Terminated: ok {rc=0} 08:04:43.757335 --- ParallelTerminationStrategy: PID 14540 died... 08:04:43.776895 run iperf3-srv_10.42.42.10(pid=14540): Terminated {rc=256} 08:04:43.822731 --- ParallelTerminationStrategy: PID 14541 died... 08:04:43.842320 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14541): Terminated: ok {rc=0} 08:04:43.888122 --- ParallelTerminationStrategy: PID 14542 died... 08:04:43.907734 run iperf3-srv_10.42.42.10(pid=14542): Terminated {rc=256} 08:04:43.953361 --- ParallelTerminationStrategy: PID 14543 died... 08:04:43.973221 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14543): Terminated: ok {rc=0} 08:04:44.019291 --- ParallelTerminationStrategy: PID 14544 died... 08:04:44.038856 run iperf3-srv_10.42.42.10(pid=14544): Terminated {rc=256} 08:04:44.084891 --- ParallelTerminationStrategy: PID 14545 died... 08:04:44.104525 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14545): Terminated: ok {rc=0} 08:04:44.150602 --- ParallelTerminationStrategy: PID 14546 died... 08:04:44.170250 run iperf3-srv_10.42.42.10(pid=14546): Terminated {rc=256} 08:04:44.216329 --- ParallelTerminationStrategy: PID 14549 died... 08:04:44.235850 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14549): Terminated: ok {rc=0} 08:04:44.281865 --- ParallelTerminationStrategy: PID 14552 died... 08:04:44.301575 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14552): Terminated: ok {rc=0} 08:04:44.347714 --- ParallelTerminationStrategy: PID 14555 died... 08:04:44.367417 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14555): Terminated: ok {rc=0} 08:04:44.455088 bus /gobi_4: Setting Powered False 08:04:45.554400 bus /gobi_4: Setting Powered False 08:04:46.670370 bus /gobi_1: Setting Powered False 08:04:47.768448 bus /gobi_1: Setting Powered False 08:04:48.885241 bus /gobi_0: Setting Powered False 08:04:49.983902 bus /gobi_0: Setting Powered False 08:04:51.101841 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-900+mod-bts0-egprs ping.py ---------------------------------------------- 08:04:52.205214 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:52.217618 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:04:52.268484 tst ping.py: using LAC 27002 08:04:52.392531 tst ping.py: using RAC 227 08:04:52.507599 tst ping.py: using CellId 27002 08:04:52.620784 tst ping.py: using BVCI 27003 08:04:52.726159 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:52.736911 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:52.747525 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:52.758593 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:52.769482 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:52.780175 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:52.791173 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:04:52.802096 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:04:52.915913 tst ping.py:19: start network... 08:04:53.109064 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:04:53.555610 run create_hlr_db(pid=14557): Launched 08:04:53.666305 bus /gobi_6: Setting Powered False 08:04:54.724597 run create_hlr_db(pid=14557): Terminated: ok {rc=0} 08:04:55.150978 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14559): Launched 08:04:55.461286 run osmo-hlr_10.42.42.2(pid=14560): Launched 08:04:55.581152 run osmo-stp_10.42.42.5: Starting osmo-stp 08:04:56.120430 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14562): Launched 08:04:56.431552 run osmo-stp_10.42.42.5(pid=14563): Launched 08:04:56.550999 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:04:57.087391 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14565): Launched 08:04:57.206435 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:04:57.468555 run patchelf(pid=14566): Launched 08:04:57.642309 run osmo-stp_10.42.42.5(pid=14563): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14563)] 08:04:57.774456 run osmo-stp_10.42.42.5(pid=14563): stdout: | (launched: 2022-12-10_08:04:56.374844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:57.908078 run osmo-stp_10.42.42.5(pid=14563): stderr: | [0;m[38;5;43m20221210080456563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080456563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080456563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080456564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080456564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080456564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080456564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:58.041859 run osmo-stp_10.42.42.5(pid=14563): stdout: | (launched: 2022-12-10_08:04:56.374844) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:04:58.169299 run osmo-stp_10.42.42.5(pid=14563): stderr: | [0;m[38;5;43m20221210080456563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080456563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080456563 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080456564 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080456564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080456564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080456564 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:04:58.320315 run patchelf(pid=14566): Terminating (SIGINT) 08:04:58.495330 run patchelf(pid=14566): Terminated: ok {rc=0} 08:04:58.621552 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14563): Process ended prematurely: osmo-stp_10.42.42.5(pid=14563) [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14563)] [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22] 08:04:58.630799 tst ping.py:22: Test FAILED (6.4 sec) 08:04:58.658709 run osmo-hlr_10.42.42.2(pid=14560): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14560)] 08:04:58.708365 run osmo-hlr_10.42.42.2(pid=14560): stdout: | (launched: 2022-12-10_08:04:55.404810) 08:04:58.759814 run osmo-hlr_10.42.42.2(pid=14560): stderr: | [0;m[1;31m20221210080455599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080455599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080455599 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080455600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080455600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080455600 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080455618 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-900+mod-bts0-egprs/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080455626 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080455627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080455627 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:04:58.811567 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14559): Terminating (SIGTERM) 08:04:58.853336 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14562): Terminating (SIGTERM) 08:04:58.895230 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14565): Terminating (SIGTERM) 08:04:58.937384 --- ParallelTerminationStrategy: PID 14559 died... 08:04:58.957469 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14559): Terminated: ok {rc=0} 08:04:59.004090 --- ParallelTerminationStrategy: PID 14562 died... 08:04:59.023919 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14562): Terminated: ok {rc=0} 08:04:59.070273 --- ParallelTerminationStrategy: PID 14565 died... 08:04:59.090296 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14565): Terminated: ok {rc=0} 08:04:59.177431 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-900+mod-bts0-egprs ping_idle_ping.py ---------------------------------------------- 08:05:00.263125 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:05:00.275029 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x bts (candidates: 1) 08:05:00.326481 tst ping_idle_ping.py: using LAC 27003 08:05:00.451959 tst ping_idle_ping.py: using RAC 228 08:05:00.577917 tst ping_idle_ping.py: using CellId 27003 08:05:00.699853 tst ping_idle_ping.py: using BVCI 27004 08:05:00.814015 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:05:00.825362 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:05:00.839920 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:05:00.851883 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:05:00.864149 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:05:00.883101 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:05:00.901763 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x ip_address (candidates: 9) 08:05:00.914905 tst gprs:nanobts+band-900+mod-bts0-egprs: Using 1 x modem (candidates: 4) 08:05:01.036359 tst ping_idle_ping.py:24: start network... 08:05:01.238410 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:05:01.745079 run create_hlr_db(pid=14570): Launched 08:05:01.920387 bus /gobi_6: Setting Powered False 08:05:02.982582 run create_hlr_db(pid=14570): Terminated: ok {rc=0} 08:05:03.418247 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14572): Launched 08:05:03.730202 run osmo-hlr_10.42.42.2(pid=14573): Launched 08:05:03.849301 run osmo-stp_10.42.42.5: Starting osmo-stp 08:05:04.384461 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14575): Launched 08:05:04.695642 run osmo-stp_10.42.42.5(pid=14576): Launched 08:05:04.814855 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:05:05.354073 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14578): Launched 08:05:05.473448 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:05:05.736799 run patchelf(pid=14579): Launched 08:05:05.911085 run osmo-stp_10.42.42.5(pid=14576): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14576)] 08:05:06.042962 run osmo-stp_10.42.42.5(pid=14576): stdout: | (launched: 2022-12-10_08:05:04.638879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:06.176312 run osmo-stp_10.42.42.5(pid=14576): stderr: | [0;m[38;5;43m20221210080504830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080504830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080504830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080504831 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080504833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080504833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080504833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:06.309587 run osmo-stp_10.42.42.5(pid=14576): stdout: | (launched: 2022-12-10_08:05:04.638879) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:06.436791 run osmo-stp_10.42.42.5(pid=14576): stderr: | [0;m[38;5;43m20221210080504830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080504830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080504830 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080504831 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080504833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080504833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080504833 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:06.587704 run patchelf(pid=14579): Terminating (SIGINT) 08:05:06.762429 run patchelf(pid=14579): Terminated: ok {rc=0} 08:05:06.888036 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14576): Process ended prematurely: osmo-stp_10.42.42.5(pid=14576) [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14576)] [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27] 08:05:06.897518 tst ping_idle_ping.py:27: Test FAILED (6.6 sec) 08:05:06.925327 run osmo-hlr_10.42.42.2(pid=14573): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14573)] 08:05:06.975078 run osmo-hlr_10.42.42.2(pid=14573): stdout: | (launched: 2022-12-10_08:05:03.673504) 08:05:07.026374 run osmo-hlr_10.42.42.2(pid=14573): stderr: | [0;m[1;31m20221210080503869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080503869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080503869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080503869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080503869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080503869 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080503883 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-900+mod-bts0-egprs/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080503893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080503893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080503893 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:05:07.078044 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14572): Terminating (SIGTERM) 08:05:07.119502 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14575): Terminating (SIGTERM) 08:05:07.161256 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14578): Terminating (SIGTERM) 08:05:07.203296 --- ParallelTerminationStrategy: PID 14572 died... 08:05:07.223550 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14572): Terminated: ok {rc=0} 08:05:07.270107 --- ParallelTerminationStrategy: PID 14575 died... 08:05:07.289924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14575): Terminated: ok {rc=0} 08:05:07.336184 --- ParallelTerminationStrategy: PID 14578 died... 08:05:07.356016 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14578): Terminated: ok {rc=0} 08:05:07.443587 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:nanobts+band-900+mod-bts0-egprs FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:nanobts+band-900+mod-bts0-dynts-ipa --------------------------------------------------------------------- 08:05:08.750815 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:05:08.758219 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 1 x bts (candidates: 11) 08:05:08.791008 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 9 x ip_address (candidates: 9) 08:05:08.830120 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Verifying 4 x modem (candidates: 12) 08:05:08.919272 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 1 x bts (candidates: 11) 08:05:08.952236 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 9 x ip_address (candidates: 9) 08:05:08.990529 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Reserving 4 x modem (candidates: 12) 08:05:09.580193 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:nanobts+band-900+mod-bts0-dynts-ipa cs_paging_gprs_active.py ---------------------------------------------- 08:05:09.632661 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:09.644047 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:05:09.715030 tst cs_paging_gprs_active.py: using LAC 27004 08:05:09.830352 tst cs_paging_gprs_active.py: using RAC 229 08:05:09.946707 tst cs_paging_gprs_active.py: using CellId 27004 08:05:10.060719 tst cs_paging_gprs_active.py: using BVCI 27005 08:05:10.167630 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:10.178595 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:10.189509 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:10.200110 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:10.210871 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:10.222002 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:10.233175 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:10.244127 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:10.255170 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:05:10.373882 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:05:10.489440 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:05:10.687160 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:05:10.981714 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14583): Launched 08:05:11.238471 run iperf3-srv_10.42.42.10(pid=14584): Launched 08:05:11.349471 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:05:11.546678 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:05:11.842399 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14585): Launched 08:05:12.099406 run iperf3-srv_10.42.42.10(pid=14586): Launched 08:05:12.210513 tst cs_paging_gprs_active.py:38: start network... 08:05:12.407352 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:05:12.862233 run create_hlr_db(pid=14587): Launched 08:05:12.975612 bus /gobi_6: Setting Powered False 08:05:14.034872 run create_hlr_db(pid=14587): Terminated: ok {rc=0} 08:05:14.466363 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14589): Launched 08:05:14.761165 run osmo-hlr_10.42.42.2(pid=14590): Launched 08:05:14.874534 run osmo-stp_10.42.42.5: Starting osmo-stp 08:05:15.394578 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14592): Launched 08:05:15.689691 run osmo-stp_10.42.42.5(pid=14593): Launched 08:05:15.803296 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:05:16.430529 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14595): Launched 08:05:16.564312 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:05:16.848425 run patchelf(pid=14596): Launched 08:05:17.077619 run osmo-stp_10.42.42.5(pid=14593): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14593)] 08:05:17.213721 run osmo-stp_10.42.42.5(pid=14593): stdout: | (launched: 2022-12-10_08:05:15.635746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:17.349865 run osmo-stp_10.42.42.5(pid=14593): stderr: | [0;m[38;5;43m20221210080515805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080515805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080515805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080515806 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080515806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080515806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080515806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:17.485671 run osmo-stp_10.42.42.5(pid=14593): stdout: | (launched: 2022-12-10_08:05:15.635746) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:17.615587 run osmo-stp_10.42.42.5(pid=14593): stderr: | [0;m[38;5;43m20221210080515805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080515805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080515805 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080515806 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080515806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080515806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080515806 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:17.768931 run patchelf(pid=14596): Terminating (SIGINT) 08:05:17.947607 run patchelf(pid=14596): Terminated: ok {rc=0} 08:05:18.076651 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14593): Process ended prematurely: osmo-stp_10.42.42.5(pid=14593) [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14593)] [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38] 08:05:18.086549 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 08:05:18.114832 run osmo-hlr_10.42.42.2(pid=14590): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14590)] 08:05:18.164583 run osmo-hlr_10.42.42.2(pid=14590): stdout: | (launched: 2022-12-10_08:05:14.707349) 08:05:18.216089 run osmo-hlr_10.42.42.2(pid=14590): stderr: | [0;m[1;31m20221210080514885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080514885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080514885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080514885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080514885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080514885 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080514896 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-900+mod-bts0-dynts-ipa/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080514904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080514904 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080514905 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:05:18.267854 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14583): Terminating (SIGTERM) 08:05:18.309182 run iperf3-srv_10.42.42.10(pid=14584): Terminating (SIGTERM) 08:05:18.350545 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14585): Terminating (SIGTERM) 08:05:18.391981 run iperf3-srv_10.42.42.10(pid=14586): Terminating (SIGTERM) 08:05:18.433432 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14589): Terminating (SIGTERM) 08:05:18.474874 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14592): Terminating (SIGTERM) 08:05:18.516209 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14595): Terminating (SIGTERM) 08:05:18.558197 --- ParallelTerminationStrategy: PID 14583 died... 08:05:18.577998 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14583): Terminated: ok {rc=0} 08:05:18.623818 --- ParallelTerminationStrategy: PID 14584 died... 08:05:18.643494 run iperf3-srv_10.42.42.10(pid=14584): Terminated {rc=256} 08:05:18.689441 --- ParallelTerminationStrategy: PID 14585 died... 08:05:18.709077 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14585): Terminated: ok {rc=0} 08:05:18.754740 --- ParallelTerminationStrategy: PID 14586 died... 08:05:18.774360 run iperf3-srv_10.42.42.10(pid=14586): Terminated {rc=256} 08:05:18.820155 --- ParallelTerminationStrategy: PID 14589 died... 08:05:18.839622 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14589): Terminated: ok {rc=0} 08:05:18.885402 --- ParallelTerminationStrategy: PID 14592 died... 08:05:18.905191 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14592): Terminated: ok {rc=0} 08:05:18.950935 --- ParallelTerminationStrategy: PID 14595 died... 08:05:18.970520 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14595): Terminated: ok {rc=0} 08:05:19.058486 bus /gobi_0: Setting Powered False 08:05:20.157278 bus /gobi_0: Setting Powered False 08:05:21.273463 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3.py ---------------------------------------------- 08:05:22.417557 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:22.429121 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:05:22.498409 tst iperf3.py: using LAC 27005 08:05:22.615229 tst iperf3.py: using RAC 230 08:05:22.733378 tst iperf3.py: using CellId 27005 08:05:22.851567 tst iperf3.py: using BVCI 27006 08:05:22.959856 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:22.970870 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:22.981614 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:22.992288 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:23.003083 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:23.013953 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:23.025233 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:23.036089 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:23.047258 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:05:23.161627 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:05:23.359937 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:05:23.656215 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14597): Launched 08:05:23.914082 run iperf3-srv_10.42.42.10(pid=14598): Launched 08:05:24.024862 tst iperf3.py:8: start network... 08:05:24.221954 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:05:24.676519 run create_hlr_db(pid=14599): Launched 08:05:24.788584 bus /gobi_6: Setting Powered False 08:05:25.849362 run create_hlr_db(pid=14599): Terminated: ok {rc=0} 08:05:26.282998 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14601): Launched 08:05:26.599814 run osmo-hlr_10.42.42.2(pid=14602): Launched 08:05:26.721491 run osmo-stp_10.42.42.5: Starting osmo-stp 08:05:27.264842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14604): Launched 08:05:27.580020 run osmo-stp_10.42.42.5(pid=14605): Launched 08:05:27.700717 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:05:28.245392 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14607): Launched 08:05:28.366731 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:05:28.633679 run patchelf(pid=14608): Launched 08:05:28.809754 run osmo-stp_10.42.42.5(pid=14605): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14605)] 08:05:28.943377 run osmo-stp_10.42.42.5(pid=14605): stdout: | (launched: 2022-12-10_08:05:27.522821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:29.079815 run osmo-stp_10.42.42.5(pid=14605): stderr: | [0;m[38;5;43m20221210080527713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080527713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080527713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080527714 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080527714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080527714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080527714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:29.215452 run osmo-stp_10.42.42.5(pid=14605): stdout: | (launched: 2022-12-10_08:05:27.522821) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:29.345256 run osmo-stp_10.42.42.5(pid=14605): stderr: | [0;m[38;5;43m20221210080527713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080527713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080527713 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080527714 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080527714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080527714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080527714 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:29.499262 run patchelf(pid=14608): Terminating (SIGINT) 08:05:29.677146 run patchelf(pid=14608): Terminated: ok {rc=0} 08:05:29.805594 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14605): Process ended prematurely: osmo-stp_10.42.42.5(pid=14605) [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14605)] [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8] 08:05:29.815513 tst iperf3.py:8: Test FAILED (7.4 sec) 08:05:29.843805 run osmo-hlr_10.42.42.2(pid=14602): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14602)] 08:05:29.893140 run osmo-hlr_10.42.42.2(pid=14602): stdout: | (launched: 2022-12-10_08:05:26.542465) 08:05:29.944099 run osmo-hlr_10.42.42.2(pid=14602): stderr: | [0;m[1;31m20221210080526739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080526739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080526739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080526739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080526739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080526739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080526751 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080526759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080526760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080526760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:05:29.996230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14597): Terminating (SIGTERM) 08:05:30.038245 run iperf3-srv_10.42.42.10(pid=14598): Terminating (SIGTERM) 08:05:30.079774 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14601): Terminating (SIGTERM) 08:05:30.121455 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14604): Terminating (SIGTERM) 08:05:30.163051 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14607): Terminating (SIGTERM) 08:05:30.205147 --- ParallelTerminationStrategy: PID 14597 died... 08:05:30.225240 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14597): Terminated: ok {rc=0} 08:05:30.271459 --- ParallelTerminationStrategy: PID 14598 died... 08:05:30.291138 run iperf3-srv_10.42.42.10(pid=14598): Terminated {rc=256} 08:05:30.337308 --- ParallelTerminationStrategy: PID 14601 died... 08:05:30.357083 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14601): Terminated: ok {rc=0} 08:05:30.403010 --- ParallelTerminationStrategy: PID 14604 died... 08:05:30.422716 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14604): Terminated: ok {rc=0} 08:05:30.468858 --- ParallelTerminationStrategy: PID 14607 died... 08:05:30.489086 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14607): Terminated: ok {rc=0} 08:05:30.577422 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-900+mod-bts0-dynts-ipa iperf3m4.py ---------------------------------------------- 08:05:31.728253 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:31.741238 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:05:31.811791 tst iperf3m4.py: using LAC 27006 08:05:31.939370 tst iperf3m4.py: using RAC 231 08:05:32.059742 tst iperf3m4.py: using CellId 27006 08:05:32.206542 tst iperf3m4.py: using BVCI 27007 08:05:32.317973 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:32.328804 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:32.339656 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:32.350431 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:32.361193 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:32.372648 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:32.384418 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:32.395834 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:32.407478 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:05:32.524255 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:05:32.648013 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:05:32.767950 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:05:32.883982 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:05:33.082966 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:05:33.380242 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14609): Launched 08:05:33.637944 run iperf3-srv_10.42.42.10(pid=14610): Launched 08:05:33.749750 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:05:33.947168 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:05:34.243902 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14611): Launched 08:05:34.501473 run iperf3-srv_10.42.42.10(pid=14612): Launched 08:05:34.612465 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:05:34.809913 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:05:35.106283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14613): Launched 08:05:35.363542 run iperf3-srv_10.42.42.10(pid=14614): Launched 08:05:35.474930 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:05:35.672559 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:05:35.968932 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14615): Launched 08:05:36.227200 run iperf3-srv_10.42.42.10(pid=14616): Launched 08:05:36.338075 tst iperf3m4.py:8: start network... 08:05:36.535069 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:05:36.990460 run create_hlr_db(pid=14617): Launched 08:05:37.104245 bus /gobi_6: Setting Powered False 08:05:38.162053 run create_hlr_db(pid=14617): Terminated: ok {rc=0} 08:05:38.573893 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14619): Launched 08:05:38.869345 run osmo-hlr_10.42.42.2(pid=14620): Launched 08:05:38.982927 run osmo-stp_10.42.42.5: Starting osmo-stp 08:05:39.507344 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14622): Launched 08:05:39.802674 run osmo-stp_10.42.42.5(pid=14623): Launched 08:05:39.916200 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:05:40.426423 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14625): Launched 08:05:40.539503 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:05:40.788355 run patchelf(pid=14626): Launched 08:05:40.953784 run osmo-stp_10.42.42.5(pid=14623): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14623)] 08:05:41.078772 run osmo-stp_10.42.42.5(pid=14623): stdout: | (launched: 2022-12-10_08:05:39.748406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:41.205269 run osmo-stp_10.42.42.5(pid=14623): stderr: | [0;m[38;5;43m20221210080539918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080539919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080539919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080539919 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080539920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080539920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080539920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:41.331807 run osmo-stp_10.42.42.5(pid=14623): stdout: | (launched: 2022-12-10_08:05:39.748406) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:41.452388 run osmo-stp_10.42.42.5(pid=14623): stderr: | [0;m[38;5;43m20221210080539918 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080539919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080539919 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080539919 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080539920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080539920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080539920 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:41.595061 run patchelf(pid=14626): Terminating (SIGINT) 08:05:41.761800 run patchelf(pid=14626): Terminated: ok {rc=0} 08:05:41.882247 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14623): Process ended prematurely: osmo-stp_10.42.42.5(pid=14623) [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14623)] [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8] 08:05:41.891599 tst iperf3m4.py:8: Test FAILED (10.2 sec) 08:05:41.918764 run osmo-hlr_10.42.42.2(pid=14620): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14620)] 08:05:41.966836 run osmo-hlr_10.42.42.2(pid=14620): stdout: | (launched: 2022-12-10_08:05:38.815101) 08:05:42.016165 run osmo-hlr_10.42.42.2(pid=14620): stderr: | [0;m[1;31m20221210080538991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080538991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080538991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080538991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080538991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080538991 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080539006 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-900+mod-bts0-dynts-ipa/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080539016 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080539017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080539017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:05:42.065997 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14609): Terminating (SIGTERM) 08:05:42.106021 run iperf3-srv_10.42.42.10(pid=14610): Terminating (SIGTERM) 08:05:42.145654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14611): Terminating (SIGTERM) 08:05:42.185379 run iperf3-srv_10.42.42.10(pid=14612): Terminating (SIGTERM) 08:05:42.224888 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14613): Terminating (SIGTERM) 08:05:42.264454 run iperf3-srv_10.42.42.10(pid=14614): Terminating (SIGTERM) 08:05:42.304053 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14615): Terminating (SIGTERM) 08:05:42.343698 run iperf3-srv_10.42.42.10(pid=14616): Terminating (SIGTERM) 08:05:42.383060 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14619): Terminating (SIGTERM) 08:05:42.422607 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14622): Terminating (SIGTERM) 08:05:42.462019 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14625): Terminating (SIGTERM) 08:05:42.501842 --- ParallelTerminationStrategy: PID 14609 died... 08:05:42.521117 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14609): Terminated: ok {rc=0} 08:05:42.565433 --- ParallelTerminationStrategy: PID 14610 died... 08:05:42.584162 run iperf3-srv_10.42.42.10(pid=14610): Terminated {rc=256} 08:05:42.628084 --- ParallelTerminationStrategy: PID 14611 died... 08:05:42.647002 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14611): Terminated: ok {rc=0} 08:05:42.690992 --- ParallelTerminationStrategy: PID 14612 died... 08:05:42.710259 run iperf3-srv_10.42.42.10(pid=14612): Terminated {rc=256} 08:05:42.754023 --- ParallelTerminationStrategy: PID 14613 died... 08:05:42.772654 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14613): Terminated: ok {rc=0} 08:05:42.817014 --- ParallelTerminationStrategy: PID 14614 died... 08:05:42.835944 run iperf3-srv_10.42.42.10(pid=14614): Terminated {rc=256} 08:05:42.879802 --- ParallelTerminationStrategy: PID 14615 died... 08:05:42.898783 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14615): Terminated: ok {rc=0} 08:05:42.942708 --- ParallelTerminationStrategy: PID 14616 died... 08:05:42.961243 run iperf3-srv_10.42.42.10(pid=14616): Terminated {rc=256} 08:05:43.005229 --- ParallelTerminationStrategy: PID 14619 died... 08:05:43.023701 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14619): Terminated: ok {rc=0} 08:05:43.067606 --- ParallelTerminationStrategy: PID 14622 died... 08:05:43.086228 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14622): Terminated: ok {rc=0} 08:05:43.130427 --- ParallelTerminationStrategy: PID 14625 died... 08:05:43.149092 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14625): Terminated: ok {rc=0} 08:05:43.233805 bus /gobi_4: Setting Powered False 08:05:44.331392 bus /gobi_4: Setting Powered False 08:05:45.447043 bus /gobi_1: Setting Powered False 08:05:46.543068 bus /gobi_1: Setting Powered False 08:05:47.657819 bus /gobi_0: Setting Powered False 08:05:48.755435 bus /gobi_0: Setting Powered False 08:05:49.869527 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping.py ---------------------------------------------- 08:05:50.972197 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:50.983829 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:05:51.050565 tst ping.py: using LAC 27007 08:05:51.166972 tst ping.py: using RAC 232 08:05:51.280635 tst ping.py: using CellId 27007 08:05:51.394044 tst ping.py: using BVCI 27008 08:05:51.498934 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:51.509935 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:51.520574 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:51.531377 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:51.542298 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:51.553037 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:51.564134 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:51.575083 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:05:51.692163 tst ping.py:19: start network... 08:05:51.901743 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:05:52.384739 run create_hlr_db(pid=14627): Launched 08:05:52.511375 bus /gobi_6: Setting Powered False 08:05:53.573440 run create_hlr_db(pid=14627): Terminated: ok {rc=0} 08:05:53.988151 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14629): Launched 08:05:54.278649 run osmo-hlr_10.42.42.2(pid=14630): Launched 08:05:54.390472 run osmo-stp_10.42.42.5: Starting osmo-stp 08:05:54.891832 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14632): Launched 08:05:55.181295 run osmo-stp_10.42.42.5(pid=14633): Launched 08:05:55.292268 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:05:55.792816 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14635): Launched 08:05:55.904280 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:05:56.148394 run patchelf(pid=14636): Launched 08:05:56.310397 run osmo-stp_10.42.42.5(pid=14633): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14633)] 08:05:56.433256 run osmo-stp_10.42.42.5(pid=14633): stdout: | (launched: 2022-12-10_08:05:55.128146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:56.557897 run osmo-stp_10.42.42.5(pid=14633): stderr: | [0;m[38;5;43m20221210080555295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080555295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080555295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080555296 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080555296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080555296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080555296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:56.682706 run osmo-stp_10.42.42.5(pid=14633): stdout: | (launched: 2022-12-10_08:05:55.128146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:05:56.801370 run osmo-stp_10.42.42.5(pid=14633): stderr: | [0;m[38;5;43m20221210080555295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080555295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080555295 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080555296 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080555296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080555296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080555296 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:05:56.942485 run patchelf(pid=14636): Terminating (SIGINT) 08:05:57.106549 run patchelf(pid=14636): Terminated: ok {rc=0} 08:05:57.225066 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14633): Process ended prematurely: osmo-stp_10.42.42.5(pid=14633) [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14633)] [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22] 08:05:57.233795 tst ping.py:22: Test FAILED (6.3 sec) 08:05:57.260270 run osmo-hlr_10.42.42.2(pid=14630): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14630)] 08:05:57.307826 run osmo-hlr_10.42.42.2(pid=14630): stdout: | (launched: 2022-12-10_08:05:54.225735) 08:05:57.356910 run osmo-hlr_10.42.42.2(pid=14630): stderr: | [0;m[1;31m20221210080554399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080554399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080554399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080554399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080554399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080554399 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080554411 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080554422 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080554423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080554423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:05:57.406133 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14629): Terminating (SIGTERM) 08:05:57.446216 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14632): Terminating (SIGTERM) 08:05:57.485911 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14635): Terminating (SIGTERM) 08:05:57.526000 --- ParallelTerminationStrategy: PID 14629 died... 08:05:57.545371 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14629): Terminated: ok {rc=0} 08:05:57.589563 --- ParallelTerminationStrategy: PID 14632 died... 08:05:57.608116 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14632): Terminated: ok {rc=0} 08:05:57.652580 --- ParallelTerminationStrategy: PID 14635 died... 08:05:57.671318 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14635): Terminated: ok {rc=0} 08:05:57.755850 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-900+mod-bts0-dynts-ipa ping_idle_ping.py ---------------------------------------------- 08:05:58.842304 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:58.854771 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x bts (candidates: 1) 08:05:58.925209 tst ping_idle_ping.py: using LAC 27008 08:05:59.047119 tst ping_idle_ping.py: using RAC 233 08:05:59.169032 tst ping_idle_ping.py: using CellId 27008 08:05:59.292128 tst ping_idle_ping.py: using BVCI 27009 08:05:59.405188 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:59.416469 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:59.427677 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:59.438965 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:59.450113 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:59.461355 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:59.472617 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x ip_address (candidates: 9) 08:05:59.483794 tst gprs:nanobts+band-900+mod-bts0-dynts-ipa: Using 1 x modem (candidates: 4) 08:05:59.599322 tst ping_idle_ping.py:24: start network... 08:05:59.809783 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:06:00.296554 run create_hlr_db(pid=14637): Launched 08:06:00.424724 bus /gobi_6: Setting Powered False 08:06:01.489365 run create_hlr_db(pid=14637): Terminated: ok {rc=0} 08:06:02.094857 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14641): Launched 08:06:02.417718 run osmo-hlr_10.42.42.2(pid=14642): Launched 08:06:02.538403 run osmo-stp_10.42.42.5: Starting osmo-stp 08:06:03.076662 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14644): Launched 08:06:03.388331 run osmo-stp_10.42.42.5(pid=14645): Launched 08:06:03.507933 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:06:04.046280 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14647): Launched 08:06:04.165642 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:06:04.429031 run patchelf(pid=14648): Launched 08:06:04.603323 run osmo-stp_10.42.42.5(pid=14645): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14645)] 08:06:04.735500 run osmo-stp_10.42.42.5(pid=14645): stdout: | (launched: 2022-12-10_08:06:03.331562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:04.869513 run osmo-stp_10.42.42.5(pid=14645): stderr: | [0;m[38;5;43m20221210080603523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080603523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080603523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080603524 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080603524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080603524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080603524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:05.003777 run osmo-stp_10.42.42.5(pid=14645): stdout: | (launched: 2022-12-10_08:06:03.331562) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:05.132440 run osmo-stp_10.42.42.5(pid=14645): stderr: | [0;m[38;5;43m20221210080603523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080603523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080603523 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080603524 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080603524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080603524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080603524 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:05.284157 run patchelf(pid=14648): Terminating (SIGINT) 08:06:05.459927 run patchelf(pid=14648): Terminated: ok {rc=0} 08:06:05.586314 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14645): Process ended prematurely: osmo-stp_10.42.42.5(pid=14645) [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14645)] [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27] 08:06:05.595688 tst ping_idle_ping.py:27: Test FAILED (6.7 sec) 08:06:05.623582 run osmo-hlr_10.42.42.2(pid=14642): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14642)] 08:06:05.672763 run osmo-hlr_10.42.42.2(pid=14642): stdout: | (launched: 2022-12-10_08:06:02.361034) 08:06:05.723671 run osmo-hlr_10.42.42.2(pid=14642): stderr: | [0;m[1;31m20221210080602558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080602558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080602558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080602558 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080602559 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080602559 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080602571 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-900+mod-bts0-dynts-ipa/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080602581 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080602582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080602582 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:06:05.774853 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14641): Terminating (SIGTERM) 08:06:05.815911 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14644): Terminating (SIGTERM) 08:06:05.857177 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14647): Terminating (SIGTERM) 08:06:05.898889 --- ParallelTerminationStrategy: PID 14641 died... 08:06:05.918986 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14641): Terminated: ok {rc=0} 08:06:05.965075 --- ParallelTerminationStrategy: PID 14644 died... 08:06:05.984398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14644): Terminated: ok {rc=0} 08:06:06.030606 --- ParallelTerminationStrategy: PID 14647 died... 08:06:06.050240 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14647): Terminated: ok {rc=0} 08:06:06.137918 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:nanobts+band-900+mod-bts0-dynts-ipa FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend --------------------------------------------------------------------- 08:06:07.445344 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:06:07.452478 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 1 x bts (candidates: 11) 08:06:07.483895 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 9 x ip_address (candidates: 9) 08:06:07.524103 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Verifying 4 x modem (candidates: 12) 08:06:07.614898 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 1 x bts (candidates: 11) 08:06:07.648109 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 9 x ip_address (candidates: 9) 08:06:07.686249 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Reserving 4 x modem (candidates: 12) 08:06:08.277814 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: RESERVED RESOURCES for gprs: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 10.42.42.10 modem ec20_1 ec20_2 ec20_3 ec20_4 ---------------------------------------------- trial-2371 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend cs_paging_gprs_active.py ---------------------------------------------- 08:06:08.324646 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:08.337257 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:06:08.385363 tst cs_paging_gprs_active.py: using LAC 27009 08:06:08.498131 tst cs_paging_gprs_active.py: using RAC 234 08:06:08.610331 tst cs_paging_gprs_active.py: using CellId 27009 08:06:08.722955 tst cs_paging_gprs_active.py: using BVCI 27010 08:06:08.828419 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:08.839729 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:08.850881 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:08.862132 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:08.873404 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:08.884655 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:08.896521 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:08.907712 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:08.919310 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:06:09.038719 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:06:09.155829 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5003... 08:06:09.367392 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:06:09.680452 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14652): Launched 08:06:09.951620 run iperf3-srv_10.42.42.10(pid=14653): Launched 08:06:10.069729 tst cs_paging_gprs_active.py:38: start iperfv3 server 10.42.42.10:5004... 08:06:10.281210 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:06:10.594350 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14654): Launched 08:06:10.865274 run iperf3-srv_10.42.42.10(pid=14655): Launched 08:06:10.982312 tst cs_paging_gprs_active.py:38: start network... 08:06:11.193117 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:06:11.677086 run create_hlr_db(pid=14656): Launched 08:06:11.805638 bus /gobi_6: Setting Powered False 08:06:12.869336 run create_hlr_db(pid=14656): Terminated: ok {rc=0} 08:06:13.288732 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14658): Launched 08:06:13.603179 run osmo-hlr_10.42.42.2(pid=14659): Launched 08:06:13.723065 run osmo-stp_10.42.42.5: Starting osmo-stp 08:06:14.260085 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14661): Launched 08:06:14.572245 run osmo-stp_10.42.42.5(pid=14662): Launched 08:06:14.691532 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:06:15.232183 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14664): Launched 08:06:15.352585 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:06:15.615870 run patchelf(pid=14665): Launched 08:06:15.789516 run osmo-stp_10.42.42.5(pid=14662): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14662)] 08:06:15.941937 run osmo-stp_10.42.42.5(pid=14662): stdout: | (launched: 2022-12-10_08:06:14.515675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:16.074781 run osmo-stp_10.42.42.5(pid=14662): stderr: | [0;m[38;5;43m20221210080614708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080614708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080614709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080614709 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080614709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080614709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080614710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:16.207556 run osmo-stp_10.42.42.5(pid=14662): stdout: | (launched: 2022-12-10_08:06:14.515675) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:16.332921 run osmo-stp_10.42.42.5(pid=14662): stderr: | [0;m[38;5;43m20221210080614708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080614708 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080614709 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080614709 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080614709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080614709 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080614710 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:16.483823 run patchelf(pid=14665): Terminating (SIGINT) 08:06:16.658073 run patchelf(pid=14665): Terminated: ok {rc=0} 08:06:16.783776 tst cs_paging_gprs_active.py:38: ERR: Error: osmo-stp_10.42.42.5(pid=14662): Process ended prematurely: osmo-stp_10.42.42.5(pid=14662) [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14662)] [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38] 08:06:16.794590 tst cs_paging_gprs_active.py:38: Test FAILED (8.5 sec) 08:06:16.822890 run osmo-hlr_10.42.42.2(pid=14659): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py↪cs_paging_gprs_active.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14659)] 08:06:16.875765 run osmo-hlr_10.42.42.2(pid=14659): stdout: | (launched: 2022-12-10_08:06:13.546540) 08:06:16.928540 run osmo-hlr_10.42.42.2(pid=14659): stderr: | [0;m[1;31m20221210080613743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080613743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080613743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080613743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080613743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080613743 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080613756 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/cs_paging_gprs_active.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080613764 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080613765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080613765 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:06:16.981066 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14652): Terminating (SIGTERM) 08:06:17.024043 run iperf3-srv_10.42.42.10(pid=14653): Terminating (SIGTERM) 08:06:17.070656 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14654): Terminating (SIGTERM) 08:06:17.114061 run iperf3-srv_10.42.42.10(pid=14655): Terminating (SIGTERM) 08:06:17.159675 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14658): Terminating (SIGTERM) 08:06:17.201404 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14661): Terminating (SIGTERM) 08:06:17.242160 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14664): Terminating (SIGTERM) 08:06:17.283137 --- ParallelTerminationStrategy: PID 14652 died... 08:06:17.302956 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14652): Terminated: ok {rc=0} 08:06:17.347863 --- ParallelTerminationStrategy: PID 14653 died... 08:06:17.366617 run iperf3-srv_10.42.42.10(pid=14653): Terminated {rc=256} 08:06:17.412193 --- ParallelTerminationStrategy: PID 14654 died... 08:06:17.431883 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14654): Terminated: ok {rc=0} 08:06:17.476042 --- ParallelTerminationStrategy: PID 14655 died... 08:06:17.495622 run iperf3-srv_10.42.42.10(pid=14655): Terminated {rc=256} 08:06:17.541338 --- ParallelTerminationStrategy: PID 14658 died... 08:06:17.560442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14658): Terminated: ok {rc=0} 08:06:17.604650 --- ParallelTerminationStrategy: PID 14661 died... 08:06:17.623420 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14661): Terminated: ok {rc=0} 08:06:17.668200 --- ParallelTerminationStrategy: PID 14664 died... 08:06:17.687281 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14664): Terminated: ok {rc=0} 08:06:17.773872 bus /gobi_0: Setting Powered False 08:06:18.873415 bus /gobi_0: Setting Powered False 08:06:19.989437 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3.py ---------------------------------------------- 08:06:21.135381 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:21.147669 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:06:21.198325 tst iperf3.py: using LAC 27010 08:06:21.323219 tst iperf3.py: using RAC 235 08:06:21.445518 tst iperf3.py: using CellId 27010 08:06:21.569146 tst iperf3.py: using BVCI 27011 08:06:21.682110 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:21.693712 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:21.705332 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:21.716905 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:21.728393 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:21.739856 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:21.751413 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:21.762832 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:21.774760 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:06:21.905264 tst iperf3.py:8: start iperfv3 server 10.42.42.10:5003... 08:06:22.124758 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:06:22.437230 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14666): Launched 08:06:22.707434 run iperf3-srv_10.42.42.10(pid=14667): Launched 08:06:22.824532 tst iperf3.py:8: start network... 08:06:23.034149 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:06:23.516392 run create_hlr_db(pid=14668): Launched 08:06:23.643947 bus /gobi_6: Setting Powered False 08:06:24.706601 run create_hlr_db(pid=14668): Terminated: ok {rc=0} 08:06:25.125610 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14670): Launched 08:06:25.418516 run osmo-hlr_10.42.42.2(pid=14671): Launched 08:06:25.531742 run osmo-stp_10.42.42.5: Starting osmo-stp 08:06:26.034467 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14673): Launched 08:06:26.326997 run osmo-stp_10.42.42.5(pid=14674): Launched 08:06:26.439231 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:06:26.941731 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14676): Launched 08:06:27.054657 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:06:27.301410 run patchelf(pid=14677): Launched 08:06:27.465081 run osmo-stp_10.42.42.5(pid=14674): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14674)] 08:06:27.589858 run osmo-stp_10.42.42.5(pid=14674): stdout: | (launched: 2022-12-10_08:06:26.274091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:27.716283 run osmo-stp_10.42.42.5(pid=14674): stderr: | [0;m[38;5;43m20221210080626443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080626443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080626444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080626444 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080626445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080626445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080626445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:27.843474 run osmo-stp_10.42.42.5(pid=14674): stdout: | (launched: 2022-12-10_08:06:26.274091) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:27.964093 run osmo-stp_10.42.42.5(pid=14674): stderr: | [0;m[38;5;43m20221210080626443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080626443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080626444 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080626444 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080626445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080626445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080626445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:28.107317 run patchelf(pid=14677): Terminating (SIGINT) 08:06:28.273299 run patchelf(pid=14677): Terminated: ok {rc=0} 08:06:28.393222 tst iperf3.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14674): Process ended prematurely: osmo-stp_10.42.42.5(pid=14674) [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14674)] [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8] 08:06:28.402581 tst iperf3.py:8: Test FAILED (7.3 sec) 08:06:28.429241 run osmo-hlr_10.42.42.2(pid=14671): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py↪iperf3.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14671)] 08:06:28.477098 run osmo-hlr_10.42.42.2(pid=14671): stdout: | (launched: 2022-12-10_08:06:25.365721) 08:06:28.526378 run osmo-hlr_10.42.42.2(pid=14671): stderr: | [0;m[1;31m20221210080625541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080625541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080625541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080625541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080625541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080625541 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080625554 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080625563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080625563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080625563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:06:28.575983 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14666): Terminating (SIGTERM) 08:06:28.615623 run iperf3-srv_10.42.42.10(pid=14667): Terminating (SIGTERM) 08:06:28.654872 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14670): Terminating (SIGTERM) 08:06:28.695065 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14673): Terminating (SIGTERM) 08:06:28.734802 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14676): Terminating (SIGTERM) 08:06:28.774531 --- ParallelTerminationStrategy: PID 14666 died... 08:06:28.793490 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14666): Terminated: ok {rc=0} 08:06:28.837238 --- ParallelTerminationStrategy: PID 14667 died... 08:06:28.855913 run iperf3-srv_10.42.42.10(pid=14667): Terminated {rc=256} 08:06:28.899203 --- ParallelTerminationStrategy: PID 14670 died... 08:06:28.917945 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14670): Terminated: ok {rc=0} 08:06:28.961596 --- ParallelTerminationStrategy: PID 14673 died... 08:06:28.980235 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14673): Terminated: ok {rc=0} 08:06:29.024271 --- ParallelTerminationStrategy: PID 14676 died... 08:06:29.042970 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14676): Terminated: ok {rc=0} 08:06:29.129817 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend iperf3m4.py ---------------------------------------------- 08:06:30.272601 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:30.284778 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:06:30.336737 tst iperf3m4.py: using LAC 27011 08:06:30.460778 tst iperf3m4.py: using RAC 236 08:06:30.583484 tst iperf3m4.py: using CellId 27011 08:06:30.706274 tst iperf3m4.py: using BVCI 27012 08:06:30.819623 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:30.833355 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:30.860628 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:30.873633 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:30.885831 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:30.897870 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:30.910078 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:30.923011 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:30.936100 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:06:31.074573 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:06:31.194513 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:06:31.309607 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:06:31.430872 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5003... 08:06:31.639822 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:06:31.948446 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14678): Launched 08:06:32.221296 run iperf3-srv_10.42.42.10(pid=14679): Launched 08:06:32.332049 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5004... 08:06:32.528809 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:06:32.821973 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14680): Launched 08:06:33.076390 run iperf3-srv_10.42.42.10(pid=14681): Launched 08:06:33.186264 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5005... 08:06:33.382169 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:06:33.676011 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14682): Launched 08:06:33.930605 run iperf3-srv_10.42.42.10(pid=14683): Launched 08:06:34.040476 tst iperf3m4.py:8: start iperfv3 server 10.42.42.10:5006... 08:06:34.235768 run iperf3-srv_10.42.42.10: Starting iperf3-srv 08:06:34.529283 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14684): Launched 08:06:34.784391 run iperf3-srv_10.42.42.10(pid=14685): Launched 08:06:34.894426 tst iperf3m4.py:8: start network... 08:06:35.090139 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:06:35.542216 run create_hlr_db(pid=14686): Launched 08:06:35.654912 bus /gobi_6: Setting Powered False 08:06:36.713082 run create_hlr_db(pid=14686): Terminated: ok {rc=0} 08:06:37.141697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14688): Launched 08:06:37.455313 run osmo-hlr_10.42.42.2(pid=14689): Launched 08:06:37.577098 run osmo-stp_10.42.42.5: Starting osmo-stp 08:06:38.120165 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14691): Launched 08:06:38.434427 run osmo-stp_10.42.42.5(pid=14692): Launched 08:06:38.553899 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:06:39.093887 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14694): Launched 08:06:39.213966 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:06:39.478900 run patchelf(pid=14695): Launched 08:06:39.653949 run osmo-stp_10.42.42.5(pid=14692): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14692)] 08:06:39.786505 run osmo-stp_10.42.42.5(pid=14692): stdout: | (launched: 2022-12-10_08:06:38.376137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:39.920738 run osmo-stp_10.42.42.5(pid=14692): stderr: | [0;m[38;5;43m20221210080638568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080638568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080638568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080638569 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080638569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080638569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080638569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:40.056349 run osmo-stp_10.42.42.5(pid=14692): stdout: | (launched: 2022-12-10_08:06:38.376137) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:40.185381 run osmo-stp_10.42.42.5(pid=14692): stderr: | [0;m[38;5;43m20221210080638568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080638568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080638568 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080638569 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080638569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080638569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080638569 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:40.337836 run patchelf(pid=14695): Terminating (SIGINT) 08:06:40.514326 run patchelf(pid=14695): Terminated: ok {rc=0} 08:06:40.641925 tst iperf3m4.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14692): Process ended prematurely: osmo-stp_10.42.42.5(pid=14692) [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14692)] [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8] 08:06:40.652149 tst iperf3m4.py:8: Test FAILED (10.4 sec) 08:06:40.680836 run osmo-hlr_10.42.42.2(pid=14689): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py↪iperf3m4.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14689)] 08:06:40.730583 run osmo-hlr_10.42.42.2(pid=14689): stdout: | (launched: 2022-12-10_08:06:37.398722) 08:06:40.782029 run osmo-hlr_10.42.42.2(pid=14689): stderr: | [0;m[1;31m20221210080637595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080637595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080637595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080637595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080637595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080637595 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080637608 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/iperf3m4.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080637616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080637616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080637616 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:06:40.833622 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14678): Terminating (SIGTERM) 08:06:40.875159 run iperf3-srv_10.42.42.10(pid=14679): Terminating (SIGTERM) 08:06:40.916678 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14680): Terminating (SIGTERM) 08:06:40.958836 run iperf3-srv_10.42.42.10(pid=14681): Terminating (SIGTERM) 08:06:41.000335 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14682): Terminating (SIGTERM) 08:06:41.042275 run iperf3-srv_10.42.42.10(pid=14683): Terminating (SIGTERM) 08:06:41.083830 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14684): Terminating (SIGTERM) 08:06:41.125475 run iperf3-srv_10.42.42.10(pid=14685): Terminating (SIGTERM) 08:06:41.166743 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14688): Terminating (SIGTERM) 08:06:41.208252 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14691): Terminating (SIGTERM) 08:06:41.249704 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14694): Terminating (SIGTERM) 08:06:41.291506 --- ParallelTerminationStrategy: PID 14678 died... 08:06:41.311334 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14678): Terminated: ok {rc=0} 08:06:41.357427 --- ParallelTerminationStrategy: PID 14679 died... 08:06:41.376844 run iperf3-srv_10.42.42.10(pid=14679): Terminated {rc=256} 08:06:41.422351 --- ParallelTerminationStrategy: PID 14680 died... 08:06:41.441716 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14680): Terminated: ok {rc=0} 08:06:41.487384 --- ParallelTerminationStrategy: PID 14681 died... 08:06:41.506992 run iperf3-srv_10.42.42.10(pid=14681): Terminated {rc=256} 08:06:41.552450 --- ParallelTerminationStrategy: PID 14682 died... 08:06:41.571722 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14682): Terminated: ok {rc=0} 08:06:41.617359 --- ParallelTerminationStrategy: PID 14683 died... 08:06:41.636786 run iperf3-srv_10.42.42.10(pid=14683): Terminated {rc=256} 08:06:41.682223 --- ParallelTerminationStrategy: PID 14684 died... 08:06:41.701594 run pcap-recorder_any(filters='host 10.42.42.10 and port not 22')(pid=14684): Terminated: ok {rc=0} 08:06:41.747139 --- ParallelTerminationStrategy: PID 14685 died... 08:06:41.766501 run iperf3-srv_10.42.42.10(pid=14685): Terminated {rc=256} 08:06:41.811810 --- ParallelTerminationStrategy: PID 14688 died... 08:06:41.831364 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14688): Terminated: ok {rc=0} 08:06:41.877056 --- ParallelTerminationStrategy: PID 14691 died... 08:06:41.896516 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14691): Terminated: ok {rc=0} 08:06:41.942044 --- ParallelTerminationStrategy: PID 14694 died... 08:06:41.961533 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14694): Terminated: ok {rc=0} 08:06:42.050176 bus /gobi_4: Setting Powered False 08:06:43.149058 bus /gobi_4: Setting Powered False 08:06:44.266862 bus /gobi_1: Setting Powered False 08:06:45.365615 bus /gobi_1: Setting Powered False 08:06:46.477781 bus /gobi_0: Setting Powered False 08:06:47.573468 bus /gobi_0: Setting Powered False 08:06:48.688089 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping.py ---------------------------------------------- 08:06:49.793564 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:49.805838 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:06:49.855588 tst ping.py: using LAC 27012 08:06:49.971073 tst ping.py: using RAC 237 08:06:50.085078 tst ping.py: using CellId 27012 08:06:50.198922 tst ping.py: using BVCI 27013 08:06:50.304278 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:50.315723 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:50.326947 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:50.338194 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:50.349484 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:50.361224 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:50.372644 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:50.383964 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:06:50.497867 tst ping.py:19: start network... 08:06:50.689485 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:06:51.132519 run create_hlr_db(pid=14696): Launched 08:06:51.241819 bus /gobi_6: Setting Powered False 08:06:52.299838 run create_hlr_db(pid=14696): Terminated: ok {rc=0} 08:06:52.721704 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14698): Launched 08:06:53.027963 run osmo-hlr_10.42.42.2(pid=14699): Launched 08:06:53.145832 run osmo-stp_10.42.42.5: Starting osmo-stp 08:06:53.676615 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14701): Launched 08:06:53.983785 run osmo-stp_10.42.42.5(pid=14702): Launched 08:06:54.102744 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:06:54.635514 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14704): Launched 08:06:54.753502 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:06:55.012591 run patchelf(pid=14705): Launched 08:06:55.184890 run osmo-stp_10.42.42.5(pid=14702): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14702)] 08:06:55.315778 run osmo-stp_10.42.42.5(pid=14702): stdout: | (launched: 2022-12-10_08:06:53.927969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:55.447809 run osmo-stp_10.42.42.5(pid=14702): stderr: | [0;m[38;5;43m20221210080654119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080654119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080654120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080654120 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080654121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080654121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080654121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:55.579978 run osmo-stp_10.42.42.5(pid=14702): stdout: | (launched: 2022-12-10_08:06:53.927969) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:06:55.706484 run osmo-stp_10.42.42.5(pid=14702): stderr: | [0;m[38;5;43m20221210080654119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080654119 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080654120 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080654120 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080654121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080654121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080654121 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:06:55.855739 run patchelf(pid=14705): Terminating (SIGINT) 08:06:56.029100 run patchelf(pid=14705): Terminated: ok {rc=0} 08:06:56.153780 tst ping.py:22: ERR: Error: osmo-stp_10.42.42.5(pid=14702): Process ended prematurely: osmo-stp_10.42.42.5(pid=14702) [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14702)] [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22] 08:06:56.163083 tst ping.py:22: Test FAILED (6.4 sec) 08:06:56.190714 run osmo-hlr_10.42.42.2(pid=14699): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py↪ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14699)] 08:06:56.240412 run osmo-hlr_10.42.42.2(pid=14699): stdout: | (launched: 2022-12-10_08:06:52.972351) 08:06:56.291534 run osmo-hlr_10.42.42.2(pid=14699): stderr: | [0;m[1;31m20221210080653168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080653168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080653168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080653168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080653168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080653168 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080653183 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080653193 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080653194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080653194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:06:56.343516 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14698): Terminating (SIGTERM) 08:06:56.384656 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14701): Terminating (SIGTERM) 08:06:56.425982 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14704): Terminating (SIGTERM) 08:06:56.467878 --- ParallelTerminationStrategy: PID 14698 died... 08:06:56.487755 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14698): Terminated: ok {rc=0} 08:06:56.533561 --- ParallelTerminationStrategy: PID 14701 died... 08:06:56.552905 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14701): Terminated: ok {rc=0} 08:06:56.598710 --- ParallelTerminationStrategy: PID 14704 died... 08:06:56.618141 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14704): Terminated: ok {rc=0} 08:06:56.706739 bus /gobi_6: Setting Powered False ---------------------------------------------- trial-2371 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend ping_idle_ping.py ---------------------------------------------- 08:06:57.794771 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:57.807535 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x bts (candidates: 1) 08:06:57.860186 tst ping_idle_ping.py: using LAC 27013 08:06:57.980928 tst ping_idle_ping.py: using RAC 238 08:06:58.102010 tst ping_idle_ping.py: using CellId 27013 08:06:58.224184 tst ping_idle_ping.py: using BVCI 27014 08:06:58.337464 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:58.349208 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:58.360670 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:58.372224 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:58.384216 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:58.395804 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:58.407419 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x ip_address (candidates: 9) 08:06:58.418884 tst gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend: Using 1 x modem (candidates: 4) 08:06:58.535338 tst ping_idle_ping.py:24: start network... 08:06:58.744365 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:06:59.224325 run create_hlr_db(pid=14706): Launched 08:06:59.350069 bus /gobi_6: Setting Powered False 08:07:00.411673 run create_hlr_db(pid=14706): Terminated: ok {rc=0} 08:07:00.825690 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14708): Launched 08:07:01.172369 run osmo-hlr_10.42.42.2(pid=14709): Launched 08:07:01.447490 run osmo-stp_10.42.42.5: Starting osmo-stp 08:07:02.103163 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14711): Launched 08:07:02.425392 run osmo-stp_10.42.42.5(pid=14712): Launched 08:07:02.545210 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:07:03.078305 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14714): Launched 08:07:03.195552 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:07:03.454596 run patchelf(pid=14715): Launched 08:07:03.625301 run osmo-stp_10.42.42.5(pid=14712): ERR: Terminated: ERROR {rc=1} [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14712)] 08:07:03.755754 run osmo-stp_10.42.42.5(pid=14712): stdout: | (launched: 2022-12-10_08:07:02.369817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:03.887960 run osmo-stp_10.42.42.5(pid=14712): stderr: | [0;m[38;5;43m20221210080702559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080702559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080702559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080702560 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080702560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080702560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080702560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:04.020097 run osmo-stp_10.42.42.5(pid=14712): stdout: | (launched: 2022-12-10_08:07:02.369817) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:04.147145 run osmo-stp_10.42.42.5(pid=14712): stderr: | [0;m[38;5;43m20221210080702559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080702559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080702559 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080702560 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080702560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080702560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080702560 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:04.296890 run patchelf(pid=14715): Terminating (SIGINT) 08:07:04.469906 run patchelf(pid=14715): Terminated: ok {rc=0} 08:07:04.593927 tst ping_idle_ping.py:27: ERR: Error: osmo-stp_10.42.42.5(pid=14712): Process ended prematurely: osmo-stp_10.42.42.5(pid=14712) [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14712)] [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27] 08:07:04.603249 tst ping_idle_ping.py:27: Test FAILED (6.8 sec) 08:07:04.630858 run osmo-hlr_10.42.42.2(pid=14709): ERR: Terminated: ERROR {rc=237} [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py↪ping_idle_ping.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14709)] 08:07:04.680320 run osmo-hlr_10.42.42.2(pid=14709): stdout: | (launched: 2022-12-10_08:07:01.105844) 08:07:04.731836 run osmo-hlr_10.42.42.2(pid=14709): stderr: | [0;m[1;31m20221210080701402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080701402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080701402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080701402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080701402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080701402 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080701420 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend/ping_idle_ping.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080701447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080701447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080701447 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:07:04.783713 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14708): Terminating (SIGTERM) 08:07:04.824602 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14711): Terminating (SIGTERM) 08:07:04.865873 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14714): Terminating (SIGTERM) 08:07:04.907246 --- ParallelTerminationStrategy: PID 14708 died... 08:07:04.927031 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14708): Terminated: ok {rc=0} 08:07:04.972495 --- ParallelTerminationStrategy: PID 14711 died... 08:07:04.991753 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14711): Terminated: ok {rc=0} 08:07:05.037465 --- ParallelTerminationStrategy: PID 14714 died... 08:07:05.056572 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14714): Terminated: ok {rc=0} 08:07:05.143652 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any --------------------------------------------------------------------- 08:07:06.453095 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:07:06.460127 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 1 x bts (candidates: 11) 08:07:06.492742 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 8 x ip_address (candidates: 9) 08:07:06.529612 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Verifying 2 x modem (candidates: 12) 08:07:06.583120 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 1 x bts (candidates: 11) 08:07:06.615006 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 8 x ip_address (candidates: 9) 08:07:06.648804 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Reserving 2 x modem (candidates: 12) 08:07:07.211775 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: RESERVED RESOURCES for dynts: bts NanoBTS-ONW-900 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 10.42.42.8 10.42.42.9 modem ec20_1 ec20_2 ---------------------------------------------- trial-2371 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any switch_tch_pdch.py ---------------------------------------------- 08:07:07.217810 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:07:07.229830 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x bts (candidates: 1) 08:07:07.296179 tst switch_tch_pdch.py: using LAC 27014 08:07:07.409141 tst switch_tch_pdch.py: using RAC 239 08:07:07.521585 tst switch_tch_pdch.py: using CellId 27014 08:07:07.646491 tst switch_tch_pdch.py: using BVCI 27015 08:07:07.759219 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:07:07.771196 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:07:07.782999 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:07:07.794896 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:07:07.806742 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:07:07.818699 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:07:07.830712 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x ip_address (candidates: 8) 08:07:07.842485 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:07:07.961641 tst dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any: Using 1 x modem (candidates: 2) 08:07:08.077789 tst switch_tch_pdch.py:51: start network... 08:07:08.269630 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:07:08.713825 run create_hlr_db(pid=14719): Launched 08:07:08.824850 bus /gobi_6: Setting Powered False 08:07:09.882709 run create_hlr_db(pid=14719): Terminated: ok {rc=0} 08:07:10.303365 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14721): Launched 08:07:10.609561 run osmo-hlr_10.42.42.2(pid=14722): Launched 08:07:10.726614 run osmo-stp_10.42.42.5: Starting osmo-stp 08:07:11.259221 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14724): Launched 08:07:11.565241 run osmo-stp_10.42.42.5(pid=14725): Launched 08:07:11.683397 run osmo-ggsn_10.42.42.6: Starting osmo-ggsn 08:07:12.213936 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14727): Launched 08:07:12.330985 run osmo-ggsn_10.42.42.6: Setting RPATH for osmo-ggsn 08:07:12.589368 run patchelf(pid=14728): Launched 08:07:12.760666 run osmo-stp_10.42.42.5(pid=14725): ERR: Terminated: ERROR {rc=1} [trial-2371↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14725)] 08:07:12.891710 run osmo-stp_10.42.42.5(pid=14725): stdout: | (launched: 2022-12-10_08:07:11.509889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:13.024014 run osmo-stp_10.42.42.5(pid=14725): stderr: | [0;m[38;5;43m20221210080711701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080711701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080711702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080711702 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080711703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080711703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080711703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:13.157040 run osmo-stp_10.42.42.5(pid=14725): stdout: | (launched: 2022-12-10_08:07:11.509889) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:13.283530 run osmo-stp_10.42.42.5(pid=14725): stderr: | [0;m[38;5;43m20221210080711701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080711701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080711702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080711702 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080711703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080711703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080711703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:13.433399 run patchelf(pid=14728): Terminating (SIGINT) 08:07:13.606590 run patchelf(pid=14728): Terminated: ok {rc=0} 08:07:13.731313 tst switch_tch_pdch.py:54: ERR: Error: osmo-stp_10.42.42.5(pid=14725): Process ended prematurely: osmo-stp_10.42.42.5(pid=14725) [trial-2371↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14725)] [trial-2371↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54] 08:07:13.740702 tst switch_tch_pdch.py:54: Test FAILED (6.5 sec) 08:07:13.768199 run osmo-hlr_10.42.42.2(pid=14722): ERR: Terminated: ERROR {rc=237} [trial-2371↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py↪switch_tch_pdch.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14722)] 08:07:13.818085 run osmo-hlr_10.42.42.2(pid=14722): stdout: | (launched: 2022-12-10_08:07:10.554119) 08:07:13.869519 run osmo-hlr_10.42.42.2(pid=14722): stderr: | [0;m[1;31m20221210080710750 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080710750 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080710750 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080710750 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080710750 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080710750 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080710763 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any/switch_tch_pdch.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080710772 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080710773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080710773 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:07:13.921277 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14721): Terminating (SIGTERM) 08:07:13.962698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14724): Terminating (SIGTERM) 08:07:14.004000 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14727): Terminating (SIGTERM) 08:07:14.045933 --- ParallelTerminationStrategy: PID 14721 died... 08:07:14.065841 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14721): Terminated: ok {rc=0} 08:07:14.111715 --- ParallelTerminationStrategy: PID 14724 died... 08:07:14.131017 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14724): Terminated: ok {rc=0} 08:07:14.176556 --- ParallelTerminationStrategy: PID 14727 died... 08:07:14.195937 run pcap-recorder_any(filters='host 10.42.42.6')(pid=14727): Terminated: ok {rc=0} 08:07:14.282605 bus /gobi_0: Setting Powered False 08:07:15.382377 bus /gobi_0: Setting Powered False 08:07:16.501706 bus /gobi_6: Setting Powered False --------------------------------------------------------------------- trial-2371 dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 nitb_smpp --------------------------------------------------------------------- 08:07:17.758646 tst nitb_smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:07:17.761702 tst nitb_smpp: Verifying 1 x bts (candidates: 11) 08:07:17.782227 tst nitb_smpp: Verifying 1 x ip_address (candidates: 9) 08:07:17.789797 tst nitb_smpp: Verifying 1 x modem (candidates: 12) 08:07:17.823106 tst nitb_smpp: Reserving 1 x bts (candidates: 11) 08:07:17.843451 tst nitb_smpp: Reserving 1 x ip_address (candidates: 9) 08:07:17.850165 tst nitb_smpp: Reserving 1 x modem (candidates: 12) 08:07:18.371735 tst nitb_smpp: RESERVED RESOURCES for nitb_smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 modem sierra_1st ---------------------------------------------- trial-2371 nitb_smpp esme_connect_policy_acceptall.py ---------------------------------------------- 08:07:18.376895 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 08:07:18.395387 tst esme_connect_policy_acceptall.py: using MSISDN 7625 08:07:18.534979 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:07:19.081471 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14733): Launched 08:07:19.374451 run osmo-nitb_10.42.42.2(pid=14734): Launched 08:07:19.537452 run osmo-nitb_10.42.42.2(pid=14734): ERR: Terminated: ERROR {rc=2} [trial-2371↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14734)] 08:07:19.668873 run osmo-nitb_10.42.42.2(pid=14734): stdout: | (launched: 2022-12-10_08:07:19.321395) 08:07:19.801590 run osmo-nitb_10.42.42.2(pid=14734): stderr: | (launched: 2022-12-10_08:07:19.364781) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:07:19.934566 run osmo-nitb_10.42.42.2(pid=14734): stdout: | (launched: 2022-12-10_08:07:19.321395) 08:07:20.062060 run osmo-nitb_10.42.42.2(pid=14734): stderr: | (launched: 2022-12-10_08:07:19.364781) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f5483dba268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14734): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14734) [trial-2371↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14734)] 08:07:20.485851 tst osmo-nitb_10.42.42.2(pid=14734): stdout: | (launched: 2022-12-10_08:07:19.321395) 08:07:20.604708 tst osmo-nitb_10.42.42.2(pid=14734): stderr: | (launched: 2022-12-10_08:07:19.364781) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:07:20.744773 tst esme_connect_policy_acceptall.py:18: ERR: Error: osmo-nitb_10.42.42.2(pid=14734): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14734) [trial-2371↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14734)] [trial-2371↪nitb_smpp↪esme_connect_policy_acceptall.py:18] 08:07:20.753108 tst esme_connect_policy_acceptall.py:18: Test FAILED (2.4 sec) 08:07:20.759697 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14733): Terminating (SIGTERM) 08:07:20.969195 --- ParallelTerminationStrategy: PID 14733 died... 08:07:20.989412 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14733): Terminated: ok {rc=0} ---------------------------------------------- trial-2371 nitb_smpp esme_connect_policy_closed.py ---------------------------------------------- 08:07:21.037870 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 08:07:21.057971 tst esme_connect_policy_closed.py: using MSISDN 7626 08:07:21.177032 tst esme_connect_policy_closed.py: using MSISDN 7627 08:07:21.282392 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:07:21.828286 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14735): Launched 08:07:22.123128 run osmo-nitb_10.42.42.2(pid=14736): Launched 08:07:22.281784 run osmo-nitb_10.42.42.2(pid=14736): ERR: Terminated: ERROR {rc=2} [trial-2371↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14736)] 08:07:22.402758 run osmo-nitb_10.42.42.2(pid=14736): stdout: | (launched: 2022-12-10_08:07:22.069260) 08:07:22.525228 run osmo-nitb_10.42.42.2(pid=14736): stderr: | (launched: 2022-12-10_08:07:22.112898) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:07:22.647555 run osmo-nitb_10.42.42.2(pid=14736): stdout: | (launched: 2022-12-10_08:07:22.069260) 08:07:22.765084 run osmo-nitb_10.42.42.2(pid=14736): stderr: | (launched: 2022-12-10_08:07:22.112898) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:07:22.905549 tst esme_connect_policy_closed.py:24: ERR: Error: osmo-nitb_10.42.42.2(pid=14736): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14736) [trial-2371↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14736)] [trial-2371↪nitb_smpp↪esme_connect_policy_closed.py:24] 08:07:22.913782 tst esme_connect_policy_closed.py:24: Test FAILED (1.9 sec) 08:07:22.920119 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14735): Terminating (SIGTERM) 08:07:23.128581 --- ParallelTerminationStrategy: PID 14735 died... 08:07:23.148762 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14735): Terminated: ok {rc=0} ---------------------------------------------- trial-2371 nitb_smpp esme_ms_sms_storeforward.py ---------------------------------------------- 08:07:23.197484 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 08:07:23.208423 tst nitb_smpp: Using 1 x bts (candidates: 1) 08:07:23.243960 tst esme_ms_sms_storeforward.py: using LAC 27015 08:07:23.361450 tst esme_ms_sms_storeforward.py: using RAC 240 08:07:23.489454 tst esme_ms_sms_storeforward.py: using CellId 27015 08:07:23.614241 tst esme_ms_sms_storeforward.py: using BVCI 27016 08:07:23.728275 tst nitb_smpp: Using 1 x modem (candidates: 1) 08:07:23.855164 tst esme_ms_sms_storeforward.py: using MSISDN 7628 08:07:23.963460 tst esme_ms_sms_storeforward.py:20: start nitb and bts... 08:07:24.161462 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:07:24.762700 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14737): Launched 08:07:25.057735 run osmo-nitb_10.42.42.2(pid=14738): Launched 08:07:25.217147 run osmo-nitb_10.42.42.2(pid=14738): ERR: Terminated: ERROR {rc=2} [trial-2371↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14738)] 08:07:25.339207 run osmo-nitb_10.42.42.2(pid=14738): stdout: | (launched: 2022-12-10_08:07:25.004354) 08:07:25.462200 run osmo-nitb_10.42.42.2(pid=14738): stderr: | (launched: 2022-12-10_08:07:25.048123) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:07:25.585204 run osmo-nitb_10.42.42.2(pid=14738): stdout: | (launched: 2022-12-10_08:07:25.004354) 08:07:25.702868 run osmo-nitb_10.42.42.2(pid=14738): stderr: | (launched: 2022-12-10_08:07:25.048123) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:07:25.843748 tst esme_ms_sms_storeforward.py:23: ERR: Error: osmo-nitb_10.42.42.2(pid=14738): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14738) [trial-2371↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14738)] [trial-2371↪nitb_smpp↪esme_ms_sms_storeforward.py:23] 08:07:25.851972 tst esme_ms_sms_storeforward.py:23: Test FAILED (2.6 sec) 08:07:25.858379 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14737): Terminating (SIGTERM) 08:07:26.067044 --- ParallelTerminationStrategy: PID 14737 died... 08:07:26.087556 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14737): Terminated: ok {rc=0} 08:07:26.173286 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 nitb_smpp esme_ms_sms_transaction.py ---------------------------------------------- 08:07:27.261017 tst nitb_smpp: Using 1 x ip_address (candidates: 1) 08:07:27.272212 tst nitb_smpp: Using 1 x bts (candidates: 1) 08:07:27.309980 tst esme_ms_sms_transaction.py: using LAC 27016 08:07:27.428483 tst esme_ms_sms_transaction.py: using RAC 241 08:07:27.544060 tst esme_ms_sms_transaction.py: using CellId 27016 08:07:27.660570 tst esme_ms_sms_transaction.py: using BVCI 27017 08:07:27.767637 tst nitb_smpp: Using 1 x modem (candidates: 1) 08:07:27.897309 tst esme_ms_sms_transaction.py: using MSISDN 7629 08:07:28.011739 tst esme_ms_sms_transaction.py:18: start nitb and bts... 08:07:28.225524 run osmo-nitb_10.42.42.2: Starting osmo-nitb 08:07:28.865264 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14739): Launched 08:07:29.180287 run osmo-nitb_10.42.42.2(pid=14740): Launched 08:07:29.355101 run osmo-nitb_10.42.42.2(pid=14740): ERR: Terminated: ERROR {rc=2} [trial-2371↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14740)] 08:07:29.496162 run osmo-nitb_10.42.42.2(pid=14740): stdout: | (launched: 2022-12-10_08:07:29.123518) 08:07:29.638669 run osmo-nitb_10.42.42.2(pid=14740): stderr: | (launched: 2022-12-10_08:07:29.170450) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:07:29.781142 run osmo-nitb_10.42.42.2(pid=14740): stdout: | (launched: 2022-12-10_08:07:29.123518) 08:07:29.918153 run osmo-nitb_10.42.42.2(pid=14740): stderr: | (launched: 2022-12-10_08:07:29.170450) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== Exception ignored in: <function ModemDbusInteraction.__del__ at 0x7f5483dba268> Traceback (most recent call last): File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 193, in __del__ self.cleanup() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 187, in cleanup self.set_powered(False) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 323, in set_powered self.set_bool('Powered', powered) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/obj/ms_ofono.py", line 314, in set_bool MainLoop.poll() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 86, in poll self.deferred_handling.handle_queue() File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/core/event_loop.py", line 33, in handle_queue handler(*args, **kwargs) File "/home/jenkins/workspace/osmo-gsm-tester_run-prod/osmo-gsm-tester/src/osmo_gsm_tester/testenv.py", line 142, in poll raise log_module.Error('Process ended prematurely: %s' % proc.name()) osmo_gsm_tester.core.log.Error: osmo-nitb_10.42.42.2(pid=14740): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14740) [trial-2371↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14740)] 08:07:30.299630 tst osmo-nitb_10.42.42.2(pid=14740): stdout: | (launched: 2022-12-10_08:07:29.123518) 08:07:30.427136 tst osmo-nitb_10.42.42.2(pid=14740): stderr: | (launched: 2022-12-10_08:07:29.170450) | ====================================================================== | ERROR: You should not run osmo-nitb. It is ancient, unmaintained and | obsolete for several years. If you really want to ignore years of hard work on | the new post-NITB stack (osmo-bsc, osmo-mgw, osmo-msc, osmo-hlr, osmo-stp), | you may ues the '--yes-i-really-want-to-run-prehistoric-software' command line | argument. DON'T EVER BOTHER THE DEVELOPERS IF YOU ENCOUNTER PROBLEMS WITH IT!!! | Use https://osmocom.org/projects/cellular-infrastructure/wiki/Osmocom_Network_In_The_Box | ====================================================================== 08:07:30.577205 tst esme_ms_sms_transaction.py:21: ERR: Error: osmo-nitb_10.42.42.2(pid=14740): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14740) [trial-2371↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14740)] [trial-2371↪nitb_smpp↪esme_ms_sms_transaction.py:21] 08:07:30.586117 tst esme_ms_sms_transaction.py:21: Test FAILED (3.3 sec) 08:07:30.592908 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14739): Terminating (SIGTERM) 08:07:30.803191 --- ParallelTerminationStrategy: PID 14739 died... 08:07:30.824652 run pcap-recorder_any(filters='host 10.42.42.2 and port not 22')(pid=14739): Terminated: ok {rc=0} 08:07:30.927173 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 nitb_smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 smpp --------------------------------------------------------------------- 08:07:32.111347 tst smpp: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:07:32.117146 tst smpp: Verifying 1 x bts (candidates: 11) 08:07:32.149362 tst smpp: Verifying 6 x ip_address (candidates: 9) 08:07:32.183609 tst smpp: Verifying 1 x modem (candidates: 12) 08:07:32.221557 tst smpp: Reserving 1 x bts (candidates: 11) 08:07:32.244644 tst smpp: Reserving 6 x ip_address (candidates: 9) 08:07:32.282522 tst smpp: Reserving 1 x modem (candidates: 12) 08:07:32.802418 tst smpp: RESERVED RESOURCES for smpp: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2371 smpp esme_connect_policy_acceptall.py ---------------------------------------------- 08:07:32.807744 tst smpp: Using 1 x ip_address (candidates: 6) 08:07:32.818624 tst smpp: Using 1 x ip_address (candidates: 6) 08:07:32.829505 tst smpp: Using 1 x ip_address (candidates: 6) 08:07:32.840585 tst smpp: Using 1 x ip_address (candidates: 6) 08:07:32.860128 tst esme_connect_policy_acceptall.py: using MSISDN 7630 08:07:32.975809 run osmo-stp_10.42.42.4: Starting osmo-stp 08:07:33.513122 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14744): Launched 08:07:33.827025 run osmo-stp_10.42.42.4(pid=14745): Launched 08:07:33.948101 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:07:34.436921 run create_hlr_db(pid=14746): Launched 08:07:34.565488 bus /sierra_2: Setting Powered False 08:07:35.627994 run create_hlr_db(pid=14746): Terminated: ok {rc=0} 08:07:36.052922 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14755): Launched 08:07:36.346396 run osmo-hlr_10.42.42.2(pid=14756): Launched 08:07:36.458513 run osmo-msc_10.42.42.5: Starting osmo-msc 08:07:37.006634 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14758): Launched 08:07:37.301357 run osmo-msc_10.42.42.5(pid=14759): Launched 08:07:37.467376 run osmo-hlr_10.42.42.2(pid=14756): ERR: Terminated: ERROR {rc=237} [trial-2371↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14756)] 08:07:37.597675 run osmo-hlr_10.42.42.2(pid=14756): stdout: | (launched: 2022-12-10_08:07:36.293177) 08:07:37.724243 run osmo-hlr_10.42.42.2(pid=14756): stderr: | [0;m[1;31m20221210080736465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080736465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080736465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080736465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080736465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080736465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080736478 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080736486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080736487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080736487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:07:37.847858 run osmo-hlr_10.42.42.2(pid=14756): stdout: | (launched: 2022-12-10_08:07:36.293177) 08:07:37.965704 run osmo-hlr_10.42.42.2(pid=14756): stderr: | [0;m[1;31m20221210080736465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080736465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080736465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080736465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080736465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080736465 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080736478 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/smpp/esme_connect_policy_acceptall.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080736486 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080736487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080736487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:07:38.106638 tst esme_connect_policy_acceptall.py:23: ERR: Error: osmo-hlr_10.42.42.2(pid=14756): Process ended prematurely: osmo-hlr_10.42.42.2(pid=14756) [trial-2371↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14756)] [trial-2371↪smpp↪esme_connect_policy_acceptall.py:23] 08:07:38.114678 tst esme_connect_policy_acceptall.py:23: Test FAILED (5.3 sec) 08:07:38.140645 run osmo-msc_10.42.42.5(pid=14759): ERR: Terminated: ERROR {rc=9} [trial-2371↪smpp↪esme_connect_policy_acceptall.py↪esme_connect_policy_acceptall.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=14759)] 08:07:38.188894 run osmo-msc_10.42.42.5(pid=14759): stdout: | (launched: 2022-12-10_08:07:37.247553) 08:07:38.238401 run osmo-msc_10.42.42.5(pid=14759): stderr: | [0;m[38;5;43m20221210080737561 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221210080737561 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221210080737562 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221210080737562 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221210080737562 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221210080737562 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221210080737562 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221210080737562 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210080737562 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 08:07:38.288223 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14744): Terminating (SIGTERM) 08:07:38.327562 run osmo-stp_10.42.42.4(pid=14745): Terminating (SIGTERM) 08:07:38.367134 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14755): Terminating (SIGTERM) 08:07:38.408783 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14758): Terminating (SIGTERM) 08:07:38.451408 --- ParallelTerminationStrategy: PID 14744 died... 08:07:38.470736 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14744): Terminated: ok {rc=0} 08:07:38.514985 --- ParallelTerminationStrategy: PID 14745 died... 08:07:38.533475 run osmo-stp_10.42.42.4(pid=14745): Terminated: ok {rc=0} 08:07:38.577272 --- ParallelTerminationStrategy: PID 14755 died... 08:07:38.595686 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14755): Terminated: ok {rc=0} 08:07:38.639491 --- ParallelTerminationStrategy: PID 14758 died... 08:07:38.657897 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14758): Terminated: ok {rc=0} ---------------------------------------------- trial-2371 smpp esme_connect_policy_closed.py ---------------------------------------------- 08:07:38.707073 tst smpp: Using 1 x ip_address (candidates: 6) 08:07:38.717979 tst smpp: Using 1 x bts (candidates: 1) 08:07:38.753346 tst esme_connect_policy_closed.py: using LAC 27017 08:07:38.870282 tst esme_connect_policy_closed.py: using RAC 242 08:07:38.985530 tst esme_connect_policy_closed.py: using CellId 27017 08:07:39.105932 tst esme_connect_policy_closed.py: using BVCI 27018 08:07:39.222662 tst smpp: Using 1 x ip_address (candidates: 6) 08:07:39.233544 tst smpp: Using 1 x ip_address (candidates: 6) 08:07:39.244430 tst smpp: Using 1 x ip_address (candidates: 6) 08:07:39.265195 tst esme_connect_policy_closed.py: using MSISDN 7631 08:07:39.393790 tst esme_connect_policy_closed.py: using MSISDN 7632 08:07:39.509549 run osmo-stp_10.42.42.4: Starting osmo-stp 08:07:40.047884 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14762): Launched 08:07:40.363826 run osmo-stp_10.42.42.4(pid=14763): Launched 08:07:40.485332 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:07:40.975026 run create_hlr_db(pid=14764): Launched 08:07:42.161977 run create_hlr_db(pid=14764): Terminated: ok {rc=0} 08:07:42.494653 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14766): Launched 08:07:42.810447 run osmo-hlr_10.42.42.2(pid=14767): Launched 08:07:42.931282 run osmo-msc_10.42.42.5: Starting osmo-msc 08:07:43.505649 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14769): Launched 08:07:43.820927 run osmo-msc_10.42.42.5(pid=14770): Launched 08:07:43.997934 run osmo-hlr_10.42.42.2(pid=14767): ERR: Terminated: ERROR {rc=237} [trial-2371↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14767)] 08:07:44.132765 run osmo-hlr_10.42.42.2(pid=14767): stdout: | (launched: 2022-12-10_08:07:42.753333) 08:07:44.267220 run osmo-hlr_10.42.42.2(pid=14767): stderr: | [0;m[1;31m20221210080742951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080742951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080742951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080742951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080742951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080742951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080742964 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080742972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080742973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080742973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:07:44.401282 run osmo-hlr_10.42.42.2(pid=14767): stdout: | (launched: 2022-12-10_08:07:42.753333) 08:07:44.527276 run osmo-hlr_10.42.42.2(pid=14767): stderr: | [0;m[1;31m20221210080742951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080742951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080742951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080742951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080742951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080742951 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080742964 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/smpp/esme_connect_policy_closed.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080742972 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080742973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080742973 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:07:44.677654 tst esme_connect_policy_closed.py:31: ERR: Error: osmo-hlr_10.42.42.2(pid=14767): Process ended prematurely: osmo-hlr_10.42.42.2(pid=14767) [trial-2371↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14767)] [trial-2371↪smpp↪esme_connect_policy_closed.py:31] 08:07:44.686466 tst esme_connect_policy_closed.py:31: Test FAILED (6.0 sec) 08:07:44.713566 run osmo-msc_10.42.42.5(pid=14770): ERR: Terminated: ERROR {rc=9} [trial-2371↪smpp↪esme_connect_policy_closed.py↪esme_connect_policy_closed.py↪osmo-msc_10.42.42.5↪osmo-msc_10.42.42.5(pid=14770)] 08:07:44.763733 run osmo-msc_10.42.42.5(pid=14770): stdout: | (launched: 2022-12-10_08:07:43.763908) 08:07:44.815087 run osmo-msc_10.42.42.5(pid=14770): stderr: | [0;m[38;5;43m20221210080744129 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Freeing instance (osmo_ss7.c:1650) | [0;m[38;5;43m20221210080744129 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Deallocated (fsm.c:568) | [0;m[38;5;43m20221210080744129 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000015820]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;45m20221210080744129 [1;33mDLSCCP[0;m[38;5;45m [1;33mNOTICE[0;m[38;5;45m OsmoMSC-A-Iu: Using ASP instance asp0 (sccp_user.c:647) | [0;m[38;5;43m20221210080744129 [1;33mDLSS7[0;m[38;5;43m [1;33mNOTICE[0;m[38;5;43m 0: Creating SCCP instance (osmo_ss7.c:458) | [0;m[38;5;45m20221210080744129 [1;32mDLSCCP[0;m[38;5;45m [1;32mINFO[0;m[38;5;45m Binding user 'SCCP Management' to SSN=1 PC=(no PC) (sccp_user.c:108) | [0;m[38;5;43m20221210080744129 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m registering user=SCCP for SI 3 with priv 0x6120000159a0 (osmo_ss7.c:482) | [0;m20221210080744130 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 0.0.0.0:29118: Address already in use (socket.c:822) | 20221210080744130 [1;31mDSGS[0;m [1;31mERROR[0;m SGs socket cannot be opened: Address already in use (sgs_server.c:182) | Starting SGs server failed 08:07:44.866809 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14762): Terminating (SIGTERM) 08:07:44.908056 run osmo-stp_10.42.42.4(pid=14763): Terminating (SIGTERM) 08:07:44.949617 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14766): Terminating (SIGTERM) 08:07:44.993077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14769): Terminating (SIGTERM) 08:07:45.038415 --- ParallelTerminationStrategy: PID 14762 died... 08:07:45.059375 run pcap-recorder_any(filters='host 10.42.42.4 and port not 22')(pid=14762): Terminated: ok {rc=0} 08:07:45.108410 --- ParallelTerminationStrategy: PID 14763 died... 08:07:45.128075 run osmo-stp_10.42.42.4(pid=14763): Terminated: ok {rc=0} 08:07:45.174695 --- ParallelTerminationStrategy: PID 14766 died... 08:07:45.194314 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14766): Terminated: ok {rc=0} 08:07:45.240226 --- ParallelTerminationStrategy: PID 14769 died... 08:07:45.259878 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14769): Terminated: ok {rc=0} ---------------------------------------------- trial-2371 smpp esme_ms_sms_storeforward.py ---------------------------------------------- 08:07:45.310630 tst smpp: Using 1 x ip_address (candidates: 6) 08:07:45.322129 tst smpp: Using 1 x bts (candidates: 1) 08:07:45.357359 tst esme_ms_sms_storeforward.py: using LAC 27018 08:07:45.482595 tst esme_ms_sms_storeforward.py: using RAC 243 08:07:45.608453 tst esme_ms_sms_storeforward.py: using CellId 27018 08:07:45.734348 tst esme_ms_sms_storeforward.py: using BVCI 27019 08:07:45.868501 tst smpp: Using 1 x ip_address (candidates: 6) 08:07:45.887244 tst smpp: Using 1 x ip_address (candidates: 6) 08:07:45.900941 tst smpp: Using 1 x ip_address (candidates: 6) 08:07:45.912113 tst smpp: Using 1 x ip_address (candidates: 6) 08:07:45.923312 tst smpp: Using 1 x ip_address (candidates: 6) 08:07:45.934758 tst smpp: Using 1 x modem (candidates: 1) 08:07:46.067830 tst esme_ms_sms_storeforward.py: using MSISDN 7633 08:07:46.187147 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:07:46.688066 run create_hlr_db(pid=14773): Launched 08:07:47.906345 run create_hlr_db(pid=14773): Terminated: ok {rc=0} 08:07:48.240426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14775): Launched 08:07:48.557275 run osmo-hlr_10.42.42.2(pid=14776): Launched 08:07:48.679163 run osmo-stp_10.42.42.5: Starting osmo-stp 08:07:49.228697 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14778): Launched 08:07:49.546357 run osmo-stp_10.42.42.5(pid=14779): Launched 08:07:49.669146 run osmo-msc_10.42.42.6: Starting osmo-msc 08:07:50.243453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14781): Launched 08:07:50.559554 run osmo-msc_10.42.42.6(pid=14782): Launched 08:07:50.736386 run osmo-stp_10.42.42.5(pid=14779): ERR: Terminated: ERROR {rc=1} [trial-2371↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14779)] 08:07:50.870451 run osmo-stp_10.42.42.5(pid=14779): stdout: | (launched: 2022-12-10_08:07:49.488835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:51.004542 run osmo-stp_10.42.42.5(pid=14779): stderr: | [0;m[38;5;43m20221210080749680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080749680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080749680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080749680 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080749681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080749681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080749681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:51.139623 run osmo-stp_10.42.42.5(pid=14779): stdout: | (launched: 2022-12-10_08:07:49.488835) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:51.265974 run osmo-stp_10.42.42.5(pid=14779): stderr: | [0;m[38;5;43m20221210080749680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080749680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080749680 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080749680 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080749681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080749681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080749681 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:51.416757 tst esme_ms_sms_storeforward.py:30: ERR: Error: osmo-stp_10.42.42.5(pid=14779): Process ended prematurely: osmo-stp_10.42.42.5(pid=14779) [trial-2371↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14779)] [trial-2371↪smpp↪esme_ms_sms_storeforward.py:30] 08:07:51.425831 tst esme_ms_sms_storeforward.py:30: Test FAILED (6.1 sec) 08:07:51.452635 run osmo-hlr_10.42.42.2(pid=14776): ERR: Terminated: ERROR {rc=237} [trial-2371↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14776)] 08:07:51.502186 run osmo-hlr_10.42.42.2(pid=14776): stdout: | (launched: 2022-12-10_08:07:48.500008) 08:07:51.553578 run osmo-hlr_10.42.42.2(pid=14776): stderr: | [0;m[1;31m20221210080748699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080748699 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080748700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080748700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080748700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080748700 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080748717 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/smpp/esme_ms_sms_storeforward.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080748727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080748727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080748727 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:07:51.624741 run osmo-msc_10.42.42.6(pid=14782): ERR: Terminated: ERROR {rc=2} [trial-2371↪smpp↪esme_ms_sms_storeforward.py↪esme_ms_sms_storeforward.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14782)] 08:07:51.674159 run osmo-msc_10.42.42.6(pid=14782): stdout: | (launched: 2022-12-10_08:07:50.502392) 08:07:51.725211 run osmo-msc_10.42.42.6(pid=14782): stderr: | [0;m[38;5;43m20221210080750822 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080750822 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fdec04cdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080750822 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080750822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080750822 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080750823 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080750824 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080750825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080750825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080750825 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:07:51.776485 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14775): Terminating (SIGTERM) 08:07:51.817964 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14778): Terminating (SIGTERM) 08:07:51.859539 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14781): Terminating (SIGTERM) 08:07:51.901563 --- ParallelTerminationStrategy: PID 14775 died... 08:07:51.921693 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14775): Terminated: ok {rc=0} 08:07:51.967751 --- ParallelTerminationStrategy: PID 14778 died... 08:07:51.987373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14778): Terminated: ok {rc=0} 08:07:52.033126 --- ParallelTerminationStrategy: PID 14781 died... 08:07:52.052766 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14781): Terminated: ok {rc=0} 08:07:52.140698 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 smpp esme_ms_sms_transaction.py ---------------------------------------------- 08:07:53.229283 tst smpp: Using 1 x ip_address (candidates: 6) 08:07:53.241143 tst smpp: Using 1 x bts (candidates: 1) 08:07:53.278459 tst esme_ms_sms_transaction.py: using LAC 27019 08:07:53.405673 tst esme_ms_sms_transaction.py: using RAC 244 08:07:53.524602 tst esme_ms_sms_transaction.py: using CellId 27019 08:07:53.640090 tst esme_ms_sms_transaction.py: using BVCI 27020 08:07:53.746927 tst smpp: Using 1 x ip_address (candidates: 6) 08:07:53.757467 tst smpp: Using 1 x ip_address (candidates: 6) 08:07:53.767768 tst smpp: Using 1 x ip_address (candidates: 6) 08:07:53.778071 tst smpp: Using 1 x ip_address (candidates: 6) 08:07:53.788624 tst smpp: Using 1 x ip_address (candidates: 6) 08:07:53.798953 tst smpp: Using 1 x modem (candidates: 1) 08:07:53.926657 tst esme_ms_sms_transaction.py: using MSISDN 7634 08:07:54.035253 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:07:54.490901 run create_hlr_db(pid=14784): Launched 08:07:54.603700 bus /sierra_2: Setting Powered False 08:07:55.662684 run create_hlr_db(pid=14784): Terminated: ok {rc=0} 08:07:56.096822 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14786): Launched 08:07:56.414599 run osmo-hlr_10.42.42.2(pid=14787): Launched 08:07:56.536628 run osmo-stp_10.42.42.5: Starting osmo-stp 08:07:57.079506 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14789): Launched 08:07:57.395025 run osmo-stp_10.42.42.5(pid=14790): Launched 08:07:57.516939 run osmo-msc_10.42.42.6: Starting osmo-msc 08:07:58.089716 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14792): Launched 08:07:58.405318 run osmo-msc_10.42.42.6(pid=14793): Launched 08:07:58.583304 run osmo-stp_10.42.42.5(pid=14790): ERR: Terminated: ERROR {rc=1} [trial-2371↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14790)] 08:07:58.716579 run osmo-stp_10.42.42.5(pid=14790): stdout: | (launched: 2022-12-10_08:07:57.337897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:58.850467 run osmo-stp_10.42.42.5(pid=14790): stderr: | [0;m[38;5;43m20221210080757528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080757528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080757528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080757528 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080757529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080757529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080757529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:58.983747 run osmo-stp_10.42.42.5(pid=14790): stdout: | (launched: 2022-12-10_08:07:57.337897) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:07:59.110187 run osmo-stp_10.42.42.5(pid=14790): stderr: | [0;m[38;5;43m20221210080757528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080757528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080757528 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080757528 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080757529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080757529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080757529 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:07:59.261017 tst esme_ms_sms_transaction.py:28: ERR: Error: osmo-stp_10.42.42.5(pid=14790): Process ended prematurely: osmo-stp_10.42.42.5(pid=14790) [trial-2371↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14790)] [trial-2371↪smpp↪esme_ms_sms_transaction.py:28] 08:07:59.269812 tst esme_ms_sms_transaction.py:28: Test FAILED (6.0 sec) 08:07:59.296871 run osmo-hlr_10.42.42.2(pid=14787): ERR: Terminated: ERROR {rc=237} [trial-2371↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14787)] 08:07:59.346937 run osmo-hlr_10.42.42.2(pid=14787): stdout: | (launched: 2022-12-10_08:07:56.357373) 08:07:59.398741 run osmo-hlr_10.42.42.2(pid=14787): stderr: | [0;m[1;31m20221210080756554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080756554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080756554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080756554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080756554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080756554 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080756566 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/smpp/esme_ms_sms_transaction.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080756574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080756574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080756575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:07:59.470927 run osmo-msc_10.42.42.6(pid=14793): ERR: Terminated: ERROR {rc=2} [trial-2371↪smpp↪esme_ms_sms_transaction.py↪esme_ms_sms_transaction.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14793)] 08:07:59.520857 run osmo-msc_10.42.42.6(pid=14793): stdout: | (launched: 2022-12-10_08:07:58.348170) 08:07:59.572593 run osmo-msc_10.42.42.6(pid=14793): stderr: | [0;m[38;5;43m20221210080758671 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080758671 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2779e71c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080758671 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080758671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080758672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080758672 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080758674 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080758674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080758674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080758674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:07:59.624555 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14786): Terminating (SIGTERM) 08:07:59.666245 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14789): Terminating (SIGTERM) 08:07:59.707908 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14792): Terminating (SIGTERM) 08:07:59.749812 --- ParallelTerminationStrategy: PID 14786 died... 08:07:59.769790 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14786): Terminated: ok {rc=0} 08:07:59.815896 --- ParallelTerminationStrategy: PID 14789 died... 08:07:59.835326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14789): Terminated: ok {rc=0} 08:07:59.881448 --- ParallelTerminationStrategy: PID 14792 died... 08:07:59.901068 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14792): Terminated: ok {rc=0} 08:07:59.988741 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 smpp FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 encryption --------------------------------------------------------------------- 08:08:01.185881 tst encryption: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:08:01.190629 tst encryption: Verifying 1 x bts (candidates: 11) 08:08:01.217557 tst encryption: Verifying 6 x ip_address (candidates: 9) 08:08:01.253230 tst encryption: Verifying 1 x modem (candidates: 12) 08:08:01.297992 tst encryption: Reserving 1 x bts (candidates: 11) 08:08:01.322640 tst encryption: Reserving 6 x ip_address (candidates: 9) 08:08:01.355378 tst encryption: Reserving 1 x modem (candidates: 12) 08:08:01.872342 tst encryption: RESERVED RESOURCES for encryption: bts sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st ---------------------------------------------- trial-2371 encryption register_a5_0_authopt.py ---------------------------------------------- 08:08:01.953356 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:01.968425 tst encryption: Using 1 x bts (candidates: 1) 08:08:02.011522 tst register_a5_0_authopt.py: using LAC 27020 08:08:02.133506 tst register_a5_0_authopt.py: using RAC 245 08:08:02.262414 tst register_a5_0_authopt.py: using CellId 27020 08:08:02.388734 tst register_a5_0_authopt.py: using BVCI 27021 08:08:02.504820 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:02.515648 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:02.526374 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:02.537032 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:02.547960 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:02.558581 tst encryption: Using 1 x modem (candidates: 1) 08:08:02.674390 tst register_a5_0_authopt.py:8: start network... 08:08:02.875622 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:08:03.339230 run create_hlr_db(pid=14798): Launched 08:08:03.454754 bus /sierra_2: Setting Powered False 08:08:04.514523 run create_hlr_db(pid=14798): Terminated: ok {rc=0} 08:08:04.952446 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14800): Launched 08:08:05.273286 run osmo-hlr_10.42.42.2(pid=14801): Launched 08:08:05.396489 run osmo-stp_10.42.42.5: Starting osmo-stp 08:08:05.949762 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14803): Launched 08:08:06.267663 run osmo-stp_10.42.42.5(pid=14804): Launched 08:08:06.389439 run osmo-msc_10.42.42.6: Starting osmo-msc 08:08:06.963540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14806): Launched 08:08:07.284256 run osmo-msc_10.42.42.6(pid=14807): Launched 08:08:07.462710 run osmo-stp_10.42.42.5(pid=14804): ERR: Terminated: ERROR {rc=1} [trial-2371↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14804)] 08:08:07.598393 run osmo-stp_10.42.42.5(pid=14804): stdout: | (launched: 2022-12-10_08:08:06.210274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:07.733118 run osmo-stp_10.42.42.5(pid=14804): stderr: | [0;m[38;5;43m20221210080806403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080806403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080806404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080806404 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080806405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080806405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080806405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:07.867019 run osmo-stp_10.42.42.5(pid=14804): stdout: | (launched: 2022-12-10_08:08:06.210274) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:07.994865 run osmo-stp_10.42.42.5(pid=14804): stderr: | [0;m[38;5;43m20221210080806403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080806403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080806404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080806404 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080806405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080806405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080806405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:08.147881 tst register_a5_0_authopt.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14804): Process ended prematurely: osmo-stp_10.42.42.5(pid=14804) [trial-2371↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14804)] [trial-2371↪encryption↪register_a5_0_authopt.py:8] 08:08:08.157326 tst register_a5_0_authopt.py:8: Test FAILED (6.3 sec) 08:08:08.184634 run osmo-hlr_10.42.42.2(pid=14801): ERR: Terminated: ERROR {rc=237} [trial-2371↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14801)] 08:08:08.234513 run osmo-hlr_10.42.42.2(pid=14801): stdout: | (launched: 2022-12-10_08:08:05.215675) 08:08:08.286023 run osmo-hlr_10.42.42.2(pid=14801): stderr: | [0;m[1;31m20221210080805412 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080805413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080805413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080805413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080805413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080805413 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080805424 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/encryption/register_a5_0_authopt.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080805434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080805434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080805434 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:08:08.357797 run osmo-msc_10.42.42.6(pid=14807): ERR: Terminated: ERROR {rc=2} [trial-2371↪encryption↪register_a5_0_authopt.py↪register_a5_0_authopt.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14807)] 08:08:08.407424 run osmo-msc_10.42.42.6(pid=14807): stdout: | (launched: 2022-12-10_08:08:07.226422) 08:08:08.458660 run osmo-msc_10.42.42.6(pid=14807): stderr: | [0;m[38;5;43m20221210080807547 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080807547 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff47d83cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080807547 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080807547 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080807548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080807548 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080807550 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080807550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080807550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080807550 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:08:08.510777 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14800): Terminating (SIGTERM) 08:08:08.552574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14803): Terminating (SIGTERM) 08:08:08.594599 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14806): Terminating (SIGTERM) 08:08:08.636222 --- ParallelTerminationStrategy: PID 14800 died... 08:08:08.655739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14800): Terminated: ok {rc=0} 08:08:08.701809 --- ParallelTerminationStrategy: PID 14803 died... 08:08:08.721479 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14803): Terminated: ok {rc=0} 08:08:08.767226 --- ParallelTerminationStrategy: PID 14806 died... 08:08:08.786705 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14806): Terminated: ok {rc=0} 08:08:08.873665 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 encryption register_a5_0_authreq.py ---------------------------------------------- 08:08:10.020758 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:10.032029 tst encryption: Using 1 x bts (candidates: 1) 08:08:10.069685 tst register_a5_0_authreq.py: using LAC 27021 08:08:10.198774 tst register_a5_0_authreq.py: using RAC 246 08:08:10.322869 tst register_a5_0_authreq.py: using CellId 27021 08:08:10.446460 tst register_a5_0_authreq.py: using BVCI 27022 08:08:10.562236 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:10.573221 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:10.584068 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:10.594807 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:10.605512 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:10.616039 tst encryption: Using 1 x modem (candidates: 1) 08:08:10.735247 tst register_a5_0_authreq.py:8: start network... 08:08:10.952265 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:08:11.447883 run create_hlr_db(pid=14809): Launched 08:08:11.576852 bus /sierra_2: Setting Powered False 08:08:12.640212 run create_hlr_db(pid=14809): Terminated: ok {rc=0} 08:08:13.066740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14811): Launched 08:08:13.366239 run osmo-hlr_10.42.42.2(pid=14812): Launched 08:08:13.481073 run osmo-stp_10.42.42.5: Starting osmo-stp 08:08:13.995360 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14814): Launched 08:08:14.293463 run osmo-stp_10.42.42.5(pid=14815): Launched 08:08:14.408164 run osmo-msc_10.42.42.6: Starting osmo-msc 08:08:14.947423 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14817): Launched 08:08:15.246358 run osmo-msc_10.42.42.6(pid=14818): Launched 08:08:15.414872 run osmo-stp_10.42.42.5(pid=14815): ERR: Terminated: ERROR {rc=1} [trial-2371↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14815)] 08:08:15.541729 run osmo-stp_10.42.42.5(pid=14815): stdout: | (launched: 2022-12-10_08:08:14.239200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:15.668634 run osmo-stp_10.42.42.5(pid=14815): stderr: | [0;m[38;5;43m20221210080814408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080814408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080814409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080814409 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080814410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080814410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080814410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:15.793787 run osmo-stp_10.42.42.5(pid=14815): stdout: | (launched: 2022-12-10_08:08:14.239200) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:15.929589 run osmo-stp_10.42.42.5(pid=14815): stderr: | [0;m[38;5;43m20221210080814408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080814408 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080814409 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080814409 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080814410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080814410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080814410 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:16.075445 tst register_a5_0_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=14815): Process ended prematurely: osmo-stp_10.42.42.5(pid=14815) [trial-2371↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14815)] [trial-2371↪encryption↪register_a5_0_authreq.py:8] 08:08:16.084570 tst register_a5_0_authreq.py:8: Test FAILED (6.1 sec) 08:08:16.111680 run osmo-hlr_10.42.42.2(pid=14812): ERR: Terminated: ERROR {rc=237} [trial-2371↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14812)] 08:08:16.160403 run osmo-hlr_10.42.42.2(pid=14812): stdout: | (launched: 2022-12-10_08:08:13.311856) 08:08:16.210368 run osmo-hlr_10.42.42.2(pid=14812): stderr: | [0;m[1;31m20221210080813487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080813487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080813487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080813487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080813487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080813487 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080813499 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/encryption/register_a5_0_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080813509 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080813510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080813510 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:08:16.280199 run osmo-msc_10.42.42.6(pid=14818): ERR: Terminated: ERROR {rc=2} [trial-2371↪encryption↪register_a5_0_authreq.py↪register_a5_0_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=14818)] 08:08:16.332453 run osmo-msc_10.42.42.6(pid=14818): stdout: | (launched: 2022-12-10_08:08:15.191441) 08:08:16.392482 run osmo-msc_10.42.42.6(pid=14818): stderr: | [0;m[38;5;43m20221210080815461 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080815461 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f261dc77c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080815461 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080815461 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080815462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080815462 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080815465 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080815466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080815466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080815466 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:08:16.461692 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14811): Terminating (SIGTERM) 08:08:16.508632 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14814): Terminating (SIGTERM) 08:08:16.556145 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14817): Terminating (SIGTERM) 08:08:16.601109 --- ParallelTerminationStrategy: PID 14811 died... 08:08:16.620747 run pcap-recorder_any(filters='host 10.42.42.2')(pid=14811): Terminated: ok {rc=0} 08:08:16.675740 --- ParallelTerminationStrategy: PID 14814 died... 08:08:16.698592 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=14814): Terminated: ok {rc=0} 08:08:16.751818 --- ParallelTerminationStrategy: PID 14817 died... 08:08:16.774714 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=14817): Terminated: ok {rc=0} 08:08:16.872788 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 encryption register_a5_1_authreq.py ---------------------------------------------- 08:08:18.067512 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:18.079188 tst encryption: Using 1 x bts (candidates: 1) 08:08:18.119922 tst register_a5_1_authreq.py: using LAC 27022 08:08:18.266931 tst register_a5_1_authreq.py: using RAC 247 08:08:18.418305 tst register_a5_1_authreq.py: using CellId 27022 08:08:18.570132 tst register_a5_1_authreq.py: using BVCI 27023 08:08:18.716317 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:18.730544 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:18.742642 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:18.754446 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:18.767162 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:18.778733 tst encryption: Using 1 x modem (candidates: 1) 08:08:18.911697 tst register_a5_1_authreq.py:8: start network... 08:08:19.131111 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:08:19.612718 run create_hlr_db(pid=15090): Launched 08:08:19.754861 bus /sierra_2: Setting Powered False 08:08:20.819174 run create_hlr_db(pid=15090): Terminated: ok {rc=0} 08:08:21.269718 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15094): Launched 08:08:21.597670 run osmo-hlr_10.42.42.2(pid=15095): Launched 08:08:21.842804 run osmo-stp_10.42.42.5: Starting osmo-stp 08:08:22.513717 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15097): Launched 08:08:22.853459 run osmo-stp_10.42.42.5(pid=15098): Launched 08:08:23.102613 run osmo-msc_10.42.42.6: Starting osmo-msc 08:08:23.789689 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15100): Launched 08:08:24.137706 run osmo-msc_10.42.42.6(pid=15101): Launched 08:08:24.501674 run osmo-stp_10.42.42.5(pid=15098): ERR: Terminated: ERROR {rc=1} [trial-2371↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15098)] 08:08:24.780381 run osmo-stp_10.42.42.5(pid=15098): stdout: | (launched: 2022-12-10_08:08:22.787059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:24.946301 run osmo-stp_10.42.42.5(pid=15098): stderr: | [0;m[38;5;43m20221210080823084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080823093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080823093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080823094 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080823094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080823094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080823094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:25.085556 run osmo-stp_10.42.42.5(pid=15098): stdout: | (launched: 2022-12-10_08:08:22.787059) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:25.217999 run osmo-stp_10.42.42.5(pid=15098): stderr: | [0;m[38;5;43m20221210080823084 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080823093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080823093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080823094 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080823094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080823094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080823094 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:25.377372 tst register_a5_1_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15098): Process ended prematurely: osmo-stp_10.42.42.5(pid=15098) [trial-2371↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15098)] [trial-2371↪encryption↪register_a5_1_authreq.py:8] 08:08:25.387828 tst register_a5_1_authreq.py:8: Test FAILED (7.4 sec) 08:08:25.417309 run osmo-hlr_10.42.42.2(pid=15095): ERR: Terminated: ERROR {rc=237} [trial-2371↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15095)] 08:08:25.470554 run osmo-hlr_10.42.42.2(pid=15095): stdout: | (launched: 2022-12-10_08:08:21.528285) 08:08:25.524015 run osmo-hlr_10.42.42.2(pid=15095): stderr: | [0;m[1;31m20221210080821832 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080821833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080821833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080821833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080821833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080821833 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080821851 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/encryption/register_a5_1_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080821868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080821868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080821868 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:08:25.599414 run osmo-msc_10.42.42.6(pid=15101): ERR: Terminated: ERROR {rc=2} [trial-2371↪encryption↪register_a5_1_authreq.py↪register_a5_1_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15101)] 08:08:25.651987 run osmo-msc_10.42.42.6(pid=15101): stdout: | (launched: 2022-12-10_08:08:24.064161) 08:08:25.705549 run osmo-msc_10.42.42.6(pid=15101): stderr: | [0;m[38;5;43m20221210080824569 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080824569 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa93f6fdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080824569 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080824569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080824569 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080824570 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080824571 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080824572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080824572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080824572 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:08:25.759488 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15094): Terminating (SIGTERM) 08:08:25.802388 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15097): Terminating (SIGTERM) 08:08:25.847033 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15100): Terminating (SIGTERM) 08:08:25.892271 --- ParallelTerminationStrategy: PID 15094 died... 08:08:25.913458 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15094): Terminated: ok {rc=0} 08:08:25.962992 --- ParallelTerminationStrategy: PID 15097 died... 08:08:25.983234 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15097): Terminated: ok {rc=0} 08:08:26.030523 --- ParallelTerminationStrategy: PID 15100 died... 08:08:26.051820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15100): Terminated: ok {rc=0} 08:08:26.142238 bus /sierra_2: Setting Powered False ---------------------------------------------- trial-2371 encryption register_a5_3_authreq.py ---------------------------------------------- 08:08:27.293492 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:27.305708 tst encryption: Using 1 x bts (candidates: 1) 08:08:27.344311 tst register_a5_3_authreq.py: using LAC 27023 08:08:27.469477 tst register_a5_3_authreq.py: using RAC 248 08:08:27.593175 tst register_a5_3_authreq.py: using CellId 27023 08:08:27.716098 tst register_a5_3_authreq.py: using BVCI 27024 08:08:27.829550 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:27.841771 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:27.853107 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:27.865586 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:27.879077 tst encryption: Using 1 x ip_address (candidates: 6) 08:08:27.890233 tst encryption: Using 1 x modem (candidates: 1) 08:08:28.019196 tst register_a5_3_authreq.py:8: start network... 08:08:28.241284 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:08:28.753553 run create_hlr_db(pid=15103): Launched 08:08:28.916768 bus /sierra_2: Setting Powered False 08:08:29.981687 run create_hlr_db(pid=15103): Terminated: ok {rc=0} 08:08:30.449879 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15105): Launched 08:08:30.797064 run osmo-hlr_10.42.42.2(pid=15106): Launched 08:08:31.037173 run osmo-stp_10.42.42.5: Starting osmo-stp 08:08:31.898342 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15108): Launched 08:08:32.314044 run osmo-stp_10.42.42.5(pid=15109): Launched 08:08:32.605564 run osmo-msc_10.42.42.6: Starting osmo-msc 08:08:33.394172 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15111): Launched 08:08:33.749689 run osmo-msc_10.42.42.6(pid=15112): Launched 08:08:34.099416 run osmo-stp_10.42.42.5(pid=15109): ERR: Terminated: ERROR {rc=1} [trial-2371↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15109)] 08:08:34.352521 run osmo-stp_10.42.42.5(pid=15109): stdout: | (launched: 2022-12-10_08:08:32.237026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:34.591888 run osmo-stp_10.42.42.5(pid=15109): stderr: | [0;m[38;5;43m20221210080832583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080832583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080832583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080832584 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080832586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080832586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080832587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:34.731129 run osmo-stp_10.42.42.5(pid=15109): stdout: | (launched: 2022-12-10_08:08:32.237026) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:08:34.865218 run osmo-stp_10.42.42.5(pid=15109): stderr: | [0;m[38;5;43m20221210080832583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210080832583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210080832583 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210080832584 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210080832586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210080832586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210080832587 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:08:35.023065 tst register_a5_3_authreq.py:8: ERR: Error: osmo-stp_10.42.42.5(pid=15109): Process ended prematurely: osmo-stp_10.42.42.5(pid=15109) [trial-2371↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15109)] [trial-2371↪encryption↪register_a5_3_authreq.py:8] 08:08:35.033599 tst register_a5_3_authreq.py:8: Test FAILED (7.8 sec) 08:08:35.063292 run osmo-hlr_10.42.42.2(pid=15106): ERR: Terminated: ERROR {rc=237} [trial-2371↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15106)] 08:08:35.115802 run osmo-hlr_10.42.42.2(pid=15106): stdout: | (launched: 2022-12-10_08:08:30.731228) 08:08:35.169395 run osmo-hlr_10.42.42.2(pid=15106): stderr: | [0;m[1;31m20221210080831100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210080831100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210080831100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210080831100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210080831100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210080831100 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210080831115 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/encryption/register_a5_3_authreq.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210080831128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210080831128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210080831128 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:08:35.243938 run osmo-msc_10.42.42.6(pid=15112): ERR: Terminated: ERROR {rc=2} [trial-2371↪encryption↪register_a5_3_authreq.py↪register_a5_3_authreq.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15112)] 08:08:35.296752 run osmo-msc_10.42.42.6(pid=15112): stdout: | (launched: 2022-12-10_08:08:33.686895) 08:08:35.350550 run osmo-msc_10.42.42.6(pid=15112): stderr: | [0;m[38;5;43m20221210080834278 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210080834278 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7de5e9ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210080834279 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210080834279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210080834279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210080834279 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210080834281 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210080834281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210080834281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210080834281 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:08:35.404166 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15105): Terminating (SIGTERM) 08:08:35.449316 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15108): Terminating (SIGTERM) 08:08:35.495026 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15111): Terminating (SIGTERM) 08:08:35.540266 --- ParallelTerminationStrategy: PID 15105 died... 08:08:35.561748 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15105): Terminated: ok {rc=0} 08:08:35.611430 --- ParallelTerminationStrategy: PID 15108 died... 08:08:35.632400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15108): Terminated: ok {rc=0} 08:08:35.681108 --- ParallelTerminationStrategy: PID 15111 died... 08:08:35.702140 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15111): Terminated: ok {rc=0} 08:08:35.792747 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 encryption FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 4g:srsenb-rftype@zmq+srsue-rftype@zmq --------------------------------------------------------------------- 08:08:37.000258 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:08:37.005740 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x enb (candidates: 2) 08:08:37.024644 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x modem (candidates: 12) 08:08:37.054795 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Verifying 1 x run_node (candidates: 1) 08:08:37.081886 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x enb (candidates: 2) 08:08:37.101922 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x modem (candidates: 12) 08:08:37.131258 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Reserving 1 x run_node (candidates: 1) 08:08:37.639606 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: RESERVED RESOURCES for 4g: enb srsENB-zmq modem srsUE-zmq_1 run_node e55cbce541824969b492cc4fa86bdef69cf65e7d ---------------------------------------------- trial-2371 4g:srsenb-rftype@zmq+srsue-rftype@zmq handover.py ---------------------------------------------- 08:08:37.646887 tst handover.py:11: TEST_CONFIG: {} 08:08:37.856128 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 08:08:37.872868 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 08:08:37.898360 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 08:08:37.952483 tst handover.py: using MSISDN 7635 08:08:38.067968 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7635', subscriber_id=0} 08:08:38.177606 run srsepc_10.42.42.118: Starting srsepc 08:08:40.059088 run rm-remote-dir(pid=15117): Launched 08:08:40.187815 bus /sierra_2: Setting Powered False 08:08:41.255770 run rm-remote-dir(pid=15117): Terminated: ok {rc=0} 08:08:41.715331 run mk-remote-dir(pid=15118): Launched 08:08:42.904038 run mk-remote-dir(pid=15118): Terminated: ok {rc=0} 08:08:43.203344 run scp-inst-to-remote(pid=15119): Launched 08:08:45.390248 run scp-inst-to-remote(pid=15119): Terminated: ok {rc=0} 08:08:45.739695 run rm-remote-dir(pid=15121): Launched 08:08:46.961130 run rm-remote-dir(pid=15121): Terminated: ok {rc=0} 08:08:47.320383 run mk-remote-dir(pid=15122): Launched 08:08:48.508601 run mk-remote-dir(pid=15122): Terminated: ok {rc=0} 08:08:48.807303 run scp-cfg-to-remote(pid=15123): Launched 08:08:49.992178 run scp-cfg-to-remote(pid=15123): Terminated: ok {rc=0} 08:08:50.289470 run scp-db-to-remote(pid=15125): Launched 08:08:51.475491 run scp-db-to-remote(pid=15125): Terminated: ok {rc=0} 08:08:51.614020 run srsepc_10.42.42.118: Setting RPATH for srsepc 08:08:51.935374 run patchelf(pid=15127): Launched 08:08:53.121260 run patchelf(pid=15127): Terminated: ok {rc=0} 08:08:53.259005 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 08:08:53.581392 run setcap-netadm(pid=15128): Launched 08:08:54.765750 run setcap-netadm(pid=15128): Terminated: ok {rc=0} 08:08:55.102378 run srsepc(pid=15129): Launched 08:08:55.223243 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 08:08:56.375071 run rm-remote-dir(pid=15130): Launched 08:08:56.560031 run srsepc(pid=15129): ERR: Terminated: ERROR {rc=127} [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15129)] 08:08:56.701872 run srsepc(pid=15129): stdout: | (launched: 2022-12-10_08:08:55.044221) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:08:56.843453 run srsepc(pid=15129): stderr: | (launched: 2022-12-10_08:08:55.092021) | Connection to 10.42.42.116 closed. 08:08:56.984332 run srsepc(pid=15129): stdout: | (launched: 2022-12-10_08:08:55.044221) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:08:57.119864 run srsepc(pid=15129): stderr: | (launched: 2022-12-10_08:08:55.092021) | Connection to 10.42.42.116 closed. 08:08:57.280178 run rm-remote-dir(pid=15130): Terminating (SIGINT) 08:08:57.466678 run rm-remote-dir(pid=15130): Terminated: ok {rc=0} 08:08:57.601645 tst handover.py:37: ERR: Error: srsepc(pid=15129): Process ended prematurely: srsepc(pid=15129) [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15129)] [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37] 08:08:57.612261 tst handover.py:37: Test FAILED (20.0 sec) 08:08:57.692290 run scp-back-log(pid=15131): Launched 08:08:58.772518 run scp-back-log(pid=15131): ERR: Terminated: ERROR {rc=1} [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15131)] 08:08:58.836528 run scp-back-log(pid=15131): stdout: | (launched: 2022-12-10_08:08:57.661454) 08:08:58.902064 run scp-back-log(pid=15131): stderr: | (launched: 2022-12-10_08:08:57.682127) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 08:08:58.975815 tst srsepc_10.42.42.118: Error('scp-back-log(pid=15131): launch_sync(): local process exited with status 1 [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15131)]') ---------------------------------------------- trial-2371 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_bidir.py ---------------------------------------------- 08:08:59.023050 tst iperf3_bidir.py:13: Number of physical ue: 1 08:08:59.238185 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 08:08:59.281768 tst iperf3_bidir.py:20: ue index0: srsue_10.42.42.116 08:08:59.481721 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 08:08:59.497455 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 08:08:59.529379 tst iperf3_bidir.py: using MSISDN 7636 08:08:59.638177 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7636', subscriber_id=0} 08:08:59.742831 run srsepc_10.42.42.118: Starting srsepc 08:09:00.355194 run rm-remote-dir(pid=15133): Launched 08:09:01.550919 run rm-remote-dir(pid=15133): Terminated: ok {rc=0} 08:09:01.918635 run mk-remote-dir(pid=15134): Launched 08:09:03.166375 run mk-remote-dir(pid=15134): Terminated: ok {rc=0} 08:09:03.465640 run scp-inst-to-remote(pid=15135): Launched 08:09:05.652656 run scp-inst-to-remote(pid=15135): Terminated: ok {rc=0} 08:09:06.001249 run rm-remote-dir(pid=15137): Launched 08:09:07.189660 run rm-remote-dir(pid=15137): Terminated: ok {rc=0} 08:09:07.540460 run mk-remote-dir(pid=15138): Launched 08:09:08.729475 run mk-remote-dir(pid=15138): Terminated: ok {rc=0} 08:09:09.027891 run scp-cfg-to-remote(pid=15139): Launched 08:09:10.213583 run scp-cfg-to-remote(pid=15139): Terminated: ok {rc=0} 08:09:10.510078 run scp-db-to-remote(pid=15141): Launched 08:09:11.696012 run scp-db-to-remote(pid=15141): Terminated: ok {rc=0} 08:09:11.833672 run srsepc_10.42.42.118: Setting RPATH for srsepc 08:09:12.157128 run patchelf(pid=15143): Launched 08:09:13.342348 run patchelf(pid=15143): Terminated: ok {rc=0} 08:09:13.480311 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 08:09:13.802802 run setcap-netadm(pid=15144): Launched 08:09:14.988765 run setcap-netadm(pid=15144): Terminated: ok {rc=0} 08:09:15.326698 run srsepc(pid=15145): Launched 08:09:15.447326 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 08:09:16.646986 run rm-remote-dir(pid=15146): Launched 08:09:16.946843 run srsepc(pid=15145): ERR: Terminated: ERROR {rc=127} [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15145)] 08:09:17.094055 run srsepc(pid=15145): stdout: | (launched: 2022-12-10_08:09:15.268485) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:09:17.236863 run srsepc(pid=15145): stderr: | (launched: 2022-12-10_08:09:15.316215) | Connection to 10.42.42.116 closed. 08:09:17.378826 run srsepc(pid=15145): stdout: | (launched: 2022-12-10_08:09:15.268485) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:09:17.514690 run srsepc(pid=15145): stderr: | (launched: 2022-12-10_08:09:15.316215) | Connection to 10.42.42.116 closed. 08:09:17.675210 run rm-remote-dir(pid=15146): Terminating (SIGINT) 08:09:17.862371 run rm-remote-dir(pid=15146): Terminated: ok {rc=0} 08:09:17.997129 tst iperf3_bidir.py:42: ERR: Error: srsepc(pid=15145): Process ended prematurely: srsepc(pid=15145) [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15145)] [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42] 08:09:18.007897 tst iperf3_bidir.py:42: Test FAILED (19.0 sec) 08:09:18.087845 run scp-back-log(pid=15147): Launched 08:09:19.167853 run scp-back-log(pid=15147): ERR: Terminated: ERROR {rc=1} [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15147)] 08:09:19.231355 run scp-back-log(pid=15147): stdout: | (launched: 2022-12-10_08:09:18.056941) 08:09:19.296527 run scp-back-log(pid=15147): stderr: | (launched: 2022-12-10_08:09:18.077672) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 08:09:19.369651 tst srsepc_10.42.42.118: Error('scp-back-log(pid=15147): launch_sync(): local process exited with status 1 [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15147)]') ---------------------------------------------- trial-2371 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_dl.py ---------------------------------------------- 08:09:19.416639 tst iperf3_dl.py:13: Number of physical ue: 1 08:09:19.632374 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 08:09:19.675369 tst iperf3_dl.py:20: ue index0: srsue_10.42.42.116 08:09:19.888714 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 08:09:19.904852 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 08:09:19.937754 tst iperf3_dl.py: using MSISDN 7637 08:09:20.053640 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7637', subscriber_id=0} 08:09:20.165942 run srsepc_10.42.42.118: Starting srsepc 08:09:20.815764 run rm-remote-dir(pid=15149): Launched 08:09:22.003810 run rm-remote-dir(pid=15149): Terminated: ok {rc=0} 08:09:22.352922 run mk-remote-dir(pid=15150): Launched 08:09:23.540472 run mk-remote-dir(pid=15150): Terminated: ok {rc=0} 08:09:23.837644 run scp-inst-to-remote(pid=15151): Launched 08:09:26.020394 run scp-inst-to-remote(pid=15151): Terminated: ok {rc=0} 08:09:26.345414 run rm-remote-dir(pid=15153): Launched 08:09:27.518861 run rm-remote-dir(pid=15153): Terminated: ok {rc=0} 08:09:27.845213 run mk-remote-dir(pid=15154): Launched 08:09:29.020628 run mk-remote-dir(pid=15154): Terminated: ok {rc=0} 08:09:29.297911 run scp-cfg-to-remote(pid=15155): Launched 08:09:30.469551 run scp-cfg-to-remote(pid=15155): Terminated: ok {rc=0} 08:09:30.745447 run scp-db-to-remote(pid=15157): Launched 08:09:31.940551 run scp-db-to-remote(pid=15157): Terminated: ok {rc=0} 08:09:32.106319 run srsepc_10.42.42.118: Setting RPATH for srsepc 08:09:32.443614 run patchelf(pid=15159): Launched 08:09:33.629318 run patchelf(pid=15159): Terminated: ok {rc=0} 08:09:33.767067 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 08:09:34.087848 run setcap-netadm(pid=15160): Launched 08:09:35.272552 run setcap-netadm(pid=15160): Terminated: ok {rc=0} 08:09:35.607916 run srsepc(pid=15161): Launched 08:09:35.728271 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 08:09:36.814304 run rm-remote-dir(pid=15162): Launched 08:09:36.985818 run srsepc(pid=15161): ERR: Terminated: ERROR {rc=127} [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15161)] 08:09:37.116175 run srsepc(pid=15161): stdout: | (launched: 2022-12-10_08:09:35.550470) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:09:37.247773 run srsepc(pid=15161): stderr: | (launched: 2022-12-10_08:09:35.597862) | Connection to 10.42.42.116 closed. 08:09:37.379424 run srsepc(pid=15161): stdout: | (launched: 2022-12-10_08:09:35.550470) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:09:37.505379 run srsepc(pid=15161): stderr: | (launched: 2022-12-10_08:09:35.597862) | Connection to 10.42.42.116 closed. 08:09:37.653893 run rm-remote-dir(pid=15162): Terminating (SIGINT) 08:09:37.827541 run rm-remote-dir(pid=15162): Terminated: ok {rc=0} 08:09:37.953633 tst iperf3_dl.py:42: ERR: Error: srsepc(pid=15161): Process ended prematurely: srsepc(pid=15161) [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15161)] [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42] 08:09:37.963323 tst iperf3_dl.py:42: Test FAILED (18.5 sec) 08:09:38.039589 run scp-back-log(pid=15163): Launched 08:09:39.115558 run scp-back-log(pid=15163): ERR: Terminated: ERROR {rc=1} [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15163)] 08:09:39.175761 run scp-back-log(pid=15163): stdout: | (launched: 2022-12-10_08:09:38.009933) 08:09:39.237862 run scp-back-log(pid=15163): stderr: | (launched: 2022-12-10_08:09:38.029583) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 08:09:39.307985 tst srsepc_10.42.42.118: Error('scp-back-log(pid=15163): launch_sync(): local process exited with status 1 [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15163)]') ---------------------------------------------- trial-2371 4g:srsenb-rftype@zmq+srsue-rftype@zmq iperf3_ul.py ---------------------------------------------- 08:09:39.353058 tst iperf3_ul.py:13: Number of physical ue: 1 08:09:39.552595 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 08:09:39.594470 tst iperf3_ul.py:20: ue index0: srsue_10.42.42.116 08:09:39.790709 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 08:09:39.806361 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 08:09:39.838435 tst iperf3_ul.py: using MSISDN 7638 08:09:39.946526 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7638', subscriber_id=0} 08:09:40.052299 run srsepc_10.42.42.118: Starting srsepc 08:09:40.661691 run rm-remote-dir(pid=15165): Launched 08:09:41.836855 run rm-remote-dir(pid=15165): Terminated: ok {rc=0} 08:09:42.165137 run mk-remote-dir(pid=15166): Launched 08:09:43.339382 run mk-remote-dir(pid=15166): Terminated: ok {rc=0} 08:09:43.618385 run scp-inst-to-remote(pid=15167): Launched 08:09:45.792784 run scp-inst-to-remote(pid=15167): Terminated: ok {rc=0} 08:09:46.174485 run rm-remote-dir(pid=15169): Launched 08:09:47.400892 run rm-remote-dir(pid=15169): Terminated: ok {rc=0} 08:09:47.750693 run mk-remote-dir(pid=15170): Launched 08:09:48.938729 run mk-remote-dir(pid=15170): Terminated: ok {rc=0} 08:09:49.237553 run scp-cfg-to-remote(pid=15171): Launched 08:09:50.423582 run scp-cfg-to-remote(pid=15171): Terminated: ok {rc=0} 08:09:50.719641 run scp-db-to-remote(pid=15173): Launched 08:09:51.904764 run scp-db-to-remote(pid=15173): Terminated: ok {rc=0} 08:09:52.042495 run srsepc_10.42.42.118: Setting RPATH for srsepc 08:09:52.365312 run patchelf(pid=15175): Launched 08:09:53.550825 run patchelf(pid=15175): Terminated: ok {rc=0} 08:09:53.689056 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 08:09:54.010720 run setcap-netadm(pid=15176): Launched 08:09:55.192489 run setcap-netadm(pid=15176): Terminated: ok {rc=0} 08:09:55.512064 run srsepc(pid=15177): Launched 08:09:55.624337 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 08:09:56.708444 run rm-remote-dir(pid=15178): Launched 08:09:56.880436 run srsepc(pid=15177): ERR: Terminated: ERROR {rc=127} [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15177)] 08:09:57.011871 run srsepc(pid=15177): stdout: | (launched: 2022-12-10_08:09:55.457437) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:09:57.144713 run srsepc(pid=15177): stderr: | (launched: 2022-12-10_08:09:55.502023) | Connection to 10.42.42.116 closed. 08:09:57.277381 run srsepc(pid=15177): stdout: | (launched: 2022-12-10_08:09:55.457437) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:09:57.403931 run srsepc(pid=15177): stderr: | (launched: 2022-12-10_08:09:55.502023) | Connection to 10.42.42.116 closed. 08:09:57.554076 run rm-remote-dir(pid=15178): Terminating (SIGINT) 08:09:57.729276 run rm-remote-dir(pid=15178): Terminated: ok {rc=0} 08:09:57.855233 tst iperf3_ul.py:42: ERR: Error: srsepc(pid=15177): Process ended prematurely: srsepc(pid=15177) [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15177)] [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42] 08:09:57.865178 tst iperf3_ul.py:42: Test FAILED (18.5 sec) 08:09:57.941475 run scp-back-log(pid=15179): Launched 08:09:59.018450 run scp-back-log(pid=15179): ERR: Terminated: ERROR {rc=1} [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15179)] 08:09:59.079368 run scp-back-log(pid=15179): stdout: | (launched: 2022-12-10_08:09:57.911756) 08:09:59.141702 run scp-back-log(pid=15179): stderr: | (launched: 2022-12-10_08:09:57.931280) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 08:09:59.211326 tst srsepc_10.42.42.118: Error('scp-back-log(pid=15179): launch_sync(): local process exited with status 1 [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15179)]') ---------------------------------------------- trial-2371 4g:srsenb-rftype@zmq+srsue-rftype@zmq ping.py ---------------------------------------------- 08:09:59.257045 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 08:09:59.273641 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 08:09:59.296349 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 08:09:59.347722 tst ping.py: using MSISDN 7639 08:09:59.458992 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7639', subscriber_id=0} 08:09:59.563359 run srsepc_10.42.42.118: Starting srsepc 08:10:00.175031 run rm-remote-dir(pid=15181): Launched 08:10:01.382772 run rm-remote-dir(pid=15181): Terminated: ok {rc=0} 08:10:01.793721 run mk-remote-dir(pid=15185): Launched 08:10:03.050949 run mk-remote-dir(pid=15185): Terminated: ok {rc=0} 08:10:03.349708 run scp-inst-to-remote(pid=15186): Launched 08:10:05.536120 run scp-inst-to-remote(pid=15186): Terminated: ok {rc=0} 08:10:05.883434 run rm-remote-dir(pid=15188): Launched 08:10:07.070472 run rm-remote-dir(pid=15188): Terminated: ok {rc=0} 08:10:07.420084 run mk-remote-dir(pid=15189): Launched 08:10:08.608034 run mk-remote-dir(pid=15189): Terminated: ok {rc=0} 08:10:08.905127 run scp-cfg-to-remote(pid=15190): Launched 08:10:10.089169 run scp-cfg-to-remote(pid=15190): Terminated: ok {rc=0} 08:10:10.385349 run scp-db-to-remote(pid=15192): Launched 08:10:11.571113 run scp-db-to-remote(pid=15192): Terminated: ok {rc=0} 08:10:11.707889 run srsepc_10.42.42.118: Setting RPATH for srsepc 08:10:12.028350 run patchelf(pid=15194): Launched 08:10:13.213244 run patchelf(pid=15194): Terminated: ok {rc=0} 08:10:13.350000 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 08:10:13.670057 run setcap-netadm(pid=15195): Launched 08:10:14.851688 run setcap-netadm(pid=15195): Terminated: ok {rc=0} 08:10:15.164744 run srsepc(pid=15196): Launched 08:10:15.276150 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 08:10:16.453730 run rm-remote-dir(pid=15197): Launched 08:10:16.718460 run srsepc(pid=15196): ERR: Terminated: ERROR {rc=127} [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15196)] 08:10:16.871890 run srsepc(pid=15196): stdout: | (launched: 2022-12-10_08:10:15.110712) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:10:17.060547 run srsepc(pid=15196): stderr: | (launched: 2022-12-10_08:10:15.154879) | Connection to 10.42.42.116 closed. 08:10:17.215067 run srsepc(pid=15196): stdout: | (launched: 2022-12-10_08:10:15.110712) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:10:17.344402 run srsepc(pid=15196): stderr: | (launched: 2022-12-10_08:10:15.154879) | Connection to 10.42.42.116 closed. 08:10:17.494438 run rm-remote-dir(pid=15197): Terminating (SIGINT) 08:10:17.669351 run rm-remote-dir(pid=15197): Terminated: ok {rc=0} 08:10:17.795546 tst ping.py:16: ERR: Error: srsepc(pid=15196): Process ended prematurely: srsepc(pid=15196) [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15196)] [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16] 08:10:17.806052 tst ping.py:16: Test FAILED (18.5 sec) 08:10:17.882354 run scp-back-log(pid=15198): Launched 08:10:18.960679 run scp-back-log(pid=15198): ERR: Terminated: ERROR {rc=1} [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15198)] 08:10:19.024079 run scp-back-log(pid=15198): stdout: | (launched: 2022-12-10_08:10:17.853122) 08:10:19.089333 run scp-back-log(pid=15198): stderr: | (launched: 2022-12-10_08:10:17.872775) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 08:10:19.162783 tst srsepc_10.42.42.118: Error('scp-back-log(pid=15198): launch_sync(): local process exited with status 1 [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15198)]') ---------------------------------------------- trial-2371 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mo_ping.py ---------------------------------------------- 08:10:19.210973 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 08:10:19.228016 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 08:10:19.251840 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 08:10:19.308488 tst rrc_idle_mo_ping.py: using MSISDN 7640 08:10:19.427486 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7640', subscriber_id=0} 08:10:19.538924 run srsepc_10.42.42.118: Starting srsepc 08:10:20.189832 run rm-remote-dir(pid=15200): Launched 08:10:21.377744 run rm-remote-dir(pid=15200): Terminated: ok {rc=0} 08:10:21.726259 run mk-remote-dir(pid=15201): Launched 08:10:22.913667 run mk-remote-dir(pid=15201): Terminated: ok {rc=0} 08:10:23.211586 run scp-inst-to-remote(pid=15202): Launched 08:10:25.395346 run scp-inst-to-remote(pid=15202): Terminated: ok {rc=0} 08:10:25.719864 run rm-remote-dir(pid=15204): Launched 08:10:26.893681 run rm-remote-dir(pid=15204): Terminated: ok {rc=0} 08:10:27.220080 run mk-remote-dir(pid=15205): Launched 08:10:28.398653 run mk-remote-dir(pid=15205): Terminated: ok {rc=0} 08:10:28.696675 run scp-cfg-to-remote(pid=15206): Launched 08:10:29.882019 run scp-cfg-to-remote(pid=15206): Terminated: ok {rc=0} 08:10:30.178089 run scp-db-to-remote(pid=15208): Launched 08:10:31.375337 run scp-db-to-remote(pid=15208): Terminated: ok {rc=0} 08:10:31.557739 run srsepc_10.42.42.118: Setting RPATH for srsepc 08:10:31.897786 run patchelf(pid=15210): Launched 08:10:33.119819 run patchelf(pid=15210): Terminated: ok {rc=0} 08:10:33.248917 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 08:10:33.547564 run setcap-netadm(pid=15211): Launched 08:10:34.719417 run setcap-netadm(pid=15211): Terminated: ok {rc=0} 08:10:35.032779 run srsepc(pid=15212): Launched 08:10:35.143647 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 08:10:36.218478 run rm-remote-dir(pid=15213): Launched 08:10:36.388803 run srsepc(pid=15212): ERR: Terminated: ERROR {rc=127} [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15212)] 08:10:36.520315 run srsepc(pid=15212): stdout: | (launched: 2022-12-10_08:10:34.978968) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:10:36.652452 run srsepc(pid=15212): stderr: | (launched: 2022-12-10_08:10:35.022953) | Connection to 10.42.42.116 closed. 08:10:36.784044 run srsepc(pid=15212): stdout: | (launched: 2022-12-10_08:10:34.978968) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:10:36.909476 run srsepc(pid=15212): stderr: | (launched: 2022-12-10_08:10:35.022953) | Connection to 10.42.42.116 closed. 08:10:37.058212 run rm-remote-dir(pid=15213): Terminating (SIGINT) 08:10:37.232653 run rm-remote-dir(pid=15213): Terminated: ok {rc=0} 08:10:37.358625 tst rrc_idle_mo_ping.py:16: ERR: Error: srsepc(pid=15212): Process ended prematurely: srsepc(pid=15212) [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15212)] [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16] 08:10:37.368431 tst rrc_idle_mo_ping.py:16: Test FAILED (18.2 sec) 08:10:37.444551 run scp-back-log(pid=15214): Launched 08:10:38.520759 run scp-back-log(pid=15214): ERR: Terminated: ERROR {rc=1} [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15214)] 08:10:38.581222 run scp-back-log(pid=15214): stdout: | (launched: 2022-12-10_08:10:37.414682) 08:10:38.643885 run scp-back-log(pid=15214): stderr: | (launched: 2022-12-10_08:10:37.434645) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 08:10:38.713870 tst srsepc_10.42.42.118: Error('scp-back-log(pid=15214): launch_sync(): local process exited with status 1 [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15214)]') ---------------------------------------------- trial-2371 4g:srsenb-rftype@zmq+srsue-rftype@zmq rrc_idle_mt_ping.py ---------------------------------------------- 08:10:38.759584 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x run_node (candidates: 1) 08:10:38.776338 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x enb (candidates: 1) 08:10:38.799291 tst 4g:srsenb-rftype@zmq+srsue-rftype@zmq: Using 1 x modem (candidates: 1) 08:10:38.851906 tst rrc_idle_mt_ping.py: using MSISDN 7641 08:10:38.971200 run srsepc_10.42.42.118: Add subscriber {algo_str='mil', imsi='001010123456789', msisdn='7641', subscriber_id=0} 08:10:39.083111 run srsepc_10.42.42.118: Starting srsepc 08:10:39.735904 run rm-remote-dir(pid=15216): Launched 08:10:40.925171 run rm-remote-dir(pid=15216): Terminated: ok {rc=0} 08:10:41.274667 run mk-remote-dir(pid=15217): Launched 08:10:42.462136 run mk-remote-dir(pid=15217): Terminated: ok {rc=0} 08:10:42.759734 run scp-inst-to-remote(pid=15218): Launched 08:10:44.946476 run scp-inst-to-remote(pid=15218): Terminated: ok {rc=0} 08:10:45.294252 run rm-remote-dir(pid=15220): Launched 08:10:46.479372 run rm-remote-dir(pid=15220): Terminated: ok {rc=0} 08:10:46.833786 run mk-remote-dir(pid=15221): Launched 08:10:48.060743 run mk-remote-dir(pid=15221): Terminated: ok {rc=0} 08:10:48.338735 run scp-cfg-to-remote(pid=15222): Launched 08:10:49.510819 run scp-cfg-to-remote(pid=15222): Terminated: ok {rc=0} 08:10:49.786899 run scp-db-to-remote(pid=15224): Launched 08:10:50.959698 run scp-db-to-remote(pid=15224): Terminated: ok {rc=0} 08:10:51.087572 run srsepc_10.42.42.118: Setting RPATH for srsepc 08:10:51.386824 run patchelf(pid=15226): Launched 08:10:52.559238 run patchelf(pid=15226): Terminated: ok {rc=0} 08:10:52.687461 run srsepc_10.42.42.118: Applying CAP_NET_ADMIN capability to srsepc 08:10:52.986575 run setcap-netadm(pid=15227): Launched 08:10:54.157522 run setcap-netadm(pid=15227): Terminated: ok {rc=0} 08:10:54.470773 run srsepc(pid=15228): Launched 08:10:54.582263 run srsenb_srsENB-zmq_10.42.42.117: Starting srsENB 08:10:55.733715 run rm-remote-dir(pid=15229): Launched 08:10:55.918617 run srsepc(pid=15228): ERR: Terminated: ERROR {rc=127} [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15228)] 08:10:56.059966 run srsepc(pid=15228): stdout: | (launched: 2022-12-10_08:10:54.416658) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:10:56.201719 run srsepc(pid=15228): stderr: | (launched: 2022-12-10_08:10:54.460790) | Connection to 10.42.42.116 closed. 08:10:56.342321 run srsepc(pid=15228): stdout: | (launched: 2022-12-10_08:10:54.416658) | /osmo-gsm-tester-srsepc/srslte/bin/srsepc: error while loading shared libraries: libboost_program_options.so.1.62.0: cannot open shared object file: No such file or directory 08:10:56.476876 run srsepc(pid=15228): stderr: | (launched: 2022-12-10_08:10:54.460790) | Connection to 10.42.42.116 closed. 08:10:56.636615 run rm-remote-dir(pid=15229): Terminating (SIGINT) 08:10:56.822565 run rm-remote-dir(pid=15229): Terminated: ok {rc=0} 08:10:56.956793 tst rrc_idle_mt_ping.py:16: ERR: Error: srsepc(pid=15228): Process ended prematurely: srsepc(pid=15228) [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15228)] [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16] 08:10:56.967445 tst rrc_idle_mt_ping.py:16: Test FAILED (18.2 sec) 08:10:57.046593 run scp-back-log(pid=15230): Launched 08:10:58.126731 run scp-back-log(pid=15230): ERR: Terminated: ERROR {rc=1} [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15230)] 08:10:58.190105 run scp-back-log(pid=15230): stdout: | (launched: 2022-12-10_08:10:57.015911) 08:10:58.255179 run scp-back-log(pid=15230): stderr: | (launched: 2022-12-10_08:10:57.036329) | scp: /osmo-gsm-tester-srsepc/srsepc/srsepc.log: No such file or directory 08:10:58.327960 tst srsepc_10.42.42.118: Error('scp-back-log(pid=15230): launch_sync(): local process exited with status 1 [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪scp-back-log(pid=15230)]') --------------------------------------------------------------------- trial-2371 4g:srsenb-rftype@zmq+srsue-rftype@zmq FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:nanobts+bts1-oc2g --------------------------------------------------------------------- 08:10:58.463014 tst handover_2G:nanobts+bts1-oc2g: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:10:58.468463 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x bts (candidates: 11) 08:10:58.510476 tst handover_2G:nanobts+bts1-oc2g: Verifying 6 x ip_address (candidates: 9) 08:10:58.537592 tst handover_2G:nanobts+bts1-oc2g: Verifying 2 x modem (candidates: 12) 08:10:58.591413 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x bts (candidates: 11) 08:10:58.635429 tst handover_2G:nanobts+bts1-oc2g: Reserving 6 x ip_address (candidates: 9) 08:10:58.662509 tst handover_2G:nanobts+bts1-oc2g: Reserving 2 x modem (candidates: 12) 08:10:59.209619 tst handover_2G:nanobts+bts1-oc2g: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OC-2G ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:nanobts+bts1-oc2g handover.py ---------------------------------------------- 08:10:59.215662 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 08:10:59.227028 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 08:10:59.265357 tst handover.py: using LAC 27024 08:10:59.392256 tst handover.py: using RAC 249 08:10:59.515953 tst handover.py: using CellId 27024 08:10:59.641248 tst handover.py: using BVCI 27025 08:10:59.755595 tst handover_2G:nanobts+bts1-oc2g: Using 1 x bts (candidates: 2) 08:10:59.790892 tst handover.py: using LAC 27025 08:10:59.915845 tst handover.py: using RAC 250 08:11:00.038932 tst handover.py: using CellId 27025 08:11:00.165697 tst handover.py: using BVCI 27026 08:11:00.281395 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 08:11:00.292496 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 08:11:00.303531 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 08:11:00.314813 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 08:11:00.326151 tst handover_2G:nanobts+bts1-oc2g: Using 1 x ip_address (candidates: 6) 08:11:00.337470 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 08:11:00.457526 tst handover_2G:nanobts+bts1-oc2g: Using 1 x modem (candidates: 2) 08:11:00.575664 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:11:01.057702 run create_hlr_db(pid=15235): Launched 08:11:02.270977 run create_hlr_db(pid=15235): Terminated: ok {rc=0} 08:11:02.582411 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15237): Launched 08:11:02.875195 run osmo-hlr_10.42.42.2(pid=15238): Launched 08:11:02.987070 run osmo-stp_10.42.42.5: Starting osmo-stp 08:11:03.489713 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15240): Launched 08:11:03.781912 run osmo-stp_10.42.42.5(pid=15241): Launched 08:11:03.895499 run osmo-msc_10.42.42.6: Starting osmo-msc 08:11:04.424732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15243): Launched 08:11:04.717277 run osmo-msc_10.42.42.6(pid=15244): Launched 08:11:04.882131 run osmo-stp_10.42.42.5(pid=15241): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15241)] 08:11:05.014397 run osmo-stp_10.42.42.5(pid=15241): stdout: | (launched: 2022-12-10_08:11:03.728490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:11:05.149438 run osmo-stp_10.42.42.5(pid=15241): stderr: | [0;m[38;5;43m20221210081103897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081103897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081103897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081103898 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081103898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081103898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081103898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:11:05.281421 run osmo-stp_10.42.42.5(pid=15241): stdout: | (launched: 2022-12-10_08:11:03.728490) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:11:05.406731 run osmo-stp_10.42.42.5(pid=15241): stderr: | [0;m[38;5;43m20221210081103897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081103897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081103897 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081103898 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081103898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081103898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081103898 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:11:05.556608 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15241): Process ended prematurely: osmo-stp_10.42.42.5(pid=15241) [trial-2371↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15241)] [trial-2371↪handover_2G:nanobts+bts1-oc2g↪handover.py:18] 08:11:05.565979 tst handover.py:18: Test FAILED (6.3 sec) 08:11:05.593578 run osmo-hlr_10.42.42.2(pid=15238): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15238)] 08:11:05.643470 run osmo-hlr_10.42.42.2(pid=15238): stdout: | (launched: 2022-12-10_08:11:02.822027) 08:11:05.695047 run osmo-hlr_10.42.42.2(pid=15238): stderr: | [0;m[1;31m20221210081102997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081102997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081102997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081102997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081102997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081102997 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081103010 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:nanobts+bts1-oc2g/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081103018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081103018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081103018 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:11:05.767210 run osmo-msc_10.42.42.6(pid=15244): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:nanobts+bts1-oc2g↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15244)] 08:11:05.817447 run osmo-msc_10.42.42.6(pid=15244): stdout: | (launched: 2022-12-10_08:11:04.664088) 08:11:05.868728 run osmo-msc_10.42.42.6(pid=15244): stderr: | [0;m[38;5;43m20221210081104930 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081104930 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc94dde8c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081104930 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081104930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081104930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081104930 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081104932 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081104932 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081104933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081104933 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:11:05.920575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15237): Terminating (SIGTERM) 08:11:05.962248 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15240): Terminating (SIGTERM) 08:11:06.004398 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15243): Terminating (SIGTERM) 08:11:06.046574 --- ParallelTerminationStrategy: PID 15237 died... 08:11:06.066442 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15237): Terminated: ok {rc=0} 08:11:06.112758 --- ParallelTerminationStrategy: PID 15240 died... 08:11:06.132271 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15240): Terminated: ok {rc=0} 08:11:06.178820 --- ParallelTerminationStrategy: PID 15243 died... 08:11:06.198493 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15243): Terminated: ok {rc=0} 08:11:06.286509 bus /sierra_3: Setting Powered False 08:11:07.385844 bus /sierra_3: Setting Powered False 08:11:08.502986 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:nanobts+bts1-oc2g FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:nanobts+bts1-octphy --------------------------------------------------------------------- 08:11:09.745151 tst handover_2G:nanobts+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:11:09.750228 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x bts (candidates: 11) 08:11:09.790358 tst handover_2G:nanobts+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 08:11:09.816274 tst handover_2G:nanobts+bts1-octphy: Verifying 2 x modem (candidates: 12) 08:11:09.867358 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x bts (candidates: 11) 08:11:09.906043 tst handover_2G:nanobts+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 08:11:09.931936 tst handover_2G:nanobts+bts1-octphy: Reserving 2 x modem (candidates: 12) 08:11:10.485346 tst handover_2G:nanobts+bts1-octphy: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:nanobts+bts1-octphy handover.py ---------------------------------------------- 08:11:10.490463 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:11:10.501267 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 08:11:10.538905 tst handover.py: using LAC 27026 08:11:10.654824 tst handover.py: using RAC 251 08:11:10.771988 tst handover.py: using CellId 27026 08:11:10.887765 tst handover.py: using BVCI 27027 08:11:10.995428 tst handover_2G:nanobts+bts1-octphy: Using 1 x bts (candidates: 2) 08:11:11.029203 tst handover.py: using LAC 27027 08:11:11.144849 tst handover.py: using RAC 252 08:11:11.259687 tst handover.py: using CellId 27027 08:11:11.376522 tst handover.py: using BVCI 27028 08:11:11.482419 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:11:11.493116 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:11:11.503547 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:11:11.514315 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:11:11.525185 tst handover_2G:nanobts+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:11:11.535903 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 08:11:11.654442 tst handover_2G:nanobts+bts1-octphy: Using 1 x modem (candidates: 2) 08:11:11.774180 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:11:12.236506 run create_hlr_db(pid=15250): Launched 08:11:12.358035 bus /sierra_2: Setting Powered False 08:11:13.420057 run create_hlr_db(pid=15250): Terminated: ok {rc=0} 08:11:13.815828 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15252): Launched 08:11:14.111009 run osmo-hlr_10.42.42.2(pid=15253): Launched 08:11:14.224178 run osmo-stp_10.42.42.5: Starting osmo-stp 08:11:14.704351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15255): Launched 08:11:14.998671 run osmo-stp_10.42.42.5(pid=15256): Launched 08:11:15.112109 run osmo-msc_10.42.42.6: Starting osmo-msc 08:11:15.619264 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15258): Launched 08:11:15.929705 run osmo-msc_10.42.42.6(pid=15259): Launched 08:11:16.393406 run osmo-stp_10.42.42.5(pid=15256): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15256)] 08:11:16.687199 run osmo-stp_10.42.42.5(pid=15256): stdout: | (launched: 2022-12-10_08:11:14.945193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:11:16.860340 run osmo-stp_10.42.42.5(pid=15256): stderr: | [0;m[38;5;43m20221210081115111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081115111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081115111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081115112 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081115114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081115114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081115114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:11:16.987967 run osmo-stp_10.42.42.5(pid=15256): stdout: | (launched: 2022-12-10_08:11:14.945193) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:11:17.109569 run osmo-stp_10.42.42.5(pid=15256): stderr: | [0;m[38;5;43m20221210081115111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081115111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081115111 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081115112 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081115114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081115114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081115114 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:11:17.253680 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15256): Process ended prematurely: osmo-stp_10.42.42.5(pid=15256) [trial-2371↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15256)] [trial-2371↪handover_2G:nanobts+bts1-octphy↪handover.py:18] 08:11:17.263101 tst handover.py:18: Test FAILED (6.8 sec) 08:11:17.289923 run osmo-hlr_10.42.42.2(pid=15253): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15253)] 08:11:17.338624 run osmo-hlr_10.42.42.2(pid=15253): stdout: | (launched: 2022-12-10_08:11:14.057347) 08:11:17.389258 run osmo-hlr_10.42.42.2(pid=15253): stderr: | [0;m[1;31m20221210081114233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081114233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081114233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081114233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081114233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081114233 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081114245 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:nanobts+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081114254 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081114255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081114255 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:11:17.461057 run osmo-msc_10.42.42.6(pid=15259): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:nanobts+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15259)] 08:11:17.509599 run osmo-msc_10.42.42.6(pid=15259): stdout: | (launched: 2022-12-10_08:11:15.860271) 08:11:17.558638 run osmo-msc_10.42.42.6(pid=15259): stderr: | [0;m[38;5;43m20221210081116403 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081116404 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fd13fee7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081116404 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081116404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081116404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081116404 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081116406 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081116406 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081116407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081116407 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:11:17.607929 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15252): Terminating (SIGTERM) 08:11:17.647570 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15255): Terminating (SIGTERM) 08:11:17.687920 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15258): Terminating (SIGTERM) 08:11:17.727535 --- ParallelTerminationStrategy: PID 15252 died... 08:11:17.746540 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15252): Terminated: ok {rc=0} 08:11:17.790599 --- ParallelTerminationStrategy: PID 15255 died... 08:11:17.809343 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15255): Terminated: ok {rc=0} 08:11:17.853117 --- ParallelTerminationStrategy: PID 15258 died... 08:11:17.871626 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15258): Terminated: ok {rc=0} 08:11:17.957113 bus /sierra_3: Setting Powered False 08:11:19.058643 bus /sierra_3: Setting Powered False 08:11:20.175088 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:nanobts+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:nanobts+bts1-trx-lms --------------------------------------------------------------------- 08:11:21.419787 tst handover_2G:nanobts+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:11:21.425442 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 08:11:21.481078 tst handover_2G:nanobts+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 08:11:21.508366 tst handover_2G:nanobts+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 08:11:21.560943 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 08:11:21.615289 tst handover_2G:nanobts+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 08:11:21.642106 tst handover_2G:nanobts+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 08:11:22.194069 tst handover_2G:nanobts+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:nanobts+bts1-trx-lms handover.py ---------------------------------------------- 08:11:22.199648 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:11:22.211175 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 08:11:22.250721 tst handover.py: using LAC 27028 08:11:22.375989 tst handover.py: using RAC 253 08:11:22.492533 tst handover.py: using CellId 27028 08:11:22.611165 tst handover.py: using BVCI 27029 08:11:22.718833 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x bts (candidates: 2) 08:11:22.766306 tst handover.py: using LAC 27029 08:11:22.886980 tst handover.py: using RAC 254 08:11:23.001307 tst handover.py: using CellId 27029 08:11:23.114632 tst handover.py: using BVCI 27030 08:11:23.220523 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:11:23.231189 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:11:23.241642 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:11:23.252176 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:11:23.262962 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:11:23.273545 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 08:11:23.390413 tst handover_2G:nanobts+bts1-trx-lms: Using 1 x modem (candidates: 2) 08:11:23.510003 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:11:23.969939 run create_hlr_db(pid=15265): Launched 08:11:24.091735 bus /sierra_2: Setting Powered False 08:11:25.154117 run create_hlr_db(pid=15265): Terminated: ok {rc=0} 08:11:25.551099 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15267): Launched 08:11:25.845303 run osmo-hlr_10.42.42.2(pid=15268): Launched 08:11:25.957876 run osmo-stp_10.42.42.5: Starting osmo-stp 08:11:26.437141 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15270): Launched 08:11:26.732561 run osmo-stp_10.42.42.5(pid=15271): Launched 08:11:26.845531 run osmo-msc_10.42.42.6: Starting osmo-msc 08:11:27.352096 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15273): Launched 08:11:27.645660 run osmo-msc_10.42.42.6(pid=15274): Launched 08:11:27.809922 run osmo-stp_10.42.42.5(pid=15271): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15271)] 08:11:27.933865 run osmo-stp_10.42.42.5(pid=15271): stdout: | (launched: 2022-12-10_08:11:26.677275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:11:28.057876 run osmo-stp_10.42.42.5(pid=15271): stderr: | [0;m[38;5;43m20221210081126847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081126847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081126848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081126848 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081126848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081126848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081126849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:11:28.180199 run osmo-stp_10.42.42.5(pid=15271): stdout: | (launched: 2022-12-10_08:11:26.677275) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:11:28.297615 run osmo-stp_10.42.42.5(pid=15271): stderr: | [0;m[38;5;43m20221210081126847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081126847 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081126848 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081126848 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081126848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081126848 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081126849 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:11:28.437526 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15271): Process ended prematurely: osmo-stp_10.42.42.5(pid=15271) [trial-2371↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15271)] [trial-2371↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18] 08:11:28.445641 tst handover.py:18: Test FAILED (6.2 sec) 08:11:28.471376 run osmo-hlr_10.42.42.2(pid=15268): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15268)] 08:11:28.518509 run osmo-hlr_10.42.42.2(pid=15268): stdout: | (launched: 2022-12-10_08:11:25.791534) 08:11:28.567258 run osmo-hlr_10.42.42.2(pid=15268): stderr: | [0;m[1;31m20221210081125966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081125966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081125966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081125966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081125966 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081125967 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081126006 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:nanobts+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081126017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081126017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081126017 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:11:28.635354 run osmo-msc_10.42.42.6(pid=15274): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:nanobts+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15274)] 08:11:28.682234 run osmo-msc_10.42.42.6(pid=15274): stdout: | (launched: 2022-12-10_08:11:27.592216) 08:11:28.730833 run osmo-msc_10.42.42.6(pid=15274): stderr: | [0;m[38;5;43m20221210081127864 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081127864 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f72f4deac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081127864 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081127864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081127864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081127864 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081127866 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081127867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081127867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081127867 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:11:28.779739 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15267): Terminating (SIGTERM) 08:11:28.819069 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15270): Terminating (SIGTERM) 08:11:28.858035 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15273): Terminating (SIGTERM) 08:11:28.897391 --- ParallelTerminationStrategy: PID 15267 died... 08:11:28.916343 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15267): Terminated: ok {rc=0} 08:11:28.959598 --- ParallelTerminationStrategy: PID 15270 died... 08:11:28.977875 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15270): Terminated: ok {rc=0} 08:11:29.020916 --- ParallelTerminationStrategy: PID 15273 died... 08:11:29.039758 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15273): Terminated: ok {rc=0} 08:11:29.124875 bus /sierra_3: Setting Powered False 08:11:30.222673 bus /sierra_3: Setting Powered False 08:11:31.336611 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:nanobts+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:nanobts+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 08:11:32.594288 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:11:32.599674 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 08:11:32.651268 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 08:11:32.678240 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 08:11:32.730619 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 08:11:32.780667 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 08:11:32.807472 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 08:11:33.361679 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:nanobts+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 08:11:33.367242 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:11:33.378588 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:11:33.416780 tst handover.py: using LAC 27030 08:11:33.540595 tst handover.py: using RAC 255 08:11:33.664666 tst handover.py: using CellId 27030 08:11:33.780430 tst handover.py: using BVCI 27031 08:11:33.886563 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:11:33.931015 tst handover.py: using LAC 27031 08:11:34.047814 tst handover.py: using RAC 1 08:11:34.171774 tst handover.py: using CellId 27031 08:11:34.296362 tst handover.py: using BVCI 27032 08:11:34.410758 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:11:34.422401 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:11:34.434027 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:11:34.445318 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:11:34.457022 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:11:34.468143 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:11:34.584726 tst handover_2G:nanobts+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:11:34.698774 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:11:35.129270 run create_hlr_db(pid=15279): Launched 08:11:35.250890 bus /sierra_2: Setting Powered False 08:11:36.310200 run create_hlr_db(pid=15279): Terminated: ok {rc=0} 08:11:36.713366 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15281): Launched 08:11:37.029270 run osmo-hlr_10.42.42.2(pid=15282): Launched 08:11:37.150499 run osmo-stp_10.42.42.5: Starting osmo-stp 08:11:37.665565 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15284): Launched 08:11:37.980407 run osmo-stp_10.42.42.5(pid=15285): Launched 08:11:38.101640 run osmo-msc_10.42.42.6: Starting osmo-msc 08:11:38.647586 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15287): Launched 08:11:38.963640 run osmo-msc_10.42.42.6(pid=15288): Launched 08:11:39.140355 run osmo-stp_10.42.42.5(pid=15285): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15285)] 08:11:39.273428 run osmo-stp_10.42.42.5(pid=15285): stdout: | (launched: 2022-12-10_08:11:37.923273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:11:39.406720 run osmo-stp_10.42.42.5(pid=15285): stderr: | [0;m[38;5;43m20221210081138113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081138114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081138114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081138114 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081138115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081138115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081138115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:11:39.539217 run osmo-stp_10.42.42.5(pid=15285): stdout: | (launched: 2022-12-10_08:11:37.923273) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:11:39.664842 run osmo-stp_10.42.42.5(pid=15285): stderr: | [0;m[38;5;43m20221210081138113 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081138114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081138114 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081138114 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081138115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081138115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081138115 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:11:39.815203 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15285): Process ended prematurely: osmo-stp_10.42.42.5(pid=15285) [trial-2371↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15285)] [trial-2371↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18] 08:11:39.823977 tst handover.py:18: Test FAILED (6.5 sec) 08:11:39.851604 run osmo-hlr_10.42.42.2(pid=15282): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15282)] 08:11:39.901319 run osmo-hlr_10.42.42.2(pid=15282): stdout: | (launched: 2022-12-10_08:11:36.972153) 08:11:39.952814 run osmo-hlr_10.42.42.2(pid=15282): stderr: | [0;m[1;31m20221210081137167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081137167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081137167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081137167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081137167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081137167 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081137179 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:nanobts+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081137188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081137188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081137188 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:11:40.024657 run osmo-msc_10.42.42.6(pid=15288): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15288)] 08:11:40.074863 run osmo-msc_10.42.42.6(pid=15288): stdout: | (launched: 2022-12-10_08:11:38.906408) 08:11:40.126303 run osmo-msc_10.42.42.6(pid=15288): stderr: | [0;m[38;5;43m20221210081139226 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081139226 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7ff69cce6c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081139226 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081139226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081139226 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081139227 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081139228 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081139229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081139229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081139229 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:11:40.178440 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15281): Terminating (SIGTERM) 08:11:40.220292 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15284): Terminating (SIGTERM) 08:11:40.262385 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15287): Terminating (SIGTERM) 08:11:40.304485 --- ParallelTerminationStrategy: PID 15281 died... 08:11:40.324410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15281): Terminated: ok {rc=0} 08:11:40.370651 --- ParallelTerminationStrategy: PID 15284 died... 08:11:40.390095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15284): Terminated: ok {rc=0} 08:11:40.436017 --- ParallelTerminationStrategy: PID 15287 died... 08:11:40.455456 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15287): Terminated: ok {rc=0} 08:11:40.542667 bus /sierra_3: Setting Powered False 08:11:41.643259 bus /sierra_3: Setting Powered False 08:11:42.760648 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:nanobts+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:nanobts+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 08:11:44.016825 tst handover_2G:nanobts+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:11:44.022459 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 08:11:44.078172 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:11:44.105314 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 08:11:44.157539 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 08:11:44.212406 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:11:44.239471 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 08:11:44.792076 tst handover_2G:nanobts+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:nanobts+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 08:11:44.798456 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:11:44.809891 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:11:44.847522 tst handover.py: using LAC 27032 08:11:44.971234 tst handover.py: using RAC 2 08:11:45.096813 tst handover.py: using CellId 27032 08:11:45.215692 tst handover.py: using BVCI 27033 08:11:45.323290 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:11:45.372102 tst handover.py: using LAC 27033 08:11:45.488554 tst handover.py: using RAC 3 08:11:45.607635 tst handover.py: using CellId 27033 08:11:45.721561 tst handover.py: using BVCI 27034 08:11:45.827223 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:11:45.841040 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:11:45.852396 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:11:45.863759 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:11:45.875035 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:11:45.886226 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:11:46.018260 tst handover_2G:nanobts+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:11:46.141619 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:11:46.649728 run create_hlr_db(pid=15295): Launched 08:11:46.811675 bus /sierra_2: Setting Powered False 08:11:47.873617 run create_hlr_db(pid=15295): Terminated: ok {rc=0} 08:11:48.284494 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15297): Launched 08:11:48.597888 run osmo-hlr_10.42.42.2(pid=15298): Launched 08:11:48.718510 run osmo-stp_10.42.42.5: Starting osmo-stp 08:11:49.236939 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15300): Launched 08:11:49.551755 run osmo-stp_10.42.42.5(pid=15301): Launched 08:11:49.673458 run osmo-msc_10.42.42.6: Starting osmo-msc 08:11:50.216308 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15303): Launched 08:11:50.531168 run osmo-msc_10.42.42.6(pid=15304): Launched 08:11:50.707953 run osmo-stp_10.42.42.5(pid=15301): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15301)] 08:11:50.841550 run osmo-stp_10.42.42.5(pid=15301): stdout: | (launched: 2022-12-10_08:11:49.494794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:11:50.975674 run osmo-stp_10.42.42.5(pid=15301): stderr: | [0;m[38;5;43m20221210081149687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081149687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081149687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081149687 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081149688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081149688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081149688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:11:51.109464 run osmo-stp_10.42.42.5(pid=15301): stdout: | (launched: 2022-12-10_08:11:49.494794) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:11:51.235806 run osmo-stp_10.42.42.5(pid=15301): stderr: | [0;m[38;5;43m20221210081149687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081149687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081149687 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081149687 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081149688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081149688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081149688 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:11:51.385971 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15301): Process ended prematurely: osmo-stp_10.42.42.5(pid=15301) [trial-2371↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15301)] [trial-2371↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18] 08:11:51.394729 tst handover.py:18: Test FAILED (6.6 sec) 08:11:51.422328 run osmo-hlr_10.42.42.2(pid=15298): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15298)] 08:11:51.471855 run osmo-hlr_10.42.42.2(pid=15298): stdout: | (launched: 2022-12-10_08:11:48.541175) 08:11:51.523380 run osmo-hlr_10.42.42.2(pid=15298): stderr: | [0;m[1;31m20221210081148738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081148738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081148738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081148739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081148739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081148739 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081148751 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:nanobts+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081148760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081148760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081148760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:11:51.594661 run osmo-msc_10.42.42.6(pid=15304): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15304)] 08:11:51.644161 run osmo-msc_10.42.42.6(pid=15304): stdout: | (launched: 2022-12-10_08:11:50.474114) 08:11:51.695310 run osmo-msc_10.42.42.6(pid=15304): stderr: | [0;m[38;5;43m20221210081150792 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081150792 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0e45606c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081150793 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081150793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081150793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081150793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081150795 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081150795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081150795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081150795 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:11:51.746909 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15297): Terminating (SIGTERM) 08:11:51.787864 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15300): Terminating (SIGTERM) 08:11:51.829301 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15303): Terminating (SIGTERM) 08:11:51.871015 --- ParallelTerminationStrategy: PID 15297 died... 08:11:51.890937 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15297): Terminated: ok {rc=0} 08:11:51.936915 --- ParallelTerminationStrategy: PID 15300 died... 08:11:51.956215 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15300): Terminated: ok {rc=0} 08:11:52.002374 --- ParallelTerminationStrategy: PID 15303 died... 08:11:52.021643 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15303): Terminated: ok {rc=0} 08:11:52.108238 bus /sierra_3: Setting Powered False 08:11:53.205701 bus /sierra_3: Setting Powered False 08:11:54.320296 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:nanobts+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:nanobts+bts1-sysmo --------------------------------------------------------------------- 08:11:55.584337 tst handover_2G:nanobts+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:11:55.589733 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x bts (candidates: 11) 08:11:55.631763 tst handover_2G:nanobts+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 08:11:55.659310 tst handover_2G:nanobts+bts1-sysmo: Verifying 2 x modem (candidates: 12) 08:11:55.710874 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x bts (candidates: 11) 08:11:55.752272 tst handover_2G:nanobts+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 08:11:55.778163 tst handover_2G:nanobts+bts1-sysmo: Reserving 2 x modem (candidates: 12) 08:11:56.327903 tst handover_2G:nanobts+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:nanobts+bts1-sysmo handover.py ---------------------------------------------- 08:11:56.333293 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:11:56.343956 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 08:11:56.381158 tst handover.py: using LAC 27034 08:11:56.494793 tst handover.py: using RAC 4 08:11:56.608167 tst handover.py: using CellId 27034 08:11:56.721648 tst handover.py: using BVCI 27035 08:11:56.827040 tst handover_2G:nanobts+bts1-sysmo: Using 1 x bts (candidates: 2) 08:11:56.860059 tst handover.py: using LAC 27035 08:11:56.974743 tst handover.py: using RAC 5 08:11:57.088822 tst handover.py: using CellId 27035 08:11:57.202893 tst handover.py: using BVCI 27036 08:11:57.308668 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:11:57.319309 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:11:57.329781 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:11:57.340727 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:11:57.351871 tst handover_2G:nanobts+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:11:57.362838 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 08:11:57.481907 tst handover_2G:nanobts+bts1-sysmo: Using 1 x modem (candidates: 2) 08:11:57.600656 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:11:58.059820 run create_hlr_db(pid=15309): Launched 08:11:58.181200 bus /sierra_2: Setting Powered False 08:11:59.243761 run create_hlr_db(pid=15309): Terminated: ok {rc=0} 08:11:59.639512 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15311): Launched 08:11:59.932374 run osmo-hlr_10.42.42.2(pid=15312): Launched 08:12:00.044630 run osmo-stp_10.42.42.5: Starting osmo-stp 08:12:00.539569 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15314): Launched 08:12:00.837684 run osmo-stp_10.42.42.5(pid=15315): Launched 08:12:01.085278 run osmo-msc_10.42.42.6: Starting osmo-msc 08:12:01.702588 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15317): Launched 08:12:02.055542 run osmo-msc_10.42.42.6(pid=15318): Launched 08:12:02.307560 run osmo-stp_10.42.42.5(pid=15315): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15315)] 08:12:02.440324 run osmo-stp_10.42.42.5(pid=15315): stdout: | (launched: 2022-12-10_08:12:00.778093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:02.579018 run osmo-stp_10.42.42.5(pid=15315): stderr: | [0;m[38;5;43m20221210081200999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081200999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081201000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081201000 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081201002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081201003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081201003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:02.713628 run osmo-stp_10.42.42.5(pid=15315): stdout: | (launched: 2022-12-10_08:12:00.778093) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:02.839598 run osmo-stp_10.42.42.5(pid=15315): stderr: | [0;m[38;5;43m20221210081200999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081200999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081201000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081201000 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081201002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081201003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081201003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:02.990714 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15315): Process ended prematurely: osmo-stp_10.42.42.5(pid=15315) [trial-2371↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15315)] [trial-2371↪handover_2G:nanobts+bts1-sysmo↪handover.py:18] 08:12:02.999547 tst handover.py:18: Test FAILED (6.7 sec) 08:12:03.027131 run osmo-hlr_10.42.42.2(pid=15312): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15312)] 08:12:03.077655 run osmo-hlr_10.42.42.2(pid=15312): stdout: | (launched: 2022-12-10_08:11:59.878822) 08:12:03.129756 run osmo-hlr_10.42.42.2(pid=15312): stderr: | [0;m[1;31m20221210081200052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081200052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081200052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081200052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081200052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081200052 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081200065 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:nanobts+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081200074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081200074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081200074 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:12:03.201970 run osmo-msc_10.42.42.6(pid=15318): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:nanobts+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15318)] 08:12:03.252092 run osmo-msc_10.42.42.6(pid=15318): stdout: | (launched: 2022-12-10_08:12:01.986552) 08:12:03.304022 run osmo-msc_10.42.42.6(pid=15318): stderr: | [0;m[38;5;43m20221210081202442 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081202442 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f54a9cfbc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081202442 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081202442 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081202443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081202443 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081202444 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081202445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081202445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081202445 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:12:03.355842 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15311): Terminating (SIGTERM) 08:12:03.397574 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15314): Terminating (SIGTERM) 08:12:03.439328 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15317): Terminating (SIGTERM) 08:12:03.481570 --- ParallelTerminationStrategy: PID 15311 died... 08:12:03.501523 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15311): Terminated: ok {rc=0} 08:12:03.548688 --- ParallelTerminationStrategy: PID 15314 died... 08:12:03.568259 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15314): Terminated: ok {rc=0} 08:12:03.614731 --- ParallelTerminationStrategy: PID 15317 died... 08:12:03.634383 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15317): Terminated: ok {rc=0} 08:12:03.722652 bus /sierra_3: Setting Powered False 08:12:04.821631 bus /sierra_3: Setting Powered False 08:12:05.938233 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:nanobts+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:nanobts+bts1-trx-b200 --------------------------------------------------------------------- 08:12:07.186153 tst handover_2G:nanobts+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:12:07.191493 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 08:12:07.244203 tst handover_2G:nanobts+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 08:12:07.270216 tst handover_2G:nanobts+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 08:12:07.322309 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 08:12:07.374961 tst handover_2G:nanobts+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 08:12:07.400775 tst handover_2G:nanobts+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 08:12:07.953756 tst handover_2G:nanobts+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:nanobts+bts1-trx-b200 handover.py ---------------------------------------------- 08:12:07.959033 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:12:07.969943 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:12:08.007272 tst handover.py: using LAC 27036 08:12:08.120533 tst handover.py: using RAC 6 08:12:08.233978 tst handover.py: using CellId 27036 08:12:08.348648 tst handover.py: using BVCI 27037 08:12:08.454030 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:12:08.500164 tst handover.py: using LAC 27037 08:12:08.625019 tst handover.py: using RAC 7 08:12:08.747158 tst handover.py: using CellId 27037 08:12:08.868896 tst handover.py: using BVCI 27038 08:12:08.983484 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:12:08.994778 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:12:09.005982 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:12:09.017789 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:12:09.029667 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:12:09.041471 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:12:09.158892 tst handover_2G:nanobts+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:12:09.272791 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:12:09.701596 run create_hlr_db(pid=15323): Launched 08:12:09.822130 bus /sierra_2: Setting Powered False 08:12:10.881447 run create_hlr_db(pid=15323): Terminated: ok {rc=0} 08:12:11.284575 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15325): Launched 08:12:11.598802 run osmo-hlr_10.42.42.2(pid=15326): Launched 08:12:11.719619 run osmo-stp_10.42.42.5: Starting osmo-stp 08:12:12.239718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15328): Launched 08:12:12.537745 run osmo-stp_10.42.42.5(pid=15329): Launched 08:12:12.650788 run osmo-msc_10.42.42.6: Starting osmo-msc 08:12:13.157742 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15331): Launched 08:12:13.452401 run osmo-msc_10.42.42.6(pid=15332): Launched 08:12:13.618691 run osmo-stp_10.42.42.5(pid=15329): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15329)] 08:12:13.743213 run osmo-stp_10.42.42.5(pid=15329): stdout: | (launched: 2022-12-10_08:12:12.484433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:13.868000 run osmo-stp_10.42.42.5(pid=15329): stderr: | [0;m[38;5;43m20221210081212651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081212651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081212652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081212652 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081212652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081212653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081212653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:13.990470 run osmo-stp_10.42.42.5(pid=15329): stdout: | (launched: 2022-12-10_08:12:12.484433) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:14.107350 run osmo-stp_10.42.42.5(pid=15329): stderr: | [0;m[38;5;43m20221210081212651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081212651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081212652 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081212652 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081212652 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081212653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081212653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:14.247961 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15329): Process ended prematurely: osmo-stp_10.42.42.5(pid=15329) [trial-2371↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15329)] [trial-2371↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18] 08:12:14.256186 tst handover.py:18: Test FAILED (6.3 sec) 08:12:14.281995 run osmo-hlr_10.42.42.2(pid=15326): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15326)] 08:12:14.329457 run osmo-hlr_10.42.42.2(pid=15326): stdout: | (launched: 2022-12-10_08:12:11.541990) 08:12:14.378558 run osmo-hlr_10.42.42.2(pid=15326): stderr: | [0;m[1;31m20221210081211738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081211738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081211738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081211738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081211738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081211738 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081211750 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:nanobts+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081211759 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081211760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081211760 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:12:14.446961 run osmo-msc_10.42.42.6(pid=15332): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:nanobts+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15332)] 08:12:14.494247 run osmo-msc_10.42.42.6(pid=15332): stdout: | (launched: 2022-12-10_08:12:13.398696) 08:12:14.543006 run osmo-msc_10.42.42.6(pid=15332): stderr: | [0;m[38;5;43m20221210081213670 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081213670 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f46660d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081213670 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081213670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081213670 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081213671 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081213673 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081213674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081213674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081213674 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:12:14.592410 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15325): Terminating (SIGTERM) 08:12:14.631579 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15328): Terminating (SIGTERM) 08:12:14.670820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15331): Terminating (SIGTERM) 08:12:14.710637 --- ParallelTerminationStrategy: PID 15325 died... 08:12:14.729606 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15325): Terminated: ok {rc=0} 08:12:14.773351 --- ParallelTerminationStrategy: PID 15328 died... 08:12:14.791861 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15328): Terminated: ok {rc=0} 08:12:14.835202 --- ParallelTerminationStrategy: PID 15331 died... 08:12:14.853721 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15331): Terminated: ok {rc=0} 08:12:14.937063 bus /sierra_3: Setting Powered False 08:12:16.040439 bus /sierra_3: Setting Powered False 08:12:17.172147 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:nanobts+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:nanobts+bts1-trx-umtrx --------------------------------------------------------------------- 08:12:18.436538 tst handover_2G:nanobts+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:12:18.443324 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:12:18.498276 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:12:18.525849 tst handover_2G:nanobts+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:12:18.578818 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:12:18.630786 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:12:18.656681 tst handover_2G:nanobts+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:12:19.210656 tst handover_2G:nanobts+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts NanoBTS-ONW-1900 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:nanobts+bts1-trx-umtrx handover.py ---------------------------------------------- 08:12:19.216412 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:12:19.227721 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:12:19.268403 tst handover.py: using LAC 27038 08:12:19.390721 tst handover.py: using RAC 8 08:12:19.516516 tst handover.py: using CellId 27038 08:12:19.639893 tst handover.py: using BVCI 27039 08:12:19.754413 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:12:19.801617 tst handover.py: using LAC 27039 08:12:19.916095 tst handover.py: using RAC 9 08:12:20.029416 tst handover.py: using CellId 27039 08:12:20.145544 tst handover.py: using BVCI 27040 08:12:20.251600 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:12:20.262313 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:12:20.272775 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:12:20.283720 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:12:20.294302 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:12:20.304701 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:12:20.422923 tst handover_2G:nanobts+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:12:20.545579 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:12:21.004420 run create_hlr_db(pid=15337): Launched 08:12:21.125932 bus /sierra_2: Setting Powered False 08:12:22.189128 run create_hlr_db(pid=15337): Terminated: ok {rc=0} 08:12:22.600001 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15339): Launched 08:12:22.914020 run osmo-hlr_10.42.42.2(pid=15340): Launched 08:12:23.035074 run osmo-stp_10.42.42.5: Starting osmo-stp 08:12:23.551242 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15344): Launched 08:12:23.866235 run osmo-stp_10.42.42.5(pid=15345): Launched 08:12:23.987396 run osmo-msc_10.42.42.6: Starting osmo-msc 08:12:24.530412 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15347): Launched 08:12:24.843596 run osmo-msc_10.42.42.6(pid=15348): Launched 08:12:25.019906 run osmo-stp_10.42.42.5(pid=15345): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15345)] 08:12:25.153312 run osmo-stp_10.42.42.5(pid=15345): stdout: | (launched: 2022-12-10_08:12:23.808628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:25.287503 run osmo-stp_10.42.42.5(pid=15345): stderr: | [0;m[38;5;43m20221210081223998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081223999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081223999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081223999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081224002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081224002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081224002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:25.420902 run osmo-stp_10.42.42.5(pid=15345): stdout: | (launched: 2022-12-10_08:12:23.808628) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:25.546202 run osmo-stp_10.42.42.5(pid=15345): stderr: | [0;m[38;5;43m20221210081223998 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081223999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081223999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081223999 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081224002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081224002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081224002 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:25.696557 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15345): Process ended prematurely: osmo-stp_10.42.42.5(pid=15345) [trial-2371↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15345)] [trial-2371↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18] 08:12:25.705349 tst handover.py:18: Test FAILED (6.5 sec) 08:12:25.732992 run osmo-hlr_10.42.42.2(pid=15340): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15340)] 08:12:25.782927 run osmo-hlr_10.42.42.2(pid=15340): stdout: | (launched: 2022-12-10_08:12:22.857122) 08:12:25.834737 run osmo-hlr_10.42.42.2(pid=15340): stderr: | [0;m[1;31m20221210081223051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081223051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081223051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081223051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081223051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081223051 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081223063 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:nanobts+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081223072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081223072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081223072 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:12:25.907097 run osmo-msc_10.42.42.6(pid=15348): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15348)] 08:12:25.957169 run osmo-msc_10.42.42.6(pid=15348): stdout: | (launched: 2022-12-10_08:12:24.786577) 08:12:26.009159 run osmo-msc_10.42.42.6(pid=15348): stderr: | [0;m[38;5;43m20221210081225105 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081225105 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f3ab853fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081225105 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081225105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081225105 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081225106 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081225107 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081225108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081225108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081225108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:12:26.061339 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15339): Terminating (SIGTERM) 08:12:26.103135 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15344): Terminating (SIGTERM) 08:12:26.145289 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15347): Terminating (SIGTERM) 08:12:26.187537 --- ParallelTerminationStrategy: PID 15339 died... 08:12:26.207359 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15339): Terminated: ok {rc=0} 08:12:26.253854 --- ParallelTerminationStrategy: PID 15344 died... 08:12:26.273311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15344): Terminated: ok {rc=0} 08:12:26.319325 --- ParallelTerminationStrategy: PID 15347 died... 08:12:26.338747 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15347): Terminated: ok {rc=0} 08:12:26.427108 bus /sierra_3: Setting Powered False 08:12:27.525786 bus /sierra_3: Setting Powered False 08:12:28.643771 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:nanobts+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:oc2g+bts1-octphy --------------------------------------------------------------------- 08:12:29.903118 tst handover_2G:oc2g+bts1-octphy: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:12:29.907985 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x bts (candidates: 11) 08:12:29.943983 tst handover_2G:oc2g+bts1-octphy: Verifying 6 x ip_address (candidates: 9) 08:12:29.969934 tst handover_2G:oc2g+bts1-octphy: Verifying 2 x modem (candidates: 12) 08:12:30.021417 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x bts (candidates: 11) 08:12:30.059327 tst handover_2G:oc2g+bts1-octphy: Reserving 6 x ip_address (candidates: 9) 08:12:30.086795 tst handover_2G:oc2g+bts1-octphy: Reserving 2 x modem (candidates: 12) 08:12:30.631679 tst handover_2G:oc2g+bts1-octphy: RESERVED RESOURCES for handover_2G: bts OC-2G OCTBTS 3500 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:oc2g+bts1-octphy handover.py ---------------------------------------------- 08:12:30.636686 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:12:30.647302 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 08:12:30.682286 tst handover.py: using LAC 27040 08:12:30.799394 tst handover.py: using RAC 10 08:12:30.941065 tst handover.py: using CellId 27040 08:12:31.082485 tst handover.py: using BVCI 27041 08:12:31.235085 tst handover_2G:oc2g+bts1-octphy: Using 1 x bts (candidates: 2) 08:12:31.269425 tst handover.py: using LAC 27041 08:12:31.402040 tst handover.py: using RAC 11 08:12:31.545751 tst handover.py: using CellId 27041 08:12:31.672671 tst handover.py: using BVCI 27042 08:12:31.818037 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:12:31.829699 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:12:31.846716 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:12:31.859647 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:12:31.872748 tst handover_2G:oc2g+bts1-octphy: Using 1 x ip_address (candidates: 6) 08:12:31.887249 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 08:12:32.011219 tst handover_2G:oc2g+bts1-octphy: Using 1 x modem (candidates: 2) 08:12:32.150835 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:12:32.585302 run create_hlr_db(pid=15354): Launched 08:12:32.705941 bus /sierra_2: Setting Powered False 08:12:33.768334 run create_hlr_db(pid=15354): Terminated: ok {rc=0} 08:12:34.179907 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15356): Launched 08:12:34.494073 run osmo-hlr_10.42.42.2(pid=15357): Launched 08:12:34.615800 run osmo-stp_10.42.42.5: Starting osmo-stp 08:12:35.133363 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15359): Launched 08:12:35.449301 run osmo-stp_10.42.42.5(pid=15360): Launched 08:12:35.571492 run osmo-msc_10.42.42.6: Starting osmo-msc 08:12:36.118965 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15363): Launched 08:12:36.435404 run osmo-msc_10.42.42.6(pid=15364): Launched 08:12:36.613799 run osmo-stp_10.42.42.5(pid=15360): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15360)] 08:12:36.747086 run osmo-stp_10.42.42.5(pid=15360): stdout: | (launched: 2022-12-10_08:12:35.392077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:36.881553 run osmo-stp_10.42.42.5(pid=15360): stderr: | [0;m[38;5;43m20221210081235584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081235584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081235585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081235585 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081235586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081235586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081235586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:37.015192 run osmo-stp_10.42.42.5(pid=15360): stdout: | (launched: 2022-12-10_08:12:35.392077) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:37.141304 run osmo-stp_10.42.42.5(pid=15360): stderr: | [0;m[38;5;43m20221210081235584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081235584 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081235585 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081235585 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081235586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081235586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081235586 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:37.292341 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15360): Process ended prematurely: osmo-stp_10.42.42.5(pid=15360) [trial-2371↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15360)] [trial-2371↪handover_2G:oc2g+bts1-octphy↪handover.py:18] 08:12:37.301200 tst handover.py:18: Test FAILED (6.7 sec) 08:12:37.328769 run osmo-hlr_10.42.42.2(pid=15357): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15357)] 08:12:37.378857 run osmo-hlr_10.42.42.2(pid=15357): stdout: | (launched: 2022-12-10_08:12:34.437125) 08:12:37.430537 run osmo-hlr_10.42.42.2(pid=15357): stderr: | [0;m[1;31m20221210081234634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081234634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081234634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081234634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081234634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081234634 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081234649 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:oc2g+bts1-octphy/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081234657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081234657 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081234658 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:12:37.502440 run osmo-msc_10.42.42.6(pid=15364): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:oc2g+bts1-octphy↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15364)] 08:12:37.552444 run osmo-msc_10.42.42.6(pid=15364): stdout: | (launched: 2022-12-10_08:12:36.378199) 08:12:37.603885 run osmo-msc_10.42.42.6(pid=15364): stderr: | [0;m[38;5;43m20221210081236698 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081236698 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1e57d30c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081236698 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081236698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081236698 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081236699 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081236700 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081236701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081236701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081236701 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:12:37.655825 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15356): Terminating (SIGTERM) 08:12:37.697361 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15359): Terminating (SIGTERM) 08:12:37.739462 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15363): Terminating (SIGTERM) 08:12:37.781760 --- ParallelTerminationStrategy: PID 15356 died... 08:12:37.801641 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15356): Terminated: ok {rc=0} 08:12:37.847804 --- ParallelTerminationStrategy: PID 15359 died... 08:12:37.867249 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15359): Terminated: ok {rc=0} 08:12:37.913334 --- ParallelTerminationStrategy: PID 15363 died... 08:12:37.932642 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15363): Terminated: ok {rc=0} 08:12:38.020132 bus /sierra_3: Setting Powered False 08:12:39.118913 bus /sierra_3: Setting Powered False 08:12:40.234768 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:oc2g+bts1-octphy FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:oc2g+bts1-trx-lms --------------------------------------------------------------------- 08:12:41.474680 tst handover_2G:oc2g+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:12:41.480301 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 08:12:41.533451 tst handover_2G:oc2g+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 08:12:41.561233 tst handover_2G:oc2g+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 08:12:41.615314 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 08:12:41.668262 tst handover_2G:oc2g+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 08:12:41.695909 tst handover_2G:oc2g+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 08:12:42.243666 tst handover_2G:oc2g+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OC-2G LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:oc2g+bts1-trx-lms handover.py ---------------------------------------------- 08:12:42.249280 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:12:42.260292 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 08:12:42.297235 tst handover.py: using LAC 27042 08:12:42.422665 tst handover.py: using RAC 12 08:12:42.545842 tst handover.py: using CellId 27042 08:12:42.669825 tst handover.py: using BVCI 27043 08:12:42.777123 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x bts (candidates: 2) 08:12:42.825866 tst handover.py: using LAC 27043 08:12:42.942805 tst handover.py: using RAC 13 08:12:43.071731 tst handover.py: using CellId 27043 08:12:43.194083 tst handover.py: using BVCI 27044 08:12:43.309157 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:12:43.320346 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:12:43.331516 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:12:43.343467 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:12:43.356019 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:12:43.368382 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 08:12:43.486235 tst handover_2G:oc2g+bts1-trx-lms: Using 1 x modem (candidates: 2) 08:12:43.605675 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:12:44.035909 run create_hlr_db(pid=15369): Launched 08:12:44.158165 bus /sierra_2: Setting Powered False 08:12:45.217272 run create_hlr_db(pid=15369): Terminated: ok {rc=0} 08:12:45.620531 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15371): Launched 08:12:45.952456 run osmo-hlr_10.42.42.2(pid=15372): Launched 08:12:46.190873 run osmo-stp_10.42.42.5: Starting osmo-stp 08:12:46.963095 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15374): Launched 08:12:47.308247 run osmo-stp_10.42.42.5(pid=15375): Launched 08:12:47.438303 run osmo-msc_10.42.42.6: Starting osmo-msc 08:12:47.981389 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15377): Launched 08:12:48.296331 run osmo-msc_10.42.42.6(pid=15378): Launched 08:12:48.474116 run osmo-stp_10.42.42.5(pid=15375): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15375)] 08:12:48.607881 run osmo-stp_10.42.42.5(pid=15375): stdout: | (launched: 2022-12-10_08:12:47.242761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:48.742290 run osmo-stp_10.42.42.5(pid=15375): stderr: | [0;m[38;5;43m20221210081247452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081247452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081247452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081247452 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081247453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081247453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081247453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:48.875875 run osmo-stp_10.42.42.5(pid=15375): stdout: | (launched: 2022-12-10_08:12:47.242761) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:49.002039 run osmo-stp_10.42.42.5(pid=15375): stderr: | [0;m[38;5;43m20221210081247452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081247452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081247452 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081247452 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081247453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081247453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081247453 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:12:49.152504 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15375): Process ended prematurely: osmo-stp_10.42.42.5(pid=15375) [trial-2371↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15375)] [trial-2371↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18] 08:12:49.161514 tst handover.py:18: Test FAILED (6.9 sec) 08:12:49.189224 run osmo-hlr_10.42.42.2(pid=15372): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15372)] 08:12:49.239499 run osmo-hlr_10.42.42.2(pid=15372): stdout: | (launched: 2022-12-10_08:12:45.891654) 08:12:49.291303 run osmo-hlr_10.42.42.2(pid=15372): stderr: | [0;m[1;31m20221210081246228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081246228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081246228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081246228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081246228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081246228 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081246254 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:oc2g+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081246266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081246266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081246266 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:12:49.363267 run osmo-msc_10.42.42.6(pid=15378): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:oc2g+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15378)] 08:12:49.413169 run osmo-msc_10.42.42.6(pid=15378): stdout: | (launched: 2022-12-10_08:12:48.239362) 08:12:49.465103 run osmo-msc_10.42.42.6(pid=15378): stderr: | [0;m[38;5;43m20221210081248560 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081248560 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f5922f96c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081248560 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081248560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081248560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081248560 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081248562 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081248562 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081248563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081248563 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:12:49.517308 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15371): Terminating (SIGTERM) 08:12:49.558810 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15374): Terminating (SIGTERM) 08:12:49.600511 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15377): Terminating (SIGTERM) 08:12:49.642522 --- ParallelTerminationStrategy: PID 15371 died... 08:12:49.662350 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15371): Terminated: ok {rc=0} 08:12:49.708674 --- ParallelTerminationStrategy: PID 15374 died... 08:12:49.728052 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15374): Terminated: ok {rc=0} 08:12:49.774272 --- ParallelTerminationStrategy: PID 15377 died... 08:12:49.793849 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15377): Terminated: ok {rc=0} 08:12:49.881567 bus /sierra_3: Setting Powered False 08:12:50.980064 bus /sierra_3: Setting Powered False 08:12:52.097147 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:oc2g+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:oc2g+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 08:12:53.356217 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:12:53.361952 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 08:12:53.408701 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 08:12:53.437014 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 08:12:53.490012 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 08:12:53.537606 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 08:12:53.564659 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 08:12:54.116742 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OC-2G LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:oc2g+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 08:12:54.122238 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:12:54.133575 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:12:54.168768 tst handover.py: using LAC 27044 08:12:54.293430 tst handover.py: using RAC 14 08:12:54.418385 tst handover.py: using CellId 27044 08:12:54.543381 tst handover.py: using BVCI 27045 08:12:54.651782 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:12:54.696576 tst handover.py: using LAC 27045 08:12:54.814605 tst handover.py: using RAC 15 08:12:54.929884 tst handover.py: using CellId 27045 08:12:55.045712 tst handover.py: using BVCI 27046 08:12:55.152054 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:12:55.163154 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:12:55.173891 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:12:55.184693 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:12:55.195671 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:12:55.206844 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:12:55.320382 tst handover_2G:oc2g+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:12:55.438716 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:12:55.870681 run create_hlr_db(pid=15383): Launched 08:12:55.991959 bus /sierra_2: Setting Powered False 08:12:57.051611 run create_hlr_db(pid=15383): Terminated: ok {rc=0} 08:12:57.437621 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15385): Launched 08:12:57.732558 run osmo-hlr_10.42.42.2(pid=15386): Launched 08:12:57.845367 run osmo-stp_10.42.42.5: Starting osmo-stp 08:12:58.325262 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15388): Launched 08:12:58.619334 run osmo-stp_10.42.42.5(pid=15389): Launched 08:12:58.732118 run osmo-msc_10.42.42.6: Starting osmo-msc 08:12:59.240495 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15391): Launched 08:12:59.535624 run osmo-msc_10.42.42.6(pid=15392): Launched 08:12:59.701419 run osmo-stp_10.42.42.5(pid=15389): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15389)] 08:12:59.827685 run osmo-stp_10.42.42.5(pid=15389): stdout: | (launched: 2022-12-10_08:12:58.565920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:12:59.952011 run osmo-stp_10.42.42.5(pid=15389): stderr: | [0;m[38;5;43m20221210081258737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081258737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081258738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081258738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081258738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081258738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081258739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:00.074663 run osmo-stp_10.42.42.5(pid=15389): stdout: | (launched: 2022-12-10_08:12:58.565920) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:00.191650 run osmo-stp_10.42.42.5(pid=15389): stderr: | [0;m[38;5;43m20221210081258737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081258737 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081258738 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081258738 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081258738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081258738 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081258739 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:00.331953 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15389): Process ended prematurely: osmo-stp_10.42.42.5(pid=15389) [trial-2371↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15389)] [trial-2371↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18] 08:13:00.340208 tst handover.py:18: Test FAILED (6.2 sec) 08:13:00.366178 run osmo-hlr_10.42.42.2(pid=15386): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15386)] 08:13:00.413591 run osmo-hlr_10.42.42.2(pid=15386): stdout: | (launched: 2022-12-10_08:12:57.679016) 08:13:00.462538 run osmo-hlr_10.42.42.2(pid=15386): stderr: | [0;m[1;31m20221210081257853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081257853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081257853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081257853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081257853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081257853 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081257866 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:oc2g+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081257875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081257875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081257875 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:13:00.530675 run osmo-msc_10.42.42.6(pid=15392): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15392)] 08:13:00.577645 run osmo-msc_10.42.42.6(pid=15392): stdout: | (launched: 2022-12-10_08:12:59.481553) 08:13:00.626167 run osmo-msc_10.42.42.6(pid=15392): stderr: | [0;m[38;5;43m20221210081259751 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081259751 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6062b3fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081259751 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081259751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081259751 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081259752 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081259754 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081259755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081259755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081259755 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:13:00.675196 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15385): Terminating (SIGTERM) 08:13:00.714470 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15388): Terminating (SIGTERM) 08:13:00.753619 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15391): Terminating (SIGTERM) 08:13:00.793177 --- ParallelTerminationStrategy: PID 15385 died... 08:13:00.812202 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15385): Terminated: ok {rc=0} 08:13:00.866597 --- ParallelTerminationStrategy: PID 15388 died... 08:13:00.892351 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15388): Terminated: ok {rc=0} 08:13:00.954998 --- ParallelTerminationStrategy: PID 15391 died... 08:13:00.976850 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15391): Terminated: ok {rc=0} 08:13:01.085362 bus /sierra_3: Setting Powered False 08:13:02.199194 bus /sierra_3: Setting Powered False 08:13:03.313648 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:oc2g+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:oc2g+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 08:13:04.568523 tst handover_2G:oc2g+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:13:04.574546 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 08:13:04.627030 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:13:04.654028 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 08:13:04.707153 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 08:13:04.757166 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:13:04.782934 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 08:13:05.337708 tst handover_2G:oc2g+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:oc2g+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 08:13:05.344124 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:13:05.355322 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:13:05.389989 tst handover.py: using LAC 27046 08:13:05.505667 tst handover.py: using RAC 16 08:13:05.625021 tst handover.py: using CellId 27046 08:13:05.740825 tst handover.py: using BVCI 27047 08:13:05.847407 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:13:05.896315 tst handover.py: using LAC 27047 08:13:06.013878 tst handover.py: using RAC 17 08:13:06.129349 tst handover.py: using CellId 27047 08:13:06.245440 tst handover.py: using BVCI 27048 08:13:06.352230 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:13:06.363410 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:13:06.374294 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:13:06.385296 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:13:06.396299 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:13:06.407231 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:13:06.524672 tst handover_2G:oc2g+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:13:06.645110 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:13:07.106119 run create_hlr_db(pid=15397): Launched 08:13:07.227747 bus /sierra_2: Setting Powered False 08:13:08.290130 run create_hlr_db(pid=15397): Terminated: ok {rc=0} 08:13:08.686742 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15399): Launched 08:13:08.980593 run osmo-hlr_10.42.42.2(pid=15400): Launched 08:13:09.093232 run osmo-stp_10.42.42.5: Starting osmo-stp 08:13:09.573031 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15402): Launched 08:13:09.868386 run osmo-stp_10.42.42.5(pid=15403): Launched 08:13:09.980768 run osmo-msc_10.42.42.6: Starting osmo-msc 08:13:10.488914 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15405): Launched 08:13:10.783290 run osmo-msc_10.42.42.6(pid=15406): Launched 08:13:10.948937 run osmo-stp_10.42.42.5(pid=15403): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15403)] 08:13:11.073866 run osmo-stp_10.42.42.5(pid=15403): stdout: | (launched: 2022-12-10_08:13:09.814146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:11.198489 run osmo-stp_10.42.42.5(pid=15403): stderr: | [0;m[38;5;43m20221210081309983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081309983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081309983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081309984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081309984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081309984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081309984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:11.321152 run osmo-stp_10.42.42.5(pid=15403): stdout: | (launched: 2022-12-10_08:13:09.814146) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:11.438104 run osmo-stp_10.42.42.5(pid=15403): stderr: | [0;m[38;5;43m20221210081309983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081309983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081309983 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081309984 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081309984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081309984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081309984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:11.578355 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15403): Process ended prematurely: osmo-stp_10.42.42.5(pid=15403) [trial-2371↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15403)] [trial-2371↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18] 08:13:11.586689 tst handover.py:18: Test FAILED (6.2 sec) 08:13:11.612480 run osmo-hlr_10.42.42.2(pid=15400): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15400)] 08:13:11.660102 run osmo-hlr_10.42.42.2(pid=15400): stdout: | (launched: 2022-12-10_08:13:08.926907) 08:13:11.709109 run osmo-hlr_10.42.42.2(pid=15400): stderr: | [0;m[1;31m20221210081309101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081309101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081309101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081309101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081309101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081309101 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081309113 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:oc2g+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081309122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081309122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081309122 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:13:11.777396 run osmo-msc_10.42.42.6(pid=15406): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15406)] 08:13:11.824597 run osmo-msc_10.42.42.6(pid=15406): stdout: | (launched: 2022-12-10_08:13:10.729683) 08:13:11.873189 run osmo-msc_10.42.42.6(pid=15406): stderr: | [0;m[38;5;43m20221210081310999 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081310999 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f91cf1f3c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081310999 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081310999 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081311000 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081311001 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081311002 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081311003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081311003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081311003 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:13:11.922422 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15399): Terminating (SIGTERM) 08:13:11.961289 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15402): Terminating (SIGTERM) 08:13:12.000099 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15405): Terminating (SIGTERM) 08:13:12.039479 --- ParallelTerminationStrategy: PID 15399 died... 08:13:12.058337 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15399): Terminated: ok {rc=0} 08:13:12.101935 --- ParallelTerminationStrategy: PID 15402 died... 08:13:12.120328 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15402): Terminated: ok {rc=0} 08:13:12.163965 --- ParallelTerminationStrategy: PID 15405 died... 08:13:12.182561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15405): Terminated: ok {rc=0} 08:13:12.268597 bus /sierra_3: Setting Powered False 08:13:13.368636 bus /sierra_3: Setting Powered False 08:13:14.486794 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:oc2g+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:oc2g+bts1-sysmo --------------------------------------------------------------------- 08:13:15.748514 tst handover_2G:oc2g+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:13:15.754041 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x bts (candidates: 11) 08:13:15.793976 tst handover_2G:oc2g+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 08:13:15.821540 tst handover_2G:oc2g+bts1-sysmo: Verifying 2 x modem (candidates: 12) 08:13:15.879652 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x bts (candidates: 11) 08:13:15.932597 tst handover_2G:oc2g+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 08:13:15.977495 tst handover_2G:oc2g+bts1-sysmo: Reserving 2 x modem (candidates: 12) 08:13:16.520817 tst handover_2G:oc2g+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OC-2G sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:oc2g+bts1-sysmo handover.py ---------------------------------------------- 08:13:16.528677 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:13:16.543071 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 08:13:16.587612 tst handover.py: using LAC 27048 08:13:16.746657 tst handover.py: using RAC 18 08:13:16.900010 tst handover.py: using CellId 27048 08:13:17.030970 tst handover.py: using BVCI 27049 08:13:17.151350 tst handover_2G:oc2g+bts1-sysmo: Using 1 x bts (candidates: 2) 08:13:17.186652 tst handover.py: using LAC 27049 08:13:17.320793 tst handover.py: using RAC 19 08:13:17.443772 tst handover.py: using CellId 27049 08:13:17.558987 tst handover.py: using BVCI 27050 08:13:17.666034 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:13:17.677163 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:13:17.687899 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:13:17.698984 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:13:17.709914 tst handover_2G:oc2g+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:13:17.720811 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 08:13:17.839025 tst handover_2G:oc2g+bts1-sysmo: Using 1 x modem (candidates: 2) 08:13:17.957732 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:13:18.419926 run create_hlr_db(pid=15411): Launched 08:13:18.541825 bus /sierra_2: Setting Powered False 08:13:19.604402 run create_hlr_db(pid=15411): Terminated: ok {rc=0} 08:13:20.000424 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15413): Launched 08:13:20.295435 run osmo-hlr_10.42.42.2(pid=15414): Launched 08:13:20.410963 run osmo-stp_10.42.42.5: Starting osmo-stp 08:13:20.909274 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15416): Launched 08:13:21.203642 run osmo-stp_10.42.42.5(pid=15417): Launched 08:13:21.316632 run osmo-msc_10.42.42.6: Starting osmo-msc 08:13:21.824313 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15419): Launched 08:13:22.118829 run osmo-msc_10.42.42.6(pid=15420): Launched 08:13:22.284163 run osmo-stp_10.42.42.5(pid=15417): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15417)] 08:13:22.408744 run osmo-stp_10.42.42.5(pid=15417): stdout: | (launched: 2022-12-10_08:13:21.149887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:22.533526 run osmo-stp_10.42.42.5(pid=15417): stderr: | [0;m[38;5;43m20221210081321321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081321321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081321321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081321322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081321322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081321322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081321322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:22.656050 run osmo-stp_10.42.42.5(pid=15417): stdout: | (launched: 2022-12-10_08:13:21.149887) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:22.772761 run osmo-stp_10.42.42.5(pid=15417): stderr: | [0;m[38;5;43m20221210081321321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081321321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081321321 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081321322 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081321322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081321322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081321322 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:22.912552 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15417): Process ended prematurely: osmo-stp_10.42.42.5(pid=15417) [trial-2371↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15417)] [trial-2371↪handover_2G:oc2g+bts1-sysmo↪handover.py:18] 08:13:22.920680 tst handover.py:18: Test FAILED (6.4 sec) 08:13:22.946357 run osmo-hlr_10.42.42.2(pid=15414): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15414)] 08:13:22.993174 run osmo-hlr_10.42.42.2(pid=15414): stdout: | (launched: 2022-12-10_08:13:20.242141) 08:13:23.041616 run osmo-hlr_10.42.42.2(pid=15414): stderr: | [0;m[1;31m20221210081320417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081320417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081320417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081320417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081320417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081320417 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081320430 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:oc2g+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081320440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081320440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081320440 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:13:23.109513 run osmo-msc_10.42.42.6(pid=15420): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:oc2g+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15420)] 08:13:23.156430 run osmo-msc_10.42.42.6(pid=15420): stdout: | (launched: 2022-12-10_08:13:22.064357) 08:13:23.204655 run osmo-msc_10.42.42.6(pid=15420): stderr: | [0;m[38;5;43m20221210081322333 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081322333 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fe00bab2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081322333 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081322333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081322333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081322333 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081322336 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081322337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081322337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081322337 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:13:23.253421 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15413): Terminating (SIGTERM) 08:13:23.292335 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15416): Terminating (SIGTERM) 08:13:23.331293 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15419): Terminating (SIGTERM) 08:13:23.370590 --- ParallelTerminationStrategy: PID 15413 died... 08:13:23.389303 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15413): Terminated: ok {rc=0} 08:13:23.433020 --- ParallelTerminationStrategy: PID 15416 died... 08:13:23.451278 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15416): Terminated: ok {rc=0} 08:13:23.495166 --- ParallelTerminationStrategy: PID 15419 died... 08:13:23.513542 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15419): Terminated: ok {rc=0} 08:13:23.599235 bus /sierra_3: Setting Powered False 08:13:24.699777 bus /sierra_3: Setting Powered False 08:13:25.813079 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:oc2g+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:oc2g+bts1-trx-b200 --------------------------------------------------------------------- 08:13:27.049959 tst handover_2G:oc2g+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:13:27.054856 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 08:13:27.104131 tst handover_2G:oc2g+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 08:13:27.130168 tst handover_2G:oc2g+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 08:13:27.180780 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 08:13:27.230247 tst handover_2G:oc2g+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 08:13:27.256319 tst handover_2G:oc2g+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 08:13:27.809922 tst handover_2G:oc2g+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OC-2G Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:oc2g+bts1-trx-b200 handover.py ---------------------------------------------- 08:13:27.815476 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:13:27.826402 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:13:27.864924 tst handover.py: using LAC 27050 08:13:27.981371 tst handover.py: using RAC 20 08:13:28.095757 tst handover.py: using CellId 27050 08:13:28.210819 tst handover.py: using BVCI 27051 08:13:28.319376 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:13:28.366383 tst handover.py: using LAC 27051 08:13:28.480595 tst handover.py: using RAC 21 08:13:28.594635 tst handover.py: using CellId 27051 08:13:28.710513 tst handover.py: using BVCI 27052 08:13:28.816758 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:13:28.827758 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:13:28.838493 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:13:28.849432 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:13:28.860358 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:13:28.871270 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:13:28.987994 tst handover_2G:oc2g+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:13:29.104802 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:13:29.566616 run create_hlr_db(pid=15425): Launched 08:13:29.688567 bus /sierra_2: Setting Powered False 08:13:30.751589 run create_hlr_db(pid=15425): Terminated: ok {rc=0} 08:13:31.215524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15427): Launched 08:13:31.539234 run osmo-hlr_10.42.42.2(pid=15428): Launched 08:13:31.780915 run osmo-stp_10.42.42.5: Starting osmo-stp 08:13:32.379205 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15430): Launched 08:13:32.672778 run osmo-stp_10.42.42.5(pid=15431): Launched 08:13:32.784365 run osmo-msc_10.42.42.6: Starting osmo-msc 08:13:33.292516 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15433): Launched 08:13:33.587064 run osmo-msc_10.42.42.6(pid=15434): Launched 08:13:33.752100 run osmo-stp_10.42.42.5(pid=15431): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15431)] 08:13:33.877290 run osmo-stp_10.42.42.5(pid=15431): stdout: | (launched: 2022-12-10_08:13:32.619022) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:34.001348 run osmo-stp_10.42.42.5(pid=15431): stderr: | [0;m[38;5;43m20221210081332785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081332785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081332786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081332786 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081332787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081332787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081332787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:34.123594 run osmo-stp_10.42.42.5(pid=15431): stdout: | (launched: 2022-12-10_08:13:32.619022) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:34.240430 run osmo-stp_10.42.42.5(pid=15431): stderr: | [0;m[38;5;43m20221210081332785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081332785 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081332786 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081332786 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081332787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081332787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081332787 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:34.380201 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15431): Process ended prematurely: osmo-stp_10.42.42.5(pid=15431) [trial-2371↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15431)] [trial-2371↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18] 08:13:34.388252 tst handover.py:18: Test FAILED (6.6 sec) 08:13:34.413840 run osmo-hlr_10.42.42.2(pid=15428): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15428)] 08:13:34.460617 run osmo-hlr_10.42.42.2(pid=15428): stdout: | (launched: 2022-12-10_08:13:31.475343) 08:13:34.509433 run osmo-hlr_10.42.42.2(pid=15428): stderr: | [0;m[1;31m20221210081331752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081331752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081331752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081331752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081331752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081331752 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081331767 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:oc2g+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081331798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081331798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081331798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:13:34.577396 run osmo-msc_10.42.42.6(pid=15434): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:oc2g+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15434)] 08:13:34.624185 run osmo-msc_10.42.42.6(pid=15434): stdout: | (launched: 2022-12-10_08:13:33.533428) 08:13:34.672634 run osmo-msc_10.42.42.6(pid=15434): stderr: | [0;m[38;5;43m20221210081333801 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081333801 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f97c0bdfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081333801 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081333801 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081333802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081333802 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081333803 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081333804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081333804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081333804 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:13:34.721221 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15427): Terminating (SIGTERM) 08:13:34.759998 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15430): Terminating (SIGTERM) 08:13:34.798979 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15433): Terminating (SIGTERM) 08:13:34.838347 --- ParallelTerminationStrategy: PID 15427 died... 08:13:34.857220 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15427): Terminated: ok {rc=0} 08:13:34.900511 --- ParallelTerminationStrategy: PID 15430 died... 08:13:34.918836 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15430): Terminated: ok {rc=0} 08:13:34.961954 --- ParallelTerminationStrategy: PID 15433 died... 08:13:34.980490 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15433): Terminated: ok {rc=0} 08:13:35.066115 bus /sierra_3: Setting Powered False 08:13:36.165035 bus /sierra_3: Setting Powered False 08:13:37.279662 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:oc2g+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:oc2g+bts1-trx-umtrx --------------------------------------------------------------------- 08:13:38.532300 tst handover_2G:oc2g+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:13:38.537198 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:13:38.585921 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:13:38.612168 tst handover_2G:oc2g+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:13:38.663185 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:13:38.711708 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:13:38.737730 tst handover_2G:oc2g+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:13:39.287830 tst handover_2G:oc2g+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OC-2G UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:oc2g+bts1-trx-umtrx handover.py ---------------------------------------------- 08:13:39.292928 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:13:39.303587 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:13:39.337404 tst handover.py: using LAC 27052 08:13:39.458289 tst handover.py: using RAC 22 08:13:39.572671 tst handover.py: using CellId 27052 08:13:39.686332 tst handover.py: using BVCI 27053 08:13:39.791981 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:13:39.842300 tst handover.py: using LAC 27053 08:13:39.957879 tst handover.py: using RAC 23 08:13:40.071341 tst handover.py: using CellId 27053 08:13:40.195318 tst handover.py: using BVCI 27054 08:13:40.311073 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:13:40.322674 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:13:40.333954 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:13:40.346035 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:13:40.358500 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:13:40.370150 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:13:40.485552 tst handover_2G:oc2g+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:13:40.598961 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:13:41.060629 run create_hlr_db(pid=15439): Launched 08:13:41.181695 bus /sierra_2: Setting Powered False 08:13:42.245743 run create_hlr_db(pid=15439): Terminated: ok {rc=0} 08:13:42.642474 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15441): Launched 08:13:42.936620 run osmo-hlr_10.42.42.2(pid=15442): Launched 08:13:43.050225 run osmo-stp_10.42.42.5: Starting osmo-stp 08:13:43.531340 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15444): Launched 08:13:43.824822 run osmo-stp_10.42.42.5(pid=15445): Launched 08:13:43.938529 run osmo-msc_10.42.42.6: Starting osmo-msc 08:13:44.445706 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15447): Launched 08:13:44.739562 run osmo-msc_10.42.42.6(pid=15448): Launched 08:13:44.904861 run osmo-stp_10.42.42.5(pid=15445): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15445)] 08:13:45.029341 run osmo-stp_10.42.42.5(pid=15445): stdout: | (launched: 2022-12-10_08:13:43.771057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:45.153913 run osmo-stp_10.42.42.5(pid=15445): stderr: | [0;m[38;5;43m20221210081343940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081343940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081343940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081343941 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081343941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081343941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081343941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:45.276157 run osmo-stp_10.42.42.5(pid=15445): stdout: | (launched: 2022-12-10_08:13:43.771057) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:45.393244 run osmo-stp_10.42.42.5(pid=15445): stderr: | [0;m[38;5;43m20221210081343940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081343940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081343940 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081343941 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081343941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081343941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081343941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:45.532643 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15445): Process ended prematurely: osmo-stp_10.42.42.5(pid=15445) [trial-2371↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15445)] [trial-2371↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18] 08:13:45.540763 tst handover.py:18: Test FAILED (6.2 sec) 08:13:45.566818 run osmo-hlr_10.42.42.2(pid=15442): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15442)] 08:13:45.614575 run osmo-hlr_10.42.42.2(pid=15442): stdout: | (launched: 2022-12-10_08:13:42.883154) 08:13:45.664035 run osmo-hlr_10.42.42.2(pid=15442): stderr: | [0;m[1;31m20221210081343055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081343055 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081343056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081343056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081343056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081343056 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081343069 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:oc2g+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081343077 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081343078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081343078 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:13:45.732404 run osmo-msc_10.42.42.6(pid=15448): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15448)] 08:13:45.779717 run osmo-msc_10.42.42.6(pid=15448): stdout: | (launched: 2022-12-10_08:13:44.686066) 08:13:45.828722 run osmo-msc_10.42.42.6(pid=15448): stderr: | [0;m[38;5;43m20221210081344959 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081344959 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fb659d38c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081344960 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081344960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081344960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081344960 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081344962 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081344962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081344962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081344962 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:13:45.893241 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15441): Terminating (SIGTERM) 08:13:45.952751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15444): Terminating (SIGTERM) 08:13:45.993732 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15447): Terminating (SIGTERM) 08:13:46.034414 --- ParallelTerminationStrategy: PID 15441 died... 08:13:46.053497 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15441): Terminated: ok {rc=0} 08:13:46.098652 --- ParallelTerminationStrategy: PID 15444 died... 08:13:46.117924 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15444): Terminated: ok {rc=0} 08:13:46.163108 --- ParallelTerminationStrategy: PID 15447 died... 08:13:46.182500 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15447): Terminated: ok {rc=0} 08:13:46.269720 bus /sierra_3: Setting Powered False 08:13:47.370178 bus /sierra_3: Setting Powered False 08:13:48.485633 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:oc2g+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:octphy+bts1-trx-lms --------------------------------------------------------------------- 08:13:49.744065 tst handover_2G:octphy+bts1-trx-lms: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:13:49.749592 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x bts (candidates: 11) 08:13:49.799640 tst handover_2G:octphy+bts1-trx-lms: Verifying 6 x ip_address (candidates: 9) 08:13:49.826816 tst handover_2G:octphy+bts1-trx-lms: Verifying 2 x modem (candidates: 12) 08:13:49.879703 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x bts (candidates: 11) 08:13:49.929415 tst handover_2G:octphy+bts1-trx-lms: Reserving 6 x ip_address (candidates: 9) 08:13:49.956852 tst handover_2G:octphy+bts1-trx-lms: Reserving 2 x modem (candidates: 12) 08:13:50.506979 tst handover_2G:octphy+bts1-trx-lms: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeSDR-USB ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:octphy+bts1-trx-lms handover.py ---------------------------------------------- 08:13:50.512701 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:13:50.523979 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 08:13:50.558555 tst handover.py: using LAC 27054 08:13:50.684010 tst handover.py: using RAC 24 08:13:50.809344 tst handover.py: using CellId 27054 08:13:50.934396 tst handover.py: using BVCI 27055 08:13:51.049085 tst handover_2G:octphy+bts1-trx-lms: Using 1 x bts (candidates: 2) 08:13:51.098907 tst handover.py: using LAC 27055 08:13:51.224276 tst handover.py: using RAC 25 08:13:51.350022 tst handover.py: using CellId 27055 08:13:51.475829 tst handover.py: using BVCI 27056 08:13:51.592029 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:13:51.603271 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:13:51.614435 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:13:51.625658 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:13:51.637097 tst handover_2G:octphy+bts1-trx-lms: Using 1 x ip_address (candidates: 6) 08:13:51.648340 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 08:13:51.763241 tst handover_2G:octphy+bts1-trx-lms: Using 1 x modem (candidates: 2) 08:13:51.877215 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:13:52.307882 run create_hlr_db(pid=15453): Launched 08:13:52.428460 bus /sierra_2: Setting Powered False 08:13:53.488379 run create_hlr_db(pid=15453): Terminated: ok {rc=0} 08:13:53.892794 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15455): Launched 08:13:54.209571 run osmo-hlr_10.42.42.2(pid=15456): Launched 08:13:54.332042 run osmo-stp_10.42.42.5: Starting osmo-stp 08:13:54.850913 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15458): Launched 08:13:55.167406 run osmo-stp_10.42.42.5(pid=15459): Launched 08:13:55.289757 run osmo-msc_10.42.42.6: Starting osmo-msc 08:13:55.839105 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15461): Launched 08:13:56.157174 run osmo-msc_10.42.42.6(pid=15462): Launched 08:13:56.335282 run osmo-stp_10.42.42.5(pid=15459): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15459)] 08:13:56.469435 run osmo-stp_10.42.42.5(pid=15459): stdout: | (launched: 2022-12-10_08:13:55.110012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:56.603722 run osmo-stp_10.42.42.5(pid=15459): stderr: | [0;m[38;5;43m20221210081355300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081355300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081355300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081355301 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081355303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081355303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081355303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:56.737219 run osmo-stp_10.42.42.5(pid=15459): stdout: | (launched: 2022-12-10_08:13:55.110012) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:13:56.863665 run osmo-stp_10.42.42.5(pid=15459): stderr: | [0;m[38;5;43m20221210081355300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081355300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081355300 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081355301 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081355303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081355303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081355303 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:13:57.014883 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15459): Process ended prematurely: osmo-stp_10.42.42.5(pid=15459) [trial-2371↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15459)] [trial-2371↪handover_2G:octphy+bts1-trx-lms↪handover.py:18] 08:13:57.023725 tst handover.py:18: Test FAILED (6.5 sec) 08:13:57.051300 run osmo-hlr_10.42.42.2(pid=15456): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15456)] 08:13:57.102689 run osmo-hlr_10.42.42.2(pid=15456): stdout: | (launched: 2022-12-10_08:13:54.152658) 08:13:57.154755 run osmo-hlr_10.42.42.2(pid=15456): stderr: | [0;m[1;31m20221210081354349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081354349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081354349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081354349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081354349 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081354350 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081354361 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:octphy+bts1-trx-lms/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081354369 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081354370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081354370 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:13:57.227445 run osmo-msc_10.42.42.6(pid=15462): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:octphy+bts1-trx-lms↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15462)] 08:13:57.277727 run osmo-msc_10.42.42.6(pid=15462): stdout: | (launched: 2022-12-10_08:13:56.099659) 08:13:57.329572 run osmo-msc_10.42.42.6(pid=15462): stderr: | [0;m[38;5;43m20221210081356420 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081356420 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9d0e30ac40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081356420 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081356420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081356420 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081356421 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081356422 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081356423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081356423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081356423 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:13:57.381706 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15455): Terminating (SIGTERM) 08:13:57.423123 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15458): Terminating (SIGTERM) 08:13:57.465553 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15461): Terminating (SIGTERM) 08:13:57.507906 --- ParallelTerminationStrategy: PID 15455 died... 08:13:57.528272 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15455): Terminated: ok {rc=0} 08:13:57.574796 --- ParallelTerminationStrategy: PID 15458 died... 08:13:57.594813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15458): Terminated: ok {rc=0} 08:13:57.641188 --- ParallelTerminationStrategy: PID 15461 died... 08:13:57.661216 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15461): Terminated: ok {rc=0} 08:13:57.749223 bus /sierra_3: Setting Powered False 08:13:58.848780 bus /sierra_3: Setting Powered False 08:13:59.966213 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:octphy+bts1-trx-lms FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:octphy+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 08:14:01.237910 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:14:01.245670 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 08:14:01.307174 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 08:14:01.334185 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 08:14:01.387077 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 08:14:01.457664 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 08:14:01.492291 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 08:14:02.009533 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:octphy+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 08:14:02.016084 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:14:02.028404 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:14:02.062755 tst handover.py: using LAC 27056 08:14:02.222535 tst handover.py: using RAC 26 08:14:02.343212 tst handover.py: using CellId 27056 08:14:02.460491 tst handover.py: using BVCI 27057 08:14:02.567238 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:14:02.609643 tst handover.py: using LAC 27057 08:14:02.724728 tst handover.py: using RAC 27 08:14:02.838935 tst handover.py: using CellId 27057 08:14:02.953738 tst handover.py: using BVCI 27058 08:14:03.061095 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:14:03.071992 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:14:03.082759 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:14:03.093529 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:14:03.104171 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:14:03.115324 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:14:03.235022 tst handover_2G:octphy+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:14:03.353225 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:14:03.815900 run create_hlr_db(pid=15468): Launched 08:14:03.938008 bus /sierra_2: Setting Powered False 08:14:05.001342 run create_hlr_db(pid=15468): Terminated: ok {rc=0} 08:14:05.416307 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15470): Launched 08:14:05.733353 run osmo-hlr_10.42.42.2(pid=15471): Launched 08:14:05.855278 run osmo-stp_10.42.42.5: Starting osmo-stp 08:14:06.373700 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15473): Launched 08:14:06.691672 run osmo-stp_10.42.42.5(pid=15474): Launched 08:14:06.813677 run osmo-msc_10.42.42.6: Starting osmo-msc 08:14:07.358426 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15476): Launched 08:14:07.675231 run osmo-msc_10.42.42.6(pid=15477): Launched 08:14:07.851950 run osmo-stp_10.42.42.5(pid=15474): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15474)] 08:14:07.985854 run osmo-stp_10.42.42.5(pid=15474): stdout: | (launched: 2022-12-10_08:14:06.634496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:14:08.120339 run osmo-stp_10.42.42.5(pid=15474): stderr: | [0;m[38;5;43m20221210081406824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081406824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081406824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081406825 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081406826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081406826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081406826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:14:08.254721 run osmo-stp_10.42.42.5(pid=15474): stdout: | (launched: 2022-12-10_08:14:06.634496) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:14:08.381593 run osmo-stp_10.42.42.5(pid=15474): stderr: | [0;m[38;5;43m20221210081406824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081406824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081406824 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081406825 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081406826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081406826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081406826 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:14:08.533056 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15474): Process ended prematurely: osmo-stp_10.42.42.5(pid=15474) [trial-2371↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15474)] [trial-2371↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18] 08:14:08.542227 tst handover.py:18: Test FAILED (6.5 sec) 08:14:08.569412 run osmo-hlr_10.42.42.2(pid=15471): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15471)] 08:14:08.619915 run osmo-hlr_10.42.42.2(pid=15471): stdout: | (launched: 2022-12-10_08:14:05.675912) 08:14:08.671757 run osmo-hlr_10.42.42.2(pid=15471): stderr: | [0;m[1;31m20221210081405873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081405873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081405873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081405873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081405873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081405873 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081405903 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:octphy+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081405912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081405912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081405912 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:14:08.743981 run osmo-msc_10.42.42.6(pid=15477): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15477)] 08:14:08.793502 run osmo-msc_10.42.42.6(pid=15477): stdout: | (launched: 2022-12-10_08:14:07.617796) 08:14:08.845163 run osmo-msc_10.42.42.6(pid=15477): stderr: | [0;m[38;5;43m20221210081407938 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081407938 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f1c3a309c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081407938 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081407938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081407938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081407938 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081407940 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081407941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081407941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081407941 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:14:08.896665 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15470): Terminating (SIGTERM) 08:14:08.938106 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15473): Terminating (SIGTERM) 08:14:08.979873 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15476): Terminating (SIGTERM) 08:14:09.021727 --- ParallelTerminationStrategy: PID 15470 died... 08:14:09.041932 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15470): Terminated: ok {rc=0} 08:14:09.088223 --- ParallelTerminationStrategy: PID 15473 died... 08:14:09.108255 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15473): Terminated: ok {rc=0} 08:14:09.154355 --- ParallelTerminationStrategy: PID 15476 died... 08:14:09.174277 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15476): Terminated: ok {rc=0} 08:14:09.262441 bus /sierra_3: Setting Powered False 08:14:10.359043 bus /sierra_3: Setting Powered False 08:14:11.473768 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:octphy+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:octphy+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 08:14:12.740561 tst handover_2G:octphy+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:14:12.745577 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 08:14:12.794316 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:14:12.820317 tst handover_2G:octphy+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 08:14:12.870361 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 08:14:12.918713 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:14:12.944594 tst handover_2G:octphy+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 08:14:13.497258 tst handover_2G:octphy+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:octphy+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 08:14:13.502380 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:14:13.513161 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:14:13.545471 tst handover.py: using LAC 27058 08:14:13.669783 tst handover.py: using RAC 28 08:14:13.784561 tst handover.py: using CellId 27058 08:14:13.898530 tst handover.py: using BVCI 27059 08:14:14.006133 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:14:14.052686 tst handover.py: using LAC 27059 08:14:14.168776 tst handover.py: using RAC 29 08:14:14.282288 tst handover.py: using CellId 27059 08:14:14.395584 tst handover.py: using BVCI 27060 08:14:14.501730 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:14:14.512463 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:14:14.523148 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:14:14.533770 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:14:14.544425 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:14:14.555003 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:14:14.670102 tst handover_2G:octphy+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:14:14.783608 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:14:15.214540 run create_hlr_db(pid=15482): Launched 08:14:15.335201 bus /sierra_2: Setting Powered False 08:14:16.393454 run create_hlr_db(pid=15482): Terminated: ok {rc=0} 08:14:16.805925 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15484): Launched 08:14:17.172367 run osmo-hlr_10.42.42.2(pid=15485): Launched 08:14:17.286409 run osmo-stp_10.42.42.5: Starting osmo-stp 08:14:17.783202 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15487): Launched 08:14:18.077172 run osmo-stp_10.42.42.5(pid=15488): Launched 08:14:18.190243 run osmo-msc_10.42.42.6: Starting osmo-msc 08:14:18.696540 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15490): Launched 08:14:18.991045 run osmo-msc_10.42.42.6(pid=15491): Launched 08:14:19.156080 run osmo-stp_10.42.42.5(pid=15488): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15488)] 08:14:19.281206 run osmo-stp_10.42.42.5(pid=15488): stdout: | (launched: 2022-12-10_08:14:18.023335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:14:19.405975 run osmo-stp_10.42.42.5(pid=15488): stderr: | [0;m[38;5;43m20221210081418191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081418191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081418191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081418192 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081418194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081418194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081418194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:14:19.528443 run osmo-stp_10.42.42.5(pid=15488): stdout: | (launched: 2022-12-10_08:14:18.023335) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:14:19.645563 run osmo-stp_10.42.42.5(pid=15488): stderr: | [0;m[38;5;43m20221210081418191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081418191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081418191 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081418192 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081418194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081418194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081418194 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:14:19.785665 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15488): Process ended prematurely: osmo-stp_10.42.42.5(pid=15488) [trial-2371↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15488)] [trial-2371↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18] 08:14:19.793704 tst handover.py:18: Test FAILED (6.3 sec) 08:14:19.819390 run osmo-hlr_10.42.42.2(pid=15485): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15485)] 08:14:19.866257 run osmo-hlr_10.42.42.2(pid=15485): stdout: | (launched: 2022-12-10_08:14:17.103691) 08:14:19.914959 run osmo-hlr_10.42.42.2(pid=15485): stderr: | [0;m[1;31m20221210081417360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081417360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081417360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081417360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081417360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081417360 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081417375 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:octphy+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081417384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081417384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081417384 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:14:19.983336 run osmo-msc_10.42.42.6(pid=15491): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15491)] 08:14:20.030401 run osmo-msc_10.42.42.6(pid=15491): stdout: | (launched: 2022-12-10_08:14:18.937103) 08:14:20.078938 run osmo-msc_10.42.42.6(pid=15491): stderr: | [0;m[38;5;43m20221210081419204 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081419204 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f40e5b72c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081419204 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081419204 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081419205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081419205 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081419206 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081419207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081419207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081419207 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:14:20.127946 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15484): Terminating (SIGTERM) 08:14:20.166928 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15487): Terminating (SIGTERM) 08:14:20.206573 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15490): Terminating (SIGTERM) 08:14:20.246211 --- ParallelTerminationStrategy: PID 15484 died... 08:14:20.265106 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15484): Terminated: ok {rc=0} 08:14:20.308434 --- ParallelTerminationStrategy: PID 15487 died... 08:14:20.326719 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15487): Terminated: ok {rc=0} 08:14:20.370023 --- ParallelTerminationStrategy: PID 15490 died... 08:14:20.388390 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15490): Terminated: ok {rc=0} 08:14:20.471505 bus /sierra_3: Setting Powered False 08:14:21.568732 bus /sierra_3: Setting Powered False 08:14:22.682866 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:octphy+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:octphy+bts1-sysmo --------------------------------------------------------------------- 08:14:23.944899 tst handover_2G:octphy+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:14:23.950387 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x bts (candidates: 11) 08:14:23.987431 tst handover_2G:octphy+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 08:14:24.015019 tst handover_2G:octphy+bts1-sysmo: Verifying 2 x modem (candidates: 12) 08:14:24.067690 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x bts (candidates: 11) 08:14:24.105294 tst handover_2G:octphy+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 08:14:24.132310 tst handover_2G:octphy+bts1-sysmo: Reserving 2 x modem (candidates: 12) 08:14:24.682512 tst handover_2G:octphy+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:octphy+bts1-sysmo handover.py ---------------------------------------------- 08:14:24.687796 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:14:24.698954 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 08:14:24.732325 tst handover.py: using LAC 27060 08:14:24.856415 tst handover.py: using RAC 30 08:14:24.980094 tst handover.py: using CellId 27060 08:14:25.104141 tst handover.py: using BVCI 27061 08:14:25.218568 tst handover_2G:octphy+bts1-sysmo: Using 1 x bts (candidates: 2) 08:14:25.254399 tst handover.py: using LAC 27061 08:14:25.378328 tst handover.py: using RAC 31 08:14:25.503139 tst handover.py: using CellId 27061 08:14:25.626843 tst handover.py: using BVCI 27062 08:14:25.743289 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:14:25.754400 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:14:25.765422 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:14:25.776298 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:14:25.787205 tst handover_2G:octphy+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:14:25.798481 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 08:14:25.919828 tst handover_2G:octphy+bts1-sysmo: Using 1 x modem (candidates: 2) 08:14:26.039245 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:14:26.502410 run create_hlr_db(pid=15496): Launched 08:14:26.622769 bus /sierra_2: Setting Powered False 08:14:27.685073 run create_hlr_db(pid=15496): Terminated: ok {rc=0} 08:14:28.097680 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15498): Launched 08:14:28.413607 run osmo-hlr_10.42.42.2(pid=15499): Launched 08:14:28.534589 run osmo-stp_10.42.42.5: Starting osmo-stp 08:14:29.053039 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15501): Launched 08:14:29.369866 run osmo-stp_10.42.42.5(pid=15502): Launched 08:14:29.490362 run osmo-msc_10.42.42.6: Starting osmo-msc 08:14:30.033372 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15504): Launched 08:14:30.350381 run osmo-msc_10.42.42.6(pid=15505): Launched 08:14:30.527503 run osmo-stp_10.42.42.5(pid=15502): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15502)] 08:14:30.660722 run osmo-stp_10.42.42.5(pid=15502): stdout: | (launched: 2022-12-10_08:14:29.312381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:14:30.794629 run osmo-stp_10.42.42.5(pid=15502): stderr: | [0;m[38;5;43m20221210081429502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081429502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081429502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081429503 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081429505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081429505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081429505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:14:30.950120 run osmo-stp_10.42.42.5(pid=15502): stdout: | (launched: 2022-12-10_08:14:29.312381) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:14:31.078713 run osmo-stp_10.42.42.5(pid=15502): stderr: | [0;m[38;5;43m20221210081429502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081429502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081429502 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081429503 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081429505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081429505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081429505 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:14:31.232576 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15502): Process ended prematurely: osmo-stp_10.42.42.5(pid=15502) [trial-2371↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15502)] [trial-2371↪handover_2G:octphy+bts1-sysmo↪handover.py:18] 08:14:31.242088 tst handover.py:18: Test FAILED (6.5 sec) 08:14:31.270975 run osmo-hlr_10.42.42.2(pid=15499): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15499)] 08:14:31.322185 run osmo-hlr_10.42.42.2(pid=15499): stdout: | (launched: 2022-12-10_08:14:28.356379) 08:14:31.375083 run osmo-hlr_10.42.42.2(pid=15499): stderr: | [0;m[1;31m20221210081428551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081428551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081428551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081428551 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081428552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081428552 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081428565 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:octphy+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081428574 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081428575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081428575 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:14:31.448584 run osmo-msc_10.42.42.6(pid=15505): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:octphy+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15505)] 08:14:31.499561 run osmo-msc_10.42.42.6(pid=15505): stdout: | (launched: 2022-12-10_08:14:30.292921) 08:14:31.552213 run osmo-msc_10.42.42.6(pid=15505): stderr: | [0;m[38;5;43m20221210081430614 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081430614 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa65ef2cc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081430615 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081430615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081430615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081430615 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081430617 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081430617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081430617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081430617 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:14:31.605479 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15498): Terminating (SIGTERM) 08:14:31.648177 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15501): Terminating (SIGTERM) 08:14:31.691091 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15504): Terminating (SIGTERM) 08:14:31.733867 --- ParallelTerminationStrategy: PID 15498 died... 08:14:31.754027 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15498): Terminated: ok {rc=0} 08:14:31.801803 --- ParallelTerminationStrategy: PID 15501 died... 08:14:31.824478 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15501): Terminated: ok {rc=0} 08:14:31.883902 --- ParallelTerminationStrategy: PID 15504 died... 08:14:31.908634 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15504): Terminated: ok {rc=0} 08:14:32.016164 bus /sierra_3: Setting Powered False 08:14:33.120866 bus /sierra_3: Setting Powered False 08:14:34.236181 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:octphy+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:octphy+bts1-trx-b200 --------------------------------------------------------------------- 08:14:35.479320 tst handover_2G:octphy+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:14:35.485263 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 08:14:35.536411 tst handover_2G:octphy+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 08:14:35.563816 tst handover_2G:octphy+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 08:14:35.617533 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 08:14:35.667717 tst handover_2G:octphy+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 08:14:35.694952 tst handover_2G:octphy+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 08:14:36.244036 tst handover_2G:octphy+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:octphy+bts1-trx-b200 handover.py ---------------------------------------------- 08:14:36.250119 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:14:36.261464 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:14:36.295610 tst handover.py: using LAC 27062 08:14:36.424653 tst handover.py: using RAC 32 08:14:36.547638 tst handover.py: using CellId 27062 08:14:36.669375 tst handover.py: using BVCI 27063 08:14:36.783867 tst handover_2G:octphy+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:14:36.830867 tst handover.py: using LAC 27063 08:14:36.953838 tst handover.py: using RAC 33 08:14:37.078156 tst handover.py: using CellId 27063 08:14:37.200340 tst handover.py: using BVCI 27064 08:14:37.315667 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:14:37.327038 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:14:37.338115 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:14:37.349560 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:14:37.360915 tst handover_2G:octphy+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:14:37.372237 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:14:37.486257 tst handover_2G:octphy+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:14:37.602830 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:14:38.064040 run create_hlr_db(pid=15510): Launched 08:14:38.184588 bus /sierra_2: Setting Powered False 08:14:39.247521 run create_hlr_db(pid=15510): Terminated: ok {rc=0} 08:14:39.643950 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15512): Launched 08:14:39.939137 run osmo-hlr_10.42.42.2(pid=15513): Launched 08:14:40.053906 run osmo-stp_10.42.42.5: Starting osmo-stp 08:14:40.556842 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15515): Launched 08:14:40.850255 run osmo-stp_10.42.42.5(pid=15516): Launched 08:14:40.962870 run osmo-msc_10.42.42.6: Starting osmo-msc 08:14:41.470487 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15518): Launched 08:14:41.764246 run osmo-msc_10.42.42.6(pid=15519): Launched 08:14:41.929537 run osmo-stp_10.42.42.5(pid=15516): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15516)] 08:14:42.054611 run osmo-stp_10.42.42.5(pid=15516): stdout: | (launched: 2022-12-10_08:14:40.796414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:14:42.179391 run osmo-stp_10.42.42.5(pid=15516): stderr: | [0;m[38;5;43m20221210081440966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081440966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081440967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081440967 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081440967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081440967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081440968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:14:42.302315 run osmo-stp_10.42.42.5(pid=15516): stdout: | (launched: 2022-12-10_08:14:40.796414) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:14:42.420261 run osmo-stp_10.42.42.5(pid=15516): stderr: | [0;m[38;5;43m20221210081440966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081440966 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081440967 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081440967 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081440967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081440967 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081440968 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:14:42.560489 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15516): Process ended prematurely: osmo-stp_10.42.42.5(pid=15516) [trial-2371↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15516)] [trial-2371↪handover_2G:octphy+bts1-trx-b200↪handover.py:18] 08:14:42.568862 tst handover.py:18: Test FAILED (6.3 sec) 08:14:42.594819 run osmo-hlr_10.42.42.2(pid=15513): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15513)] 08:14:42.641896 run osmo-hlr_10.42.42.2(pid=15513): stdout: | (launched: 2022-12-10_08:14:39.885462) 08:14:42.690771 run osmo-hlr_10.42.42.2(pid=15513): stderr: | [0;m[1;31m20221210081440060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081440060 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081440061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081440061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081440061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081440061 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081440073 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:octphy+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081440081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081440081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081440081 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:14:42.759096 run osmo-msc_10.42.42.6(pid=15519): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:octphy+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15519)] 08:14:42.806162 run osmo-msc_10.42.42.6(pid=15519): stdout: | (launched: 2022-12-10_08:14:41.710450) 08:14:42.854876 run osmo-msc_10.42.42.6(pid=15519): stderr: | [0;m[38;5;43m20221210081441980 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081441981 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f01b7733c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081441981 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081441981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081441981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081441981 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081441983 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081441983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081441983 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081441984 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:14:42.903923 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15512): Terminating (SIGTERM) 08:14:42.943200 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15515): Terminating (SIGTERM) 08:14:42.982696 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15518): Terminating (SIGTERM) 08:14:43.022448 --- ParallelTerminationStrategy: PID 15512 died... 08:14:43.041321 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15512): Terminated: ok {rc=0} 08:14:43.084929 --- ParallelTerminationStrategy: PID 15515 died... 08:14:43.103485 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15515): Terminated: ok {rc=0} 08:14:43.147316 --- ParallelTerminationStrategy: PID 15518 died... 08:14:43.165820 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15518): Terminated: ok {rc=0} 08:14:43.251811 bus /sierra_3: Setting Powered False 08:14:44.352374 bus /sierra_3: Setting Powered False 08:14:45.469289 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:octphy+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:octphy+bts1-trx-umtrx --------------------------------------------------------------------- 08:14:46.728300 tst handover_2G:octphy+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:14:46.733525 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:14:46.782957 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:14:46.810059 tst handover_2G:octphy+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:14:46.863412 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:14:46.927751 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:14:46.971216 tst handover_2G:octphy+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:14:47.489516 tst handover_2G:octphy+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts OCTBTS 3500 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:octphy+bts1-trx-umtrx handover.py ---------------------------------------------- 08:14:47.495708 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:14:47.507023 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:14:47.547439 tst handover.py: using LAC 27064 08:14:47.671190 tst handover.py: using RAC 34 08:14:47.793809 tst handover.py: using CellId 27064 08:14:47.917301 tst handover.py: using BVCI 27065 08:14:48.024913 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:14:48.071314 tst handover.py: using LAC 27065 08:14:48.185610 tst handover.py: using RAC 35 08:14:48.299995 tst handover.py: using CellId 27065 08:14:48.414102 tst handover.py: using BVCI 27066 08:14:48.521110 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:14:48.532084 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:14:48.542824 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:14:48.553760 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:14:48.564557 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:14:48.575198 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:14:48.691517 tst handover_2G:octphy+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:14:48.811861 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:14:49.275229 run create_hlr_db(pid=15524): Launched 08:14:49.397422 bus /sierra_2: Setting Powered False 08:14:50.460124 run create_hlr_db(pid=15524): Terminated: ok {rc=0} 08:14:50.873619 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15526): Launched 08:14:51.190551 run osmo-hlr_10.42.42.2(pid=15527): Launched 08:14:51.313404 run osmo-stp_10.42.42.5: Starting osmo-stp 08:14:51.835635 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15529): Launched 08:14:52.153618 run osmo-stp_10.42.42.5(pid=15530): Launched 08:14:52.276072 run osmo-msc_10.42.42.6: Starting osmo-msc 08:14:52.822816 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15532): Launched 08:14:53.140610 run osmo-msc_10.42.42.6(pid=15533): Launched 08:14:53.320209 run osmo-stp_10.42.42.5(pid=15530): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15530)] 08:14:53.455967 run osmo-stp_10.42.42.5(pid=15530): stdout: | (launched: 2022-12-10_08:14:52.096023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:14:53.591717 run osmo-stp_10.42.42.5(pid=15530): stderr: | [0;m[38;5;43m20221210081452287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081452287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081452287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081452287 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081452288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081452288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081452288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:14:53.726556 run osmo-stp_10.42.42.5(pid=15530): stdout: | (launched: 2022-12-10_08:14:52.096023) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:14:53.853402 run osmo-stp_10.42.42.5(pid=15530): stderr: | [0;m[38;5;43m20221210081452287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081452287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081452287 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081452287 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081452288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081452288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081452288 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:14:54.005388 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15530): Process ended prematurely: osmo-stp_10.42.42.5(pid=15530) [trial-2371↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15530)] [trial-2371↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18] 08:14:54.013948 tst handover.py:18: Test FAILED (6.5 sec) 08:14:54.041695 run osmo-hlr_10.42.42.2(pid=15527): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15527)] 08:14:54.091810 run osmo-hlr_10.42.42.2(pid=15527): stdout: | (launched: 2022-12-10_08:14:51.133304) 08:14:54.143479 run osmo-hlr_10.42.42.2(pid=15527): stderr: | [0;m[1;31m20221210081451330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081451330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081451330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081451330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081451330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081451330 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081451342 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:octphy+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081451351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081451351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081451351 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:14:54.215486 run osmo-msc_10.42.42.6(pid=15533): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:octphy+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15533)] 08:14:54.265903 run osmo-msc_10.42.42.6(pid=15533): stdout: | (launched: 2022-12-10_08:14:53.082764) 08:14:54.317516 run osmo-msc_10.42.42.6(pid=15533): stderr: | [0;m[38;5;43m20221210081453402 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081453402 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc3432a2c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081453402 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081453402 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081453403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081453403 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081453404 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081453405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081453405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081453405 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:14:54.369419 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15526): Terminating (SIGTERM) 08:14:54.410751 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15529): Terminating (SIGTERM) 08:14:54.452287 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15532): Terminating (SIGTERM) 08:14:54.494362 --- ParallelTerminationStrategy: PID 15526 died... 08:14:54.514252 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15526): Terminated: ok {rc=0} 08:14:54.560681 --- ParallelTerminationStrategy: PID 15529 died... 08:14:54.580281 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15529): Terminated: ok {rc=0} 08:14:54.626733 --- ParallelTerminationStrategy: PID 15532 died... 08:14:54.646167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15532): Terminated: ok {rc=0} 08:14:54.733872 bus /sierra_3: Setting Powered False 08:14:55.832660 bus /sierra_3: Setting Powered False 08:14:56.948337 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:octphy+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:trx-lms+bts1-trx-lms-limenet-micro --------------------------------------------------------------------- 08:14:58.200569 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:14:58.205762 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x bts (candidates: 11) 08:14:58.263836 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 6 x ip_address (candidates: 9) 08:14:58.290093 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Verifying 2 x modem (candidates: 12) 08:14:58.343139 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x bts (candidates: 11) 08:14:58.402504 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 6 x ip_address (candidates: 9) 08:14:58.428686 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Reserving 2 x modem (candidates: 12) 08:14:58.983182 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB LimeNET-Micro ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:trx-lms+bts1-trx-lms-limenet-micro handover.py ---------------------------------------------- 08:14:58.989031 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:14:59.000435 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:14:59.050245 tst handover.py: using LAC 27066 08:14:59.175574 tst handover.py: using RAC 36 08:14:59.299913 tst handover.py: using CellId 27066 08:14:59.425165 tst handover.py: using BVCI 27067 08:14:59.539648 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x bts (candidates: 2) 08:14:59.593626 tst handover.py: using LAC 27067 08:14:59.717939 tst handover.py: using RAC 37 08:14:59.842282 tst handover.py: using CellId 27067 08:14:59.964794 tst handover.py: using BVCI 27068 08:15:00.079801 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:15:00.091175 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:15:00.102461 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:15:00.113983 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:15:00.125525 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x ip_address (candidates: 6) 08:15:00.136721 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:15:00.251988 tst handover_2G:trx-lms+bts1-trx-lms-limenet-micro: Using 1 x modem (candidates: 2) 08:15:00.369368 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:15:00.832582 run create_hlr_db(pid=15538): Launched 08:15:00.989546 bus /sierra_2: Setting Powered False 08:15:02.068719 run create_hlr_db(pid=15538): Terminated: ok {rc=0} 08:15:02.483222 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15550): Launched 08:15:02.779581 run osmo-hlr_10.42.42.2(pid=15551): Launched 08:15:02.892537 run osmo-stp_10.42.42.5: Starting osmo-stp 08:15:03.386475 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15553): Launched 08:15:03.681487 run osmo-stp_10.42.42.5(pid=15554): Launched 08:15:03.794099 run osmo-msc_10.42.42.6: Starting osmo-msc 08:15:04.301238 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15556): Launched 08:15:04.597258 run osmo-msc_10.42.42.6(pid=15557): Launched 08:15:04.762984 run osmo-stp_10.42.42.5(pid=15554): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15554)] 08:15:04.888000 run osmo-stp_10.42.42.5(pid=15554): stdout: | (launched: 2022-12-10_08:15:03.627378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:05.012649 run osmo-stp_10.42.42.5(pid=15554): stderr: | [0;m[38;5;43m20221210081503796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081503797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081503797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081503797 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081503798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081503798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081503798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:05.135862 run osmo-stp_10.42.42.5(pid=15554): stdout: | (launched: 2022-12-10_08:15:03.627378) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:05.253780 run osmo-stp_10.42.42.5(pid=15554): stderr: | [0;m[38;5;43m20221210081503796 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081503797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081503797 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081503797 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081503798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081503798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081503798 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:05.394532 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15554): Process ended prematurely: osmo-stp_10.42.42.5(pid=15554) [trial-2371↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15554)] [trial-2371↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18] 08:15:05.402788 tst handover.py:18: Test FAILED (6.4 sec) 08:15:05.429063 run osmo-hlr_10.42.42.2(pid=15551): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15551)] 08:15:05.476579 run osmo-hlr_10.42.42.2(pid=15551): stdout: | (launched: 2022-12-10_08:15:02.725728) 08:15:05.526004 run osmo-hlr_10.42.42.2(pid=15551): stderr: | [0;m[1;31m20221210081502903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081502903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081502903 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081502904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081502904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081502904 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081502917 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:trx-lms+bts1-trx-lms-limenet-micro/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081502927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081502927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081502927 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:15:05.594478 run osmo-msc_10.42.42.6(pid=15557): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15557)] 08:15:05.642140 run osmo-msc_10.42.42.6(pid=15557): stdout: | (launched: 2022-12-10_08:15:04.542915) 08:15:05.691228 run osmo-msc_10.42.42.6(pid=15557): stderr: | [0;m[38;5;43m20221210081504814 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081504814 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f99adcdfc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081504814 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081504814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081504814 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081504815 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081504816 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081504817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081504817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081504817 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:15:05.740312 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15550): Terminating (SIGTERM) 08:15:05.779698 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15553): Terminating (SIGTERM) 08:15:05.819177 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15556): Terminating (SIGTERM) 08:15:05.859082 --- ParallelTerminationStrategy: PID 15550 died... 08:15:05.878124 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15550): Terminated: ok {rc=0} 08:15:05.922442 --- ParallelTerminationStrategy: PID 15553 died... 08:15:05.940912 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15553): Terminated: ok {rc=0} 08:15:05.984856 --- ParallelTerminationStrategy: PID 15556 died... 08:15:06.003946 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15556): Terminated: ok {rc=0} 08:15:06.087142 bus /sierra_3: Setting Powered False 08:15:07.183296 bus /sierra_3: Setting Powered False 08:15:08.298038 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:trx-lms+bts1-trx-lms-limenet-micro FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:trx-lms+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 08:15:09.561575 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:15:09.566866 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 08:15:09.629238 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:15:09.655213 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 08:15:09.707582 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 08:15:09.773120 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:15:09.800589 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 08:15:10.346313 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:trx-lms+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 08:15:10.351477 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:10.362420 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:15:10.409176 tst handover.py: using LAC 27068 08:15:10.525185 tst handover.py: using RAC 38 08:15:10.641075 tst handover.py: using CellId 27068 08:15:10.756722 tst handover.py: using BVCI 27069 08:15:10.862736 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:15:10.911595 tst handover.py: using LAC 27069 08:15:11.029359 tst handover.py: using RAC 39 08:15:11.144741 tst handover.py: using CellId 27069 08:15:11.260122 tst handover.py: using BVCI 27070 08:15:11.368095 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:11.378923 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:11.389636 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:11.400253 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:11.410998 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:11.421592 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:15:11.539679 tst handover_2G:trx-lms+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:15:11.657108 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:15:12.088447 run create_hlr_db(pid=15562): Launched 08:15:12.221823 bus /sierra_2: Setting Powered False 08:15:13.286715 run create_hlr_db(pid=15562): Terminated: ok {rc=0} 08:15:13.708926 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15786): Launched 08:15:14.023165 run osmo-hlr_10.42.42.2(pid=15839): Launched 08:15:14.251209 run osmo-stp_10.42.42.5: Starting osmo-stp 08:15:14.864426 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15920): Launched 08:15:15.160244 run osmo-stp_10.42.42.5(pid=15921): Launched 08:15:15.273351 run osmo-msc_10.42.42.6: Starting osmo-msc 08:15:15.780278 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15923): Launched 08:15:16.114600 run osmo-msc_10.42.42.6(pid=15924): Launched 08:15:16.601377 run osmo-stp_10.42.42.5(pid=15921): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15921)] 08:15:16.782400 run osmo-stp_10.42.42.5(pid=15921): stdout: | (launched: 2022-12-10_08:15:15.106268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:16.909365 run osmo-stp_10.42.42.5(pid=15921): stderr: | [0;m[38;5;43m20221210081515277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081515277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081515277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081515278 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081515278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081515278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081515278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:17.036097 run osmo-stp_10.42.42.5(pid=15921): stdout: | (launched: 2022-12-10_08:15:15.106268) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:17.157377 run osmo-stp_10.42.42.5(pid=15921): stderr: | [0;m[38;5;43m20221210081515277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081515277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081515277 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081515278 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081515278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081515278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081515278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:17.301822 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=15921): Process ended prematurely: osmo-stp_10.42.42.5(pid=15921) [trial-2371↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15921)] [trial-2371↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18] 08:15:17.310501 tst handover.py:18: Test FAILED (7.0 sec) 08:15:17.337436 run osmo-hlr_10.42.42.2(pid=15839): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=15839)] 08:15:17.386069 run osmo-hlr_10.42.42.2(pid=15839): stdout: | (launched: 2022-12-10_08:15:13.963341) 08:15:17.435608 run osmo-hlr_10.42.42.2(pid=15839): stderr: | [0;m[1;31m20221210081514276 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081514285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081514285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081514285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081514285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081514285 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081514312 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:trx-lms+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081514330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081514330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081514330 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:15:17.504747 run osmo-msc_10.42.42.6(pid=15924): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=15924)] 08:15:17.552761 run osmo-msc_10.42.42.6(pid=15924): stdout: | (launched: 2022-12-10_08:15:16.054282) 08:15:17.602369 run osmo-msc_10.42.42.6(pid=15924): stderr: | [0;m[38;5;43m20221210081516438 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081516438 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f2964f87c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081516438 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081516438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081516438 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081516439 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081516440 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081516442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081516442 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081516443 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:15:17.652204 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15786): Terminating (SIGTERM) 08:15:17.691718 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15920): Terminating (SIGTERM) 08:15:17.731613 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15923): Terminating (SIGTERM) 08:15:17.771630 --- ParallelTerminationStrategy: PID 15786 died... 08:15:17.790688 run pcap-recorder_any(filters='host 10.42.42.2')(pid=15786): Terminated: ok {rc=0} 08:15:17.835222 --- ParallelTerminationStrategy: PID 15920 died... 08:15:17.854103 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=15920): Terminated: ok {rc=0} 08:15:17.898717 --- ParallelTerminationStrategy: PID 15923 died... 08:15:17.917612 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=15923): Terminated: ok {rc=0} 08:15:18.003622 bus /sierra_3: Setting Powered False 08:15:19.104352 bus /sierra_3: Setting Powered False 08:15:20.217836 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:trx-lms+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:trx-lms+bts1-sysmo --------------------------------------------------------------------- 08:15:21.490274 tst handover_2G:trx-lms+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:15:21.495218 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x bts (candidates: 11) 08:15:21.544872 tst handover_2G:trx-lms+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 08:15:21.570908 tst handover_2G:trx-lms+bts1-sysmo: Verifying 2 x modem (candidates: 12) 08:15:21.620803 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x bts (candidates: 11) 08:15:21.670414 tst handover_2G:trx-lms+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 08:15:21.696253 tst handover_2G:trx-lms+bts1-sysmo: Reserving 2 x modem (candidates: 12) 08:15:22.246955 tst handover_2G:trx-lms+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:trx-lms+bts1-sysmo handover.py ---------------------------------------------- 08:15:22.252172 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:15:22.262792 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 08:15:22.309324 tst handover.py: using LAC 27070 08:15:22.423941 tst handover.py: using RAC 40 08:15:22.551001 tst handover.py: using CellId 27070 08:15:22.682708 tst handover.py: using BVCI 27071 08:15:22.805423 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x bts (candidates: 2) 08:15:22.839215 tst handover.py: using LAC 27071 08:15:22.959477 tst handover.py: using RAC 41 08:15:23.081643 tst handover.py: using CellId 27071 08:15:23.200387 tst handover.py: using BVCI 27072 08:15:23.320827 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:15:23.333150 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:15:23.346468 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:15:23.359240 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:15:23.372260 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:15:23.386315 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 08:15:23.507006 tst handover_2G:trx-lms+bts1-sysmo: Using 1 x modem (candidates: 2) 08:15:23.622245 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:15:24.070992 run create_hlr_db(pid=16104): Launched 08:15:24.226212 bus /sierra_2: Setting Powered False 08:15:25.287982 run create_hlr_db(pid=16104): Terminated: ok {rc=0} 08:15:25.697943 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16106): Launched 08:15:26.011408 run osmo-hlr_10.42.42.2(pid=16107): Launched 08:15:26.244394 run osmo-stp_10.42.42.5: Starting osmo-stp 08:15:26.941756 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16109): Launched 08:15:27.254024 run osmo-stp_10.42.42.5(pid=16110): Launched 08:15:27.485069 run osmo-msc_10.42.42.6: Starting osmo-msc 08:15:28.187506 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16113): Launched 08:15:28.499642 run osmo-msc_10.42.42.6(pid=16114): Launched 08:15:28.666648 run osmo-stp_10.42.42.5(pid=16110): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16110)] 08:15:28.792109 run osmo-stp_10.42.42.5(pid=16110): stdout: | (launched: 2022-12-10_08:15:27.192912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:28.916336 run osmo-stp_10.42.42.5(pid=16110): stderr: | [0;m[38;5;43m20221210081527532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081527532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081527532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081527532 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081527533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081527533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081527533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:29.038906 run osmo-stp_10.42.42.5(pid=16110): stdout: | (launched: 2022-12-10_08:15:27.192912) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:29.155886 run osmo-stp_10.42.42.5(pid=16110): stderr: | [0;m[38;5;43m20221210081527532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081527532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081527532 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081527532 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081527533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081527533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081527533 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:29.296031 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16110): Process ended prematurely: osmo-stp_10.42.42.5(pid=16110) [trial-2371↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16110)] [trial-2371↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18] 08:15:29.304270 tst handover.py:18: Test FAILED (7.0 sec) 08:15:29.330162 run osmo-hlr_10.42.42.2(pid=16107): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16107)] 08:15:29.377440 run osmo-hlr_10.42.42.2(pid=16107): stdout: | (launched: 2022-12-10_08:15:25.951263) 08:15:29.426351 run osmo-hlr_10.42.42.2(pid=16107): stderr: | [0;m[1;31m20221210081526292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081526292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081526292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081526292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081526292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081526292 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081526311 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:trx-lms+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081526319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081526319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081526319 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:15:29.494593 run osmo-msc_10.42.42.6(pid=16114): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:trx-lms+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16114)] 08:15:29.541904 run osmo-msc_10.42.42.6(pid=16114): stdout: | (launched: 2022-12-10_08:15:28.445651) 08:15:29.590417 run osmo-msc_10.42.42.6(pid=16114): stderr: | [0;m[38;5;43m20221210081528717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081528717 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7d86c33c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081528717 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081528717 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081528718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081528718 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081528719 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081528720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081528720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081528720 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:15:29.639437 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16106): Terminating (SIGTERM) 08:15:29.678593 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16109): Terminating (SIGTERM) 08:15:29.717937 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16113): Terminating (SIGTERM) 08:15:29.757699 --- ParallelTerminationStrategy: PID 16106 died... 08:15:29.776603 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16106): Terminated: ok {rc=0} 08:15:29.820620 --- ParallelTerminationStrategy: PID 16109 died... 08:15:29.839157 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16109): Terminated: ok {rc=0} 08:15:29.882828 --- ParallelTerminationStrategy: PID 16113 died... 08:15:29.901536 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16113): Terminated: ok {rc=0} 08:15:29.986333 bus /sierra_3: Setting Powered False 08:15:31.089306 bus /sierra_3: Setting Powered False 08:15:32.216549 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:trx-lms+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:trx-lms+bts1-trx-b200 --------------------------------------------------------------------- 08:15:33.472412 tst handover_2G:trx-lms+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:15:33.479569 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 08:15:33.545327 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 08:15:33.573127 tst handover_2G:trx-lms+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 08:15:33.627451 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 08:15:33.693276 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 08:15:33.720878 tst handover_2G:trx-lms+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 08:15:34.270831 tst handover_2G:trx-lms+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:trx-lms+bts1-trx-b200 handover.py ---------------------------------------------- 08:15:34.278492 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:15:34.290250 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:15:34.338562 tst handover.py: using LAC 27072 08:15:34.452818 tst handover.py: using RAC 42 08:15:34.567156 tst handover.py: using CellId 27072 08:15:34.680456 tst handover.py: using BVCI 27073 08:15:34.787014 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:15:34.833458 tst handover.py: using LAC 27073 08:15:34.949831 tst handover.py: using RAC 43 08:15:35.063632 tst handover.py: using CellId 27073 08:15:35.187004 tst handover.py: using BVCI 27074 08:15:35.302309 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:15:35.313770 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:15:35.325081 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:15:35.336640 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:15:35.348444 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:15:35.360086 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:15:35.475955 tst handover_2G:trx-lms+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:15:35.589337 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:15:36.021989 run create_hlr_db(pid=16119): Launched 08:15:36.143617 bus /sierra_2: Setting Powered False 08:15:37.204160 run create_hlr_db(pid=16119): Terminated: ok {rc=0} 08:15:37.609970 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16121): Launched 08:15:37.926719 run osmo-hlr_10.42.42.2(pid=16122): Launched 08:15:38.048604 run osmo-stp_10.42.42.5: Starting osmo-stp 08:15:38.569562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16124): Launched 08:15:38.886272 run osmo-stp_10.42.42.5(pid=16125): Launched 08:15:39.007412 run osmo-msc_10.42.42.6: Starting osmo-msc 08:15:39.555961 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16127): Launched 08:15:39.873431 run osmo-msc_10.42.42.6(pid=16128): Launched 08:15:40.053411 run osmo-stp_10.42.42.5(pid=16125): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16125)] 08:15:40.189210 run osmo-stp_10.42.42.5(pid=16125): stdout: | (launched: 2022-12-10_08:15:38.828768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:40.324867 run osmo-stp_10.42.42.5(pid=16125): stderr: | [0;m[38;5;43m20221210081539018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081539018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081539019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081539019 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081539020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081539020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081539020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:40.460016 run osmo-stp_10.42.42.5(pid=16125): stdout: | (launched: 2022-12-10_08:15:38.828768) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:40.587378 run osmo-stp_10.42.42.5(pid=16125): stderr: | [0;m[38;5;43m20221210081539018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081539018 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081539019 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081539019 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081539020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081539020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081539020 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:40.739586 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16125): Process ended prematurely: osmo-stp_10.42.42.5(pid=16125) [trial-2371↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16125)] [trial-2371↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18] 08:15:40.748501 tst handover.py:18: Test FAILED (6.5 sec) 08:15:40.777180 run osmo-hlr_10.42.42.2(pid=16122): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16122)] 08:15:40.827788 run osmo-hlr_10.42.42.2(pid=16122): stdout: | (launched: 2022-12-10_08:15:37.869482) 08:15:40.880378 run osmo-hlr_10.42.42.2(pid=16122): stderr: | [0;m[1;31m20221210081538065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081538065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081538065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081538065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081538065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081538065 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081538078 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:trx-lms+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081538087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081538087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081538087 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:15:40.952875 run osmo-msc_10.42.42.6(pid=16128): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:trx-lms+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16128)] 08:15:41.003238 run osmo-msc_10.42.42.6(pid=16128): stdout: | (launched: 2022-12-10_08:15:39.816020) 08:15:41.055192 run osmo-msc_10.42.42.6(pid=16128): stderr: | [0;m[38;5;43m20221210081540137 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081540138 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0e38090c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081540138 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081540138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081540138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081540138 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081540140 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081540140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081540140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081540140 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:15:41.108059 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16121): Terminating (SIGTERM) 08:15:41.150046 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16124): Terminating (SIGTERM) 08:15:41.192027 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16127): Terminating (SIGTERM) 08:15:41.234515 --- ParallelTerminationStrategy: PID 16121 died... 08:15:41.254443 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16121): Terminated: ok {rc=0} 08:15:41.301627 --- ParallelTerminationStrategy: PID 16124 died... 08:15:41.322146 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16124): Terminated: ok {rc=0} 08:15:41.368734 --- ParallelTerminationStrategy: PID 16127 died... 08:15:41.388318 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16127): Terminated: ok {rc=0} 08:15:41.477532 bus /sierra_3: Setting Powered False 08:15:42.577497 bus /sierra_3: Setting Powered False 08:15:43.694382 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:trx-lms+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:trx-lms+bts1-trx-umtrx --------------------------------------------------------------------- 08:15:44.966404 tst handover_2G:trx-lms+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:15:44.972583 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:15:45.034189 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:15:45.060666 tst handover_2G:trx-lms+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:15:45.117812 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:15:45.182537 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:15:45.209823 tst handover_2G:trx-lms+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:15:45.748813 tst handover_2G:trx-lms+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeSDR-USB UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:trx-lms+bts1-trx-umtrx handover.py ---------------------------------------------- 08:15:45.755414 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:15:45.766859 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:15:45.815903 tst handover.py: using LAC 27074 08:15:45.974600 tst handover.py: using RAC 44 08:15:46.096332 tst handover.py: using CellId 27074 08:15:46.261690 tst handover.py: using BVCI 27075 08:15:46.412258 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:15:46.459866 tst handover.py: using LAC 27075 08:15:46.586669 tst handover.py: using RAC 45 08:15:46.709386 tst handover.py: using CellId 27075 08:15:46.858024 tst handover.py: using BVCI 27076 08:15:46.970867 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:15:46.982520 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:15:46.994070 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:15:47.005632 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:15:47.016796 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:15:47.028136 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:15:47.147570 tst handover_2G:trx-lms+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:15:47.280739 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:15:47.714967 run create_hlr_db(pid=16135): Launched 08:15:47.835942 bus /sierra_2: Setting Powered False 08:15:48.896457 run create_hlr_db(pid=16135): Terminated: ok {rc=0} 08:15:49.302098 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16137): Launched 08:15:49.618397 run osmo-hlr_10.42.42.2(pid=16138): Launched 08:15:49.741012 run osmo-stp_10.42.42.5: Starting osmo-stp 08:15:50.260445 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16140): Launched 08:15:50.577079 run osmo-stp_10.42.42.5(pid=16141): Launched 08:15:50.699260 run osmo-msc_10.42.42.6: Starting osmo-msc 08:15:51.246167 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16143): Launched 08:15:51.564287 run osmo-msc_10.42.42.6(pid=16144): Launched 08:15:51.743382 run osmo-stp_10.42.42.5(pid=16141): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16141)] 08:15:51.877602 run osmo-stp_10.42.42.5(pid=16141): stdout: | (launched: 2022-12-10_08:15:50.519784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:52.013492 run osmo-stp_10.42.42.5(pid=16141): stderr: | [0;m[38;5;43m20221210081550711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081550711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081550712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081550712 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081550712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081550712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081550713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:52.147117 run osmo-stp_10.42.42.5(pid=16141): stdout: | (launched: 2022-12-10_08:15:50.519784) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:15:52.273282 run osmo-stp_10.42.42.5(pid=16141): stderr: | [0;m[38;5;43m20221210081550711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081550711 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081550712 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081550712 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081550712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081550712 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081550713 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:15:52.425132 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16141): Process ended prematurely: osmo-stp_10.42.42.5(pid=16141) [trial-2371↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16141)] [trial-2371↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18] 08:15:52.433968 tst handover.py:18: Test FAILED (6.7 sec) 08:15:52.461838 run osmo-hlr_10.42.42.2(pid=16138): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16138)] 08:15:52.512089 run osmo-hlr_10.42.42.2(pid=16138): stdout: | (launched: 2022-12-10_08:15:49.561423) 08:15:52.564044 run osmo-hlr_10.42.42.2(pid=16138): stderr: | [0;m[1;31m20221210081549758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081549758 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081549759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081549759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081549759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081549759 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081549770 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:trx-lms+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081549778 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081549779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081549779 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:15:52.636177 run osmo-msc_10.42.42.6(pid=16144): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16144)] 08:15:52.686290 run osmo-msc_10.42.42.6(pid=16144): stdout: | (launched: 2022-12-10_08:15:51.506268) 08:15:52.737883 run osmo-msc_10.42.42.6(pid=16144): stderr: | [0;m[38;5;43m20221210081551825 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081551825 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f7165519c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081551825 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081551825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081551825 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081551826 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081551827 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081551828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081551828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081551828 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:15:52.789778 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16137): Terminating (SIGTERM) 08:15:52.831400 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16140): Terminating (SIGTERM) 08:15:52.873254 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16143): Terminating (SIGTERM) 08:15:52.915441 --- ParallelTerminationStrategy: PID 16137 died... 08:15:52.935565 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16137): Terminated: ok {rc=0} 08:15:52.982195 --- ParallelTerminationStrategy: PID 16140 died... 08:15:53.001813 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16140): Terminated: ok {rc=0} 08:15:53.048383 --- ParallelTerminationStrategy: PID 16143 died... 08:15:53.068066 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16143): Terminated: ok {rc=0} 08:15:53.156100 bus /sierra_3: Setting Powered False 08:15:54.255142 bus /sierra_3: Setting Powered False 08:15:55.371142 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:trx-lms+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 --------------------------------------------------------------------- 08:15:56.642308 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:15:56.648583 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x bts (candidates: 11) 08:15:56.707609 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 6 x ip_address (candidates: 9) 08:15:56.733876 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Verifying 2 x modem (candidates: 12) 08:15:56.784922 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x bts (candidates: 11) 08:15:56.843524 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 6 x ip_address (candidates: 9) 08:15:56.869685 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Reserving 2 x modem (candidates: 12) 08:15:57.429281 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoCell 5000 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 handover.py ---------------------------------------------- 08:15:57.434722 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:57.446271 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:15:57.490637 tst handover.py: using LAC 27076 08:15:57.614235 tst handover.py: using RAC 46 08:15:57.737807 tst handover.py: using CellId 27076 08:15:57.861705 tst handover.py: using BVCI 27077 08:15:57.969803 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x bts (candidates: 2) 08:15:58.018905 tst handover.py: using LAC 27077 08:15:58.136755 tst handover.py: using RAC 47 08:15:58.252034 tst handover.py: using CellId 27077 08:15:58.369371 tst handover.py: using BVCI 27078 08:15:58.485688 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:58.497603 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:58.509289 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:58.521353 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:58.533281 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x ip_address (candidates: 6) 08:15:58.545732 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:15:58.661380 tst handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000: Using 1 x modem (candidates: 2) 08:15:58.778792 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:15:59.248344 run create_hlr_db(pid=16149): Launched 08:15:59.371184 bus /sierra_2: Setting Powered False 08:16:00.434076 run create_hlr_db(pid=16149): Terminated: ok {rc=0} 08:16:00.857780 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16151): Launched 08:16:01.207158 run osmo-hlr_10.42.42.2(pid=16152): Launched 08:16:01.369039 run osmo-stp_10.42.42.5: Starting osmo-stp 08:16:02.060109 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16154): Launched 08:16:02.401561 run osmo-stp_10.42.42.5(pid=16155): Launched 08:16:02.524198 run osmo-msc_10.42.42.6: Starting osmo-msc 08:16:03.073574 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16157): Launched 08:16:03.389684 run osmo-msc_10.42.42.6(pid=16158): Launched 08:16:03.567827 run osmo-stp_10.42.42.5(pid=16155): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16155)] 08:16:03.701975 run osmo-stp_10.42.42.5(pid=16155): stdout: | (launched: 2022-12-10_08:16:02.344140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:03.836907 run osmo-stp_10.42.42.5(pid=16155): stderr: | [0;m[38;5;43m20221210081602536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081602536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081602536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081602537 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081602537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081602537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081602537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:03.970876 run osmo-stp_10.42.42.5(pid=16155): stdout: | (launched: 2022-12-10_08:16:02.344140) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:04.096572 run osmo-stp_10.42.42.5(pid=16155): stderr: | [0;m[38;5;43m20221210081602536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081602536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081602536 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081602537 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081602537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081602537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081602537 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:04.247538 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16155): Process ended prematurely: osmo-stp_10.42.42.5(pid=16155) [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16155)] [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18] 08:16:04.256175 tst handover.py:18: Test FAILED (6.8 sec) 08:16:04.283967 run osmo-hlr_10.42.42.2(pid=16152): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16152)] 08:16:04.333841 run osmo-hlr_10.42.42.2(pid=16152): stdout: | (launched: 2022-12-10_08:16:01.146145) 08:16:04.385461 run osmo-hlr_10.42.42.2(pid=16152): stderr: | [0;m[1;31m20221210081601492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081601492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081601492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081601492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081601492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081601492 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081601553 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081601566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081601566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081601566 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:16:04.456903 run osmo-msc_10.42.42.6(pid=16158): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16158)] 08:16:04.506564 run osmo-msc_10.42.42.6(pid=16158): stdout: | (launched: 2022-12-10_08:16:03.332122) 08:16:04.557937 run osmo-msc_10.42.42.6(pid=16158): stderr: | [0;m[38;5;43m20221210081603650 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081603651 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f96d2a02c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081603651 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081603651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081603651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081603651 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081603653 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081603653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081603653 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081603654 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:16:04.609740 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16151): Terminating (SIGTERM) 08:16:04.650970 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16154): Terminating (SIGTERM) 08:16:04.692444 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16157): Terminating (SIGTERM) 08:16:04.734349 --- ParallelTerminationStrategy: PID 16151 died... 08:16:04.754457 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16151): Terminated: ok {rc=0} 08:16:04.800681 --- ParallelTerminationStrategy: PID 16154 died... 08:16:04.820077 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16154): Terminated: ok {rc=0} 08:16:04.866030 --- ParallelTerminationStrategy: PID 16157 died... 08:16:04.885377 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16157): Terminated: ok {rc=0} 08:16:04.973068 bus /sierra_3: Setting Powered False 08:16:06.071719 bus /sierra_3: Setting Powered False 08:16:07.186770 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:trx-lms-limenet-micro+bts1-sysmo --------------------------------------------------------------------- 08:16:08.462316 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:16:08.467794 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x bts (candidates: 11) 08:16:08.516125 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 08:16:08.543088 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Verifying 2 x modem (candidates: 12) 08:16:08.595741 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x bts (candidates: 11) 08:16:08.643241 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 08:16:08.670387 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Reserving 2 x modem (candidates: 12) 08:16:09.219173 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:trx-lms-limenet-micro+bts1-sysmo handover.py ---------------------------------------------- 08:16:09.224606 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:09.235681 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 08:16:09.280097 tst handover.py: using LAC 27078 08:16:09.397677 tst handover.py: using RAC 48 08:16:09.513096 tst handover.py: using CellId 27078 08:16:09.628743 tst handover.py: using BVCI 27079 08:16:09.744310 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x bts (candidates: 2) 08:16:09.783259 tst handover.py: using LAC 27079 08:16:09.907009 tst handover.py: using RAC 49 08:16:10.029320 tst handover.py: using CellId 27079 08:16:10.151760 tst handover.py: using BVCI 27080 08:16:10.266518 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:10.277867 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:10.289027 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:10.300747 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:10.312310 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:10.324034 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 08:16:10.442934 tst handover_2G:trx-lms-limenet-micro+bts1-sysmo: Using 1 x modem (candidates: 2) 08:16:10.562002 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:16:11.024694 run create_hlr_db(pid=16163): Launched 08:16:11.146986 bus /sierra_2: Setting Powered False 08:16:12.210160 run create_hlr_db(pid=16163): Terminated: ok {rc=0} 08:16:12.622377 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16165): Launched 08:16:12.938169 run osmo-hlr_10.42.42.2(pid=16166): Launched 08:16:13.059922 run osmo-stp_10.42.42.5: Starting osmo-stp 08:16:13.578729 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16168): Launched 08:16:13.894698 run osmo-stp_10.42.42.5(pid=16169): Launched 08:16:14.016516 run osmo-msc_10.42.42.6: Starting osmo-msc 08:16:14.560288 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16171): Launched 08:16:14.876578 run osmo-msc_10.42.42.6(pid=16172): Launched 08:16:15.044292 run osmo-stp_10.42.42.5(pid=16169): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16169)] 08:16:15.170914 run osmo-stp_10.42.42.5(pid=16169): stdout: | (launched: 2022-12-10_08:16:13.837192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:15.296047 run osmo-stp_10.42.42.5(pid=16169): stderr: | [0;m[38;5;43m20221210081614029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081614029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081614030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081614030 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081614030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081614030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081614030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:15.419262 run osmo-stp_10.42.42.5(pid=16169): stdout: | (launched: 2022-12-10_08:16:13.837192) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:15.537240 run osmo-stp_10.42.42.5(pid=16169): stderr: | [0;m[38;5;43m20221210081614029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081614029 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081614030 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081614030 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081614030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081614030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081614030 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:15.678189 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16169): Process ended prematurely: osmo-stp_10.42.42.5(pid=16169) [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16169)] [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18] 08:16:15.686517 tst handover.py:18: Test FAILED (6.5 sec) 08:16:15.712692 run osmo-hlr_10.42.42.2(pid=16166): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16166)] 08:16:15.760519 run osmo-hlr_10.42.42.2(pid=16166): stdout: | (launched: 2022-12-10_08:16:12.880758) 08:16:15.809843 run osmo-hlr_10.42.42.2(pid=16166): stderr: | [0;m[1;31m20221210081613078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081613078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081613078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081613078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081613078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081613078 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081613093 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:trx-lms-limenet-micro+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081613103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081613103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081613103 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:16:15.884026 run osmo-msc_10.42.42.6(pid=16172): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16172)] 08:16:15.950458 run osmo-msc_10.42.42.6(pid=16172): stdout: | (launched: 2022-12-10_08:16:14.819145) 08:16:16.000828 run osmo-msc_10.42.42.6(pid=16172): stderr: | [0;m[38;5;43m20221210081615093 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081615093 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa7bba6ec40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081615093 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081615093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081615093 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081615094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081615096 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081615096 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081615097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081615097 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:16:16.065306 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16165): Terminating (SIGTERM) 08:16:16.106338 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16168): Terminating (SIGTERM) 08:16:16.148531 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16171): Terminating (SIGTERM) 08:16:16.191042 --- ParallelTerminationStrategy: PID 16165 died... 08:16:16.210476 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16165): Terminated: ok {rc=0} 08:16:16.256935 --- ParallelTerminationStrategy: PID 16168 died... 08:16:16.276490 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16168): Terminated: ok {rc=0} 08:16:16.321471 --- ParallelTerminationStrategy: PID 16171 died... 08:16:16.340625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16171): Terminated: ok {rc=0} 08:16:16.426265 bus /sierra_3: Setting Powered False 08:16:17.523141 bus /sierra_3: Setting Powered False 08:16:18.640074 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:trx-lms-limenet-micro+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 --------------------------------------------------------------------- 08:16:19.894565 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:16:19.900152 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 08:16:19.960293 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 08:16:19.987361 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 08:16:20.043545 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 08:16:20.103278 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 08:16:20.129600 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 08:16:20.681748 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 handover.py ---------------------------------------------- 08:16:20.687382 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:20.699041 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:16:20.745668 tst handover.py: using LAC 27080 08:16:20.862964 tst handover.py: using RAC 50 08:16:20.981214 tst handover.py: using CellId 27080 08:16:21.096860 tst handover.py: using BVCI 27081 08:16:21.204471 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:16:21.256133 tst handover.py: using LAC 27081 08:16:21.370491 tst handover.py: using RAC 51 08:16:21.489238 tst handover.py: using CellId 27081 08:16:21.604713 tst handover.py: using BVCI 27082 08:16:21.710977 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:21.721962 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:21.732585 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:21.743385 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:21.754188 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:21.765175 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:16:21.882955 tst handover_2G:trx-lms-limenet-micro+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:16:22.001130 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:16:22.465309 run create_hlr_db(pid=16177): Launched 08:16:22.587639 bus /sierra_2: Setting Powered False 08:16:23.651311 run create_hlr_db(pid=16177): Terminated: ok {rc=0} 08:16:24.048834 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16179): Launched 08:16:24.344351 run osmo-hlr_10.42.42.2(pid=16180): Launched 08:16:24.457530 run osmo-stp_10.42.42.5: Starting osmo-stp 08:16:24.955752 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16182): Launched 08:16:25.251888 run osmo-stp_10.42.42.5(pid=16183): Launched 08:16:25.365494 run osmo-msc_10.42.42.6: Starting osmo-msc 08:16:25.874061 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16185): Launched 08:16:26.169288 run osmo-msc_10.42.42.6(pid=16186): Launched 08:16:26.334800 run osmo-stp_10.42.42.5(pid=16183): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16183)] 08:16:26.459469 run osmo-stp_10.42.42.5(pid=16183): stdout: | (launched: 2022-12-10_08:16:25.197503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:26.583776 run osmo-stp_10.42.42.5(pid=16183): stderr: | [0;m[38;5;43m20221210081625368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081625368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081625368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081625369 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081625371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081625371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081625371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:26.705952 run osmo-stp_10.42.42.5(pid=16183): stdout: | (launched: 2022-12-10_08:16:25.197503) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:26.822981 run osmo-stp_10.42.42.5(pid=16183): stderr: | [0;m[38;5;43m20221210081625368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081625368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081625368 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081625369 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081625371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081625371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081625371 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:26.962896 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16183): Process ended prematurely: osmo-stp_10.42.42.5(pid=16183) [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16183)] [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18] 08:16:26.971122 tst handover.py:18: Test FAILED (6.3 sec) 08:16:26.997209 run osmo-hlr_10.42.42.2(pid=16180): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16180)] 08:16:27.044648 run osmo-hlr_10.42.42.2(pid=16180): stdout: | (launched: 2022-12-10_08:16:24.290174) 08:16:27.093519 run osmo-hlr_10.42.42.2(pid=16180): stderr: | [0;m[1;31m20221210081624466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081624466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081624466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081624466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081624466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081624466 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081624478 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:trx-lms-limenet-micro+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081624487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081624487 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081624488 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:16:27.161695 run osmo-msc_10.42.42.6(pid=16186): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16186)] 08:16:27.209322 run osmo-msc_10.42.42.6(pid=16186): stdout: | (launched: 2022-12-10_08:16:26.114959) 08:16:27.258155 run osmo-msc_10.42.42.6(pid=16186): stderr: | [0;m[38;5;43m20221210081626386 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081626386 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f9f144ecc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081626386 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081626386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081626386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081626386 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081626388 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081626388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081626388 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081626389 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:16:27.307118 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16179): Terminating (SIGTERM) 08:16:27.346311 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16182): Terminating (SIGTERM) 08:16:27.385517 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16185): Terminating (SIGTERM) 08:16:27.425149 --- ParallelTerminationStrategy: PID 16179 died... 08:16:27.444406 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16179): Terminated: ok {rc=0} 08:16:27.488290 --- ParallelTerminationStrategy: PID 16182 died... 08:16:27.506954 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16182): Terminated: ok {rc=0} 08:16:27.550421 --- ParallelTerminationStrategy: PID 16185 died... 08:16:27.568797 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16185): Terminated: ok {rc=0} 08:16:27.652031 bus /sierra_3: Setting Powered False 08:16:28.747186 bus /sierra_3: Setting Powered False 08:16:29.862579 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:trx-lms-limenet-micro+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx --------------------------------------------------------------------- 08:16:31.149410 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:16:31.155368 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:16:31.218931 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:16:31.248464 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:16:31.302691 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:16:31.361129 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:16:31.387851 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:16:31.944048 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts LimeNET-Micro UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx handover.py ---------------------------------------------- 08:16:31.951378 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:16:31.964755 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:16:32.015089 tst handover.py: using LAC 27082 08:16:32.142519 tst handover.py: using RAC 52 08:16:32.270776 tst handover.py: using CellId 27082 08:16:32.396140 tst handover.py: using BVCI 27083 08:16:32.511407 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:16:32.559763 tst handover.py: using LAC 27083 08:16:32.685903 tst handover.py: using RAC 53 08:16:32.812365 tst handover.py: using CellId 27083 08:16:32.931814 tst handover.py: using BVCI 27084 08:16:33.040301 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:16:33.051474 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:16:33.062686 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:16:33.073985 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:16:33.085161 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:16:33.096384 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:16:33.214739 tst handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:16:33.334670 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:16:33.799653 run create_hlr_db(pid=16191): Launched 08:16:33.921806 bus /sierra_2: Setting Powered False 08:16:34.985213 run create_hlr_db(pid=16191): Terminated: ok {rc=0} 08:16:35.385062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16193): Launched 08:16:35.681908 run osmo-hlr_10.42.42.2(pid=16194): Launched 08:16:35.795148 run osmo-stp_10.42.42.5: Starting osmo-stp 08:16:36.291504 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16196): Launched 08:16:36.586961 run osmo-stp_10.42.42.5(pid=16197): Launched 08:16:36.700766 run osmo-msc_10.42.42.6: Starting osmo-msc 08:16:37.208501 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16199): Launched 08:16:37.503536 run osmo-msc_10.42.42.6(pid=16200): Launched 08:16:37.668298 run osmo-stp_10.42.42.5(pid=16197): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16197)] 08:16:37.792532 run osmo-stp_10.42.42.5(pid=16197): stdout: | (launched: 2022-12-10_08:16:36.532640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:37.916925 run osmo-stp_10.42.42.5(pid=16197): stderr: | [0;m[38;5;43m20221210081636702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081636703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081636703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081636703 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081636704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081636704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081636704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:38.039604 run osmo-stp_10.42.42.5(pid=16197): stdout: | (launched: 2022-12-10_08:16:36.532640) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:38.156846 run osmo-stp_10.42.42.5(pid=16197): stderr: | [0;m[38;5;43m20221210081636702 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081636703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081636703 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081636703 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081636704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081636704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081636704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:38.297241 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16197): Process ended prematurely: osmo-stp_10.42.42.5(pid=16197) [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16197)] [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18] 08:16:38.305462 tst handover.py:18: Test FAILED (6.3 sec) 08:16:38.331728 run osmo-hlr_10.42.42.2(pid=16194): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16194)] 08:16:38.379438 run osmo-hlr_10.42.42.2(pid=16194): stdout: | (launched: 2022-12-10_08:16:35.627216) 08:16:38.428600 run osmo-hlr_10.42.42.2(pid=16194): stderr: | [0;m[1;31m20221210081635803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081635803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081635803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081635803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081635803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081635803 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081635815 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081635824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081635824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081635824 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:16:38.496908 run osmo-msc_10.42.42.6(pid=16200): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16200)] 08:16:38.544585 run osmo-msc_10.42.42.6(pid=16200): stdout: | (launched: 2022-12-10_08:16:37.449686) 08:16:38.593316 run osmo-msc_10.42.42.6(pid=16200): stderr: | [0;m[38;5;43m20221210081637723 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081637723 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f6cfac67c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081637723 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081637723 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081637724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081637724 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081637726 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081637726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081637726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081637726 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:16:38.642524 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16193): Terminating (SIGTERM) 08:16:38.681790 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16196): Terminating (SIGTERM) 08:16:38.721130 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16199): Terminating (SIGTERM) 08:16:38.760664 --- ParallelTerminationStrategy: PID 16193 died... 08:16:38.779783 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16193): Terminated: ok {rc=0} 08:16:38.823680 --- ParallelTerminationStrategy: PID 16196 died... 08:16:38.842293 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16196): Terminated: ok {rc=0} 08:16:38.885986 --- ParallelTerminationStrategy: PID 16199 died... 08:16:38.904343 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16199): Terminated: ok {rc=0} 08:16:38.987601 bus /sierra_3: Setting Powered False 08:16:40.082758 bus /sierra_3: Setting Powered False 08:16:41.197337 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:trx-sysmocell5000+bts1-sysmo --------------------------------------------------------------------- 08:16:42.466257 tst handover_2G:trx-sysmocell5000+bts1-sysmo: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:16:42.471479 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x bts (candidates: 11) 08:16:42.522107 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 6 x ip_address (candidates: 9) 08:16:42.548329 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Verifying 2 x modem (candidates: 12) 08:16:42.599074 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x bts (candidates: 11) 08:16:42.649257 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 6 x ip_address (candidates: 9) 08:16:42.675275 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Reserving 2 x modem (candidates: 12) 08:16:43.227400 tst handover_2G:trx-sysmocell5000+bts1-sysmo: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 sysmoBTS 1002 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:trx-sysmocell5000+bts1-sysmo handover.py ---------------------------------------------- 08:16:43.232936 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:43.243915 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 08:16:43.291291 tst handover.py: using LAC 27084 08:16:43.406458 tst handover.py: using RAC 54 08:16:43.521222 tst handover.py: using CellId 27084 08:16:43.636016 tst handover.py: using BVCI 27085 08:16:43.743113 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x bts (candidates: 2) 08:16:43.776411 tst handover.py: using LAC 27085 08:16:43.892067 tst handover.py: using RAC 55 08:16:44.006430 tst handover.py: using CellId 27085 08:16:44.122397 tst handover.py: using BVCI 27086 08:16:44.229322 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:44.240212 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:44.251146 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:44.262093 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:44.273204 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x ip_address (candidates: 6) 08:16:44.284110 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 08:16:44.404192 tst handover_2G:trx-sysmocell5000+bts1-sysmo: Using 1 x modem (candidates: 2) 08:16:44.524757 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:16:44.989460 run create_hlr_db(pid=16205): Launched 08:16:45.112677 bus /sierra_2: Setting Powered False 08:16:46.173123 run create_hlr_db(pid=16205): Terminated: ok {rc=0} 08:16:46.623062 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16207): Launched 08:16:46.963658 run osmo-hlr_10.42.42.2(pid=16208): Launched 08:16:47.215483 run osmo-stp_10.42.42.5: Starting osmo-stp 08:16:47.744685 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16210): Launched 08:16:48.062533 run osmo-stp_10.42.42.5(pid=16211): Launched 08:16:48.184679 run osmo-msc_10.42.42.6: Starting osmo-msc 08:16:48.731499 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16213): Launched 08:16:49.049532 run osmo-msc_10.42.42.6(pid=16214): Launched 08:16:49.228200 run osmo-stp_10.42.42.5(pid=16211): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16211)] 08:16:49.362995 run osmo-stp_10.42.42.5(pid=16211): stdout: | (launched: 2022-12-10_08:16:48.004616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:49.497464 run osmo-stp_10.42.42.5(pid=16211): stderr: | [0;m[38;5;43m20221210081648197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081648197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081648198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081648198 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081648198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081648198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081648198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:49.631119 run osmo-stp_10.42.42.5(pid=16211): stdout: | (launched: 2022-12-10_08:16:48.004616) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:16:49.757252 run osmo-stp_10.42.42.5(pid=16211): stderr: | [0;m[38;5;43m20221210081648197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081648197 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081648198 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081648198 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081648198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081648198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081648198 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:16:49.908021 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16211): Process ended prematurely: osmo-stp_10.42.42.5(pid=16211) [trial-2371↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16211)] [trial-2371↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18] 08:16:49.917011 tst handover.py:18: Test FAILED (6.7 sec) 08:16:49.944776 run osmo-hlr_10.42.42.2(pid=16208): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16208)] 08:16:49.994758 run osmo-hlr_10.42.42.2(pid=16208): stdout: | (launched: 2022-12-10_08:16:46.897526) 08:16:50.046261 run osmo-hlr_10.42.42.2(pid=16208): stderr: | [0;m[1;31m20221210081647240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081647240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081647240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081647240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081647240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081647240 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081647263 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:trx-sysmocell5000+bts1-sysmo/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081647278 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081647279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081647279 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:16:50.118034 run osmo-msc_10.42.42.6(pid=16214): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16214)] 08:16:50.167815 run osmo-msc_10.42.42.6(pid=16214): stdout: | (launched: 2022-12-10_08:16:48.991813) 08:16:50.219432 run osmo-msc_10.42.42.6(pid=16214): stderr: | [0;m[38;5;43m20221210081649314 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081649314 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fcd0dc9bc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081649314 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081649314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081649314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081649314 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081649316 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081649317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081649317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081649317 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:16:50.271426 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16207): Terminating (SIGTERM) 08:16:50.313326 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16210): Terminating (SIGTERM) 08:16:50.355087 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16213): Terminating (SIGTERM) 08:16:50.397561 --- ParallelTerminationStrategy: PID 16207 died... 08:16:50.417626 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16207): Terminated: ok {rc=0} 08:16:50.464428 --- ParallelTerminationStrategy: PID 16210 died... 08:16:50.484102 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16210): Terminated: ok {rc=0} 08:16:50.530664 --- ParallelTerminationStrategy: PID 16213 died... 08:16:50.550202 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16213): Terminated: ok {rc=0} 08:16:50.638263 bus /sierra_3: Setting Powered False 08:16:51.737396 bus /sierra_3: Setting Powered False 08:16:52.853844 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:trx-sysmocell5000+bts1-sysmo FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:trx-sysmocell5000+bts1-trx-b200 --------------------------------------------------------------------- 08:16:54.116732 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:16:54.122844 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 08:16:54.188320 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 08:16:54.215446 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 08:16:54.268444 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 08:16:54.336085 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 08:16:54.363240 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 08:16:54.915442 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:trx-sysmocell5000+bts1-trx-b200 handover.py ---------------------------------------------- 08:16:54.920842 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:54.932157 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:16:54.981349 tst handover.py: using LAC 27086 08:16:55.103445 tst handover.py: using RAC 56 08:16:55.226313 tst handover.py: using CellId 27086 08:16:55.349376 tst handover.py: using BVCI 27087 08:16:55.465152 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:16:55.512783 tst handover.py: using LAC 27087 08:16:55.635821 tst handover.py: using RAC 57 08:16:55.752640 tst handover.py: using CellId 27087 08:16:55.867459 tst handover.py: using BVCI 27088 08:16:55.974841 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:55.985827 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:55.996590 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:56.007948 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:56.019136 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:16:56.030226 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:16:56.149486 tst handover_2G:trx-sysmocell5000+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:16:56.269495 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:16:56.701689 run create_hlr_db(pid=16220): Launched 08:16:56.822535 bus /sierra_2: Setting Powered False 08:16:57.881754 run create_hlr_db(pid=16220): Terminated: ok {rc=0} 08:16:58.287445 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16222): Launched 08:16:58.604645 run osmo-hlr_10.42.42.2(pid=16223): Launched 08:16:58.726774 run osmo-stp_10.42.42.5: Starting osmo-stp 08:16:59.248460 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16225): Launched 08:16:59.567314 run osmo-stp_10.42.42.5(pid=16226): Launched 08:16:59.688753 run osmo-msc_10.42.42.6: Starting osmo-msc 08:17:00.235453 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16228): Launched 08:17:00.553369 run osmo-msc_10.42.42.6(pid=16229): Launched 08:17:00.731750 run osmo-stp_10.42.42.5(pid=16226): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16226)] 08:17:00.873392 run osmo-stp_10.42.42.5(pid=16226): stdout: | (launched: 2022-12-10_08:16:59.509609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:01.171319 run osmo-stp_10.42.42.5(pid=16226): stderr: | [0;m[38;5;43m20221210081659700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081659701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081659701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081659701 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081659703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081659704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081659704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:01.365700 run osmo-stp_10.42.42.5(pid=16226): stdout: | (launched: 2022-12-10_08:16:59.509609) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:01.515283 run osmo-stp_10.42.42.5(pid=16226): stderr: | [0;m[38;5;43m20221210081659700 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081659701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081659701 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081659701 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081659703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081659704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081659704 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:01.659841 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16226): Process ended prematurely: osmo-stp_10.42.42.5(pid=16226) [trial-2371↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16226)] [trial-2371↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18] 08:17:01.669092 tst handover.py:18: Test FAILED (6.7 sec) 08:17:01.696854 run osmo-hlr_10.42.42.2(pid=16223): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16223)] 08:17:01.746266 run osmo-hlr_10.42.42.2(pid=16223): stdout: | (launched: 2022-12-10_08:16:58.547360) 08:17:01.797751 run osmo-hlr_10.42.42.2(pid=16223): stderr: | [0;m[1;31m20221210081658746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081658746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081658746 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081658747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081658747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081658747 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081658760 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:trx-sysmocell5000+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081658770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081658770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081658770 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:17:01.868127 run osmo-msc_10.42.42.6(pid=16229): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16229)] 08:17:01.918237 run osmo-msc_10.42.42.6(pid=16229): stdout: | (launched: 2022-12-10_08:17:00.495674) 08:17:01.967754 run osmo-msc_10.42.42.6(pid=16229): stderr: | [0;m[38;5;43m20221210081700816 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081700816 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f0b28c21c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081700816 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081700816 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081700817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081700817 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081700818 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081700819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081700819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081700819 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:17:02.019663 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16222): Terminating (SIGTERM) 08:17:02.060604 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16225): Terminating (SIGTERM) 08:17:02.105848 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16228): Terminating (SIGTERM) 08:17:02.149036 --- ParallelTerminationStrategy: PID 16222 died... 08:17:02.169493 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16222): Terminated: ok {rc=0} 08:17:02.216083 --- ParallelTerminationStrategy: PID 16225 died... 08:17:02.234958 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16225): Terminated: ok {rc=0} 08:17:02.279933 --- ParallelTerminationStrategy: PID 16228 died... 08:17:02.300749 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16228): Terminated: ok {rc=0} 08:17:02.384662 bus /sierra_3: Setting Powered False 08:17:03.479013 bus /sierra_3: Setting Powered False 08:17:04.594580 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:trx-sysmocell5000+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:trx-sysmocell5000+bts1-trx-umtrx --------------------------------------------------------------------- 08:17:05.864230 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:17:05.869430 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:17:05.931032 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:17:05.957281 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:17:06.010693 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:17:06.072799 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:17:06.098937 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:17:06.647871 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoCell 5000 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:trx-sysmocell5000+bts1-trx-umtrx handover.py ---------------------------------------------- 08:17:06.653376 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:06.664093 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:17:06.711548 tst handover.py: using LAC 27088 08:17:06.827232 tst handover.py: using RAC 58 08:17:06.944651 tst handover.py: using CellId 27088 08:17:07.059724 tst handover.py: using BVCI 27089 08:17:07.167536 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:17:07.214356 tst handover.py: using LAC 27089 08:17:07.331420 tst handover.py: using RAC 59 08:17:07.457776 tst handover.py: using CellId 27089 08:17:07.586464 tst handover.py: using BVCI 27090 08:17:07.703743 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:07.714995 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:07.726222 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:07.738329 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:07.751120 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:07.762385 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:17:07.877022 tst handover_2G:trx-sysmocell5000+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:17:07.993657 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:17:08.459344 run create_hlr_db(pid=16237): Launched 08:17:08.580898 bus /sierra_2: Setting Powered False 08:17:09.644712 run create_hlr_db(pid=16237): Terminated: ok {rc=0} 08:17:10.058721 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16239): Launched 08:17:10.376042 run osmo-hlr_10.42.42.2(pid=16240): Launched 08:17:10.498327 run osmo-stp_10.42.42.5: Starting osmo-stp 08:17:11.014227 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16242): Launched 08:17:11.331262 run osmo-stp_10.42.42.5(pid=16243): Launched 08:17:11.454387 run osmo-msc_10.42.42.6: Starting osmo-msc 08:17:12.001625 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16245): Launched 08:17:12.318437 run osmo-msc_10.42.42.6(pid=16246): Launched 08:17:12.496419 run osmo-stp_10.42.42.5(pid=16243): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16243)] 08:17:12.630828 run osmo-stp_10.42.42.5(pid=16243): stdout: | (launched: 2022-12-10_08:17:11.273439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:12.765847 run osmo-stp_10.42.42.5(pid=16243): stderr: | [0;m[38;5;43m20221210081711464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081711464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081711464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081711464 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081711465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081711465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081711465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:12.899802 run osmo-stp_10.42.42.5(pid=16243): stdout: | (launched: 2022-12-10_08:17:11.273439) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:13.025594 run osmo-stp_10.42.42.5(pid=16243): stderr: | [0;m[38;5;43m20221210081711464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081711464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081711464 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081711464 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081711465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081711465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081711465 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:13.176180 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16243): Process ended prematurely: osmo-stp_10.42.42.5(pid=16243) [trial-2371↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16243)] [trial-2371↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18] 08:17:13.184918 tst handover.py:18: Test FAILED (6.5 sec) 08:17:13.212252 run osmo-hlr_10.42.42.2(pid=16240): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16240)] 08:17:13.262010 run osmo-hlr_10.42.42.2(pid=16240): stdout: | (launched: 2022-12-10_08:17:10.318299) 08:17:13.313319 run osmo-hlr_10.42.42.2(pid=16240): stderr: | [0;m[1;31m20221210081710514 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081710515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081710515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081710515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081710515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081710515 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081710527 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:trx-sysmocell5000+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081710535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081710535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081710535 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:17:13.385422 run osmo-msc_10.42.42.6(pid=16246): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16246)] 08:17:13.434840 run osmo-msc_10.42.42.6(pid=16246): stdout: | (launched: 2022-12-10_08:17:12.260803) 08:17:13.486025 run osmo-msc_10.42.42.6(pid=16246): stderr: | [0;m[38;5;43m20221210081712581 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x612000004a20]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081712582 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f77c7e8fc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081712582 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004d20]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081712582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081712582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081712582 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081712584 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081712584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081712584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081712584 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:17:13.537395 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16239): Terminating (SIGTERM) 08:17:13.579186 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16242): Terminating (SIGTERM) 08:17:13.621048 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16245): Terminating (SIGTERM) 08:17:13.662821 --- ParallelTerminationStrategy: PID 16239 died... 08:17:13.682761 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16239): Terminated: ok {rc=0} 08:17:13.729058 --- ParallelTerminationStrategy: PID 16242 died... 08:17:13.748349 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16242): Terminated: ok {rc=0} 08:17:13.794413 --- ParallelTerminationStrategy: PID 16245 died... 08:17:13.813822 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16245): Terminated: ok {rc=0} 08:17:13.900566 bus /sierra_3: Setting Powered False 08:17:14.998060 bus /sierra_3: Setting Powered False 08:17:16.110606 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:trx-sysmocell5000+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:sysmo+bts1-trx-b200 --------------------------------------------------------------------- 08:17:17.394029 tst handover_2G:sysmo+bts1-trx-b200: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:17:17.399594 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x bts (candidates: 11) 08:17:17.449488 tst handover_2G:sysmo+bts1-trx-b200: Verifying 6 x ip_address (candidates: 9) 08:17:17.475555 tst handover_2G:sysmo+bts1-trx-b200: Verifying 2 x modem (candidates: 12) 08:17:17.525228 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x bts (candidates: 11) 08:17:17.574806 tst handover_2G:sysmo+bts1-trx-b200: Reserving 6 x ip_address (candidates: 9) 08:17:17.601515 tst handover_2G:sysmo+bts1-trx-b200: Reserving 2 x modem (candidates: 12) 08:17:18.154308 tst handover_2G:sysmo+bts1-trx-b200: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 Ettus B200 ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:sysmo+bts1-trx-b200 handover.py ---------------------------------------------- 08:17:18.159880 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:17:18.170577 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:17:18.203716 tst handover.py: using LAC 27090 08:17:18.317588 tst handover.py: using RAC 60 08:17:18.431585 tst handover.py: using CellId 27090 08:17:18.545359 tst handover.py: using BVCI 27091 08:17:18.651269 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x bts (candidates: 2) 08:17:18.697742 tst handover.py: using LAC 27091 08:17:18.816482 tst handover.py: using RAC 61 08:17:18.930697 tst handover.py: using CellId 27091 08:17:19.046563 tst handover.py: using BVCI 27092 08:17:19.152893 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:17:19.163534 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:17:19.174043 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:17:19.184514 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:17:19.195079 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x ip_address (candidates: 6) 08:17:19.205513 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:17:19.322954 tst handover_2G:sysmo+bts1-trx-b200: Using 1 x modem (candidates: 2) 08:17:19.439061 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:17:19.903189 run create_hlr_db(pid=16251): Launched 08:17:20.026449 bus /sierra_2: Setting Powered False 08:17:21.085657 run create_hlr_db(pid=16251): Terminated: ok {rc=0} 08:17:21.473697 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16253): Launched 08:17:21.768672 run osmo-hlr_10.42.42.2(pid=16254): Launched 08:17:21.881824 run osmo-stp_10.42.42.5: Starting osmo-stp 08:17:22.381509 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16256): Launched 08:17:22.676658 run osmo-stp_10.42.42.5(pid=16257): Launched 08:17:22.789113 run osmo-msc_10.42.42.6: Starting osmo-msc 08:17:23.299283 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16259): Launched 08:17:23.594356 run osmo-msc_10.42.42.6(pid=16260): Launched 08:17:23.760551 run osmo-stp_10.42.42.5(pid=16257): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16257)] 08:17:23.885930 run osmo-stp_10.42.42.5(pid=16257): stdout: | (launched: 2022-12-10_08:17:22.622467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:24.010115 run osmo-stp_10.42.42.5(pid=16257): stderr: | [0;m[38;5;43m20221210081722793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081722793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081722793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081722794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081722794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081722794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081722794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:24.133247 run osmo-stp_10.42.42.5(pid=16257): stdout: | (launched: 2022-12-10_08:17:22.622467) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:24.250646 run osmo-stp_10.42.42.5(pid=16257): stderr: | [0;m[38;5;43m20221210081722793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081722793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081722793 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081722794 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081722794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081722794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081722794 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:24.391535 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16257): Process ended prematurely: osmo-stp_10.42.42.5(pid=16257) [trial-2371↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16257)] [trial-2371↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18] 08:17:24.399662 tst handover.py:18: Test FAILED (6.2 sec) 08:17:24.425446 run osmo-hlr_10.42.42.2(pid=16254): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16254)] 08:17:24.472696 run osmo-hlr_10.42.42.2(pid=16254): stdout: | (launched: 2022-12-10_08:17:21.714946) 08:17:24.521413 run osmo-hlr_10.42.42.2(pid=16254): stderr: | [0;m[1;31m20221210081721890 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081721891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081721891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081721891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081721891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081721891 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081721903 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:sysmo+bts1-trx-b200/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081721914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081721914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081721914 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:17:24.589805 run osmo-msc_10.42.42.6(pid=16260): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:sysmo+bts1-trx-b200↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16260)] 08:17:24.637110 run osmo-msc_10.42.42.6(pid=16260): stdout: | (launched: 2022-12-10_08:17:23.540247) 08:17:24.685676 run osmo-msc_10.42.42.6(pid=16260): stderr: | [0;m[38;5;43m20221210081723808 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081723809 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fc62ebcdc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081723809 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081723809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081723809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081723809 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081723811 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081723811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081723811 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081723812 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:17:24.734633 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16253): Terminating (SIGTERM) 08:17:24.773678 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16256): Terminating (SIGTERM) 08:17:24.813030 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16259): Terminating (SIGTERM) 08:17:24.852595 --- ParallelTerminationStrategy: PID 16253 died... 08:17:24.871560 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16253): Terminated: ok {rc=0} 08:17:24.915817 --- ParallelTerminationStrategy: PID 16256 died... 08:17:24.934562 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16256): Terminated: ok {rc=0} 08:17:24.978351 --- ParallelTerminationStrategy: PID 16259 died... 08:17:24.997156 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16259): Terminated: ok {rc=0} 08:17:25.080694 bus /sierra_3: Setting Powered False 08:17:26.178147 bus /sierra_3: Setting Powered False 08:17:27.294715 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:sysmo+bts1-trx-b200 FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:sysmo+bts1-trx-umtrx --------------------------------------------------------------------- 08:17:28.545574 tst handover_2G:sysmo+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:17:28.550792 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:17:28.600005 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:17:28.626258 tst handover_2G:sysmo+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:17:28.680082 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:17:28.731734 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:17:28.759094 tst handover_2G:sysmo+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:17:29.301931 tst handover_2G:sysmo+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts sysmoBTS 1002 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:sysmo+bts1-trx-umtrx handover.py ---------------------------------------------- 08:17:29.307081 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:29.317801 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:17:29.354104 tst handover.py: using LAC 27092 08:17:29.468143 tst handover.py: using RAC 62 08:17:29.592505 tst handover.py: using CellId 27092 08:17:29.714249 tst handover.py: using BVCI 27093 08:17:29.822132 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:17:29.867324 tst handover.py: using LAC 27093 08:17:29.991054 tst handover.py: using RAC 63 08:17:30.114000 tst handover.py: using CellId 27093 08:17:30.238579 tst handover.py: using BVCI 27094 08:17:30.355375 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:30.366695 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:30.377946 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:30.389369 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:30.401175 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:30.412482 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:17:30.527906 tst handover_2G:sysmo+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:17:30.644004 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:17:31.101989 run create_hlr_db(pid=16265): Launched 08:17:31.265237 bus /sierra_2: Setting Powered False 08:17:32.325391 run create_hlr_db(pid=16265): Terminated: ok {rc=0} 08:17:32.717719 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16267): Launched 08:17:33.035559 run osmo-hlr_10.42.42.2(pid=16268): Launched 08:17:33.157349 run osmo-stp_10.42.42.5: Starting osmo-stp 08:17:33.674971 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16270): Launched 08:17:33.994029 run osmo-stp_10.42.42.5(pid=16271): Launched 08:17:34.116450 run osmo-msc_10.42.42.6: Starting osmo-msc 08:17:34.662984 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16273): Launched 08:17:34.980860 run osmo-msc_10.42.42.6(pid=16274): Launched 08:17:35.159215 run osmo-stp_10.42.42.5(pid=16271): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16271)] 08:17:35.350380 run osmo-stp_10.42.42.5(pid=16271): stdout: | (launched: 2022-12-10_08:17:33.936060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:35.481324 run osmo-stp_10.42.42.5(pid=16271): stderr: | [0;m[38;5;43m20221210081734130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081734130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081734130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081734131 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081734131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081734131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081734131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:35.614310 run osmo-stp_10.42.42.5(pid=16271): stdout: | (launched: 2022-12-10_08:17:33.936060) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:35.741693 run osmo-stp_10.42.42.5(pid=16271): stderr: | [0;m[38;5;43m20221210081734130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081734130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081734130 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081734131 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081734131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081734131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081734131 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:35.893639 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16271): Process ended prematurely: osmo-stp_10.42.42.5(pid=16271) [trial-2371↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16271)] [trial-2371↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18] 08:17:35.902642 tst handover.py:18: Test FAILED (6.6 sec) 08:17:35.932036 run osmo-hlr_10.42.42.2(pid=16268): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16268)] 08:17:35.990198 run osmo-hlr_10.42.42.2(pid=16268): stdout: | (launched: 2022-12-10_08:17:32.978106) 08:17:36.042156 run osmo-hlr_10.42.42.2(pid=16268): stderr: | [0;m[1;31m20221210081733174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081733174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081733174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081733174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081733174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081733174 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081733186 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:sysmo+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081733195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081733195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081733195 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:17:36.114604 run osmo-msc_10.42.42.6(pid=16274): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16274)] 08:17:36.164831 run osmo-msc_10.42.42.6(pid=16274): stdout: | (launched: 2022-12-10_08:17:34.923218) 08:17:36.216540 run osmo-msc_10.42.42.6(pid=16274): stderr: | [0;m[38;5;43m20221210081735250 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081735250 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7f239cb5dc40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081735250 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081735250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081735250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081735250 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081735252 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081735252 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081735253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081735253 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:17:36.268737 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16267): Terminating (SIGTERM) 08:17:36.310909 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16270): Terminating (SIGTERM) 08:17:36.353692 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16273): Terminating (SIGTERM) 08:17:36.396410 --- ParallelTerminationStrategy: PID 16267 died... 08:17:36.416381 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16267): Terminated: ok {rc=0} 08:17:36.463859 --- ParallelTerminationStrategy: PID 16270 died... 08:17:36.483398 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16270): Terminated: ok {rc=0} 08:17:36.530998 --- ParallelTerminationStrategy: PID 16273 died... 08:17:36.550488 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16273): Terminated: ok {rc=0} 08:17:36.640559 bus /sierra_3: Setting Powered False 08:17:37.738850 bus /sierra_3: Setting Powered False 08:17:38.857758 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:sysmo+bts1-trx-umtrx FAIL --------------------------------------------------------------------- --------------------------------------------------------------------- trial-2371 handover_2G:trx-b200+bts1-trx-umtrx --------------------------------------------------------------------- 08:17:40.109084 tst handover_2G:trx-b200+bts1-trx-umtrx: reserving resources in /var/tmp/osmo-gsm-tester/state ... 08:17:40.114598 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x bts (candidates: 11) 08:17:40.175784 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 6 x ip_address (candidates: 9) 08:17:40.201934 tst handover_2G:trx-b200+bts1-trx-umtrx: Verifying 2 x modem (candidates: 12) 08:17:40.254327 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x bts (candidates: 11) 08:17:40.316461 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 6 x ip_address (candidates: 9) 08:17:40.342557 tst handover_2G:trx-b200+bts1-trx-umtrx: Reserving 2 x modem (candidates: 12) 08:17:40.890024 tst handover_2G:trx-b200+bts1-trx-umtrx: RESERVED RESOURCES for handover_2G: bts Ettus B200 UmTRX ip_address 10.42.42.2 10.42.42.3 10.42.42.4 10.42.42.5 10.42.42.6 10.42.42.7 modem sierra_1st sierra_2nd ---------------------------------------------- trial-2371 handover_2G:trx-b200+bts1-trx-umtrx handover.py ---------------------------------------------- 08:17:40.895191 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:40.906025 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:17:40.953148 tst handover.py: using LAC 27094 08:17:41.072206 tst handover.py: using RAC 64 08:17:41.188154 tst handover.py: using CellId 27094 08:17:41.303177 tst handover.py: using BVCI 27095 08:17:41.409779 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x bts (candidates: 2) 08:17:41.455585 tst handover.py: using LAC 27095 08:17:41.571475 tst handover.py: using RAC 65 08:17:41.687133 tst handover.py: using CellId 27095 08:17:41.803608 tst handover.py: using BVCI 27096 08:17:41.910194 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:41.920824 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:41.931337 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:41.941912 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:41.952484 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x ip_address (candidates: 6) 08:17:41.962970 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:17:42.080820 tst handover_2G:trx-b200+bts1-trx-umtrx: Using 1 x modem (candidates: 2) 08:17:42.198961 run osmo-hlr_10.42.42.2: Starting osmo-hlr 08:17:42.632697 run create_hlr_db(pid=16281): Launched 08:17:42.753997 bus /sierra_2: Setting Powered False 08:17:43.814599 run create_hlr_db(pid=16281): Terminated: ok {rc=0} 08:17:44.220274 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16283): Launched 08:17:44.538584 run osmo-hlr_10.42.42.2(pid=16284): Launched 08:17:44.660879 run osmo-stp_10.42.42.5: Starting osmo-stp 08:17:45.183576 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16286): Launched 08:17:45.502731 run osmo-stp_10.42.42.5(pid=16287): Launched 08:17:45.625716 run osmo-msc_10.42.42.6: Starting osmo-msc 08:17:46.221561 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16289): Launched 08:17:46.551161 run osmo-msc_10.42.42.6(pid=16290): Launched 08:17:46.939402 run osmo-stp_10.42.42.5(pid=16287): ERR: Terminated: ERROR {rc=1} [trial-2371↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16287)] 08:17:47.269324 run osmo-stp_10.42.42.5(pid=16287): stdout: | (launched: 2022-12-10_08:17:45.445223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:47.430838 run osmo-stp_10.42.42.5(pid=16287): stderr: | [0;m[38;5;43m20221210081745635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081745636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081745636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081745636 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081745639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081745639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081745639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:47.554541 run osmo-stp_10.42.42.5(pid=16287): stdout: | (launched: 2022-12-10_08:17:45.445223) | Copyright (C) 2015-2020 by Harald Welte <laforge@gnumonks.org> | Contributions by Holger Freyther, Neels Hofmeyr, Pau Espin, Vadim Yanitskiy | License GPLv2+: GNU GPL Version 2 or later <http://gnu.org/licenses/gpl-2.0.html> | This is free software: you are free to change and redistribute it. | There is NO WARRANTY, to the extent permitted by law. | | Free Software lives by contribution. If you use this, please contribute! | 08:17:47.672345 run osmo-stp_10.42.42.5(pid=16287): stderr: | [0;m[38;5;43m20221210081745635 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Creating m3ua Server (null):2905 (osmo_ss7.c:2189) | [0;m[38;5;43m20221210081745636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m Created m3ua server on (null):2905 (osmo_ss7.c:2207) | [0;m[38;5;43m20221210081745636 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m (Re)binding m3ua Server to 10.42.42.5:2905 (osmo_ss7.c:2235) | [0;m20221210081745636 [1;33mDLGLOBAL[0;m [1;33mNOTICE[0;m unable to bind socket: 10.42.42.5:2905: Address already in use (socket.c:822) | % Unable to bind xUA server to IP(s) | 20221210081745639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.5:4239: Address already in use (socket.c:935) | 20221210081745639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.5:4239 (socket.c:946) | 20221210081745639 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.5 4239 (telnet_interface.c:99) | Error binding VTY port | : Address already in use 08:17:47.812881 tst handover.py:18: ERR: Error: osmo-stp_10.42.42.5(pid=16287): Process ended prematurely: osmo-stp_10.42.42.5(pid=16287) [trial-2371↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16287)] [trial-2371↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18] 08:17:47.821534 tst handover.py:18: Test FAILED (6.9 sec) 08:17:47.848030 run osmo-hlr_10.42.42.2(pid=16284): ERR: Terminated: ERROR {rc=237} [trial-2371↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=16284)] 08:17:47.896179 run osmo-hlr_10.42.42.2(pid=16284): stdout: | (launched: 2022-12-10_08:17:44.481022) 08:17:47.945861 run osmo-hlr_10.42.42.2(pid=16284): stderr: | [0;m[1;31m20221210081744680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SECURE_DELETE' (db.c:579) | [0;m[1;31m20221210081744680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'SOUNDEX' (db.c:579) | [0;m[1;31m20221210081744680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'TEMP_STORE=1' (db.c:579) | [0;m[1;31m20221210081744680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'THREADSAFE=1' (db.c:579) | [0;m[1;31m20221210081744680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m SQLite3 compiled with 'USE_URI' (db.c:579) | [0;m[1;31m20221210081744680 [1;34mDDB[0;m[1;31m [1;34mDEBUG[0;m[1;31m Not setting SQL log callback: SQLite3 compiled without support for it (db.c:596) | [0;m[1;31m20221210081744693 [1;33mDDB[0;m[1;31m [1;33mNOTICE[0;m[1;31m Database '/home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/handover_2G:trx-b200+bts1-trx-umtrx/handover.py/osmo-hlr_10.42.42.2/hlr.db' has HLR DB schema version 6 (db.c:636) | [0;m20221210081744703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.2:4258: Address already in use (socket.c:935) | 20221210081744703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.2:4258 (socket.c:946) | 20221210081744703 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.2 4258 (telnet_interface.c:99) 08:17:48.015127 run osmo-msc_10.42.42.6(pid=16290): ERR: Terminated: ERROR {rc=2} [trial-2371↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py↪handover.py↪osmo-msc_10.42.42.6↪osmo-msc_10.42.42.6(pid=16290)] 08:17:48.063394 run osmo-msc_10.42.42.6(pid=16290): stdout: | (launched: 2022-12-10_08:17:46.489522) 08:17:48.112849 run osmo-msc_10.42.42.6(pid=16290): stderr: | [0;m[38;5;43m20221210081747094 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_ASP(asp0)[0x6120000048a0]{ASP_DOWN}: Allocated (fsm.c:456) | [0;m20221210081747094 [1;34mDLGLOBAL[0;m [1;34mDEBUG[0;m validating counter group 0x7fa7910d7c40(sigtran_as) with 2 counters (rate_ctr.c:87) | [38;5;43m20221210081747094 [1;34mDLSS7[0;m[38;5;43m [1;34mDEBUG[0;m[38;5;43m XUA_AS(as0)[0x612000004ba0]{AS_DOWN}: Allocated (fsm.c:456) | [0;m[38;5;43m20221210081747094 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Created AS (osmo_ss7.c:1034) | [0;m[38;5;43m20221210081747096 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: as-as0: Adding ASP asp0 to AS (osmo_ss7.c:1054) | [0;m[38;5;43m20221210081747097 [1;32mDLSS7[0;m[38;5;43m [1;32mINFO[0;m[38;5;43m 0: Creating route: pc=1=0.0.1 mask=0x3fff via AS 'as0' (osmo_ss7.c:831) | [0;m[1;39m20221210081747107 [1;34mDMNCC[0;m[1;39m [1;34mDEBUG[0;m[1;39m Using internal MNCC handler. (msc_main.c:678) | [0;m20221210081747108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m unable to bind socket:10.42.42.6:4254: Address already in use (socket.c:935) | 20221210081747108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m no suitable addr found for: 10.42.42.6:4254 (socket.c:946) | 20221210081747108 [1;31mDLGLOBAL[0;m [1;31mERROR[0;m Cannot bind telnet at 10.42.42.6 4254 (telnet_interface.c:99) 08:17:48.162496 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16283): Terminating (SIGTERM) 08:17:48.202373 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16286): Terminating (SIGTERM) 08:17:48.242468 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16289): Terminating (SIGTERM) 08:17:48.282755 --- ParallelTerminationStrategy: PID 16283 died... 08:17:48.301979 run pcap-recorder_any(filters='host 10.42.42.2')(pid=16283): Terminated: ok {rc=0} 08:17:48.346381 --- ParallelTerminationStrategy: PID 16286 died... 08:17:48.365159 run pcap-recorder_any(filters='host 10.42.42.5 and port not 22')(pid=16286): Terminated: ok {rc=0} 08:17:48.409129 --- ParallelTerminationStrategy: PID 16289 died... 08:17:48.427819 run pcap-recorder_any(filters='host 10.42.42.6 and port not 22')(pid=16289): Terminated: ok {rc=0} 08:17:48.514651 bus /sierra_3: Setting Powered False 08:17:49.614555 bus /sierra_3: Setting Powered False 08:17:50.727215 bus /sierra_2: Setting Powered False --------------------------------------------------------------------- trial-2371 handover_2G:trx-b200+bts1-trx-umtrx FAIL --------------------------------------------------------------------- 08:17:51.997767 tst trial-2371: Storing JUnit report in /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371/run.2022-12-10_06-54-20/trial-2371.xml -------------------------------------------------------------------------------------------- trial-2371 FAIL -------------------------------------------------------------------------------------------- 08:17:53.923572 tst trial-2371: trial-2371: FAIL, 200 suites failed FAIL: nitb_sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (4.9 sec) Error: osmo-nitb_10.42.42.2(pid=8089): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8089) [trial-2371↪nitb_sms:sysmo↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8089)] FAIL: sms:sysmo (fail: 1) FAIL: mo_mt_sms.py (14.2 sec) Error: osmo-stp_10.42.42.5(pid=8100): Process ended prematurely: osmo-stp_10.42.42.5(pid=8100) [trial-2371↪sms:sysmo↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8100)] FAIL: nitb_ussd:sysmo (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=8109): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8109) [trial-2371↪nitb_ussd:sysmo↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8109)] FAIL: ussd:sysmo (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=8120): Process ended prematurely: osmo-stp_10.42.42.5(pid=8120) [trial-2371↪ussd:sysmo↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8120)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8134): Process ended prematurely: osmo-stp_10.42.42.5(pid=8134) [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8134)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8145): Process ended prematurely: osmo-stp_10.42.42.5(pid=8145) [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8145)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8161): Process ended prematurely: osmo-stp_10.42.42.5(pid=8161) [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8161)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8172): Process ended prematurely: osmo-stp_10.42.42.5(pid=8172) [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8172)] FAIL: voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8186): Process ended prematurely: osmo-stp_10.42.42.5(pid=8186) [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8186)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8197): Process ended prematurely: osmo-stp_10.42.42.5(pid=8197) [trial-2371↪voice:sysmo+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8197)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8211): Process ended prematurely: osmo-stp_10.42.42.5(pid=8211) [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8211)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8223): Process ended prematurely: osmo-stp_10.42.42.5(pid=8223) [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8223)] FAIL: voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8237): Process ended prematurely: osmo-stp_10.42.42.5(pid=8237) [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8237)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8248): Process ended prematurely: osmo-stp_10.42.42.5(pid=8248) [trial-2371↪voice:sysmo+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8248)] FAIL: voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8274): Process ended prematurely: osmo-stp_10.42.42.5(pid=8274) [trial-2371↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8274)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8285): Process ended prematurely: osmo-stp_10.42.42.5(pid=8285) [trial-2371↪voice:sysmo+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8285)] FAIL: voice:sysmo+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8299): Process ended prematurely: osmo-stp_10.42.42.5(pid=8299) [trial-2371↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8299)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8310): Process ended prematurely: osmo-stp_10.42.42.5(pid=8310) [trial-2371↪voice:sysmo+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8310)] FAIL: emergency:sysmo (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8324): Process ended prematurely: osmo-stp_10.42.42.5(pid=8324) [trial-2371↪emergency:sysmo↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8324)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8336): Process ended prematurely: osmo-stp_10.42.42.5(pid=8336) [trial-2371↪emergency:sysmo↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8336)] FAIL: gprs:sysmo (fail: 5) FAIL: cs_paging_gprs_active.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=8358): Process ended prematurely: osmo-stp_10.42.42.5(pid=8358) [trial-2371↪gprs:sysmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8358)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=8370): Process ended prematurely: osmo-stp_10.42.42.5(pid=8370) [trial-2371↪gprs:sysmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8370)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=8388): Process ended prematurely: osmo-stp_10.42.42.5(pid=8388) [trial-2371↪gprs:sysmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8388)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8398): Process ended prematurely: osmo-stp_10.42.42.5(pid=8398) [trial-2371↪gprs:sysmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8398)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8408): Process ended prematurely: osmo-stp_10.42.42.5(pid=8408) [trial-2371↪gprs:sysmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8408)] FAIL: gprs:sysmo+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=8426): Process ended prematurely: osmo-stp_10.42.42.5(pid=8426) [trial-2371↪gprs:sysmo+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8426)] FAIL: iperf3.py (8.1 sec) Error: osmo-stp_10.42.42.5(pid=8438): Process ended prematurely: osmo-stp_10.42.42.5(pid=8438) [trial-2371↪gprs:sysmo+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8438)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=8456): Process ended prematurely: osmo-stp_10.42.42.5(pid=8456) [trial-2371↪gprs:sysmo+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8456)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8466): Process ended prematurely: osmo-stp_10.42.42.5(pid=8466) [trial-2371↪gprs:sysmo+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8466)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8476): Process ended prematurely: osmo-stp_10.42.42.5(pid=8476) [trial-2371↪gprs:sysmo+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8476)] FAIL: gprs:sysmo+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=8494): Process ended prematurely: osmo-stp_10.42.42.5(pid=8494) [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8494)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=8506): Process ended prematurely: osmo-stp_10.42.42.5(pid=8506) [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8506)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=8529): Process ended prematurely: osmo-stp_10.42.42.5(pid=8529) [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8529)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8539): Process ended prematurely: osmo-stp_10.42.42.5(pid=8539) [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8539)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8550): Process ended prematurely: osmo-stp_10.42.42.5(pid=8550) [trial-2371↪gprs:sysmo+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8550)] FAIL: gprs:sysmo+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (9.0 sec) Error: osmo-stp_10.42.42.5(pid=8567): Process ended prematurely: osmo-stp_10.42.42.5(pid=8567) [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8567)] FAIL: iperf3.py (7.9 sec) Error: osmo-stp_10.42.42.5(pid=8579): Process ended prematurely: osmo-stp_10.42.42.5(pid=8579) [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8579)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=8597): Process ended prematurely: osmo-stp_10.42.42.5(pid=8597) [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8597)] FAIL: ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=8607): Process ended prematurely: osmo-stp_10.42.42.5(pid=8607) [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8607)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8617): Process ended prematurely: osmo-stp_10.42.42.5(pid=8617) [trial-2371↪gprs:sysmo+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8617)] FAIL: dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=8630): Process ended prematurely: osmo-stp_10.42.42.5(pid=8630) [trial-2371↪dynts:sysmo+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8630)] FAIL: dynts:sysmo+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8643): Process ended prematurely: osmo-stp_10.42.42.5(pid=8643) [trial-2371↪dynts:sysmo+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8643)] FAIL: nitb_sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=8651): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8651) [trial-2371↪nitb_sms:oc2g↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8651)] FAIL: sms:oc2g (fail: 1) FAIL: mo_mt_sms.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8662): Process ended prematurely: osmo-stp_10.42.42.5(pid=8662) [trial-2371↪sms:oc2g↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8662)] FAIL: nitb_ussd:oc2g (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=8671): Process ended prematurely: osmo-nitb_10.42.42.2(pid=8671) [trial-2371↪nitb_ussd:oc2g↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=8671)] FAIL: ussd:oc2g (fail: 1) FAIL: assert_extension.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8685): Process ended prematurely: osmo-stp_10.42.42.5(pid=8685) [trial-2371↪ussd:oc2g↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8685)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8699): Process ended prematurely: osmo-stp_10.42.42.5(pid=8699) [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8699)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8710): Process ended prematurely: osmo-stp_10.42.42.5(pid=8710) [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8710)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8724): Process ended prematurely: osmo-stp_10.42.42.5(pid=8724) [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8724)] FAIL: mo_mt_call_osmux.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=8735): Process ended prematurely: osmo-stp_10.42.42.5(pid=8735) [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8735)] FAIL: voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8749): Process ended prematurely: osmo-stp_10.42.42.5(pid=8749) [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8749)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8760): Process ended prematurely: osmo-stp_10.42.42.5(pid=8760) [trial-2371↪voice:oc2g+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8760)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=8774): Process ended prematurely: osmo-stp_10.42.42.5(pid=8774) [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8774)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=8785): Process ended prematurely: osmo-stp_10.42.42.5(pid=8785) [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8785)] FAIL: voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8800): Process ended prematurely: osmo-stp_10.42.42.5(pid=8800) [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8800)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8811): Process ended prematurely: osmo-stp_10.42.42.5(pid=8811) [trial-2371↪voice:oc2g+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8811)] FAIL: voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=8825): Process ended prematurely: osmo-stp_10.42.42.5(pid=8825) [trial-2371↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8825)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=8836): Process ended prematurely: osmo-stp_10.42.42.5(pid=8836) [trial-2371↪voice:oc2g+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8836)] FAIL: voice:oc2g+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=8850): Process ended prematurely: osmo-stp_10.42.42.5(pid=8850) [trial-2371↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8850)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=8861): Process ended prematurely: osmo-stp_10.42.42.5(pid=8861) [trial-2371↪voice:oc2g+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8861)] FAIL: emergency:oc2g (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=8876): Process ended prematurely: osmo-stp_10.42.42.5(pid=8876) [trial-2371↪emergency:oc2g↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8876)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=8887): Process ended prematurely: osmo-stp_10.42.42.5(pid=8887) [trial-2371↪emergency:oc2g↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8887)] FAIL: gprs:oc2g (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=8907): Process ended prematurely: osmo-stp_10.42.42.5(pid=8907) [trial-2371↪gprs:oc2g↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=8907)] FAIL: iperf3.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=9190): Process ended prematurely: osmo-stp_10.42.42.5(pid=9190) [trial-2371↪gprs:oc2g↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9190)] FAIL: iperf3m4.py (11.8 sec) Error: osmo-stp_10.42.42.5(pid=9208): Process ended prematurely: osmo-stp_10.42.42.5(pid=9208) [trial-2371↪gprs:oc2g↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9208)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9218): Process ended prematurely: osmo-stp_10.42.42.5(pid=9218) [trial-2371↪gprs:oc2g↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9218)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9228): Process ended prematurely: osmo-stp_10.42.42.5(pid=9228) [trial-2371↪gprs:oc2g↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9228)] FAIL: gprs:oc2g+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=9246): Process ended prematurely: osmo-stp_10.42.42.5(pid=9246) [trial-2371↪gprs:oc2g+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9246)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=9258): Process ended prematurely: osmo-stp_10.42.42.5(pid=9258) [trial-2371↪gprs:oc2g+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9258)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=9277): Process ended prematurely: osmo-stp_10.42.42.5(pid=9277) [trial-2371↪gprs:oc2g+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9277)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9287): Process ended prematurely: osmo-stp_10.42.42.5(pid=9287) [trial-2371↪gprs:oc2g+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9287)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9300): Process ended prematurely: osmo-stp_10.42.42.5(pid=9300) [trial-2371↪gprs:oc2g+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9300)] FAIL: gprs:oc2g+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=9317): Process ended prematurely: osmo-stp_10.42.42.5(pid=9317) [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9317)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=9330): Process ended prematurely: osmo-stp_10.42.42.5(pid=9330) [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9330)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=9348): Process ended prematurely: osmo-stp_10.42.42.5(pid=9348) [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9348)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9358): Process ended prematurely: osmo-stp_10.42.42.5(pid=9358) [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9358)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9368): Process ended prematurely: osmo-stp_10.42.42.5(pid=9368) [trial-2371↪gprs:oc2g+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9368)] FAIL: gprs:oc2g+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=9385): Process ended prematurely: osmo-stp_10.42.42.5(pid=9385) [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9385)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=9397): Process ended prematurely: osmo-stp_10.42.42.5(pid=9397) [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9397)] FAIL: iperf3m4.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=9415): Process ended prematurely: osmo-stp_10.42.42.5(pid=9415) [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9415)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9426): Process ended prematurely: osmo-stp_10.42.42.5(pid=9426) [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9426)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9436): Process ended prematurely: osmo-stp_10.42.42.5(pid=9436) [trial-2371↪gprs:oc2g+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9436)] FAIL: dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9449): Process ended prematurely: osmo-stp_10.42.42.5(pid=9449) [trial-2371↪dynts:oc2g+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9449)] FAIL: dynts:oc2g+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9464): Process ended prematurely: osmo-stp_10.42.42.5(pid=9464) [trial-2371↪dynts:oc2g+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9464)] FAIL: nitb_sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=9472): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9472) [trial-2371↪nitb_sms:trx-b200↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9472)] FAIL: sms:trx-b200 (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=9482): Process ended prematurely: osmo-stp_10.42.42.5(pid=9482) [trial-2371↪sms:trx-b200↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9482)] FAIL: nitb_ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=9491): Process ended prematurely: osmo-nitb_10.42.42.2(pid=9491) [trial-2371↪nitb_ussd:trx-b200↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=9491)] FAIL: ussd:trx-b200 (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=9501): Process ended prematurely: osmo-stp_10.42.42.5(pid=9501) [trial-2371↪ussd:trx-b200↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9501)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9515): Process ended prematurely: osmo-stp_10.42.42.5(pid=9515) [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9515)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9526): Process ended prematurely: osmo-stp_10.42.42.5(pid=9526) [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9526)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9541): Process ended prematurely: osmo-stp_10.42.42.5(pid=9541) [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9541)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9552): Process ended prematurely: osmo-stp_10.42.42.5(pid=9552) [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9552)] FAIL: voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9566): Process ended prematurely: osmo-stp_10.42.42.5(pid=9566) [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9566)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=9577): Process ended prematurely: osmo-stp_10.42.42.5(pid=9577) [trial-2371↪voice:trx-b200+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9577)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9591): Process ended prematurely: osmo-stp_10.42.42.5(pid=9591) [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9591)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=9602): Process ended prematurely: osmo-stp_10.42.42.5(pid=9602) [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9602)] FAIL: voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9618): Process ended prematurely: osmo-stp_10.42.42.5(pid=9618) [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9618)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=9629): Process ended prematurely: osmo-stp_10.42.42.5(pid=9629) [trial-2371↪voice:trx-b200+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9629)] FAIL: voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9643): Process ended prematurely: osmo-stp_10.42.42.5(pid=9643) [trial-2371↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9643)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9654): Process ended prematurely: osmo-stp_10.42.42.5(pid=9654) [trial-2371↪voice:trx-b200+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9654)] FAIL: voice:trx-b200+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=9672): Process ended prematurely: osmo-stp_10.42.42.5(pid=9672) [trial-2371↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9672)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=9683): Process ended prematurely: osmo-stp_10.42.42.5(pid=9683) [trial-2371↪voice:trx-b200+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9683)] FAIL: voice:trx-b200+mod-bts0-trxdversion0 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9699): Process ended prematurely: osmo-stp_10.42.42.5(pid=9699) [trial-2371↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9699)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=9710): Process ended prematurely: osmo-stp_10.42.42.5(pid=9710) [trial-2371↪voice:trx-b200+mod-bts0-trxdversion0↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9710)] FAIL: voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=9725): Process ended prematurely: osmo-stp_10.42.42.5(pid=9725) [trial-2371↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9725)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9736): Process ended prematurely: osmo-stp_10.42.42.5(pid=9736) [trial-2371↪voice:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9736)] FAIL: emergency:trx-b200 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=9750): Process ended prematurely: osmo-stp_10.42.42.5(pid=9750) [trial-2371↪emergency:trx-b200↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9750)] FAIL: emergency_preemptive_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=9761): Process ended prematurely: osmo-stp_10.42.42.5(pid=9761) [trial-2371↪emergency:trx-b200↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9761)] FAIL: gprs:trx-b200 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=9779): Process ended prematurely: osmo-stp_10.42.42.5(pid=9779) [trial-2371↪gprs:trx-b200↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9779)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=9791): Process ended prematurely: osmo-stp_10.42.42.5(pid=9791) [trial-2371↪gprs:trx-b200↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9791)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=9812): Process ended prematurely: osmo-stp_10.42.42.5(pid=9812) [trial-2371↪gprs:trx-b200↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9812)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9822): Process ended prematurely: osmo-stp_10.42.42.5(pid=9822) [trial-2371↪gprs:trx-b200↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9822)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=9832): Process ended prematurely: osmo-stp_10.42.42.5(pid=9832) [trial-2371↪gprs:trx-b200↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9832)] FAIL: gprs:trx-b200+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=9853): Process ended prematurely: osmo-stp_10.42.42.5(pid=9853) [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9853)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=9865): Process ended prematurely: osmo-stp_10.42.42.5(pid=9865) [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9865)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=9883): Process ended prematurely: osmo-stp_10.42.42.5(pid=9883) [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9883)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9893): Process ended prematurely: osmo-stp_10.42.42.5(pid=9893) [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9893)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=9903): Process ended prematurely: osmo-stp_10.42.42.5(pid=9903) [trial-2371↪gprs:trx-b200+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9903)] FAIL: gprs:trx-b200+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=9920): Process ended prematurely: osmo-stp_10.42.42.5(pid=9920) [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9920)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=9933): Process ended prematurely: osmo-stp_10.42.42.5(pid=9933) [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9933)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=9952): Process ended prematurely: osmo-stp_10.42.42.5(pid=9952) [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9952)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=9962): Process ended prematurely: osmo-stp_10.42.42.5(pid=9962) [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9962)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=9972): Process ended prematurely: osmo-stp_10.42.42.5(pid=9972) [trial-2371↪gprs:trx-b200+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9972)] FAIL: gprs:trx-b200+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=9989): Process ended prematurely: osmo-stp_10.42.42.5(pid=9989) [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=9989)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=10001): Process ended prematurely: osmo-stp_10.42.42.5(pid=10001) [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10001)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=10022): Process ended prematurely: osmo-stp_10.42.42.5(pid=10022) [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10022)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10032): Process ended prematurely: osmo-stp_10.42.42.5(pid=10032) [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10032)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=10042): Process ended prematurely: osmo-stp_10.42.42.5(pid=10042) [trial-2371↪gprs:trx-b200+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10042)] FAIL: gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=10059): Process ended prematurely: osmo-stp_10.42.42.5(pid=10059) [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10059)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=10072): Process ended prematurely: osmo-stp_10.42.42.5(pid=10072) [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10072)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=10090): Process ended prematurely: osmo-stp_10.42.42.5(pid=10090) [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10090)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10100): Process ended prematurely: osmo-stp_10.42.42.5(pid=10100) [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10100)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10110): Process ended prematurely: osmo-stp_10.42.42.5(pid=10110) [trial-2371↪gprs:trx-b200+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10110)] FAIL: dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10124): Process ended prematurely: osmo-stp_10.42.42.5(pid=10124) [trial-2371↪dynts:trx-b200+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10124)] FAIL: dynts:trx-b200+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=10137): Process ended prematurely: osmo-stp_10.42.42.5(pid=10137) [trial-2371↪dynts:trx-b200+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10137)] FAIL: nitb_sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=10146): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10146) [trial-2371↪nitb_sms:trx-sysmocell5000↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10146)] FAIL: sms:trx-sysmocell5000 (fail: 1) FAIL: mo_mt_sms.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10157): Process ended prematurely: osmo-stp_10.42.42.5(pid=10157) [trial-2371↪sms:trx-sysmocell5000↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10157)] FAIL: nitb_ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=10166): Process ended prematurely: osmo-nitb_10.42.42.2(pid=10166) [trial-2371↪nitb_ussd:trx-sysmocell5000↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=10166)] FAIL: ussd:trx-sysmocell5000 (fail: 1) FAIL: assert_extension.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=10176): Process ended prematurely: osmo-stp_10.42.42.5(pid=10176) [trial-2371↪ussd:trx-sysmocell5000↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10176)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=10190): Process ended prematurely: osmo-stp_10.42.42.5(pid=10190) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10190)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10202): Process ended prematurely: osmo-stp_10.42.42.5(pid=10202) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10202)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10216): Process ended prematurely: osmo-stp_10.42.42.5(pid=10216) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10216)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=10227): Process ended prematurely: osmo-stp_10.42.42.5(pid=10227) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10227)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=10241): Process ended prematurely: osmo-stp_10.42.42.5(pid=10241) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10241)] FAIL: mo_mt_call_osmux.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=10524): Process ended prematurely: osmo-stp_10.42.42.5(pid=10524) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10524)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=10538): Process ended prematurely: osmo-stp_10.42.42.5(pid=10538) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10538)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10549): Process ended prematurely: osmo-stp_10.42.42.5(pid=10549) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10549)] FAIL: voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10564): Process ended prematurely: osmo-stp_10.42.42.5(pid=10564) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10564)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=10575): Process ended prematurely: osmo-stp_10.42.42.5(pid=10575) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10575)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=10589): Process ended prematurely: osmo-stp_10.42.42.5(pid=10589) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10589)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10600): Process ended prematurely: osmo-stp_10.42.42.5(pid=10600) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10600)] FAIL: voice:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=10614): Process ended prematurely: osmo-stp_10.42.42.5(pid=10614) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10614)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=10625): Process ended prematurely: osmo-stp_10.42.42.5(pid=10625) [trial-2371↪voice:trx-sysmocell5000+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10625)] FAIL: emergency:trx-sysmocell5000 (fail: 2) FAIL: emergency_mo_mt_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=10647): Process ended prematurely: osmo-stp_10.42.42.5(pid=10647) [trial-2371↪emergency:trx-sysmocell5000↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10647)] FAIL: emergency_preemptive_call.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=10662): Process ended prematurely: osmo-stp_10.42.42.5(pid=10662) [trial-2371↪emergency:trx-sysmocell5000↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=10662)] FAIL: gprs:trx-sysmocell5000 (fail: 5) FAIL: cs_paging_gprs_active.py (8.8 sec) Error: osmo-stp_10.42.42.5(pid=11239): Process ended prematurely: osmo-stp_10.42.42.5(pid=11239) [trial-2371↪gprs:trx-sysmocell5000↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11239)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=11251): Process ended prematurely: osmo-stp_10.42.42.5(pid=11251) [trial-2371↪gprs:trx-sysmocell5000↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11251)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=11270): Process ended prematurely: osmo-stp_10.42.42.5(pid=11270) [trial-2371↪gprs:trx-sysmocell5000↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11270)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11280): Process ended prematurely: osmo-stp_10.42.42.5(pid=11280) [trial-2371↪gprs:trx-sysmocell5000↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11280)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11290): Process ended prematurely: osmo-stp_10.42.42.5(pid=11290) [trial-2371↪gprs:trx-sysmocell5000↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11290)] FAIL: gprs:trx-sysmocell5000+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=11307): Process ended prematurely: osmo-stp_10.42.42.5(pid=11307) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11307)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=11319): Process ended prematurely: osmo-stp_10.42.42.5(pid=11319) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11319)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=11337): Process ended prematurely: osmo-stp_10.42.42.5(pid=11337) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11337)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11347): Process ended prematurely: osmo-stp_10.42.42.5(pid=11347) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11347)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11357): Process ended prematurely: osmo-stp_10.42.42.5(pid=11357) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11357)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=11375): Process ended prematurely: osmo-stp_10.42.42.5(pid=11375) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11375)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=11388): Process ended prematurely: osmo-stp_10.42.42.5(pid=11388) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11388)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=11406): Process ended prematurely: osmo-stp_10.42.42.5(pid=11406) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11406)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11416): Process ended prematurely: osmo-stp_10.42.42.5(pid=11416) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11416)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11426): Process ended prematurely: osmo-stp_10.42.42.5(pid=11426) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11426)] FAIL: gprs:trx-sysmocell5000+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.2 sec) Error: osmo-stp_10.42.42.5(pid=11443): Process ended prematurely: osmo-stp_10.42.42.5(pid=11443) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11443)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=11455): Process ended prematurely: osmo-stp_10.42.42.5(pid=11455) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11455)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=11473): Process ended prematurely: osmo-stp_10.42.42.5(pid=11473) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11473)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11483): Process ended prematurely: osmo-stp_10.42.42.5(pid=11483) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11483)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=11494): Process ended prematurely: osmo-stp_10.42.42.5(pid=11494) [trial-2371↪gprs:trx-sysmocell5000+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11494)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=11507): Process ended prematurely: osmo-stp_10.42.42.5(pid=11507) [trial-2371↪dynts:trx-sysmocell5000+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11507)] FAIL: dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11520): Process ended prematurely: osmo-stp_10.42.42.5(pid=11520) [trial-2371↪dynts:trx-sysmocell5000+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11520)] FAIL: nitb_sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (3.4 sec) Error: osmo-nitb_10.42.42.2(pid=11528): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11528) [trial-2371↪nitb_sms:trx-umtrx↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11528)] FAIL: sms:trx-umtrx (fail: 1) FAIL: mo_mt_sms.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=11538): Process ended prematurely: osmo-stp_10.42.42.5(pid=11538) [trial-2371↪sms:trx-umtrx↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11538)] FAIL: nitb_ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=11550): Process ended prematurely: osmo-nitb_10.42.42.2(pid=11550) [trial-2371↪nitb_ussd:trx-umtrx↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=11550)] FAIL: ussd:trx-umtrx (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=11560): Process ended prematurely: osmo-stp_10.42.42.5(pid=11560) [trial-2371↪ussd:trx-umtrx↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11560)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11574): Process ended prematurely: osmo-stp_10.42.42.5(pid=11574) [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11574)] FAIL: mo_mt_call_osmux.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=11585): Process ended prematurely: osmo-stp_10.42.42.5(pid=11585) [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11585)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11599): Process ended prematurely: osmo-stp_10.42.42.5(pid=11599) [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11599)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=11610): Process ended prematurely: osmo-stp_10.42.42.5(pid=11610) [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11610)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11624): Process ended prematurely: osmo-stp_10.42.42.5(pid=11624) [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11624)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=11636): Process ended prematurely: osmo-stp_10.42.42.5(pid=11636) [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11636)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11651): Process ended prematurely: osmo-stp_10.42.42.5(pid=11651) [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11651)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11662): Process ended prematurely: osmo-stp_10.42.42.5(pid=11662) [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11662)] FAIL: voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11676): Process ended prematurely: osmo-stp_10.42.42.5(pid=11676) [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11676)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11687): Process ended prematurely: osmo-stp_10.42.42.5(pid=11687) [trial-2371↪voice:trx-umtrx+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11687)] FAIL: voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=11701): Process ended prematurely: osmo-stp_10.42.42.5(pid=11701) [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11701)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=11712): Process ended prematurely: osmo-stp_10.42.42.5(pid=11712) [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11712)] FAIL: voice:trx-umtrx+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=11726): Process ended prematurely: osmo-stp_10.42.42.5(pid=11726) [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11726)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11737): Process ended prematurely: osmo-stp_10.42.42.5(pid=11737) [trial-2371↪voice:trx-umtrx+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11737)] FAIL: voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11751): Process ended prematurely: osmo-stp_10.42.42.5(pid=11751) [trial-2371↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11751)] FAIL: mo_mt_call_osmux.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11762): Process ended prematurely: osmo-stp_10.42.42.5(pid=11762) [trial-2371↪voice:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11762)] FAIL: emergency:trx-umtrx (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=11779): Process ended prematurely: osmo-stp_10.42.42.5(pid=11779) [trial-2371↪emergency:trx-umtrx↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11779)] FAIL: emergency_preemptive_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11790): Process ended prematurely: osmo-stp_10.42.42.5(pid=11790) [trial-2371↪emergency:trx-umtrx↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11790)] FAIL: gprs:trx-umtrx (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=11808): Process ended prematurely: osmo-stp_10.42.42.5(pid=11808) [trial-2371↪gprs:trx-umtrx↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11808)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=11820): Process ended prematurely: osmo-stp_10.42.42.5(pid=11820) [trial-2371↪gprs:trx-umtrx↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11820)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=11838): Process ended prematurely: osmo-stp_10.42.42.5(pid=11838) [trial-2371↪gprs:trx-umtrx↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11838)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=11848): Process ended prematurely: osmo-stp_10.42.42.5(pid=11848) [trial-2371↪gprs:trx-umtrx↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11848)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11858): Process ended prematurely: osmo-stp_10.42.42.5(pid=11858) [trial-2371↪gprs:trx-umtrx↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11858)] FAIL: gprs:trx-umtrx+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=11878): Process ended prematurely: osmo-stp_10.42.42.5(pid=11878) [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11878)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=11890): Process ended prematurely: osmo-stp_10.42.42.5(pid=11890) [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11890)] FAIL: iperf3m4.py (10.9 sec) Error: osmo-stp_10.42.42.5(pid=11911): Process ended prematurely: osmo-stp_10.42.42.5(pid=11911) [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11911)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=11921): Process ended prematurely: osmo-stp_10.42.42.5(pid=11921) [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11921)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=11931): Process ended prematurely: osmo-stp_10.42.42.5(pid=11931) [trial-2371↪gprs:trx-umtrx+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11931)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=11949): Process ended prematurely: osmo-stp_10.42.42.5(pid=11949) [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11949)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=11961): Process ended prematurely: osmo-stp_10.42.42.5(pid=11961) [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11961)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=11979): Process ended prematurely: osmo-stp_10.42.42.5(pid=11979) [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11979)] FAIL: ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=11990): Process ended prematurely: osmo-stp_10.42.42.5(pid=11990) [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=11990)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12000): Process ended prematurely: osmo-stp_10.42.42.5(pid=12000) [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12000)] FAIL: gprs:trx-umtrx+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=12018): Process ended prematurely: osmo-stp_10.42.42.5(pid=12018) [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12018)] FAIL: iperf3.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=12030): Process ended prematurely: osmo-stp_10.42.42.5(pid=12030) [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12030)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=12048): Process ended prematurely: osmo-stp_10.42.42.5(pid=12048) [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12048)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12058): Process ended prematurely: osmo-stp_10.42.42.5(pid=12058) [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12058)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12068): Process ended prematurely: osmo-stp_10.42.42.5(pid=12068) [trial-2371↪gprs:trx-umtrx+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12068)] FAIL: gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=12087): Process ended prematurely: osmo-stp_10.42.42.5(pid=12087) [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12087)] FAIL: iperf3.py (7.6 sec) Error: osmo-stp_10.42.42.5(pid=12099): Process ended prematurely: osmo-stp_10.42.42.5(pid=12099) [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12099)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=12117): Process ended prematurely: osmo-stp_10.42.42.5(pid=12117) [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12117)] FAIL: ping.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=12163): Process ended prematurely: osmo-stp_10.42.42.5(pid=12163) [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12163)] FAIL: ping_idle_ping.py (7.1 sec) Error: osmo-stp_10.42.42.5(pid=12408): Process ended prematurely: osmo-stp_10.42.42.5(pid=12408) [trial-2371↪gprs:trx-umtrx+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12408)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (7.7 sec) Error: osmo-stp_10.42.42.5(pid=12421): Process ended prematurely: osmo-stp_10.42.42.5(pid=12421) [trial-2371↪dynts:trx-umtrx+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12421)] FAIL: dynts:trx-umtrx+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12436): Process ended prematurely: osmo-stp_10.42.42.5(pid=12436) [trial-2371↪dynts:trx-umtrx+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12436)] FAIL: nitb_sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=12445): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12445) [trial-2371↪nitb_sms:trx-lms↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12445)] FAIL: sms:trx-lms (fail: 1) FAIL: mo_mt_sms.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=12456): Process ended prematurely: osmo-stp_10.42.42.5(pid=12456) [trial-2371↪sms:trx-lms↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12456)] FAIL: nitb_ussd:trx-lms (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=12465): Process ended prematurely: osmo-nitb_10.42.42.2(pid=12465) [trial-2371↪nitb_ussd:trx-lms↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=12465)] FAIL: ussd:trx-lms (fail: 1) FAIL: assert_extension.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=12475): Process ended prematurely: osmo-stp_10.42.42.5(pid=12475) [trial-2371↪ussd:trx-lms↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12475)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12489): Process ended prematurely: osmo-stp_10.42.42.5(pid=12489) [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12489)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12500): Process ended prematurely: osmo-stp_10.42.42.5(pid=12500) [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12500)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12514): Process ended prematurely: osmo-stp_10.42.42.5(pid=12514) [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12514)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=12528): Process ended prematurely: osmo-stp_10.42.42.5(pid=12528) [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12528)] FAIL: voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12542): Process ended prematurely: osmo-stp_10.42.42.5(pid=12542) [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12542)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=12553): Process ended prematurely: osmo-stp_10.42.42.5(pid=12553) [trial-2371↪voice:trx-lms+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12553)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12567): Process ended prematurely: osmo-stp_10.42.42.5(pid=12567) [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12567)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12578): Process ended prematurely: osmo-stp_10.42.42.5(pid=12578) [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12578)] FAIL: voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=12592): Process ended prematurely: osmo-stp_10.42.42.5(pid=12592) [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12592)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=12603): Process ended prematurely: osmo-stp_10.42.42.5(pid=12603) [trial-2371↪voice:trx-lms+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12603)] FAIL: voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12617): Process ended prematurely: osmo-stp_10.42.42.5(pid=12617) [trial-2371↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12617)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=12629): Process ended prematurely: osmo-stp_10.42.42.5(pid=12629) [trial-2371↪voice:trx-lms+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12629)] FAIL: voice:trx-lms+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=12644): Process ended prematurely: osmo-stp_10.42.42.5(pid=12644) [trial-2371↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12644)] FAIL: mo_mt_call_osmux.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12655): Process ended prematurely: osmo-stp_10.42.42.5(pid=12655) [trial-2371↪voice:trx-lms+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12655)] FAIL: emergency:trx-lms (fail: 2) FAIL: emergency_mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12669): Process ended prematurely: osmo-stp_10.42.42.5(pid=12669) [trial-2371↪emergency:trx-lms↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12669)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12685): Process ended prematurely: osmo-stp_10.42.42.5(pid=12685) [trial-2371↪emergency:trx-lms↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12685)] FAIL: gprs:trx-lms (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=12703): Process ended prematurely: osmo-stp_10.42.42.5(pid=12703) [trial-2371↪gprs:trx-lms↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12703)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=12716): Process ended prematurely: osmo-stp_10.42.42.5(pid=12716) [trial-2371↪gprs:trx-lms↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12716)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=12734): Process ended prematurely: osmo-stp_10.42.42.5(pid=12734) [trial-2371↪gprs:trx-lms↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12734)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12744): Process ended prematurely: osmo-stp_10.42.42.5(pid=12744) [trial-2371↪gprs:trx-lms↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12744)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12754): Process ended prematurely: osmo-stp_10.42.42.5(pid=12754) [trial-2371↪gprs:trx-lms↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12754)] FAIL: gprs:trx-lms+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=12771): Process ended prematurely: osmo-stp_10.42.42.5(pid=12771) [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12771)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=12783): Process ended prematurely: osmo-stp_10.42.42.5(pid=12783) [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12783)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=12802): Process ended prematurely: osmo-stp_10.42.42.5(pid=12802) [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12802)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12812): Process ended prematurely: osmo-stp_10.42.42.5(pid=12812) [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12812)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12822): Process ended prematurely: osmo-stp_10.42.42.5(pid=12822) [trial-2371↪gprs:trx-lms+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12822)] FAIL: gprs:trx-lms+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=12839): Process ended prematurely: osmo-stp_10.42.42.5(pid=12839) [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12839)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=12851): Process ended prematurely: osmo-stp_10.42.42.5(pid=12851) [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12851)] FAIL: iperf3m4.py (10.5 sec) Error: osmo-stp_10.42.42.5(pid=12869): Process ended prematurely: osmo-stp_10.42.42.5(pid=12869) [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12869)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12886): Process ended prematurely: osmo-stp_10.42.42.5(pid=12886) [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12886)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=12896): Process ended prematurely: osmo-stp_10.42.42.5(pid=12896) [trial-2371↪gprs:trx-lms+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12896)] FAIL: gprs:trx-lms+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=12913): Process ended prematurely: osmo-stp_10.42.42.5(pid=12913) [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12913)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=12925): Process ended prematurely: osmo-stp_10.42.42.5(pid=12925) [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12925)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=12943): Process ended prematurely: osmo-stp_10.42.42.5(pid=12943) [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12943)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=12953): Process ended prematurely: osmo-stp_10.42.42.5(pid=12953) [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12953)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=12963): Process ended prematurely: osmo-stp_10.42.42.5(pid=12963) [trial-2371↪gprs:trx-lms+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12963)] FAIL: dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=12976): Process ended prematurely: osmo-stp_10.42.42.5(pid=12976) [trial-2371↪dynts:trx-lms+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12976)] FAIL: dynts:trx-lms+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=12991): Process ended prematurely: osmo-stp_10.42.42.5(pid=12991) [trial-2371↪dynts:trx-lms+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=12991)] FAIL: nitb_sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=13002): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13002) [trial-2371↪nitb_sms:trx-lms-limenet-micro↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13002)] FAIL: sms:trx-lms-limenet-micro (fail: 1) FAIL: mo_mt_sms.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=13012): Process ended prematurely: osmo-stp_10.42.42.5(pid=13012) [trial-2371↪sms:trx-lms-limenet-micro↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13012)] FAIL: nitb_ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=13021): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13021) [trial-2371↪nitb_ussd:trx-lms-limenet-micro↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13021)] FAIL: ussd:trx-lms-limenet-micro (fail: 1) FAIL: assert_extension.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=13031): Process ended prematurely: osmo-stp_10.42.42.5(pid=13031) [trial-2371↪ussd:trx-lms-limenet-micro↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13031)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13045): Process ended prematurely: osmo-stp_10.42.42.5(pid=13045) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13045)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13056): Process ended prematurely: osmo-stp_10.42.42.5(pid=13056) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13056)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13070): Process ended prematurely: osmo-stp_10.42.42.5(pid=13070) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13070)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13081): Process ended prematurely: osmo-stp_10.42.42.5(pid=13081) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13081)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=13095): Process ended prematurely: osmo-stp_10.42.42.5(pid=13095) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13095)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13106): Process ended prematurely: osmo-stp_10.42.42.5(pid=13106) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13106)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13120): Process ended prematurely: osmo-stp_10.42.42.5(pid=13120) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13120)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13131): Process ended prematurely: osmo-stp_10.42.42.5(pid=13131) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13131)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13145): Process ended prematurely: osmo-stp_10.42.42.5(pid=13145) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13145)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13156): Process ended prematurely: osmo-stp_10.42.42.5(pid=13156) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13156)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13172): Process ended prematurely: osmo-stp_10.42.42.5(pid=13172) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13172)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13183): Process ended prematurely: osmo-stp_10.42.42.5(pid=13183) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13183)] FAIL: voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13197): Process ended prematurely: osmo-stp_10.42.42.5(pid=13197) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13197)] FAIL: mo_mt_call_osmux.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13208): Process ended prematurely: osmo-stp_10.42.42.5(pid=13208) [trial-2371↪voice:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13208)] FAIL: emergency:trx-lms-limenet-micro (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13222): Process ended prematurely: osmo-stp_10.42.42.5(pid=13222) [trial-2371↪emergency:trx-lms-limenet-micro↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13222)] FAIL: emergency_preemptive_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13233): Process ended prematurely: osmo-stp_10.42.42.5(pid=13233) [trial-2371↪emergency:trx-lms-limenet-micro↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13233)] FAIL: gprs:trx-lms-limenet-micro (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=13255): Process ended prematurely: osmo-stp_10.42.42.5(pid=13255) [trial-2371↪gprs:trx-lms-limenet-micro↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13255)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=13267): Process ended prematurely: osmo-stp_10.42.42.5(pid=13267) [trial-2371↪gprs:trx-lms-limenet-micro↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13267)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=13285): Process ended prematurely: osmo-stp_10.42.42.5(pid=13285) [trial-2371↪gprs:trx-lms-limenet-micro↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13285)] FAIL: ping.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13295): Process ended prematurely: osmo-stp_10.42.42.5(pid=13295) [trial-2371↪gprs:trx-lms-limenet-micro↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13295)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13305): Process ended prematurely: osmo-stp_10.42.42.5(pid=13305) [trial-2371↪gprs:trx-lms-limenet-micro↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13305)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=13322): Process ended prematurely: osmo-stp_10.42.42.5(pid=13322) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13322)] FAIL: iperf3.py (7.2 sec) Error: osmo-stp_10.42.42.5(pid=13334): Process ended prematurely: osmo-stp_10.42.42.5(pid=13334) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13334)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=13352): Process ended prematurely: osmo-stp_10.42.42.5(pid=13352) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13352)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13363): Process ended prematurely: osmo-stp_10.42.42.5(pid=13363) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13363)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13373): Process ended prematurely: osmo-stp_10.42.42.5(pid=13373) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13373)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=13390): Process ended prematurely: osmo-stp_10.42.42.5(pid=13390) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13390)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=13402): Process ended prematurely: osmo-stp_10.42.42.5(pid=13402) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13402)] FAIL: iperf3m4.py (10.8 sec) Error: osmo-stp_10.42.42.5(pid=13420): Process ended prematurely: osmo-stp_10.42.42.5(pid=13420) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13420)] FAIL: ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13432): Process ended prematurely: osmo-stp_10.42.42.5(pid=13432) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13432)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13442): Process ended prematurely: osmo-stp_10.42.42.5(pid=13442) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13442)] FAIL: gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=13459): Process ended prematurely: osmo-stp_10.42.42.5(pid=13459) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13459)] FAIL: iperf3.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=13741): Process ended prematurely: osmo-stp_10.42.42.5(pid=13741) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13741)] FAIL: iperf3m4.py (11.9 sec) Error: osmo-stp_10.42.42.5(pid=13761): Process ended prematurely: osmo-stp_10.42.42.5(pid=13761) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13761)] FAIL: ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13772): Process ended prematurely: osmo-stp_10.42.42.5(pid=13772) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13772)] FAIL: ping_idle_ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=13782): Process ended prematurely: osmo-stp_10.42.42.5(pid=13782) [trial-2371↪gprs:trx-lms-limenet-micro+mod-bts0-dynts-osmo↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13782)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=13795): Process ended prematurely: osmo-stp_10.42.42.5(pid=13795) [trial-2371↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-ipa+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13795)] FAIL: dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=13810): Process ended prematurely: osmo-stp_10.42.42.5(pid=13810) [trial-2371↪dynts:trx-lms-limenet-micro+mod-bts0-dynts67-osmo↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13810)] FAIL: nitb_sms:nanobts (fail: 1) FAIL: mo_mt_sms.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=13820): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13820) [trial-2371↪nitb_sms:nanobts↪mo_mt_sms.py:11↪mo_mt_sms.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13820)] FAIL: sms:nanobts+band-1900 (fail: 1) FAIL: mo_mt_sms.py (5.7 sec) Error: osmo-stp_10.42.42.5(pid=13830): Process ended prematurely: osmo-stp_10.42.42.5(pid=13830) [trial-2371↪sms:nanobts+band-1900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13830)] FAIL: nitb_ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (3.1 sec) Error: osmo-nitb_10.42.42.2(pid=13839): Process ended prematurely: osmo-nitb_10.42.42.2(pid=13839) [trial-2371↪nitb_ussd:nanobts+band-1900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=13839)] FAIL: ussd:nanobts+band-1900 (fail: 1) FAIL: assert_extension.py (5.6 sec) Error: osmo-stp_10.42.42.5(pid=13850): Process ended prematurely: osmo-stp_10.42.42.5(pid=13850) [trial-2371↪ussd:nanobts+band-1900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13850)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13864): Process ended prematurely: osmo-stp_10.42.42.5(pid=13864) [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13864)] FAIL: mo_mt_call_osmux.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=13878): Process ended prematurely: osmo-stp_10.42.42.5(pid=13878) [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13878)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=13893): Process ended prematurely: osmo-stp_10.42.42.5(pid=13893) [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13893)] FAIL: mo_mt_call_osmux.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=13904): Process ended prematurely: osmo-stp_10.42.42.5(pid=13904) [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13904)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13918): Process ended prematurely: osmo-stp_10.42.42.5(pid=13918) [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13918)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13929): Process ended prematurely: osmo-stp_10.42.42.5(pid=13929) [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13929)] FAIL: voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13943): Process ended prematurely: osmo-stp_10.42.42.5(pid=13943) [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13943)] FAIL: mo_mt_call_osmux.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=13955): Process ended prematurely: osmo-stp_10.42.42.5(pid=13955) [trial-2371↪voice:nanobts+band-1900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13955)] FAIL: voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=13969): Process ended prematurely: osmo-stp_10.42.42.5(pid=13969) [trial-2371↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13969)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=13980): Process ended prematurely: osmo-stp_10.42.42.5(pid=13980) [trial-2371↪voice:nanobts+band-1900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13980)] FAIL: emergency:nanobts+band-1900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=13994): Process ended prematurely: osmo-stp_10.42.42.5(pid=13994) [trial-2371↪emergency:nanobts+band-1900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=13994)] FAIL: emergency_preemptive_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14005): Process ended prematurely: osmo-stp_10.42.42.5(pid=14005) [trial-2371↪emergency:nanobts+band-1900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14005)] FAIL: gprs:nanobts+band-1900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=14025): Process ended prematurely: osmo-stp_10.42.42.5(pid=14025) [trial-2371↪gprs:nanobts+band-1900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14025)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=14037): Process ended prematurely: osmo-stp_10.42.42.5(pid=14037) [trial-2371↪gprs:nanobts+band-1900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14037)] FAIL: iperf3m4.py (10.7 sec) Error: osmo-stp_10.42.42.5(pid=14055): Process ended prematurely: osmo-stp_10.42.42.5(pid=14055) [trial-2371↪gprs:nanobts+band-1900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14055)] FAIL: ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14065): Process ended prematurely: osmo-stp_10.42.42.5(pid=14065) [trial-2371↪gprs:nanobts+band-1900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14065)] FAIL: ping_idle_ping.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14075): Process ended prematurely: osmo-stp_10.42.42.5(pid=14075) [trial-2371↪gprs:nanobts+band-1900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14075)] FAIL: gprs:nanobts+band-1900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.3 sec) Error: osmo-stp_10.42.42.5(pid=14092): Process ended prematurely: osmo-stp_10.42.42.5(pid=14092) [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14092)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=14104): Process ended prematurely: osmo-stp_10.42.42.5(pid=14104) [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14104)] FAIL: iperf3m4.py (10.3 sec) Error: osmo-stp_10.42.42.5(pid=14122): Process ended prematurely: osmo-stp_10.42.42.5(pid=14122) [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14122)] FAIL: ping.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14133): Process ended prematurely: osmo-stp_10.42.42.5(pid=14133) [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14133)] FAIL: ping_idle_ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14143): Process ended prematurely: osmo-stp_10.42.42.5(pid=14143) [trial-2371↪gprs:nanobts+band-1900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14143)] FAIL: gprs:nanobts+band-1900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.4 sec) Error: osmo-stp_10.42.42.5(pid=14160): Process ended prematurely: osmo-stp_10.42.42.5(pid=14160) [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14160)] FAIL: iperf3.py (7.5 sec) Error: osmo-stp_10.42.42.5(pid=14172): Process ended prematurely: osmo-stp_10.42.42.5(pid=14172) [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14172)] FAIL: iperf3m4.py (10.6 sec) Error: osmo-stp_10.42.42.5(pid=14190): Process ended prematurely: osmo-stp_10.42.42.5(pid=14190) [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14190)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14200): Process ended prematurely: osmo-stp_10.42.42.5(pid=14200) [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14200)] FAIL: ping_idle_ping.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14210): Process ended prematurely: osmo-stp_10.42.42.5(pid=14210) [trial-2371↪gprs:nanobts+band-1900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14210)] FAIL: dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14226): Process ended prematurely: osmo-stp_10.42.42.5(pid=14226) [trial-2371↪dynts:nanobts+band-1900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14226)] FAIL: sms:nanobts+band-900 (fail: 1) FAIL: mo_mt_sms.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=14239): Process ended prematurely: osmo-stp_10.42.42.5(pid=14239) [trial-2371↪sms:nanobts+band-900↪mo_mt_sms.py:16↪mo_mt_sms.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14239)] FAIL: nitb_ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (3.2 sec) Error: osmo-nitb_10.42.42.2(pid=14249): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14249) [trial-2371↪nitb_ussd:nanobts+band-900↪assert_extension.py:12↪assert_extension.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14249)] FAIL: ussd:nanobts+band-900 (fail: 1) FAIL: assert_extension.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14259): Process ended prematurely: osmo-stp_10.42.42.5(pid=14259) [trial-2371↪ussd:nanobts+band-900↪assert_extension.py:17↪assert_extension.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14259)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1 (fail: 2) FAIL: mo_mt_call.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=14274): Process ended prematurely: osmo-stp_10.42.42.5(pid=14274) [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14274)] FAIL: mo_mt_call_osmux.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14285): Process ended prematurely: osmo-stp_10.42.42.5(pid=14285) [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr1↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14285)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14299): Process ended prematurely: osmo-stp_10.42.42.5(pid=14299) [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14299)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=14310): Process ended prematurely: osmo-stp_10.42.42.5(pid=14310) [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr2↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14310)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3 (fail: 2) FAIL: mo_mt_call.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=14324): Process ended prematurely: osmo-stp_10.42.42.5(pid=14324) [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14324)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14335): Process ended prematurely: osmo-stp_10.42.42.5(pid=14335) [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchf+cfg-codec-fr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14335)] FAIL: voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3 (fail: 2) FAIL: mo_mt_call.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14350): Process ended prematurely: osmo-stp_10.42.42.5(pid=14350) [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14350)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14361): Process ended prematurely: osmo-stp_10.42.42.5(pid=14361) [trial-2371↪voice:nanobts+band-900+mod-bts0-ts-tchh+cfg-codec-hr3↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14361)] FAIL: voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any (fail: 2) FAIL: mo_mt_call.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14376): Process ended prematurely: osmo-stp_10.42.42.5(pid=14376) [trial-2371↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14376)] FAIL: mo_mt_call_osmux.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14387): Process ended prematurely: osmo-stp_10.42.42.5(pid=14387) [trial-2371↪voice:nanobts+band-900+mod-bts0-dynts-ipa+cfg-codec-fr-any↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14387)] FAIL: voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 2) FAIL: mo_mt_call.py (5.8 sec) Error: osmo-stp_10.42.42.5(pid=14401): Process ended prematurely: osmo-stp_10.42.42.5(pid=14401) [trial-2371↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call.py:8↪mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14401)] FAIL: mo_mt_call_osmux.py (5.9 sec) Error: osmo-stp_10.42.42.5(pid=14412): Process ended prematurely: osmo-stp_10.42.42.5(pid=14412) [trial-2371↪voice:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪mo_mt_call_osmux.py:8↪mo_mt_call_osmux.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14412)] FAIL: emergency:nanobts+band-900 (fail: 2) FAIL: emergency_mo_mt_call.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14426): Process ended prematurely: osmo-stp_10.42.42.5(pid=14426) [trial-2371↪emergency:nanobts+band-900↪emergency_mo_mt_call.py:19↪emergency_mo_mt_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14426)] FAIL: emergency_preemptive_call.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14437): Process ended prematurely: osmo-stp_10.42.42.5(pid=14437) [trial-2371↪emergency:nanobts+band-900↪emergency_preemptive_call.py:32↪emergency_preemptive_call.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14437)] FAIL: gprs:nanobts+band-900 (fail: 5) FAIL: cs_paging_gprs_active.py (8.6 sec) Error: osmo-stp_10.42.42.5(pid=14456): Process ended prematurely: osmo-stp_10.42.42.5(pid=14456) [trial-2371↪gprs:nanobts+band-900↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14456)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=14468): Process ended prematurely: osmo-stp_10.42.42.5(pid=14468) [trial-2371↪gprs:nanobts+band-900↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14468)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=14486): Process ended prematurely: osmo-stp_10.42.42.5(pid=14486) [trial-2371↪gprs:nanobts+band-900↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14486)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14496): Process ended prematurely: osmo-stp_10.42.42.5(pid=14496) [trial-2371↪gprs:nanobts+band-900↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14496)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14506): Process ended prematurely: osmo-stp_10.42.42.5(pid=14506) [trial-2371↪gprs:nanobts+band-900↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14506)] FAIL: gprs:nanobts+band-900+mod-bts0-egprs (fail: 5) FAIL: cs_paging_gprs_active.py (8.7 sec) Error: osmo-stp_10.42.42.5(pid=14523): Process ended prematurely: osmo-stp_10.42.42.5(pid=14523) [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14523)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=14535): Process ended prematurely: osmo-stp_10.42.42.5(pid=14535) [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14535)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=14553): Process ended prematurely: osmo-stp_10.42.42.5(pid=14553) [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14553)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14563): Process ended prematurely: osmo-stp_10.42.42.5(pid=14563) [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14563)] FAIL: ping_idle_ping.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=14576): Process ended prematurely: osmo-stp_10.42.42.5(pid=14576) [trial-2371↪gprs:nanobts+band-900+mod-bts0-egprs↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14576)] FAIL: gprs:nanobts+band-900+mod-bts0-dynts-ipa (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=14593): Process ended prematurely: osmo-stp_10.42.42.5(pid=14593) [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14593)] FAIL: iperf3.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=14605): Process ended prematurely: osmo-stp_10.42.42.5(pid=14605) [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14605)] FAIL: iperf3m4.py (10.2 sec) Error: osmo-stp_10.42.42.5(pid=14623): Process ended prematurely: osmo-stp_10.42.42.5(pid=14623) [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14623)] FAIL: ping.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14633): Process ended prematurely: osmo-stp_10.42.42.5(pid=14633) [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14633)] FAIL: ping_idle_ping.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=14645): Process ended prematurely: osmo-stp_10.42.42.5(pid=14645) [trial-2371↪gprs:nanobts+band-900+mod-bts0-dynts-ipa↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14645)] FAIL: gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend (fail: 5) FAIL: cs_paging_gprs_active.py (8.5 sec) Error: osmo-stp_10.42.42.5(pid=14662): Process ended prematurely: osmo-stp_10.42.42.5(pid=14662) [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪cs_paging_gprs_active.py:38↪cs_paging_gprs_active.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14662)] FAIL: iperf3.py (7.3 sec) Error: osmo-stp_10.42.42.5(pid=14674): Process ended prematurely: osmo-stp_10.42.42.5(pid=14674) [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3.py:8↪iperf3.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14674)] FAIL: iperf3m4.py (10.4 sec) Error: osmo-stp_10.42.42.5(pid=14692): Process ended prematurely: osmo-stp_10.42.42.5(pid=14692) [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪iperf3m4.py:8↪iperf3m4.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14692)] FAIL: ping.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=14702): Process ended prematurely: osmo-stp_10.42.42.5(pid=14702) [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping.py:22↪ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14702)] FAIL: ping_idle_ping.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=14712): Process ended prematurely: osmo-stp_10.42.42.5(pid=14712) [trial-2371↪gprs:nanobts+band-900+mod-bts0-numtrx2+mod-bts0-chanallocdescend↪ping_idle_ping.py:27↪ping_idle_ping.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14712)] FAIL: dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any (fail: 1) FAIL: switch_tch_pdch.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=14725): Process ended prematurely: osmo-stp_10.42.42.5(pid=14725) [trial-2371↪dynts:nanobts+band-900+mod-bts0-dynts67-ipa-compat-nanobts+cfg-codec-fr-any↪switch_tch_pdch.py:54↪switch_tch_pdch.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14725)] FAIL: nitb_smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (2.4 sec) Error: osmo-nitb_10.42.42.2(pid=14734): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14734) [trial-2371↪nitb_smpp↪esme_connect_policy_acceptall.py:18↪esme_connect_policy_acceptall.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14734)] FAIL: esme_connect_policy_closed.py (1.9 sec) Error: osmo-nitb_10.42.42.2(pid=14736): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14736) [trial-2371↪nitb_smpp↪esme_connect_policy_closed.py:24↪esme_connect_policy_closed.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14736)] FAIL: esme_ms_sms_storeforward.py (2.6 sec) Error: osmo-nitb_10.42.42.2(pid=14738): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14738) [trial-2371↪nitb_smpp↪esme_ms_sms_storeforward.py:23↪esme_ms_sms_storeforward.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14738)] FAIL: esme_ms_sms_transaction.py (3.3 sec) Error: osmo-nitb_10.42.42.2(pid=14740): Process ended prematurely: osmo-nitb_10.42.42.2(pid=14740) [trial-2371↪nitb_smpp↪esme_ms_sms_transaction.py:21↪esme_ms_sms_transaction.py↪osmo-nitb_10.42.42.2↪osmo-nitb_10.42.42.2(pid=14740)] FAIL: smpp (fail: 4) FAIL: esme_connect_policy_acceptall.py (5.3 sec) Error: osmo-hlr_10.42.42.2(pid=14756): Process ended prematurely: osmo-hlr_10.42.42.2(pid=14756) [trial-2371↪smpp↪esme_connect_policy_acceptall.py:23↪esme_connect_policy_acceptall.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14756)] FAIL: esme_connect_policy_closed.py (6.0 sec) Error: osmo-hlr_10.42.42.2(pid=14767): Process ended prematurely: osmo-hlr_10.42.42.2(pid=14767) [trial-2371↪smpp↪esme_connect_policy_closed.py:31↪esme_connect_policy_closed.py↪osmo-hlr_10.42.42.2↪osmo-hlr_10.42.42.2(pid=14767)] FAIL: esme_ms_sms_storeforward.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14779): Process ended prematurely: osmo-stp_10.42.42.5(pid=14779) [trial-2371↪smpp↪esme_ms_sms_storeforward.py:30↪esme_ms_sms_storeforward.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14779)] FAIL: esme_ms_sms_transaction.py (6.0 sec) Error: osmo-stp_10.42.42.5(pid=14790): Process ended prematurely: osmo-stp_10.42.42.5(pid=14790) [trial-2371↪smpp↪esme_ms_sms_transaction.py:28↪esme_ms_sms_transaction.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14790)] FAIL: encryption (fail: 4) FAIL: register_a5_0_authopt.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=14804): Process ended prematurely: osmo-stp_10.42.42.5(pid=14804) [trial-2371↪encryption↪register_a5_0_authopt.py:8↪register_a5_0_authopt.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14804)] FAIL: register_a5_0_authreq.py (6.1 sec) Error: osmo-stp_10.42.42.5(pid=14815): Process ended prematurely: osmo-stp_10.42.42.5(pid=14815) [trial-2371↪encryption↪register_a5_0_authreq.py:8↪register_a5_0_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=14815)] FAIL: register_a5_1_authreq.py (7.4 sec) Error: osmo-stp_10.42.42.5(pid=15098): Process ended prematurely: osmo-stp_10.42.42.5(pid=15098) [trial-2371↪encryption↪register_a5_1_authreq.py:8↪register_a5_1_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15098)] FAIL: register_a5_3_authreq.py (7.8 sec) Error: osmo-stp_10.42.42.5(pid=15109): Process ended prematurely: osmo-stp_10.42.42.5(pid=15109) [trial-2371↪encryption↪register_a5_3_authreq.py:8↪register_a5_3_authreq.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15109)] FAIL: 4g:srsenb-rftype@zmq+srsue-rftype@zmq (fail: 7) FAIL: handover.py (20.0 sec) Error: srsepc(pid=15129): Process ended prematurely: srsepc(pid=15129) [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪handover.py:37↪handover.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15129)] FAIL: iperf3_bidir.py (19.0 sec) Error: srsepc(pid=15145): Process ended prematurely: srsepc(pid=15145) [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_bidir.py:42↪iperf3_bidir.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15145)] FAIL: iperf3_dl.py (18.5 sec) Error: srsepc(pid=15161): Process ended prematurely: srsepc(pid=15161) [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_dl.py:42↪iperf3_dl.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15161)] FAIL: iperf3_ul.py (18.5 sec) Error: srsepc(pid=15177): Process ended prematurely: srsepc(pid=15177) [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪iperf3_ul.py:42↪iperf3_ul.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15177)] FAIL: ping.py (18.5 sec) Error: srsepc(pid=15196): Process ended prematurely: srsepc(pid=15196) [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪ping.py:16↪ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15196)] FAIL: rrc_idle_mo_ping.py (18.2 sec) Error: srsepc(pid=15212): Process ended prematurely: srsepc(pid=15212) [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mo_ping.py:16↪rrc_idle_mo_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15212)] FAIL: rrc_idle_mt_ping.py (18.2 sec) Error: srsepc(pid=15228): Process ended prematurely: srsepc(pid=15228) [trial-2371↪4g:srsenb-rftype@zmq+srsue-rftype@zmq↪rrc_idle_mt_ping.py:16↪rrc_idle_mt_ping.py↪srsepc_10.42.42.118↪host-jenkins@10.42.42.116↪srsepc(pid=15228)] FAIL: handover_2G:nanobts+bts1-oc2g (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15241): Process ended prematurely: osmo-stp_10.42.42.5(pid=15241) [trial-2371↪handover_2G:nanobts+bts1-oc2g↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15241)] FAIL: handover_2G:nanobts+bts1-octphy (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=15256): Process ended prematurely: osmo-stp_10.42.42.5(pid=15256) [trial-2371↪handover_2G:nanobts+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15256)] FAIL: handover_2G:nanobts+bts1-trx-lms (fail: 1) FAIL: handover.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15271): Process ended prematurely: osmo-stp_10.42.42.5(pid=15271) [trial-2371↪handover_2G:nanobts+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15271)] FAIL: handover_2G:nanobts+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15285): Process ended prematurely: osmo-stp_10.42.42.5(pid=15285) [trial-2371↪handover_2G:nanobts+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15285)] FAIL: handover_2G:nanobts+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15301): Process ended prematurely: osmo-stp_10.42.42.5(pid=15301) [trial-2371↪handover_2G:nanobts+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15301)] FAIL: handover_2G:nanobts+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15315): Process ended prematurely: osmo-stp_10.42.42.5(pid=15315) [trial-2371↪handover_2G:nanobts+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15315)] FAIL: handover_2G:nanobts+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15329): Process ended prematurely: osmo-stp_10.42.42.5(pid=15329) [trial-2371↪handover_2G:nanobts+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15329)] FAIL: handover_2G:nanobts+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15345): Process ended prematurely: osmo-stp_10.42.42.5(pid=15345) [trial-2371↪handover_2G:nanobts+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15345)] FAIL: handover_2G:oc2g+bts1-octphy (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=15360): Process ended prematurely: osmo-stp_10.42.42.5(pid=15360) [trial-2371↪handover_2G:oc2g+bts1-octphy↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15360)] FAIL: handover_2G:oc2g+bts1-trx-lms (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=15375): Process ended prematurely: osmo-stp_10.42.42.5(pid=15375) [trial-2371↪handover_2G:oc2g+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15375)] FAIL: handover_2G:oc2g+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15389): Process ended prematurely: osmo-stp_10.42.42.5(pid=15389) [trial-2371↪handover_2G:oc2g+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15389)] FAIL: handover_2G:oc2g+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15403): Process ended prematurely: osmo-stp_10.42.42.5(pid=15403) [trial-2371↪handover_2G:oc2g+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15403)] FAIL: handover_2G:oc2g+bts1-sysmo (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15417): Process ended prematurely: osmo-stp_10.42.42.5(pid=15417) [trial-2371↪handover_2G:oc2g+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15417)] FAIL: handover_2G:oc2g+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=15431): Process ended prematurely: osmo-stp_10.42.42.5(pid=15431) [trial-2371↪handover_2G:oc2g+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15431)] FAIL: handover_2G:oc2g+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=15445): Process ended prematurely: osmo-stp_10.42.42.5(pid=15445) [trial-2371↪handover_2G:oc2g+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15445)] FAIL: handover_2G:octphy+bts1-trx-lms (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15459): Process ended prematurely: osmo-stp_10.42.42.5(pid=15459) [trial-2371↪handover_2G:octphy+bts1-trx-lms↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15459)] FAIL: handover_2G:octphy+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15474): Process ended prematurely: osmo-stp_10.42.42.5(pid=15474) [trial-2371↪handover_2G:octphy+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15474)] FAIL: handover_2G:octphy+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15488): Process ended prematurely: osmo-stp_10.42.42.5(pid=15488) [trial-2371↪handover_2G:octphy+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15488)] FAIL: handover_2G:octphy+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15502): Process ended prematurely: osmo-stp_10.42.42.5(pid=15502) [trial-2371↪handover_2G:octphy+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15502)] FAIL: handover_2G:octphy+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=15516): Process ended prematurely: osmo-stp_10.42.42.5(pid=15516) [trial-2371↪handover_2G:octphy+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15516)] FAIL: handover_2G:octphy+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=15530): Process ended prematurely: osmo-stp_10.42.42.5(pid=15530) [trial-2371↪handover_2G:octphy+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15530)] FAIL: handover_2G:trx-lms+bts1-trx-lms-limenet-micro (fail: 1) FAIL: handover.py (6.4 sec) Error: osmo-stp_10.42.42.5(pid=15554): Process ended prematurely: osmo-stp_10.42.42.5(pid=15554) [trial-2371↪handover_2G:trx-lms+bts1-trx-lms-limenet-micro↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15554)] FAIL: handover_2G:trx-lms+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=15921): Process ended prematurely: osmo-stp_10.42.42.5(pid=15921) [trial-2371↪handover_2G:trx-lms+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=15921)] FAIL: handover_2G:trx-lms+bts1-sysmo (fail: 1) FAIL: handover.py (7.0 sec) Error: osmo-stp_10.42.42.5(pid=16110): Process ended prematurely: osmo-stp_10.42.42.5(pid=16110) [trial-2371↪handover_2G:trx-lms+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16110)] FAIL: handover_2G:trx-lms+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16125): Process ended prematurely: osmo-stp_10.42.42.5(pid=16125) [trial-2371↪handover_2G:trx-lms+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16125)] FAIL: handover_2G:trx-lms+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16141): Process ended prematurely: osmo-stp_10.42.42.5(pid=16141) [trial-2371↪handover_2G:trx-lms+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16141)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000 (fail: 1) FAIL: handover.py (6.8 sec) Error: osmo-stp_10.42.42.5(pid=16155): Process ended prematurely: osmo-stp_10.42.42.5(pid=16155) [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-trx-sysmocell5000↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16155)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-sysmo (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16169): Process ended prematurely: osmo-stp_10.42.42.5(pid=16169) [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16169)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16183): Process ended prematurely: osmo-stp_10.42.42.5(pid=16183) [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16183)] FAIL: handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.3 sec) Error: osmo-stp_10.42.42.5(pid=16197): Process ended prematurely: osmo-stp_10.42.42.5(pid=16197) [trial-2371↪handover_2G:trx-lms-limenet-micro+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16197)] FAIL: handover_2G:trx-sysmocell5000+bts1-sysmo (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16211): Process ended prematurely: osmo-stp_10.42.42.5(pid=16211) [trial-2371↪handover_2G:trx-sysmocell5000+bts1-sysmo↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16211)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.7 sec) Error: osmo-stp_10.42.42.5(pid=16226): Process ended prematurely: osmo-stp_10.42.42.5(pid=16226) [trial-2371↪handover_2G:trx-sysmocell5000+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16226)] FAIL: handover_2G:trx-sysmocell5000+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.5 sec) Error: osmo-stp_10.42.42.5(pid=16243): Process ended prematurely: osmo-stp_10.42.42.5(pid=16243) [trial-2371↪handover_2G:trx-sysmocell5000+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16243)] FAIL: handover_2G:sysmo+bts1-trx-b200 (fail: 1) FAIL: handover.py (6.2 sec) Error: osmo-stp_10.42.42.5(pid=16257): Process ended prematurely: osmo-stp_10.42.42.5(pid=16257) [trial-2371↪handover_2G:sysmo+bts1-trx-b200↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16257)] FAIL: handover_2G:sysmo+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.6 sec) Error: osmo-stp_10.42.42.5(pid=16271): Process ended prematurely: osmo-stp_10.42.42.5(pid=16271) [trial-2371↪handover_2G:sysmo+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16271)] FAIL: handover_2G:trx-b200+bts1-trx-umtrx (fail: 1) FAIL: handover.py (6.9 sec) Error: osmo-stp_10.42.42.5(pid=16287): Process ended prematurely: osmo-stp_10.42.42.5(pid=16287) [trial-2371↪handover_2G:trx-b200+bts1-trx-umtrx↪handover.py:18↪handover.py↪osmo-stp_10.42.42.5↪osmo-stp_10.42.42.5(pid=16287)] + rm -rf trial-2371/inst + cd trial-2371 + command -v journalctl + [ ! -z /bin/journalctl ] + readlink last_run + journalctl -u ofono -o short-precise --since 2022-12-10 06:54:09 + readlink last_run + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371-run.tgz run.2022-12-10_06-54-20 + tar czf /home/jenkins/workspace/osmo-gsm-tester_run-prod/trial-2371-bin.tgz checksums.md5 open5gs.build-8.tgz osmo-bsc.build-17657.tgz osmo-bts-oc2g.build-5534.tgz osmo-bts-sysmo.build-8038.tgz osmo-bts.build-7507.tgz osmo-ggsn.build-6680.tgz osmo-hlr.build-8701.tgz osmo-hnbgw.build-2953.tgz osmo-mgw.build-8946.tgz osmo-msc.build-29267.tgz osmo-nitb.build-12970.tgz osmo-pcu-oc2g.build-3908.tgz osmo-pcu-sysmo.build-5190.tgz osmo-pcu.build-5151.tgz osmo-sgsn.build-30044.tgz osmo-stp.build-9241.tgz osmo-trx.build-4676.tgz osmocom-bb.build-4701.tgz srslte.build-19.tgz + exit 1 Build step 'Execute shell' marked build as failure Archiving artifacts Recording test results [Checks API] No suitable checks publisher found. Sending e-mails to: pespin@sysmocom.de Finished: FAILURE